<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>DBMS 2 : DataBase Management System Services &#187; Memory-centric data management</title>
	<atom:link href="http://www.dbms2.com/category/memory-centric-data-management/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.dbms2.com</link>
	<description>Choices in data management and analysis</description>
	<lastBuildDate>Thu, 02 Sep 2010 09:06:44 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>More on NoSQL and HVSP (or OLRP)</title>
		<link>http://www.dbms2.com/2010/08/26/nosql-hvsp-olrp/</link>
		<comments>http://www.dbms2.com/2010/08/26/nosql-hvsp-olrp/#comments</comments>
		<pubDate>Thu, 26 Aug 2010 09:10:31 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Akiban]]></category>
		<category><![CDATA[Basho and Riak]]></category>
		<category><![CDATA[Cache]]></category>
		<category><![CDATA[Cassandra]]></category>
		<category><![CDATA[Cloudera]]></category>
		<category><![CDATA[Clustrix]]></category>
		<category><![CDATA[CouchDB]]></category>
		<category><![CDATA[Facebook]]></category>
		<category><![CDATA[HBase]]></category>
		<category><![CDATA[Hadoop]]></category>
		<category><![CDATA[MySQL]]></category>
		<category><![CDATA[NoSQL]]></category>
		<category><![CDATA[OLTP]]></category>
		<category><![CDATA[Object]]></category>
		<category><![CDATA[Open source]]></category>
		<category><![CDATA[Parallelization]]></category>
		<category><![CDATA[Riptano]]></category>
		<category><![CDATA[Schooner]]></category>
		<category><![CDATA[Theory and architecture]]></category>
		<category><![CDATA[Tokutek]]></category>
		<category><![CDATA[memcached]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2907</guid>
		<description><![CDATA[Since posting last Wednesday morning that I&#8217;m looking into NoSQL and HVSP, I&#8217;ve had a lot of conversations, including with (among others):

Dwight Merriman of 10gen (MongoDB)
Damien Katz of Couchio (CouchDB)
Matt Pfeil of Riptano (Cassandra)
Todd Lipcon of Cloudera (HBase committer)
Tony Falco of Basho (Riak)
John Busch of Schooner
Ori Herrnstadt of Akiban

By no means do I have time [...]]]></description>
			<content:encoded><![CDATA[<p>Since posting last Wednesday morning that <a href="http://www.dbms2.com/2010/08/18/nosql-hvsp-adoption/" >I&#8217;m looking into NoSQL and HVSP</a>, I&#8217;ve had a lot of conversations, including with (among others):</p>
<ul>
<li>Dwight Merriman of 10gen (MongoDB)</li>
<li>Damien Katz of Couchio (CouchDB)</li>
<li>Matt Pfeil of <a href="http://www.dbms2.com/2010/07/06/riptano-and-cassandra-adoption/" >Riptano</a> (Cassandra)</li>
<li>Todd Lipcon of Cloudera (HBase committer)</li>
<li>Tony Falco of Basho (Riak)</li>
<li>John Busch of Schooner</li>
<li><strong><span style="font-weight: normal;">Ori Herrnstadt</span></strong> of <a href="http://www.dbms2.com/2010/04/03/akiban-highlights/" >Akiban</a></li>
</ul>
<p><span id="more-2907"></span>By no means do I have time to do these conversations justice, in terms of giving them the write-ups and/or immediate follow-up that they deserve. Indeed, I&#8217;ll leave for vacation Saturday morning with my 2000-word NoSQL article still unwritten. So I&#8217;ll dump as many observations as I can into one or a few posts now, and play catch-up later as circumstances allow.</p>
<p>In no particular order:</p>
<ul>
<li>A number of NoSQL offerings have had more uptake to date than most of the scale-out SQL offerings have.</li>
<li>&#8220;Document-oriented&#8221; NoSQL projects CouchDB and MongoDB have probably had the most users get into production, but perhaps for pretty small systems.</li>
<li>Cassandra and Hbase &#8212; the column-group-architecture guys &#8212; have probably had the most bang-in-lots-of-writes <a href="http://www.dbms2.com/2010/03/13/the-naming-of-the-foo/" >HVSP</a> production uptake.*</li>
<li>I didn&#8217;t talk customer count with Schooner, but the decently-stocked <a href="http://www.schoonerinfotech.com/customers" onclick="javascript:pageTracker._trackPageview('/www.schoonerinfotech.com');">Schooner customer page</a> suggests Schooner may be something of an exception to these generalities.</li>
<li>A lot of these companies are in the low-to-mid-teens of employees.</li>
<li>The SQL-oriented companies, despite having fewer or no customers, often seem to have more money. (One reason I get the impression SQL guys have more money is, frankly, that more  of them are talking about engaging <a href="http://www.monash.com/advantage.html" onclick="javascript:pageTracker._trackPageview('/www.monash.com');">my services</a>.)
<ul>
<li>Schooner cites $20 million in VC.</li>
<li><a href="http://www.dbms2.com/2010/05/12/the-clustrix-story/" >Clustrix</a> cites a figure close to that.</li>
<li>Basho cites $10 million, plus <a href="http://www.masshightech.com/stories/2010/08/02/daily35-Basho-rejects-VC-takes-late-friends-and-family-round.html" onclick="javascript:pageTracker._trackPageview('/www.masshightech.com');">a new round of $1.5 or $2 or $2.5 million</a>. The new round is at a  lowered valuation.</li>
<li>That same site says <a href="http://www.dbms2.com/2009/04/16/introduction-to-tokutek/" >Tokutek</a> finally was able to<a href="http://www.masshightech.com/stories/2010/08/16/daily47-Database-software-firm-Tokutek-lands-28M.html" onclick="javascript:pageTracker._trackPageview('/www.masshightech.com');"> raise some VC</a>. Congrats!</li>
</ul>
</li>
<li>It&#8217;s only a two-company trend, but I was pleased to hear that both 10gen/MongoDB and Akiban were seeing Drupal as a major use case or potential use case. No word on rescuing WordPress from its MySQL implementation, alas, but it seems that a Drupal site typically has 40-200+ tables, while a WordPress one has 10ish.</li>
<li>Another trend I think I&#8217;m seeing is serious object-oriented apps banging things straight into a simple back end. <a href="http://www.dbms2.com/2010/08/22/workday-stan-swete-database-architecture/" >Workday</a> is a huge example of that. Akiban hopes to do something similar with Hibernate.</li>
<li>Stability and maturity are still issues for many of these products. E.g., HBase isn&#8217;t even in Release 1.0 yet. Ditto Cassandra, and surely many of the others. Unsurprisingly, <a href="http://blog.mikiobraun.de/2010/08/cassandra-gc-tuning.html" onclick="javascript:pageTracker._trackPageview('/blog.mikiobraun.de');">making Cassandra stable is still a challenge</a>.</li>
</ul>
<p><em>*As is common for terms I suggest, the &#8220;HVSP&#8221; name is not getting any traction. What do you think of Marton Trencseni&#8217;s suggestion of <a href="http://www.dbms2.com/2010/03/13/the-naming-of-the-foo/#comment-182138" >OLRP, for OnLine Request Processing</a>?</em></p>
<p>One thing that makes following this area interesting is that so many projects are open source, leading there to be a lot of information in the wild. I hardly have time to read the mailing list for each project; but the people I talk with do, and often they may sorta kinda remember something somebody else posted one or several months back. As just one example, the mailing lists are said to confirm:</p>
<ul>
<li>Contrary to rumor, <a href="http://twitter.com/eventcloudpro/status/17872687577" onclick="javascript:pageTracker._trackPageview('/twitter.com');">Facebook hasn&#8217;t moved in-box search off of Cassandra</a>.</li>
<li>Apparently, however, it&#8217;s true that <a href="http://www.dbms2.com/2008/07/21/project-cassandra-facebook-open-sourced-quasi-dbms/" >Cassandra inventor Facebook</a> has stopped working on Cassandra, and Facebook&#8217;s core Cassandra developers have shifted over to HBase.</li>
</ul>
<p>Also, figuring out usage of open source software can be &#8230; interesting.</p>
<ul>
<li> People who use open source software don&#8217;t have to reveal themselves, as there&#8217;s no purchase transaction to kick things off.</li>
<li>On the other hand, if they&#8217;re serious enough in their use, they often do.
<ul>
<li>There are two main ways to get tech support for open source software &#8212; the community or a company that sells support &#8212; and both ways let the main support-selling company know that one is a user.</li>
<li>Some folks even add themselves to open lists of users, for example these rather long lists for <a href="http://wiki.apache.org/hadoop/Hbase/PoweredBy" onclick="javascript:pageTracker._trackPageview('/wiki.apache.org');">HBase</a> and <a href="http://wiki.apache.org/couchdb/CouchDB_in_the_wild" onclick="javascript:pageTracker._trackPageview('/wiki.apache.org');">CouchDB</a>.</li>
<li>Or they show up at conferences. For example, <a href="http://twitter.com/spyced/status/21490457839" onclick="javascript:pageTracker._trackPageview('/twitter.com');">two</a> <a href="http://twitter.com/spyced/status/21675203015" onclick="javascript:pageTracker._trackPageview('/twitter.com');">tweets</a> from Riptano founder Jonathan Ellis suggest at least 30 production Cassandra users were represented at a recent event. That&#8217;s more detail than his colleague Matt Pfeil wanted to give me when talked. <img src='http://www.dbms2.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </li>
</ul>
</li>
</ul>
<p>OK. This post has gotten pretty long, even without me saying anything resembling an overview of any of the seven companies I listed up top, or of their products&#8217; adoption. So I&#8217;ll just publish this now, and edit in links below to follow-on posts if and when they become available.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/08/26/nosql-hvsp-olrp/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Microstrategy technology notes</title>
		<link>http://www.dbms2.com/2010/07/29/microstrategy-technology-notes/</link>
		<comments>http://www.dbms2.com/2010/07/29/microstrategy-technology-notes/#comments</comments>
		<pubDate>Thu, 29 Jul 2010 17:51:42 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[Microstrategy]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2692</guid>
		<description><![CDATA[Earlier this week, Microstrategy made Mark LaRow available to talk about technology. The proximate reason was my recent mention of Microstrategy&#8217;s mobile BI emphasis, but we also touched on Microstrategy&#8217;s approach to in-memory business intelligence and some other subjects. We didn&#8217;t go into the depth of a similar conversation I had recently with Qlik Technologies, [...]]]></description>
			<content:encoded><![CDATA[<p style="margin-bottom: 0in;">Earlier this week, Microstrategy made Mark LaRow available to talk about technology. The proximate reason was <a href="../2010/07/25/alerts-metrics-dashboards/">my recent mention of Microstrategy&#8217;s mobile BI emphasis</a>, but we also touched on <a href="../2009/02/19/microstrategy-tidbits/">Microstrategy&#8217;s approach to in-memory business intelligence</a> and some other subjects. We didn&#8217;t go into the depth of <a href="http://www.dbms2.com/2010/06/12/the-underlying-technology-of-qlikview/" >a similar conversation I had recently with Qlik Technologies</a>, but I found it quite interesting even so.</p>
<p style="margin-bottom: 0in;">Highlights of the <strong>in-memory BI discussion</strong> included:</p>
<ul>
<li>Microstrategy&#8217;s in-memory BI data 	structure is some kind of simple array, redundantly called a “vector 	array.” A more precise description was not available.</li>
<li>While early versions of the 	capability have been around since 2002, Microstrategy&#8217;s in-memory BI 	capability only got serious with Microstrategy 9, which was released 	in Q1 of 2009. In particular, Microstrategy 9 was the first time 	in-memory BI had full security.</li>
<li>Mark says a core reason for having 	their own in-memory BI is because Microstrategy has more smarts to 	predict which aggregates will or won&#8217;t be needed. Strictly speaking, 	that can&#8217;t be argued with. Vendors like Infobright would argue they 	come close enough to that ideal as to make little practical 	difference – but I&#8217;m also cheating by naming Infobright, which is 	particularly focused in that direction.</li>
<li>Microstrategy in-memory BI 	compresses data by about 2X. Mark didn&#8217;t know which compression 	algorithm was used.</li>
<li>The limitation on what&#8217;s in-memory 	is, of course, how much RAM you can fit on an SMP box. Microstrategy 	has seen up to ½ terabyte deployments.</li>
<li>In-memory Microstrategy data 	structures are typically built during the batch window, for 	performance reasons. This is not, strictly speaking, mandatory, but 	I didn&#8217;t get a sense that Microstrategy was being used for much that 	resembled <a href="../2008/10/20/coral8-proposes-cep-as-a-bi-data-platform/">real-time 	business intelligence</a>.</li>
<li>Mark said Microstrategy has no 	interest in using solid-state memory to expand the reach of its 	in-memory BI. Frankly, if Microstrategy doesn&#8217;t change that stance, 	it&#8217;s in-memory BI capabilities are unlikely to stay significant for 	too many years.</li>
</ul>
<p style="margin-bottom: 0in;">Another key subject we discussed was Microstrategy&#8217;s view of <strong>dashboards.</strong> <span id="more-2692"></span></p>
<ul>
<li>Microstrategy thinks that what 	customers really want is to have a whole lot of navigational 	drilldown options into a few big reports. (“50 pages, 50 columns” 	was mentioned as an example of “big”.) This has been 	Microstrategy&#8217;s approach for three years or so.</li>
<li>Microstrategy even offers a 	version of this in Flash, which can be drilled down on with no calls 	to the server whatsoever.</li>
<li>This is also Microstrategy&#8217;s 	paradigm on the iPhone and iPad, where it would seem to make 	particular sense since you aren&#8217;t exactly going to tile a portal 	page into 6 different charts anyway.</li>
<li>On the iPhone/iPad, this is all 	native code, with a simple local data structure. In a parallel 	project, Microstrategy is researching HTML 5.</li>
<li>Microstrategy would rather call 	all this “microapps” than “dashboards.”</li>
</ul>
<p style="margin-bottom: 0in;">We also discussed Microstrategy&#8217;s approach to <strong>alerting.</strong> Highlights included:</p>
<ul>
<li>Microstrategy 9 introduced an 	alerting capability that Microstrategy sees as differentiated enough 	to emphasize in lots of sales cycles.</li>
<li>Microstrategy&#8217;s alerting 	capability lets you set “thresholds”.</li>
<li>A typical Microstrategy threshold 	would be a percentage change in a variable vs. another time period. 	You get to specify the variable (duh), the percentage, and the time 	comparison.</li>
<li>When a threshold is crossed, 	Microstrategy sends you an alerting email. (There&#8217;s something native 	to Apple that&#8217;s an alternative for Apple platforms.)</li>
</ul>
<p>We discussed one other subject as well, kicked off by my question &#8220;So why does Microstrategy spawn all those temporary tables anyway?&#8221; Mark and I more or less agreed:</p>
<ul>
<li>Microstrategy tries to do bigger queries than some of its competitors like to handle, by relying more on the DBMS for query execution.</li>
<li>Not coincidentally, Microstrategy is often the favorite BI vendor of analytic DBMS vendors (and even some Hadoop folks) who specialize in very large data sets.</li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/07/29/microstrategy-technology-notes/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Some interesting links</title>
		<link>http://www.dbms2.com/2010/07/23/some-interesting-links/</link>
		<comments>http://www.dbms2.com/2010/07/23/some-interesting-links/#comments</comments>
		<pubDate>Fri, 23 Jul 2010 09:04:48 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[EnterpriseDB and Postgres Plus]]></category>
		<category><![CDATA[Fun stuff]]></category>
		<category><![CDATA[Hadoop]]></category>
		<category><![CDATA[Humor]]></category>
		<category><![CDATA[In-memory DBMS]]></category>
		<category><![CDATA[MapReduce]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[Open source]]></category>
		<category><![CDATA[Oracle]]></category>
		<category><![CDATA[SAP AG]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2626</guid>
		<description><![CDATA[In no particular order:  

Neil Raden points out that business intelligence dashboards can be dangerously misleading. His reasoning (sound) is that whatever you measure is apt to be distorted by the fact people know they&#8217;re being measured. His solution (implied) is to hire a good-looking consultant like himself to do it right.
I&#8217;ve had my issues [...]]]></description>
			<content:encoded><![CDATA[<p>In no particular order:  <span id="more-2626"></span></p>
<ul>
<li>Neil Raden points out that <a href="http://www.b-eye-network.com/channels/5083/view/9618/" onclick="javascript:pageTracker._trackPageview('/www.b-eye-network.com');">business intelligence dashboards can be dangerously misleading</a>. His reasoning (sound) is that whatever you measure is apt to be distorted by the fact people know they&#8217;re being measured. His solution (implied) is to hire a <a href="http://twitter.com/NeilRaden/status/19110492482" onclick="javascript:pageTracker._trackPageview('/twitter.com');">good-looking</a> consultant like himself to do it right.</li>
<li>I&#8217;ve had my issues with Fred Holahan, who was VP of Marketing when I posted that <a href="http://www.dbms2.com/2009/04/20/first-thoughts-on-oracle-acquiring-sun/" >EnterpriseDB was not to be trusted</a>. (That said, Fred is long gone from EnterpriseDB and my opinion hasn&#8217;t changed.) But he&#8217;s put up a good series of posts on the basis of the open source &#8220;progressive engagement&#8221; marketing funnel, including this gem on <a href="http://opensourceadvisory.com/wordpress/?p=860" onclick="javascript:pageTracker._trackPageview('/opensourceadvisory.com');">why you shouldn&#8217;t count on monetizing your community/free users</a>.</li>
<li><a href="http://tech.fortune.cnn.com/2010/07/22/oracle-plans-to-double-acquisition-budget/" onclick="javascript:pageTracker._trackPageview('/tech.fortune.cnn.com');">Oracle plans to increase its acquisition budget</a>. The figure given is $70 billion over the next 5 years. <em>Edit: But see this funny <a href="http://www.theregister.co.uk/2010/07/23/oracle_acquisition_budget/" onclick="javascript:pageTracker._trackPageview('/www.theregister.co.uk');">Register</a> followup.</em></li>
<li>Clayton Christensen wrote a phenomenal article on <a href="http://hbr.org/2010/07/how-will-you-measure-your-life/ar/1" onclick="javascript:pageTracker._trackPageview('/hbr.org');">how to live a good life</a>, from a very business-y perspective. (Only in one anecdote was it too religiously-oriented for my tastes.) Takeaways include:
<ul>
<li>Your core goals probably revolve around something other than business success. (E.g., family.) Don&#8217;t lose sight of that.</li>
<li>To the extent you&#8217;re a manager or leader, you may have a huge impact on other people&#8217;s lives. Use that power in admirable ways.</li>
<li>Teach people how to fish for answers, rather than just giving them answers. They&#8217;ll probably come to better conclusions than you would have anyway. (This is a core principle in my own consulting.)</li>
<li>Take time to reflect. And by the way, the same techniques you use for strategic analysis in business can be applied to your life as well.</li>
</ul>
</li>
<li><a href="http://www.bothsidesofthetable.com/2010/07/19/life-is-10-how-you-make-it-and-90-how-you-take-it/" onclick="javascript:pageTracker._trackPageview('/www.bothsidesofthetable.com');">Mark Suster</a> has a pretty good post expanding on my first Christensen takeaway, highlighting a point too often missing from articles in that genre: It&#8217;s not just family; it&#8217;s also all the cool things around us.</li>
<li>I haven&#8217;t gone through the <a href="http://developer.yahoo.com/events/hadoopsummit2010/agenda.html" onclick="javascript:pageTracker._trackPageview('/developer.yahoo.com');">Hadoop Summit archives</a> yet, but it looks as if there&#8217;s a lot of insight there about current Hadoop application activity.</li>
<li>If you&#8217;re a cat lover and don&#8217;t hate simple/traditional music, check out <a href="http://www.marcgunn.com/poetry/labels/cat_songs.shtml" onclick="javascript:pageTracker._trackPageview('/www.marcgunn.com');">Marc Gunn&#8217;s cat filksongs</a>, especially the infectious &#8220;What Shall We Do With a Catnipped Kitty?&#8221; and &#8220;Lord of the Pounce&#8221;, both playable from the right sidebar of that page (#7 and #10 respectively). Gunn is also a chief perpetrator of the justly (in)famous <a href="http://www.thebards.net/" onclick="javascript:pageTracker._trackPageview('/www.thebards.net');">Do Virgins Taste Better?</a> cycle of filksongs.</li>
<li>Former SAP exec Dennis Moore offers a theory as to <a href="http://dbmoore.blogspot.com/2010/05/why-is-in-memory-database-important-to.html" onclick="javascript:pageTracker._trackPageview('/dbmoore.blogspot.com');">why SAP cares so much about in-memory DBMS</a>. It&#8217;s to integrate business processes, because SAP has no other software layer good at doing same. Interestingly, Dennis originated SAP&#8217;s previous attempt at meeting a similar need via its composite applications initiative. However, in Dennis&#8217; view this benefit would only be achieved by a major rewrite of SAP&#8217;s applications.</li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/07/23/some-interesting-links/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Details and analysis of the VoltDB argument</title>
		<link>http://www.dbms2.com/2010/06/30/details-and-analysis-of-the-voltdb-argument/</link>
		<comments>http://www.dbms2.com/2010/06/30/details-and-analysis-of-the-voltdb-argument/#comments</comments>
		<pubDate>Wed, 30 Jun 2010 14:37:37 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[In-memory DBMS]]></category>
		<category><![CDATA[Michael Stonebraker]]></category>
		<category><![CDATA[OLTP]]></category>
		<category><![CDATA[Parallelization]]></category>
		<category><![CDATA[Theory and architecture]]></category>
		<category><![CDATA[VoltDB and H-Store]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2432</guid>
		<description><![CDATA[Todd Hoff (High Scalability blog) posted a lengthy examination of the case and use cases for VoltDB. That excellent post, in turn, is based on a Mike Stonebraker* webinar for VoltDB, for which the slide deck is happily available. It&#8217;s all nicely consistent with what I wrote about VoltDB last month, in connection with its [...]]]></description>
			<content:encoded><![CDATA[<p>Todd Hoff <em>(High Scalability</em> blog) posted <a href="http://highscalability.com/blog/2010/6/28/voltdb-decapitates-six-sql-urban-myths-and-delivers-internet.html" onclick="javascript:pageTracker._trackPageview('/highscalability.com');">a lengthy examination of the case and use cases for VoltDB</a>. That excellent post, in turn, is based on <a href="http://voltdb.com/voltdb-webinar-sql-urban-myths" onclick="javascript:pageTracker._trackPageview('/voltdb.com');">a Mike Stonebraker* webinar for VoltDB</a>, for which the <a href="http://voltdb.com/_pdf/VoltDB-MikeStonebraker-SQLMythsWebinar-060310.pdf" onclick="javascript:pageTracker._trackPageview('/voltdb.com');">slide deck</a> is happily available. It&#8217;s all nicely consistent with <a href="http://www.dbms2.com/2010/05/25/voltdb-finally-launches/" >what I wrote about VoltDB</a> last month, in connection with its launch.  <span id="more-2432"></span></p>
<p><em>*Who, in Todd&#8217;s apt description, is &#8220;the sword wielding Johnny Appleseed of the database world&#8221;.</em></p>
<p>Todd wrote:</p>
<blockquote><p>What matters to VoltDB is: <em>speed at scale, speed at scale, speed at scale, SQL, and ACID</em>. If that matches your priorities then you&#8217;ll probably be happy. Otherwise, as you&#8217;ll see, everything is sacrificed for speed at scale and what is sacrificed is often ease of use, generality, and <a href="http://community.voltdb.com/node/77" onclick="javascript:pageTracker._trackPageview('/community.voltdb.com');">error checking</a>. It&#8217;s likely we&#8217;ll see ease of use improve over time, but for now it looks like rough going, unless of course, you are a going for speed at scale.</p></blockquote>
<p>Indeed.</p>
<p>Todd&#8217;s list of interesting VoltDB features is also pretty good, namely</p>
<ul>
<blockquote>
<li>Main-memory storage.</li>
<li>Run transactions to completion –single threaded –in timestamp order. <em> </em></li>
<li>Replicas.</li>
<li>Tables are partitioned across multiple servers.</li>
<li>Stored procedures, written in Java, are the unit of transaction.</li>
<li>A limited subset of SQL &#8216;99 is supported.</li>
<li>Design a schema and workflow to use single-sited procedures.</li>
<li>Challenging operations model.</li>
<li>No WAN support.</li>
<li>OLAP is purposefully kept separate.</li>
</blockquote>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/06/30/details-and-analysis-of-the-voltdb-argument/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Flash is coming, well &#8230;</title>
		<link>http://www.dbms2.com/2010/06/25/flash-is-coming-well/</link>
		<comments>http://www.dbms2.com/2010/06/25/flash-is-coming-well/#comments</comments>
		<pubDate>Fri, 25 Jun 2010 16:42:26 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Data integration and middleware]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[IBM and DB2]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[Netezza]]></category>
		<category><![CDATA[Solid-state memory]]></category>
		<category><![CDATA[Theory and architecture]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2389</guid>
		<description><![CDATA[I really, really wanted to title this post &#8220;Flash is coming in a flash.&#8221; That seems a little exaggerated &#8212; but only a little.

Netezza now intends to come out with a Flash-based appliance earlier than it originally expected.
Indeed, Netezza has suspended &#8212; by which I mean &#8220;scrapped&#8221; &#8212; prior plans for a RAM-heavy disk-based appliance. [...]]]></description>
			<content:encoded><![CDATA[<p>I really, really wanted to title this post &#8220;Flash is coming in a flash.&#8221; That seems a little exaggerated &#8212; but only a little.</p>
<ul>
<li>Netezza now intends to come out with a Flash-based appliance earlier than it originally expected.</li>
<li>Indeed, Netezza has suspended &#8212; by which I mean &#8220;scrapped&#8221; &#8212; prior plans for a RAM-heavy disk-based appliance. It will use a RAM/Flash combo instead.*</li>
<li>Tim Vincent of IBM told me that customers seem ready to adopt solid-state memory. One interesting comment he made is that Flash isn&#8217;t really all that much more expensive than high-end storage area networks.</li>
</ul>
<p>Uptake of solid-state memory (i.e. Flash) for analytic database processing will probably stay pretty low in 2010, but in 2011 it should be a notable (b)leading-edge technology, and it should get mainstreamed pretty quickly after that.  <span id="more-2389"></span></p>
<p><em>*So far as I can tell, that&#8217;s one of the two significant roadmap changes between the 2009 and 2010 editions of <a href="http://www.dbms2.com/2010/06/23/my-talk-this-morning/" >Enzee Universe</a>. The other one is that </em><em>the robust form of</em><em> appliance-to-appliance replication technology is coming out later than Netezza had originally planned and hoped.</em></p>
<p>There also is increasing reason to think that the issues with Flash memory wearing out are overwrought.  And by the way, the entire history of enterprise solid-state memory use is basically shorter than the time in which these products supposedly will wear out, so it&#8217;s not as if there have been a lot of real-life failures out there.)</p>
<ul>
<li>First, clever things are being done in the area of error correction codes, although for the most part I defer that part of the discussion to Petascan&#8217;s Camuel Gilyadov. <img src='http://www.dbms2.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' />  E.g., this seems to be the idea behind Anobit.</li>
<li>Second, analytic DBMS are pretty much an ideal use case for Flash reliability. Suppose, as is the case for many products and implementations, you only write things in big blocks. Then you are, ipso facto, resetting the Flash bits only in big blocks. Thus, at least in theory, you automatically have pretty perfect wear leveling.</li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/06/25/flash-is-coming-well/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>The underlying technology of QlikView</title>
		<link>http://www.dbms2.com/2010/06/12/the-underlying-technology-of-qlikview/</link>
		<comments>http://www.dbms2.com/2010/06/12/the-underlying-technology-of-qlikview/#comments</comments>
		<pubDate>Sat, 12 Jun 2010 10:00:49 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Database compression]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[QlikTech and QlikView]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2282</guid>
		<description><![CDATA[QlikTech* finally decided both to become a client and, surely not coincidentally, to give me more technical detail about QlikView than it had when last we talked a couple of years ago. Indeed, I got to spend a couple of hours on the phone not just with Anthony Deighton, but also with QlikTech&#8217;s Hakan Wolge, [...]]]></description>
			<content:encoded><![CDATA[<p style="margin-bottom: 0in;">QlikTech* finally decided both to become a client and, surely not coincidentally, to give me more technical detail about QlikView than it had <a href="../2008/08/04/qliktech-qlikview-update/">when last we talked a couple of years ago</a>. Indeed, I got to spend a couple of hours on the phone not just with Anthony Deighton, but also with QlikTech&#8217;s Hakan Wolge, who wrote 70-80% of the code in QlikView 1.0, and remains in effect QlikTech&#8217;s chief architect to this day.</p>
<p style="margin-bottom: 0in;"><em>*Or, as it now appears to be called, Qlik Technologies.</em></p>
<p style="margin-bottom: 0in;">Let&#8217;s start with some quick reminders:</p>
<ul>
<li>QlikTech <span style="font-weight: normal;">makes 	QlikView, a wi</span>dely popular business intelligence (BI) tool 	suite.</li>
<li>QlikView is distinguished by <strong>the 	flexibility of navigation</strong> through its user interface.</li>
<li>To support this flexibility, 	<strong>QlikView preloads all data you might want to query into memory.</strong></li>
</ul>
<p style="margin-bottom: 0in;">Let&#8217;s also dispose of one confusion right up front, namely QlikTech&#8217;s use of the word <strong>associative:  <span id="more-2282"></span><br />
</strong></p>
<ul>
<li>Notwithstanding QlikT<span style="font-style: normal;">ech&#8217;s 	repeated use of phrases like “</span><em><span style="font-style: normal;">QlikView&#8217;s</span></em><span style="font-style: normal;"> unique, patented in-</span><em><span style="font-style: normal;">memory 	associative</span></em><span style="font-style: normal;"> technology,” </span><span style="font-style: normal;"><strong>there is 	nothing “associative” about QlikView&#8217;s data structures.</strong></span><span style="font-style: normal;"> </span></li>
<li><span style="font-style: normal;">Rather, 	“associative” is a term that can reasonably be used to describe 	the functionality of QlikView&#8217;s user interface. In particular, 	QlikView can “associate” over fields that have the same name, in 	that it makes it easy for users to join across them.</span></li>
</ul>
<p style="margin-bottom: 0in;"><span style="font-style: normal;">With that out of the way, let&#8217;s turn to some highlights of QlikView&#8217;s underlying technology.</span></p>
<ul>
<li><span style="font-style: normal;"><span style="font-weight: normal;">For the most part, QlikView&#8217;s in-memory 	data structures are quite simple. In particular:</span></span>
<ul>
<li><span style="font-style: normal;"><span style="font-weight: normal;">QlikView 	data is stored in a </span></span><strong><span style="font-style: normal;">straightforward 	tabular format.</span></strong></li>
<li><span style="font-style: normal;">QlikView 	data is compressed via what QlikTech calls a “symbol table,” but 	I generally call </span><span style="font-style: normal;"><strong>“dictionary” </strong></span><span style="font-style: normal;"><span style="font-weight: normal;">or</span></span><span style="font-style: normal;"><strong> “token” compression.</strong></span></li>
<li><span style="font-style: normal;">QlikView 	typically gets at its data via </span><span style="font-style: normal;"><strong>scans.</strong></span><span style="font-style: normal;"> There is very little in the way of precomputed aggregates, indexes, 	and the like. Of course, if the selection happens to be in line with 	the order in which the records are sorted, you can get great 	selectivity in a scan.</span></li>
<li><span style="font-style: normal;">One 	advantage of doing token compression is that all the fields in a 	column wind up being the same length. Thus, QlikView holds its data 	in nice </span><span style="font-style: normal;"><strong>arrays,</strong></span><span style="font-style: normal;"> so the addresses of individual rows can often be easily calculated.</span></li>
</ul>
</li>
<li><span style="font-style: normal;">To 	get its UI flexibil</span><span style="font-style: normal;"><span style="font-weight: normal;">ity, 	QlikView implicitly assumes a </span></span><span style="font-style: normal;"><strong>star/snowflake 	schema.</strong></span><span style="font-style: normal;"> That is, there 	should be no more and no less than </span><span style="font-style: normal;"><strong>one 	possible join path between any pair of tables.</strong></span><span style="font-style: normal;"> In some cases, this means one will want to rename fields as part of 	QlikView load scripts. For example,</span>
<ul>
<li><span style="font-style: normal;">If 	two keys are meant to be joined on, you might want to give them the 	same name.</span></li>
<li><span style="font-style: normal;">If 	two columns have the same name and mean different things (e.g., 	different kinds of dates), you can give them different names.</span></li>
<li><span style="font-style: normal;">You 	can mark which columns you do or don&#8217;t want to have “qualified” 	names – i.e., table-specific modifications that force the names to 	be unique.</span></li>
</ul>
</li>
<li><span style="font-style: normal;">QlikView 	is designed for </span><span style="font-style: normal;"><strong>gigabytes-scale 	databases.</strong></span><span style="font-style: normal;"> (More 	precisely, it&#8217;s constrained by how much RAM you can address in a 	single box, and that&#8217;s how the numbers currently work out.) In 	particular:</span>
<ul>
<li><span style="font-style: normal;">QlikTech 	recommends 2-4 gigabytes of compressed data per core. QlikTech says 	10X is a good rule of thumb for compression, although it sounded 	like that&#8217;s a little (not a lot) on the high side when compared 	simply to raw data.</span></li>
<li><span style="font-style: normal;">QlikTech 	further recommends RAM amounting to another 10% of data size be set 	aside for each concurrent user (e.g., for cache). However, Hakan 	said that&#8217;s really too pessimistic, and in most cases 5% would 	suffice.</span></li>
<li><span style="font-style: normal;">Bottom 	line: QlikView “comfortably” handles databases with </span><span style="font-style: normal;"><strong>10-20 	gigabytes of compressed data,</strong></span><span style="font-style: normal;"> at whatever product of record count and record length you like. 	(E.g., 1 billion relatively narrow records.) That&#8217;s on the order of </span><span style="font-style: normal;"><strong>100 gigabytes of raw 	data.</strong></span></li>
<li><span style="font-style: normal;">Indeed, 	several QlikView customers manage several billion records each.</span></li>
</ul>
</li>
<li><span style="font-style: normal;">The 	main ingredient of the performance secret sauce in QlikView is that </span><span style="font-style: normal;"><strong>selections are compiled 	straight into machine code.</strong></span><span style="font-style: normal;"> (QlikTech gave me the impression that this post is the first time 	that will be publicly revealed.) Notes on that include:</span>
<ul>
<li><span style="font-style: normal;">In 	the old days, QlikTech thought compilation gave a 10X performance 	benefit vs. interpreted code. However, 5X might be a more up-to-date 	figure.</span></li>
<li><span style="font-style: normal;">It&#8217;s 	not just code; part of the compilation is to create temporary lookup 	tables.</span></li>
<li><span style="font-style: normal;">A 	single calculation can use multiple cores. QlikTech thinks it&#8217;s done 	a very solid job of engineering efficient multicore parallelism. </span><span style="font-style: normal;"><em>(Note: So far as I could tell, Hakan was using 	“calculation” to refer both to queries and, well, calculations.)</em></span></li>
<li><span style="font-style: normal;">There&#8217;s 	a good reason QlikView runs only on Intel-compatible processors. A 	port would be painful.</span></li>
</ul>
</li>
<li><span style="font-style: normal;">In 	QlikView&#8217;s world, one set of users accesses one set of applications 	against one database on one machine. However, different subsets (or 	copies of the same subset) of the same underlying database(s) can of 	course be run on different machines.</span></li>
<li><span style="font-style: normal;">Naturally, 	QlikView caches results and tries to re-use them. One smart thing 	about QlikView&#8217;s caching algorithm is that it takes into account the 	cost of generating the calculated results. This has the happy effect 	that large result sets, which are often the ones most likely to be 	useful in a subsequent calculation, are the ones most likely to be 	retained. </span></li>
<li><span style="font-style: normal;">One 	thing I unfortunately forgot to ask about is loading QlikView data 	into memory, something that has at times been <a href="../2007/09/27/a-negative-take-on-qlikview/">problematic</a>.</span></li>
</ul>
<p style="margin-bottom: 0in;"><span style="font-style: normal;">One last thing: QlikTech is going public. That means there is a <a href="http://sec.gov/Archives/edgar/data/1305294/000095012310031429/b80142sv1.htm" onclick="javascript:pageTracker._trackPageview('/sec.gov');">QlikTech S-1</a>, from which I learned, among other things, that QlikTech now seems to be called Qlik Technologies. Dave Kellogg offers an outstanding <a href="http://www.kellblog.com/2010/04/12/thoughts-on-the-qlik-technologies-qliktech-ipo/" onclick="javascript:pageTracker._trackPageview('/www.kellblog.com');">overview of the information in QlikTech&#8217;s filing(s)</a>. The points I&#8217;d add to Dave&#8217;s are primarily from the QlikTech balance sheet:</span></p>
<ul>
<li><span style="font-style: normal;">Deferred 	revenue, which Dave calls out as high in absolute terms, is also 	growing faster than revenue (or any major component of revenue).</span></li>
<li><span style="font-style: normal;">Accounts 	receivable are also growing faster than revenue or any major 	component thereof.</span></li>
<li><span style="font-style: normal;">One 	possible explanation is weirdness with international distributors, 	which is at least potentially consistent with what QlikTech says is 	a shift in geographical mix.</span></li>
<li><span style="font-style: normal;">Another 	explanation is increasing deal size/complexity, something that is 	anyway common among enterprise software companies gaining market 	share, and that is also consistent with what QlikTech says is a 	growing fraction of revenue coming from existing customers.</span></li>
</ul>
<p style="margin-bottom: 0in;">
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/06/12/the-underlying-technology-of-qlikview/feed/</wfw:commentRss>
		<slash:comments>20</slash:comments>
		</item>
		<item>
		<title>VoltDB finally launches</title>
		<link>http://www.dbms2.com/2010/05/25/voltdb-finally-launches/</link>
		<comments>http://www.dbms2.com/2010/05/25/voltdb-finally-launches/#comments</comments>
		<pubDate>Tue, 25 May 2010 07:15:04 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[EAI, EII, ETL, ELT, ETLT]]></category>
		<category><![CDATA[Games and virtual worlds]]></category>
		<category><![CDATA[In-memory DBMS]]></category>
		<category><![CDATA[Investment research and trading]]></category>
		<category><![CDATA[Michael Stonebraker]]></category>
		<category><![CDATA[NoSQL]]></category>
		<category><![CDATA[OLTP]]></category>
		<category><![CDATA[Parallelization]]></category>
		<category><![CDATA[Solid-state memory]]></category>
		<category><![CDATA[Telecommunications]]></category>
		<category><![CDATA[Theory and architecture]]></category>
		<category><![CDATA[VoltDB and H-Store]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2201</guid>
		<description><![CDATA[VoltDB is finally launching today. As is common for companies in sectors I write about, VoltDB &#8212; or just &#8220;Volt&#8221; &#8212; has discovered the virtues of embargoes that end 12:01 am. Let&#8217;s go straight to the technical highlights:

VoltDB is based on the H-Store technology, which I wrote about in February, 2009. Most of what I [...]]]></description>
			<content:encoded><![CDATA[<p>VoltDB is finally launching today. As is common for companies in sectors I write about, VoltDB &#8212; or just &#8220;Volt&#8221; &#8212; has discovered the virtues of embargoes that end 12:01 am. Let&#8217;s go straight to the technical highlights:</p>
<ul>
<li>VoltDB is based on the <a href="http://www.dbms2.com/2008/02/19/h-store-architecture/" >H-Store</a> technology, which I wrote about in February, 2009. Most of what I said about H-Store then applies to VoltDB today.</li>
<li>VoltDB is a no-apologies ACID relational DBMS, which runs entirely in RAM.</li>
<li>VoltDB has rather limited SQL. (One example: VoltDB can&#8217;t do SUMs in SQL.) However, VoltDB guy Tim Callaghan (Mark Callaghan&#8217;s lesser-known but nonetheless smart brother) asserts that if you code up the missing functionality, it&#8217;s almost as fast as if it were present in the DBMS to begin with, because there&#8217;s no added I/O from the handoff between the DBMS and the procedural code. (The data&#8217;s in RAM one way or the other.)</li>
<li>VoltDB&#8217;s Big Conceptual Performance Story is that it does away with most locks, latches, logs, etc., and also most context switching.</li>
<li>In particular, you&#8217;re supposed to partition your data and architect your application so that most transactions execute on a single core. When you can do that, you get VoltDB&#8217;s performance benefits. To the extent you can&#8217;t, you&#8217;re in two-phase-commit performance land. (More precisely, you&#8217;re doing 2PC for multi-core writes, which is surely a major reason that multi-core reads are a lot faster in VoltDB than multi-core writes.)</li>
<li>VoltDB has a little less than one DBMS thread per core. When the data partitioning works as it should, you execute a complete transaction in that single thread. Poof. No context switching.</li>
<li>A transaction in VoltDB is a Java stored procedure. (The early idea of Ruby on Rails in lieu of the Java/SQL combo didn&#8217;t hold up performance-wise.)</li>
<li>Solid-state memory is not a viable alternative to RAM for VoltDB. Too slow.</li>
<li>Instead, VoltDB lets you snapshot data to disk at tunable intervals. &#8220;Continuous&#8221; is one of the options, wherein a new snapshot starts being made as soon as the last one completes.</li>
<li>In addition, VoltDB will also spool a kind of transaction log to the target of your choice. (Obvious choice: An analytic DBMS such as Vertica, but there&#8217;s no such connectivity partnership actually in place at this time.)</li>
</ul>
<p><span id="more-2201"></span>I should also note that when Tim Callaghan described architectural options to get around 2PC performance issues, they sounded a lot like eventual consistency. Maybe tunable <a href="http://www.dbms2.com/2010/05/01/ryw-read-your-writes-consistency/" >RYW consistency</a> isn&#8217;t in the cards, but at least there&#8217;s a NoSQL-like possibility with VoltDB.</p>
<p>VoltDB&#8217;s open source strategy is:</p>
<ul>
<li>VoltDB will be open sourced.</li>
<li>Community VoltDB will be GPLed. Professional Edition VoltDB has a non-GPL license.</li>
<li>The VoltDB Professional Edition won&#8217;t start out with features beyond the Community Edition ones, but will gain such later on. I didn&#8217;t get the sense the plans for those features were completely baked yet, but ideas mentioned included:
<ul>
<li>Management/monitoring tools.</li>
<li>Integration with expense closed-source enterprise software products, such as ones in the management/monitoring area.</li>
<li>Yet more &#8220;extreme&#8221;/edge-case performance.</li>
</ul>
</li>
<li>Before VoltDB decided for sure that it wasn&#8217;t selling licenses, it sold a license to Getco, which also seems to be an investor in the company.</li>
</ul>
<p>VoltDB had a beta test with about 150 participants. None is in production yet, although at least a few are clearly headed there. Most VoltDB beta testers are in some kind of online business, with a particular concentration in everybody&#8217;s new favorite market, online gaming. Most of the rest are in investment/trading &#8212; a major target market for at least three different Mike Stonebraker companies &#8212; and a few are in telecom. VoltDB assures me that some of the beta users are companies one actually has heard of before, but VoltDB is not in a position to name any of those.</p>
<p>VoltDB is not ideally suited for a classic order management system, since you&#8217;d want to partition both on CustomerID and SKU, the latter because you&#8217;d constantly updating inventory stock levels. However, this argument doesn&#8217;t apply in the case of virtual goods. Virtual goods that are sold for real money &#8212; and hence need ACID levels of transaction integrity &#8212; are thus a clear target market for VoltDB. (The example that came up was in, you guessed it, online gaming.) The other interesting use case that Tim highlighted was low-latency analytics/ELT. For reasons I didn&#8217;t totally grasp, Tim likes to call this &#8220;Stateful ELT.&#8221; (Given that the data goes into the VoltDB database before much else happens to it, I&#8217;m pretty sure I heard &#8220;ELT&#8221; correctly. But I guess I might have been mishearing &#8220;ETL&#8221;.)</p>
<p>VoltDB company highlights include:</p>
<ul>
<li>VoltDB has about a dozen employees, all but two of whom are technical. (However, I&#8217;m not sure they&#8217;re counting Andy Ellicott against the two. But then, last I heard he wasn&#8217;t full time at VoltDB.)</li>
<li>VoltDB&#8217;s venture funding status is, if I may paraphrase, &#8220;Mumble mumble.&#8221;</li>
<li>Although long separate from Vertica, VoltDB is still located in Vertica&#8217;s offices.</li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/05/25/voltdb-finally-launches/feed/</wfw:commentRss>
		<slash:comments>12</slash:comments>
		</item>
		<item>
		<title>Further quick SAP/Sybase reactions</title>
		<link>http://www.dbms2.com/2010/05/13/sap-sybase-reactions/</link>
		<comments>http://www.dbms2.com/2010/05/13/sap-sybase-reactions/#comments</comments>
		<pubDate>Thu, 13 May 2010 15:30:46 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Aleri and Coral8]]></category>
		<category><![CDATA[Analytic technologies]]></category>
		<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Columnar database management]]></category>
		<category><![CDATA[Complex event processing (CEP)]]></category>
		<category><![CDATA[In-memory DBMS]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[Mid-range]]></category>
		<category><![CDATA[SAP AG]]></category>
		<category><![CDATA[Sybase]]></category>
		<category><![CDATA[Theory and architecture]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2128</guid>
		<description><![CDATA[Raj Nathan of Sybase has been calling around to chat quickly about the SAP/Sybase deal and related matters. Talking with Raj didn&#8217;t change any of my initial reactions to SAP&#8217;s acquisition of Sybase. I also didn&#8217;t bother Raj with too many hard questions, as he was clearly in call-and-reassure mode, reaching out to customers and [...]]]></description>
			<content:encoded><![CDATA[<p>Raj Nathan of Sybase has been calling around to chat quickly about the SAP/Sybase deal and related matters. Talking with Raj didn&#8217;t change any of <a href="http://www.dbms2.com/2010/05/12/sap-acquire-sybase/" >my initial reactions to SAP&#8217;s acquisition of Sybase</a>. I also didn&#8217;t bother Raj with too many hard questions, as he was clearly in call-and-reassure mode, reaching out to customers and influencers alike.</p>
<p>That said,   <span id="more-2128"></span></p>
<ul>
<li>Raj said that Sybase&#8217;s Aleri acquisition was, if anything, tracking ahead of expectations.</li>
<li>Raj didn&#8217;t seem the slightest bit focused on the Coral8/Aleri CEP-based BI strategy that John Morell had long championed.</li>
<li>Raj reminded me that Sybase SQL Anywhere has numerous OEMs, not just on the true desktop/laptop or smaller, but also in a return to its server/workgroup roots. Sybase SQL Anywhere even added geospatial indexing recently.</li>
</ul>
<p>Raj also spoke glowingly of SAP&#8217;s in-memory database technology and the potential for Sybase of same &#8212; until I asked a follow-up question. At that point, he confessed that he didn&#8217;t really know much about about SAP&#8217;s in-memory database technology yet. As I said before, I believe SAP is fairly sincere about its belief that its in-memory database technology will conquer the world &#8212; but this is a naive and poorly-founded opinion even so.</p>
<p>One tidbit I did get is that SAP&#8217;s in-memory database technology is not just <a href="http://www.dbms2.com/2006/09/20/saps-bi-accelerator/" >son-of-T-REX</a>. A Korean (Raj thinks) company SAP had acquired is also in the mix. Raj also had the impression SAP&#8217;s in-memory technology can do rows, columns, or hybrid structures. On the one hand, that makes sense. On the other, it&#8217;s not a perfect fit with <a href="http://www.dbms2.com/2009/07/07/hasso-plattner-calls-for-in-memory-oltp-column-stores/" >what Hasso Plattner said last year</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/05/13/sap-sybase-reactions/feed/</wfw:commentRss>
		<slash:comments>12</slash:comments>
		</item>
		<item>
		<title>Quick reactions to SAP acquiring Sybase</title>
		<link>http://www.dbms2.com/2010/05/12/sap-acquire-sybase/</link>
		<comments>http://www.dbms2.com/2010/05/12/sap-acquire-sybase/#comments</comments>
		<pubDate>Wed, 12 May 2010 23:48:37 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[ANTs Software]]></category>
		<category><![CDATA[Analytic technologies]]></category>
		<category><![CDATA[Business Objects]]></category>
		<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Columnar database management]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[In-memory DBMS]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[OLTP]]></category>
		<category><![CDATA[ParAccel]]></category>
		<category><![CDATA[SAP AG]]></category>
		<category><![CDATA[Sybase]]></category>
		<category><![CDATA[Theory and architecture]]></category>
		<category><![CDATA[Vertica Systems]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2105</guid>
		<description><![CDATA[SAP is acquiring Sybase. On the conference call SAP said Sybase would be run as a separate division of SAP (no surprise). Most of the focus was on Sybase&#8217;s mobile technology, which is forecast at &#62;$400 million in 2010 revenues (which would be 30%ish of the total). My quick reactions include: 

Sybase&#8217;s main businesses are:

Classic [...]]]></description>
			<content:encoded><![CDATA[<p>SAP is acquiring Sybase. On the conference call SAP said Sybase would be run as a separate division of SAP (no surprise). Most of the focus was on Sybase&#8217;s mobile technology, which is forecast at &gt;$400 million in 2010 revenues (which would be 30%ish of the total). My quick reactions include: <span id="more-2105"></span></p>
<ul>
<li>Sybase&#8217;s main businesses are:
<ul>
<li><strong>Classic OLTP DBMS</strong> (Sybase ASE, for Adapative Server Enterprise, unless I&#8217;ve missed yet another name change).</li>
<li><strong>Analytic technology</strong> &#8212; mainly <strong>Sybase IQ,</strong> but more generally <a href="http://www.dbms2.com/2010/02/05/sybase-aleri-rap/" >Sybase RAP</a>.</li>
<li><strong>Mobile technology. </strong>(The frequently renamed small DBMS SQL Anywhere was the foundational product of and still is included in the mobile division.)</li>
</ul>
</li>
<li><a href="http://www.dbms2.com/2009/07/07/hasso-plattner-calls-for-in-memory-oltp-column-stores/" >SAP&#8217;s thoughts on in-memory database management</a> are interesting. However, I think SAP&#8217;s oft-repeated claim that it has a lot of important in-memory database technology to bring to Sybase (or for that matter SAP customers) is mainly smoke and mirrors. <strong>Cool data access methods, good niche database products, and broadly applicable multi-domain DBMS innovations are three different things.</strong> Granting that SAP probably has the first and thinks it has the second is not the same as giving it much credence for having the third.</li>
<li>SAP claims that, 15 years after its refusal to support Sybase turned Sybase into a DBMS also-ran, it by now is &#8220;relatively simple&#8221; to port SAP&#8217;s apps to Sybase ASE, and that they will make that happen. I actually believe that <strong>SAP&#8217;s apps will soon run on Sybase ASE,</strong> where by &#8220;soon&#8221; I mean &#8220;in a couple of years for no-apologies general availability.&#8221; (Certifying a DBMS for SAP is a long process.) The main missing features &#8212; e.g., row-level locking &#8212; were already put into Sybase back in the last millenium. Nor could there be fundamental architectural problems that keep SAP from supporting Sybase ASE, or else SAP couldn&#8217;t have supported Microsoft SQL Server (which, long ago, was a Sybase fork).</li>
<li><strong>I don&#8217;t see any market or competitive dynamics that would lead the SAP acquisition to hurt Sybase&#8217;s ASE or mobile businesses. </strong>General merger management mishegas is, of course, always a possibility.</li>
<li>SAP Business Objects partners with Sybase IQ&#8217;s competitors. That could be a problem. However, <strong>coopetition is pretty strong in the business intelligence market</strong>. I don&#8217;t think any of SAP Business Objects, IBM Cognos, or Oracle Business Intelligence are much held back from partnering by competitive dislike of their parent companies.</li>
<li><strong>The rest of SAP might be able to drum up some extra business for Sybase IQ.</strong></li>
<li><strong>It would be natural for IBM/Cognos to now buy a columnar DBMS of its own.</strong> Vertica is an obvious first choice. ParAccel would surely come much cheaper. Since ParAccel has little chance of surviving as an independent company &#8212; <a href="http://www.dbms2.com/2010/04/16/story-of-an-analytic-dbms-evaluation/" >too immature</a> and too little differentiation to overcome that &#8212; I&#8217;d expect ParAccel&#8217;s board to jump at the chance to sell out.</li>
<li>It would be interesting if SAP Business Objects would revive the <a href="http://www.dbms2.com/2009/03/25/aleri-update/" >CEP-based BI</a> idea.</li>
<li>I gather Sybase&#8217;s AnswersAnywhere concept network/object model-based natural language/speech recognition technology never went anywhere. Unsurprising (it seemed like it needed too much hand-building to scale semantically), but regrettable even so.</li>
<li>I don&#8217;t see anything in this acquisition that would revive PowerBuilder (Sybase&#8217;s Visual Basic competitor), Sybase&#8217;s CASE (Computer-Aided Software Engineering) tools, and so on.</li>
<li>And on the personal side &#8212; I&#8217;ll probably lose Sybase as a customer due to this merger, but it could have been worse. A lot of vendors smaller than Sybase are bigger customers for Monash Research.</li>
</ul>
<p><em>Edit: Right after I posted this, I saw email from Sybase clarifying that Sybase&#8217;s in-memory technology, while slightly influenced by some ANTs IP Sybase bought non-exclusive rights to, is essentially home-grown. That&#8217;s what I thought, but the call sounded like it was saying something different.</em></p>
<p><strong><em>Further coverage of SAP/Sybase:</em></strong></p>
<ul>
<li><a href="http://www.dbms2.com/2010/05/13/sap-database-proliferation/" >SAP believes in database proliferation</a></li>
<li><a href="http://www.dbms2.com/2010/05/13/sap-sybase-reactions/" >More quick reactions to SAP/Sybase</a></li>
<li><a href="http://www.dbms2.com/2010/05/17/technical-basics-of-sybase-iq/" >Technical basics of Sybase IQ</a><strong><em><br />
</em></strong></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/05/12/sap-acquire-sybase/feed/</wfw:commentRss>
		<slash:comments>11</slash:comments>
		</item>
		<item>
		<title>Truviso evidently reinvents itself</title>
		<link>http://www.dbms2.com/2010/05/04/truviso-evidently-reinvents-itself/</link>
		<comments>http://www.dbms2.com/2010/05/04/truviso-evidently-reinvents-itself/#comments</comments>
		<pubDate>Tue, 04 May 2010 19:26:03 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Complex event processing (CEP)]]></category>
		<category><![CDATA[Truviso]]></category>
		<category><![CDATA[Web analytics]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=2045</guid>
		<description><![CDATA[When Aleri bought Coral8 last year, I wrote that the independent CEP (Complex Event Processing) vendors were floundering. Aleri quickly threw in the towel and sold out to Sybase, which hardly changed my opinion. StreamBase actually is persevering, but not with any kind of breakout success. Big vendors, such as Microsoft and IBM, have at [...]]]></description>
			<content:encoded><![CDATA[<p>When Aleri bought Coral8 last year, I wrote that <a href="http://www.dbms2.com/2009/03/09/independent-cep-vendors-continue-to-flounder/" >the independent CEP (Complex Event Processing) vendors were floundering</a>. Aleri quickly threw in the towel and <a href="http://www.dbms2.com/2010/02/05/sybase-aleri-rap/" >sold out to Sybase</a>, which hardly changed my opinion. <a href="http://www.dbms2.com/2010/02/16/quick-thoughts-on-the-streambase-component-exchange/" >StreamBase actually is persevering</a>, but not with any kind of breakout success. Big vendors, such as <a href="http://www.dbms2.com/2009/05/13/microsoft-announced-cep-this-week-too/" >Microsoft</a> and <a href="http://www.dbms2.com/2009/05/18/followup-on-ibm-system-sinfosphere-streams/" >IBM</a>, have at least some aspirations of eventually filling the gap.</p>
<p>Meanwhile, Truviso &#8212; which never got much market traction in the first place &#8212; was in hiding; Roman Bukary never did keep his promise to brief me on the company&#8217;s new and improved strategy. Then Truviso had yet another management change, amidst rumors that it was repositioning away from CEP. As per a press release Truviso emailed today, that&#8217;s now official, with Truviso&#8217;s main business being something to do with web analytics.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2010/05/04/truviso-evidently-reinvents-itself/feed/</wfw:commentRss>
		<slash:comments>7</slash:comments>
		</item>
	</channel>
</rss>
