Bracing for Vertica
The word from Vertica is that the product will go GA in the fall, and that they’ll have blow-out benchmarks to exhibit.
I find this very credible. Indeed, the above may even be something of an understatement.
Vertica’s product surely has some drawbacks, which will become more apparent when the product is more available for examination. So I don’t expect row-based appliance innovators Netezza and DATAllegro to just dry up and blow away. On the other hand, not every data warehousing product is going to live long and prosper, and I’d rate Vertica’s chances higher than those of several competitors that are actually already in GA.
| Categories: Columnar database management, Data warehousing, DATAllegro, Netezza, Vertica Systems | 2 Comments |
DBMS plug-compatibility gaining steam
ANTs Software’s primary focus isn’t really even on DBMS any more. Even so, it just announced a deal to replace Informix in a large retail chain’s in-store systems. (In its 1990s heyday, Informix wound up running in-store systems at an impressive list of major retailers. Of course, Informix was long ago acquired by IBM.)
EnterpriseDB has probably passed ANTs in the DBMS plug-compability business. And taken together they’re still pretty small. Even so, plug-compatible DBMS replacement has to be taken seriously as a (possibly) emerging trend. Economically, it makes all the sense in the world.
| Categories: ANTs Software, Emulation, transparency, portability, EnterpriseDB and Postgres Plus, IBM and DB2, OLTP | Leave a Comment |
The database technology of Guild Wars
I have the enviable task of researching online game and virtual world technology. My first interview, quite naturally, was with the lead developers of a game I actually play – Guild Wars. The overview is in another post; that may provide context for this one, which focuses on the database technology. (I also did a short post just on the implications for Guild Wars players.) It also has a brief description of what Guild Wars is – namely, a MMORPG (Massively MultiPlayer Role-Playing Game) with the unusual feature that most of the game world is instanced rather than utterly shared.
First, some scope. ArenaNet (Guild Wars’ developer, now a subsidiary of NCsoft) runs Microsoft SQL Server, mainly Enterprise Edition, having just switched to 2005 4 months ago. They run 1500-2500 transactions/second all day, spiking up to 5000 in their busiest periods. They have no full-time DBA, and when the developers started this project they didn’t know SQL. They’ve only had one major SQL Server failure in the 2+ years the game has been running, and that was (like most of their bugs) a network driver problem more than an issue with the core system.
As for what’s going on — there are a few different kinds of database things that happen in an instanced MMORPG. Read more
Large DB2 data warehouses on Linux (and AIX)
I was consulting recently to a client that needs to build really big relational data warehouses, and also is attracted to native XML. Naturally, I suggested they consider DB2. They immediately shot back that they were Linux-based, and didn’t think DB2 ran (or ran well) on Linux. Since IBM often leads with AIX-based offerings in its marketing and customer success stories, that wasn’t a ridiculous opinion. On the other hand, it also was very far from what I believed.
So I fired some questions at IBM, Read more
| Categories: Data warehousing, IBM and DB2 | Leave a Comment |
StreamBase and Truviso
StreamBase is a decently-established startup, possibly the largest company in its area. Truviso, in the process of changing its name from Amalgamated Insight, has a dozen employees, one referenceable customer, and a product not yet in general availability. Both have ambitious plans for conquering the world, based on similar stories. And the stories make a considerable amount of sense.
Both companies’ core product is a memory-centric SQL engine designed to execute queries without ever writing data to disk. Of course, they both have persistence stories too — Truviso by being tightly integrated into open-source PostgreSQL, StreamBase more via “yeah, we can hand the data off to a conventional DBMS.” But the basic idea is to route data through a whole lot of different in-memory filters, to see what queries it satisfies, rather than executing many queries in sequence against disk-based data. Read more
| Categories: Memory-centric data management, PostgreSQL, StreamBase, Streaming and complex event processing (CEP), Truviso | 8 Comments |
The FileMaker story
Unfortunately, the first draft of this post got eaten. I’m now trying again.
In response to its small but vocal constituency, I got myself briefed on the FileMaker story. My conclusion, in a nutshell, is that FileMaker sometimes is a good alternative to low-end use of a standard relational DBMS. If you do feel able to use more standard-style products, you often should, for all sorts of obvious flexibility and future-proofing reasons. But if you can’t, or if you’re really confident the project won’t grow past a certain level, the FileMaker class of products can be a very appealing alternative.
Make no mistake; FileMaker is very different from conventional DBMS/app dev tool combos (and that’s the right comparison, as it combines aspects of both product categories into one). Read more
| Categories: FileMaker, OLTP | 14 Comments |
The petabyte machine
EMC has announced a machine — a virtual tape library — that supposedly stores 1.8 petabytes of data. Even though that’s only 584 terabytes uncompressed, it shows that the 1 petabyte barrier will be broken soon no matter how unhyped the measurement.
I just recently encountered some old notes in which Sybase proudly announced a “1 gigabyte challenge.” The idea was that 1 gig was a breakthrough size for business databases.
| Categories: Database compression, EMC, Sybase, Theory and architecture | Leave a Comment |
Whether or not to use MySQL
CIO Magazine has a pretty superficial back-and-forth about whether or not to use MySQL in enterprises. For example, one of the strongest claims in the pro-MySQL article is the not-so-staggering observation (italics theirs)
One way MySQL achieves this scalability is through a popular feature called stored procedures, mini, precompiled routines that reside outside of the application.
And the anti-MySQL article doesn’t have much in the way of crunchiness except for the fairly well-reasoned
Most of the required features for an RDBMS are firmly in place with the release of MySQL 5.0, but we can legitimately consider the maturity of some of these features as a possible reason to shy away from MySQL. For example, the lack of views, triggers and stored procedures has historically been the major criticism of MySQL. These have all been supported by MySQL for a year or so now, but by comparison, they have been features for about 10 years in most competing RDBMSes.
This article pair got Slashdotted, and some interesting byplay ensued. The general theme was along the lines of
“MySQL is terribly deficient out of the box.”
“Yes, but if you use this new, lightly-documented add-in, that specific problem is now solved.”
| Categories: Mid-range, MySQL, OLTP | 2 Comments |
Another short white paper on MPP data warehouse appliances
Following up on an earlier piece, DATAllegro has sponsored a second white paper on MPP data warehouse appliances. This one focuses specifically on DATAllegro’s move from Type 1 to Type 2 (i.e., virtual) appliances, via its new V3 product line. The basic tradeoffs of this move include:
- Superior hardware reliability
- Hardware lock-in shifted from DATAllegro to Dell, EMC, and Cisco
- Loss of specialized encryption acceleration
- Possibly a loss of some other performance optimization as well
- Better time-to-market in exploiting general Moore’s Law performance speedups
Actually, I didn’t make that last point explicitly in the paper, but it quite possibly trumps any performance disadvantages from the switch. And Moore’s Law itself certainly far outweighs any other performance-affecting factors.
| Categories: Data warehouse appliances, Data warehousing, DATAllegro | Leave a Comment |
IBM’s mid-range OLTP offering gets strengthened
In the past, when I’ve asked Jeff Jones of IBM for permission to post one of his well-written notes, his response has pretty much been “Of course! Why did you bother asking?” So this time I’m just going ahead and skipping that step. The note is about IBM’s mid-range flavor of DB2, targeted directly at MySQL.
Today, IBM announced that its popular DB2 9 Express-C software is now available with an optional low-cost yearly support subscription. DB2 Express-C has been available without license charges for downloading, application development, deployment and redistribution since January 2006. It remains available without license charges for those that do not require support. Electronic general availability of the new support option is scheduled for June 1, 2007.
The new DB2 Express-C support option provides 24×7 product support, regular fixpacks and upgrade protection. In addition, this option provides support for high availability clustering, offsite disaster recovery, and data replication with remote data servers without additional charge.
Background
— Subscriptions are priced at $2,995 (U.S.) per server per year. This is identical to MySQL Enterprise Gold, but DB2 Express-C includes features not found in MySQL including pureXML support, high availability clustering (MySQL Cluster support costs extra), autonomic features, and no-charge administration and development tools. Unlike the free offerings from Microsoft and Oracle, DB2 Express-C does not place limits on the size or number of databases managed. With up to 4 GB of memory and up to 2 processors, DB2 Express-C can run on more powerful servers, can scale higher and can perform faster than its competitors. Read more
| Categories: IBM and DB2, Mid-range, MySQL, OLTP | Leave a Comment |