Comments on: Mike Stonebraker on database compression — comments

By: The core of the Vertica story still seems to be compression | DBMS2 -- DataBase Management System Services

Fri, 04 Jul 2008 06:51:25 +0000

[...] in March, I suggested that compression was a central and compelling aspect of Vertica’s story. Well, in their new blog, the Vertica guys now strongly reinforce that [...]

By: Curt Monash

Curt Monash — Thu, 29 Mar 2007 23:31:47 +0000

Yeah. It’s a pity that you guys never parallelized IQ properly. It might be a fearsome competitor if you had.

Do you have any thoughts on the implications for updates, loads, and while-compressed processing on the choices of bitmaps vs. other dictionary compression vs. delta compression vs. whatever?

Thanks,

CAM

By: Peter Thawley

Peter Thawley — Thu, 29 Mar 2007 22:59:01 +0000

Looks like Mike’s paid attention to what Sybase IQ (aka Expressway Technologies)
developed in the early 90’s. Just look at the TPC-H FDRs for IQ versus Oracle if
you want tangible proof on the financial impact of column-level compression, or
the lack thereof.

Peter Thawley

By: Curt Monash

Curt Monash — Sat, 24 Mar 2007 19:07:09 +0000

Chuck,

So Vertica does horizontal partitioning (random or range) to the same extent row stores do?

CAM

By: Chuck

Chuck — Sat, 24 Mar 2007 17:13:51 +0000

#4 isn’t likely. Internode data movement has to do with what data is on which node, not how the data is organized within the node.

By: DBMS2 — DataBase Management System Services»Blog Archive » Will data compression change the hardware game?

Sat, 24 Mar 2007 07:04:02 +0000

[...] I’ve recently made a lot of posts about database compression. 3X or more compression is rapidly becoming standard; 5X+ is coming soon as processor power increases; 10X or more is not unrealistic. True, this applies mainly to data warehouses, but that’s where the big database growth is happening. And new kinds of data — geospatial, telemetry, document, video, whatever — are highly compressible as well. [...]

By: DBMS2 — DataBase Management System Services»Blog Archive » Mike Stonebraker explains column-store data compression

Sat, 24 Mar 2007 05:20:27 +0000