Comments on: Greenplum claims very fast load speeds, and Fox still throws away most of its MySpace data http://www.dbms2.com/2009/03/20/greenplum-claims-very-fast-load-speeds-and-fox-still-throws-away-most-of-its-myspace-data/ Choices in data management and analysis Thu, 09 Feb 2012 21:52:17 +0000 hourly 1 http://wordpress.org/?v=3.0.3 By: Kevin Closson http://www.dbms2.com/2009/03/20/greenplum-claims-very-fast-load-speeds-and-fox-still-throws-away-most-of-its-myspace-data/#comment-113883 Kevin Closson Fri, 20 Mar 2009 20:14:05 +0000 http://www.dbms2.com/?p=723#comment-113883 Dave wrote: "4TB per hour rate is not 4TB of continuous data loading. It’s 2TB in 30 minutes. " FWIW, I have blogged a bit about the topic of load "rates" versus load results: http://kevinclosson.wordpress.com/2009/03/17/no-proof-means-all-spoof-exadata-lags-competitor-bulk-data-loading-capability-really/ The views expressed in this comment are my own and do not necessarily reflect the views of Oracle. The views and opinions expressed by others on this comment thread are theirs, not mine. Dave wrote:
“4TB per hour rate is not 4TB of continuous data loading. It’s 2TB in 30 minutes. ”

FWIW, I have blogged a bit about the topic of load “rates” versus load results:

http://kevinclosson.wordpress.com/2009/03/17/no-proof-means-all-spoof-exadata-lags-competitor-bulk-data-loading-capability-really/

The views expressed in this comment are my own and do not necessarily reflect the views of Oracle. The views and opinions expressed by others on this comment thread are theirs, not mine.

]]> By: More on Greenplum, Fox/MySpace, and load speeds | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/03/20/greenplum-claims-very-fast-load-speeds-and-fox-still-throws-away-most-of-its-myspace-data/#comment-113862 More on Greenplum, Fox/MySpace, and load speeds | DBMS2 -- DataBase Management System Services Fri, 20 Mar 2009 16:40:43 +0000 http://www.dbms2.com/?p=723#comment-113862 [...] Lai offers more facts, figures, explanation, and competitive insight than I did on Greenplum’s loading of the Fox/MySpace database, including that Greenplum is being loaded [...] [...] Lai offers more facts, figures, explanation, and competitive insight than I did on Greenplum’s loading of the Fox/MySpace database, including that Greenplum is being loaded [...]

]]> By: Dave Menninger http://www.dbms2.com/2009/03/20/greenplum-claims-very-fast-load-speeds-and-fox-still-throws-away-most-of-its-myspace-data/#comment-113854 Dave Menninger Fri, 20 Mar 2009 14:17:11 +0000 http://www.dbms2.com/?p=723#comment-113854 I'm not sure whether to be flattered or insulted by the use of the term "contrived". ;-) According to Meriam Webster's online dictionary, contrived could be considered "artistic or ingeneous", but I suspect most people associate a negative connotation with the term. Just to set the record straight, Vertica and its partner Syncsort followed a precedent set by Informatica and then subsequently repeated by Microsoft. They had each published data loading benchmarks using the TPC-H data. Since there is no industry standard data loading benchmark we simply followed the precedent, except we had our results audited and we published a disclosure report so the effort would be transparent. The details are available at http://www.vertica.com/etlworldrecord. While we are on the subject of setting the record straight, readers might want to check out Eric Lai's article in which Ben Werther of Greenplum explains that the 4TB per hour rate is not 4TB of continuous data loading. It's 2TB in 30 minutes. http://www.networkworld.com/news/2009/031909-upstarts-speed-past-bi-vendors.html?page=2. Perhaps that rate could be sustained, perhaps not. That's why full disclosure is important. Readers need to know what the data represents. Dave I’m not sure whether to be flattered or insulted by the use of the term “contrived”. ;-) According to Meriam Webster’s online dictionary, contrived could be considered “artistic or ingeneous”, but I suspect most people associate a negative connotation with the term. Just to set the record straight, Vertica and its partner Syncsort followed a precedent set by Informatica and then subsequently repeated by Microsoft. They had each published data loading benchmarks using the TPC-H data. Since there is no industry standard data loading benchmark we simply followed the precedent, except we had our results audited and we published a disclosure report so the effort would be transparent. The details are available at http://www.vertica.com/etlworldrecord.

While we are on the subject of setting the record straight, readers might want to check out Eric Lai’s article in which Ben Werther of Greenplum explains that the 4TB per hour rate is not 4TB of continuous data loading. It’s 2TB in 30 minutes. http://www.networkworld.com/news/2009/031909-upstarts-speed-past-bi-vendors.html?page=2. Perhaps that rate could be sustained, perhaps not. That’s why full disclosure is important. Readers need to know what the data represents.

Dave

]]>