Comments on: Three broad categories of data http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/ Choices in data management and analysis Thu, 09 Feb 2012 09:22:14 +0000 hourly 1 http://wordpress.org/?v=3.0.3 By: Three kinds of software innovation, and whether patents could possibly work for them | DBMS 2 : DataBase Management System Services http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-226649 Three kinds of software innovation, and whether patents could possibly work for them | DBMS 2 : DataBase Management System Services Thu, 09 Jun 2011 04:36:34 +0000 http://www.dbms2.com/?p=1421#comment-226649 [...] things that are described by terms like “unstructured” or “semi-structured” [...] [...] things that are described by terms like “unstructured” or “semi-structured” [...]

]]> By: Traditional databases will eventually wind up in RAM | DBMS 2 : DataBase Management System Services http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-223588 Traditional databases will eventually wind up in RAM | DBMS 2 : DataBase Management System Services Mon, 23 May 2011 16:05:28 +0000 http://www.dbms2.com/?p=1421#comment-223588 [...] In January, 2010, I posted that it might be helpful to view data as being divided into three categories: [...] [...] In January, 2010, I posted that it might be helpful to view data as being divided into three categories: [...]

]]> By: Curt Monash http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-214925 Curt Monash Thu, 24 Mar 2011 10:16:36 +0000 http://www.dbms2.com/?p=1421#comment-214925 That depends, but often the answer is "not tabular" or "awkward fit for tabular." There are three main reasons for that. First, the list of possible event types is commonly too long for people to enjoy making separate columns for each one. See for example my post on eBay Singularity: http://www.dbms2.com/2010/10/06/ebay-followup-greenplum-out-teradata-10-petabytes-hadoop-has-some-value-and-more/ Second, the temporal relationships between events are commonly awkward to represent relationally. In many cases you can timestamp everything and then also store a derived field as to what's part of the same event -- still, there can be awkwardness. Third, shoehorning logs into a tabular format might just lead to expense and bloat. That depends, but often the answer is “not tabular” or “awkward fit for tabular.”

There are three main reasons for that. First, the list of possible event types is commonly too long for people to enjoy making separate columns for each one. See for example my post on eBay Singularity: http://www.dbms2.com/2010/10/06/ebay-followup-greenplum-out-teradata-10-petabytes-hadoop-has-some-value-and-more/

Second, the temporal relationships between events are commonly awkward to represent relationally. In many cases you can timestamp everything and then also store a derived field as to what’s part of the same event — still, there can be awkwardness.

Third, shoehorning logs into a tabular format might just lead to expense and bloat.

]]> By: al kumar http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-214879 al kumar Thu, 24 Mar 2011 02:28:34 +0000 http://www.dbms2.com/?p=1421#comment-214879 to be clear, using Curt's taxonomy -- is machine generated data non-tabular or tabular? to be clear, using Curt’s taxonomy — is machine generated data non-tabular or tabular?

]]> By: al kumar http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-214878 al kumar Thu, 24 Mar 2011 02:27:52 +0000 http://www.dbms2.com/?p=1421#comment-214878 so does machine generated data have *structure*? that is to say, does it lend itself to a data model in the relational sense? so does machine generated data have *structure*? that is to say, does it lend itself to a data model in the relational sense?

]]> By: Examples and definition of machine-generated data | DBMS 2 : DataBase Management System Services http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-211187 Examples and definition of machine-generated data | DBMS 2 : DataBase Management System Services Tue, 01 Mar 2011 07:46:13 +0000 http://www.dbms2.com/?p=1421#comment-211187 [...] posts made last December, January, and April, I [...] [...] posts made last December, January, and April, I [...]

]]> By: Mega-trends driving data warehousing and business intelligence | DBMS 2 : DataBase Management System Services http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-205183 Mega-trends driving data warehousing and business intelligence | DBMS 2 : DataBase Management System Services Sat, 22 Jan 2011 19:07:12 +0000 http://www.dbms2.com/?p=1421#comment-205183 [...] A year ago, I divided data into three kinds: [...] [...] A year ago, I divided data into three kinds: [...]

]]> By: How to Tame Big Bad Data | Kalido Conversations http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-182146 How to Tame Big Bad Data | Kalido Conversations Wed, 25 Aug 2010 16:35:49 +0000 http://www.dbms2.com/?p=1421#comment-182146 [...] try to get a better understanding of the nature of Big Bad Data. Curt Monash wrote about the difference between machine-generated data and human-generated data. (For the purpose of [...] [...] try to get a better understanding of the nature of Big Bad Data. Curt Monash wrote about the difference between machine-generated data and human-generated data. (For the purpose of [...]

]]> By: Examples of machine-generated data | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-164988 Examples of machine-generated data | DBMS2 -- DataBase Management System Services Thu, 08 Apr 2010 19:20:21 +0000 http://www.dbms2.com/?p=1421#comment-164988 [...] long ago I pointed out that much future Big Data growth will be in the area of machine-generated data, examples of which [...] [...] long ago I pointed out that much future Big Data growth will be in the area of machine-generated data, examples of which [...]

]]> By: Thoughts on IBM’s anti-Oracle announcements | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2010/01/17/three-broad-categories-of-data/#comment-164876 Thoughts on IBM’s anti-Oracle announcements | DBMS2 -- DataBase Management System Services Wed, 07 Apr 2010 16:12:38 +0000 http://www.dbms2.com/?p=1421#comment-164876 [...] both highly important, those are very different things. IBM has not in the past shown much impressive technology in either of those two areas, and based [...] [...] both highly important, those are very different things. IBM has not in the past shown much impressive technology in either of those two areas, and based [...]

]]>