Comments on: Facebook, Hadoop, and Hive http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/ Choices in data management and analysis Mon, 22 Feb 2010 20:56:20 -0500 http://wordpress.org/?v=2.8.4 hourly 1 By: Curt Monash http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-160014 Curt Monash Mon, 22 Feb 2010 20:56:20 +0000 http://www.dbms2.com/?p=775#comment-160014 Hadoop has some level of load balancing. That's essential to any implementation of MapReduce. If it's not good enough for you -- well, Hadoop is open source, so dive in and change it. Hadoop has some level of load balancing. That’s essential to any implementation of MapReduce. If it’s not good enough for you — well, Hadoop is open source, so dive in and change it.

]]> By: Parag Arora http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-159987 Parag Arora Mon, 22 Feb 2010 12:55:35 +0000 http://www.dbms2.com/?p=775#comment-159987 How is the load balancing to different nodes assured? Does Hadoop internally handles it or we need to define a distribution mechanism? How is the load balancing to different nodes assured? Does Hadoop internally handles it or we need to define a distribution mechanism?

]]> By: Boston Big Data Summit keynote outline | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-157166 Boston Big Data Summit keynote outline | DBMS2 -- DataBase Management System Services Thu, 28 Jan 2010 11:24:55 +0000 http://www.dbms2.com/?p=775#comment-157166 [...] Big ones — retail-oriented ones (eBay, Amazon) partially excepted — rolled their own technology stacks [...] [...] Big ones — retail-oriented ones (eBay, Amazon) partially excepted — rolled their own technology stacks [...]

]]> By: Enterprise Data Base Building In The Social Era | Digital Savant http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-152950 Enterprise Data Base Building In The Social Era | Digital Savant Tue, 15 Dec 2009 23:48:05 +0000 http://www.dbms2.com/?p=775#comment-152950 [...] utilizes the open source Hadoop/Hive system, which “ingests 15 terabytes of new data per day”. The amount of data coming in, telling details like favorite music, locations, books, thoughts and [...] [...] utilizes the open source Hadoop/Hive system, which “ingests 15 terabytes of new data per day”. The amount of data coming in, telling details like favorite music, locations, books, thoughts and [...]

]]> By: Yahoo wants to do decapetabyte-scale data warehousing in Hadoop | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-152426 Yahoo wants to do decapetabyte-scale data warehousing in Hadoop | DBMS2 -- DataBase Management System Services Sat, 12 Dec 2009 05:59:24 +0000 http://www.dbms2.com/?p=775#comment-152426 [...] Language) for Hadoop, which is however getting a SQL interface. And we talked about Pig vs. Hive. But I recently heard a rumor all that is in flux, so I won’t write it up [...] [...] Language) for Hadoop, which is however getting a SQL interface. And we talked about Pig vs. Hive. But I recently heard a rumor all that is in flux, so I won’t write it up [...]

]]> By: How 30+ enterprises are using Hadoop | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-143829 How 30+ enterprises are using Hadoop | DBMS2 -- DataBase Management System Services Fri, 16 Oct 2009 11:36:20 +0000 http://www.dbms2.com/?p=775#comment-143829 [...] to a relational DBMS; many others just leave it in HDFS (Hadoop Distributed File System), e.g. with Hive as the query language, or in exactly one case [...] [...] to a relational DBMS; many others just leave it in HDFS (Hadoop Distributed File System), e.g. with Hive as the query language, or in exactly one case [...]

]]> By: Fault-tolerant queries | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-140268 Fault-tolerant queries | DBMS2 -- DataBase Management System Services Sun, 13 Sep 2009 16:07:48 +0000 http://www.dbms2.com/?p=775#comment-140268 [...] we discussed this subject a few months ago in a couple of comment threads, it seemed to be the case [...] [...] we discussed this subject a few months ago in a couple of comment threads, it seemed to be the case [...]

]]> By: Cloudera presents the MapReduce bull case | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-140226 Cloudera presents the MapReduce bull case | DBMS2 -- DataBase Management System Services Sat, 12 Sep 2009 23:31:34 +0000 http://www.dbms2.com/?p=775#comment-140226 [...] 10 terabytes/day of data ingested via Hadoop (Edit: Some of these metrics have been updated in a subsequent post about Facebook.) [...] [...] 10 terabytes/day of data ingested via Hadoop (Edit: Some of these metrics have been updated in a subsequent post about Facebook.) [...]

]]> By: Confluence: Edmunds Central http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-139986 Confluence: Edmunds Central Thu, 10 Sep 2009 19:26:00 +0000 http://www.dbms2.com/?p=775#comment-139986 <strong>Hadoop POC Environment...</strong> Overview The Software Development team is currently researching a technology solution for addressing our ingestion and processing of weblog data that is reaching the limits of the current system based upon Informatica and Oracle RDBMS....... Hadoop POC Environment…

Overview The Software Development team is currently researching a technology solution for addressing our ingestion and processing of weblog data that is reaching the limits of the current system based upon Informatica and Oracle RDBMS…….

]]> By: Announcing release of HadoopDB (longer version) | Bookmarks http://www.dbms2.com/2009/05/11/facebook-hadoop-and-hive/comment-page-1/#comment-132222 Announcing release of HadoopDB (longer version) | Bookmarks Thu, 23 Jul 2009 20:35:44 +0000 http://www.dbms2.com/?p=775#comment-132222 [...] their analytical database system and claiming data warehouses of size more than a petabyte (see the end of this write-up for some links to large data warehouses).The second trend is what I talked about in my last blog [...] [...] their analytical database system and claiming data warehouses of size more than a petabyte (see the end of this write-up for some links to large data warehouses).The second trend is what I talked about in my last blog [...]

]]>