October 1, 2009

MapReduce tidbits

I’ve never had children, and so have never had to supervise squabbling siblings, each accusing the other of selfishness and insufficient sharing. Perhaps the MapReduce vendors are a form of karmic payback. Be that as it may, my client Cloudera has organized Hadoop World on October 2 in New York, and my other client Aster Data is hosting a MapReduce-centric Big Data Summit the night before, at the same venue. Even if you don’t go, both conference’s agenda pages offer a peek into what’s going on in MapReduce applications. I’m not going either, but even so I hope to post an overview of MapReduce uses after the conferences serve to publicize some of them.

Even better, I plan to hold a couple of webinars on MapReduce, the first at 10 am (blech) and 1 pm Eastern time on October 15. They’re sponsored by Aster Data, and so will have a strong SQL/MapReduce orientation.

In connection with its conference, Aster is introducing an nCluster-Hadoop connector — i.e., a loader from HDFS (Hadoop Distributed File System) implemented in SQL/MapReduce. In particular:

Meanwhile, each of SenSage and Splunk told me last week that they’ve been doing what amounts to MapReduce under the covers since their respective Day 1s. Who knew? (More on each company later.)

And as previously noted, Netezza and Teradata are doing MapReduce too. One of the exhibit-hall videos at Netezza’s Enzee Universe conference tour mentioned MapReduce, but I’ll confess to never having stopped to check what it actually was saying.

Comments

7 Responses to “MapReduce tidbits”

  1. Jerome Pineau on October 1st, 2009 4:27 pm

    I didn’t realize NZ, Tera and SenSage were doing MR as well. I really look forward to your webinars.

    This is an area in which information/education channels has been lacking IMHO. Yes there’s been plenty of online material and papers on it but no centalized/big picture view that common mortal can wrap their heads around.

    That’s one of the reasons I wanted to address it in my latest blog post, from a much higher altitude than I’m sure you will.

    Thanks for bringing this forward in digestable ways!

  2. Metricmine on October 3rd, 2009 12:16 am

    It would be interesting to comment on real world use cases for Hadoop/MR for enterprise *structured* data. Google, Facebook and Yahoo have unique data requirements, but that’s 3 super high volume sites. OK so Hadoop is great for them. What about everyone else.

    Are folks using it for call center monitoring? Sales territory assignment? Incentive comp calculations? Mapping journal lines to sub-ledgers? Fraud detection? Time-phased correlations?

    If the answer is well, no, then why is it reasonable for database vendors to invest so much dev and mktg resources into such an extremely niche technology.

  3. Curt Monash on October 3rd, 2009 6:01 am

    Fraud — absolutely.

    Apps on which other technologies do a really great job — not so much.

  4. How 30+ enterprises are using Hadoop | DBMS2 -- DataBase Management System Services on October 10th, 2009 6:19 am

    [...] gaining traction, especially but by no means only in the form of Hadoop. In the aftermath of Hadoop World, Jeff Hammerbacher of Cloudera walked me quickly through 25 customers he pulled from [...]

  5. Metricmine on October 13th, 2009 9:29 pm

    Thanks for the update. Omer at Vertica also clued me in. Hadoop embraces and extends the power of a relational db, not really opposing camps. Now, I need to get my hands down and dirty with it!

  6. Yahoo Still Emceeing a Growing Hadoop Lovefest — GigaOM Research on October 18th, 2013 6:07 pm

    [...] the MapReduce world converged on New York late this week, Senior VP of Cloud Computing Shelton Shugar has been telling anybody who will listen that Yahoo is [...]

  7. Today in Cloud — Gigaom Research on October 23rd, 2013 6:52 am

    [...] Aster Data’s Big Data Summit and Cloudera’s Hadoop Summit being held tonight and tomorrow, respectively, at the same NYC venue, large-scale analytics are as hot today (literally, Oct. 1, 2009) as ever. Particularly hot today [...]

Leave a Reply




Feed: DBMS (database management system), DW (data warehousing), BI (business intelligence), and analytics technology Subscribe to the Monash Research feed via RSS or email:

Login

Search our blogs and white papers

Monash Research blogs

User consulting

Building a short list? Refining your strategic plan? We can help.

Vendor advisory

We tell vendors what's happening -- and, more important, what they should do about it.

Monash Research highlights

Learn about white papers, webcasts, and blog highlights, by RSS or email.