October 18, 2010

More notes on Membase and memcached

As a companion to my post about Membase last week, the company has graciously allowed me to post a rather detailed Membase slide deck. (It even has pricing.) Also, I left one point out.

Membase announced a Cloudera partnership. I couldn’t detect anything technically exciting about that, but it serves to highlight what I do find to be an interesting usage trend. A couple of big Web players (AOL and ShareThis) are using Hadoop to crunch data and derive customer profile data, then feed that back into Membase. Why Membase? Because it can serve up the profile in a millisecond, as part of a bigger 40-millisecond-latency request.

And why Hadoop, rather than Aster Data nCluster, which ShareThis also uses? Umm, I didn’t ask.

When I mentioned this to Colin Mahony, he said Vertica had similar stories. However, I don’t recall whether they were about Membase or just memcached, and he hasn’t had a chance to get back to me with clarification.  (Edit: As per Colin’s comment below, it’s both.)

Comments

7 Responses to “More notes on Membase and memcached”

  1. Mark Callaghan on October 18th, 2010 11:53 am

    Lots of database servers have 1ms response times for cached data

  2. Vlad Rodionov on October 18th, 2010 1:29 pm

    Good to know. Loading data from Membase to Hadoop and vice verse effectively, or running M/R jobs directly from Membase – not so bad idea.

  3. Curt Monash on October 18th, 2010 6:29 pm

    Mark,

    Fair enough.

    CAM

  4. colin mahony on October 20th, 2010 10:36 am

    Curt,

    There are several Vertica customers using Membase in the manner you describe with bi-directional integration back to Vertica- sharing scoring models for instance. I also know of several customers using Memcache for object caching and other uses.

    cpm

  5. Mark Callaghan on October 20th, 2010 12:39 pm

    Curt,

    Here is an impressive result demonstrating that MySQL can be web-scale — 750,000 QPS from MySQL/InnoDB using a new interface. Hopefully this code will make it into a supported distribution.

    http://yoshinorimatsunobu.blogspot.com/2010/10/using-mysql-as-nosql-story-for.html

  6. Curt Monash on October 20th, 2010 4:02 pm

    Mark,

    As I’ve noted elsewhere, I suspect that key-value has a performance advantage over relational, but that the advantage is no more than 2X.

    But it’s pretty impossible to do a fair test, because nobody’s really motivated to put the same level of effort into optimizing each and then compare them side by side.

    Besides, it all depends on specifics of the database and of the use case.

  7. ehcache.net on January 9th, 2011 12:52 am

    More notes on Membase and memcached …

    As a companion to my post about Membase last week, the company has graciously allowed me to post a rather detailed Membase slide deck. (It even has pricing.) Also, I left one point out.

Leave a Reply




Feed: DBMS (database management system), DW (data warehousing), BI (business intelligence), and analytics technology Subscribe to the Monash Research feed via RSS or email:

Login

Search our blogs and white papers


Warning: include(): php_network_getaddresses: getaddrinfo failed: Name or service not known in /home/dbms2cm/public_html/wp-content/themes/monash/static_sidebar.php on line 29

Warning: include(http://www.monash.com/blog-promo.php): failed to open stream: php_network_getaddresses: getaddrinfo failed: Name or service not known in /home/dbms2cm/public_html/wp-content/themes/monash/static_sidebar.php on line 29

Warning: include(): Failed opening 'http://www.monash.com/blog-promo.php' for inclusion (include_path='.:/usr/lib/php:/usr/local/lib/php') in /home/dbms2cm/public_html/wp-content/themes/monash/static_sidebar.php on line 29