March 31, 2009

Twitter is considering using MapReduce

From a Twitter job listing (formatting mine).  The most interesting section is “Additional preferred experience.”


1. Data Warehouse Design and Development
* Translate business requirements into system design and implementation.
* Hands on build of end-to-end BI infrastructure, from raw data to warehouse to reporting.
2. Support
* Design, code, monitor and document highly automated and repeatable processes for maintaining data loading, distribution, integrity, backup, etc.
3. Analytics
* Write and interpret complex SQL queries for standard as well as ad-hoc data mining purposes.
* Summarize and report key analytical findings in both oral and written form.
* Develop, publish and maintain reports from business requirements.

1. Conceptual Frameworks

2. Specific Tools:

3. Additional Preferred Experience



6 Responses to “Twitter is considering using MapReduce”

  1. Twitter shows some directions for growth | Text Technologies on March 31st, 2009 12:24 am

    […] Twitter’s analytics job opening Share: These icons link to social bookmarking sites where readers can share and discover new web pages. […]

  2. Jason Adams on March 31st, 2009 12:48 am

    Interest in functional programming is an interesting twist there at the end, especially with the nod towards Java/C++ in section 2.

  3. dave on March 31st, 2009 1:03 pm

    interesting – it’s a far cry from their RoR roots, huh? with all of this money, do you think that they’ll explore vertica or greenplum type solutions? looks like an awesome cloudera prospect!

  4. Jerome on March 31st, 2009 1:49 pm

    All I know is I havent been able to login to twitter on and off for a week now…lame.

  5. Curt Monash on March 31st, 2009 2:05 pm

    Twitter’s OLTP performance/reliability has indeed been bad again recently.

    RoR is still in the mix.

    As for which data warehouse DBMS to use for web analytics — there are a lot of good possibilities. 🙂 MapReduce favors Aster or Greenplum, of course.

  6. Twitter 在招聘BI 人员 | Alex的个人Blog on March 31st, 2009 10:29 pm

Leave a Reply

Feed: DBMS (database management system), DW (data warehousing), BI (business intelligence), and analytics technology Subscribe to the Monash Research feed via RSS or email:


Search our blogs and white papers

Monash Research blogs

User consulting

Building a short list? Refining your strategic plan? We can help.

Vendor advisory

We tell vendors what's happening -- and, more important, what they should do about it.

Monash Research highlights

Learn about white papers, webcasts, and blog highlights, by RSS or email.