August 21, 2016

More about Databricks and Spark

Databricks CEO Ali Ghodsi checked in because he disagreed with part of my recent post about Databricks. Ali’s take on Databricks’ position in the Spark world includes:

Ali also walked me through customer use cases and adoption in wonderful detail. In general:

The story on those sectors, per Ali, is: 

At an unspecified place in the timeline is national security, for a use case very similar to anti-fraud — identifying communities of bad people. Graph analytics plays a big role here.

And finally, of course we discussed some technical stuff, in philosophy, futures and usage as the case may be. In particular, Ali stressed that Spark 2.0 is the first that “breaks”/changes the APIs; hence the release number. It is now the case that:

Other tidbits included:


4 Responses to “More about Databricks and Spark”

  1. Introduction to data Artisans and Flink | DBMS 2 : DataBase Management System Services on August 21st, 2016 5:16 pm

    […] recent series of Spark posts offer comparison or background to this […]

  2. Notes from a long trip, July 19, 2016 | DBMS 2 : DataBase Management System Services on August 23rd, 2016 7:41 am

    […] Spark and Databricks are both prospering, and of course enhancing their technology as well. […]

  3. Www.Ninjavouchers.Co.Uk on September 7th, 2016 3:47 am


    More about Databricks and Spark | DBMS 2 : DataBase Management System Services

  4. amar on October 16th, 2017 5:52 am

    many uses databricks in machine learning and rest of the use cases are also using it which makes it a good DBMS.

Leave a Reply

Feed: DBMS (database management system), DW (data warehousing), BI (business intelligence), and analytics technology Subscribe to the Monash Research feed via RSS or email:


Search our blogs and white papers

Monash Research blogs

User consulting

Building a short list? Refining your strategic plan? We can help.

Vendor advisory

We tell vendors what's happening -- and, more important, what they should do about it.

Monash Research highlights

Learn about white papers, webcasts, and blog highlights, by RSS or email.