January 14, 2016

BI and quasi-DBMS

I’m on two overlapping posting kicks, namely “lessons from the past” and “stuff I keep saying so might as well also write down”. My recent piece on Oracle as the new IBM is an example of both themes. In this post, another example, I’d like to memorialize some points I keep making about business intelligence and other analytics. In particular:

Similarly, BI has often been tied to data integration/ETL (Extract/Transform/Load) functionality.* But I won’t address that subject further at this time.

*In the Hadoop/Spark era, that’s even truer of other analytics than it is of BI.

My top historical examples include:

I’m not as familiar with the details for MicroStrategy, but I do know that it generates famously complex SQL so as to compensate for the inadequacies of some DBMS, which had the paradoxical effect of creating performance challenges for MicroStrategy used over more capable analytic DBMS, which in turn led at least Teradata to do special work to optimize MicroStrategy processing. Again, ebbs and flows.

More recent examples of serious DBMS-like processing in BI offerings may be found in QlikView, Zoomdata, Platfora, ClearStory, Metamarkets and others. That some of those are SaaS (Software as a Service) doesn’t undermine the general point, because in each case they have significant data processing technology that lies strictly between the visualization and data store layers.

Related link

Comments

5 Responses to “BI and quasi-DBMS”

  1. David Gruzman on January 17th, 2016 2:53 am

    For me this story underscore two things:
    – database engines are not good enough so descent BI can be built on top of them. Frequently BI vendors are forced to build their own “query layer” which do part of the job and the rest delegate to the underlying DBMS.
    – BI suite is better way to commercialize good query capability, probably for two reasons:
    – It can be sold to management instead of engineers.
    – Unless you expose free SQL a lot of engine problems can be hidden behind UI, which just will not generate “inconvenient” queries.

  2. Rui Amaral on January 18th, 2016 9:26 am

    I am the opposite. Db engines are typically good enough but that semantic definitions (as defined logically into physical objects) usually aren’t for various reasons (time, experience, constant change in the app stack, etc.). Hard to keep as workable model going with ANY technology with that sort of thing going. Hence the push to more tech that is highly flexable but also agnostic. Self-defeating I think.

  3. Aaron on January 20th, 2016 2:39 pm

    A useful perspective is to look at the dynamic between the spectrums:
    a – cost vs. time to market
    b – data purity and certification vs. ungoverned
    c – performance/scalability vs. not

    A lot of BI gets sold as all-in-one solutions, so that pushes towards no admin, and thus no dbms. This is starter edition sales ploy (to business in a hurry, like traders or sales), and as you say – over time this market goes away and products drop that. You can *always* point to new BI products that act like a dbms, and the survivors over time will get coopted and no longer need that capability.

    There is a lot of dynamic now in the cleansed:uncleansed data spectrum. Either you’re interested in data fast or you want semantically sound data that foots to what the rest of the company reports. (Semantics are hard, not technically – but because they apply agreement across the business, and over time these lose sponsorship and *politically* blow up.)

    Hadoop and such (Spark, D3, AWS, etc.) have blown up the cost structure of a lot of these, as well as the performance.

  4. Barney Finucane on February 17th, 2016 9:23 am

    MicroStrategy and Business Objects both build cubes to cache data. BO called them microcubes. MicroStrategy calls them Intelligent Cubes and says they are “cache on steroids”. Cognos, which has never been the performance leader, commonly uses TM1 cubes as a data source to speed things up.

    Cognos left its PowerPlay cube technology stranded, but then bought three companies — Frango, Adaytum and Applix — in fairly quick succession, so they never really did without cubes.

    The real innovation is that Business Objects and Microstrategy have the ability to load these cubes on demand.

  5. Barney Finucane on February 17th, 2016 10:26 am

    The companies Frango, Adaytum and Applix each had their own cube technology, as I failed to write.

Leave a Reply




Feed: DBMS (database management system), DW (data warehousing), BI (business intelligence), and analytics technology Subscribe to the Monash Research feed via RSS or email:

Login

Search our blogs and white papers

Monash Research blogs

User consulting

Building a short list? Refining your strategic plan? We can help.

Vendor advisory

We tell vendors what's happening -- and, more important, what they should do about it.

Monash Research highlights

Learn about white papers, webcasts, and blog highlights, by RSS or email.