<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>DBMS 2 : DataBase Management System Services &#187; Business intelligence</title>
	<atom:link href="http://www.dbms2.com/category/analytics-technologies/business-intelligence/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.dbms2.com</link>
	<description>Choices in data management and analysis</description>
	<lastBuildDate>Wed, 08 Feb 2012 22:51:11 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.3</generator>
		<item>
		<title>Departmental analytics &#8212; best practices</title>
		<link>http://www.dbms2.com/2012/01/25/departmental-analytics-best-practices/</link>
		<comments>http://www.dbms2.com/2012/01/25/departmental-analytics-best-practices/#comments</comments>
		<pubDate>Wed, 25 Jan 2012 16:47:59 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Data mart outsourcing]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[EAI, EII, ETL, ELT, ETLT]]></category>
		<category><![CDATA[Predictive modeling and advanced analytics]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5867</guid>
		<description><![CDATA[I believe IT departments should support and encourage departmental analytics efforts, where &#8220;support&#8221; and &#8220;encourage&#8221; are not synonyms for &#8220;control&#8221;, &#8220;dominate&#8221;, &#8220;overwhelm&#8221;, or even &#8220;tame&#8221;. A big part of that is: Let, and indeed help, departments have the data they want, when they want it, served with blazing performance. Three things that absolutely should NOT [...]]]></description>
			<content:encoded><![CDATA[<p><a href="../../../../../2012/01/23/departmental-analytics-general-observations/">I believe IT departments should support and encourage departmental analytics efforts</a>, where &#8220;support&#8221; and &#8220;encourage&#8221; are not synonyms for &#8220;control&#8221;, &#8220;dominate&#8221;, &#8220;overwhelm&#8221;, or even &#8220;tame&#8221;. A big part of that is:<br />
<strong>Let, and indeed help, departments have the data they want, when they want it, served with blazing performance.</strong></p>
<p>Three things that absolutely should NOT be obstacles to these ends are:</p>
<ul>
<li>Corporate DBMS standards.</li>
<li>Corporate data governance processes.</li>
<li>The difficulties of ETL.</li>
</ul>
<p><span id="more-5867"></span>Reasons they shouldn&#8217;t or don&#8217;t need to be obstacles include:</p>
<ul>
<li>Analytic DBMS are often vastly more cost-effective than general-purpose ones.</li>
<li>In particular, analytic DBMS are often much easier to install and manage than general-purpose ones.</li>
<li>Heavy data governance bureaucracy is often unnecessary because:
<ul>
<li>The department should know what the limitations on the data&#8217;s accuracy are.</li>
<li>The department should know how much data accuracy is required.</li>
<li>The side-effects on other departments of any data inaccuracy would be minimal.</li>
</ul>
</li>
<li>There are multiple good schemes for populating data marts, managed by cost-effective analytic DBMS, with data from integrated data warehouses.
<ul>
<li>ELT (Extract/Load/Transform) almost always works, because data cleaning/data quality was handled at or before the IDW level, and because the analytic DBMS has the processing power to pull it off.</li>
<li>ETL (Extract/Transform/Load) should be easy as well. (If isn&#8217;t, something may be lacking in your ETL set-up.)</li>
<li>Analytic DBMS are increasingly adding capabilities for easy spin-out of real or virtual data marts. Other kinds of technology (e.g. virtualization) are having their database spin-out capabilities upgraded as well.</li>
</ul>
</li>
</ul>
<p>One point to remember in support of departmental autonomy <strong>is that departments&#8217; views of what data to use may be more expansive than central IT&#8217;s.</strong> One reason is that important data may be external to the company, outside IT&#8217;s natural realm  of concern. Examples of this include but are hardly limited to:</p>
<ul>
<li>Anything like &#8220;market data&#8221;.</li>
<li>Anything like &#8220;sentiment analysis&#8221;.</li>
<li>Data owned by supply chain partners.</li>
</ul>
<p>Further, even the more innovative internal data sources are commonly departmental, for example various kinds of multi-structured data (text verbatims from customers, log file data, and so on).</p>
<p>Whatever is true of data management (and ETL) is true for metadata management, even if it&#8217;s done by some kind of business intelligence tool. What I mean by that is:</p>
<ul>
<li><strong>Whoever manages data is also responsible for ingesting and emitting it &#8230;</strong></li>
<li>&#8230; and specifically for emitting it in<strong> understandable, well-organized, well-named formats, &#8230;</strong></li>
<li><strong>&#8230; </strong>so that <strong>departments can take responsibility for</strong> what amounts to <strong>lightweight analytic application development.</strong></li>
</ul>
<p>As for the &#8220;application development&#8221; itself, I&#8217;m envisioning at least three things:</p>
<ul>
<li>Math.</li>
<li>Sophisticated relational query.</li>
<li>Data visualization.</li>
</ul>
<p>I.e., I&#8217;m talking about what &#8220;analysts&#8221; and &#8220;quants&#8221; do. So to put the point even more simply:</p>
<ul>
<li><strong>Analysts and quants should be able to consume data that&#8217;s organized in a friendly manner.</strong></li>
<li><strong>Central IT should be friendly in how it serves data.</strong></li>
</ul>
<p>One corollary of this approach is that departments should try to adhere to corporate BI standards, at least for routine dashboard and reporting. Indeed, if a department brings in a business intelligence tool different from the corporate standard, there are three main possibilities:</p>
<ul>
<li>The tool is integrated with something else it makes sense to bring in, such as a third-party data supply or application.</li>
<li>The tool has an important capability the corporate standard doesn&#8217;t have, such as more flexible visualization and drilldown.</li>
<li>Central IT screwed up, making things much more difficult than they needed to be.</li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2012/01/25/departmental-analytics-best-practices/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>Splunk update</title>
		<link>http://www.dbms2.com/2012/01/10/splunk-update/</link>
		<comments>http://www.dbms2.com/2012/01/10/splunk-update/#comments</comments>
		<pubDate>Tue, 10 Jan 2012 05:55:08 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Data models and architecture]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[Log analysis]]></category>
		<category><![CDATA[Specific users]]></category>
		<category><![CDATA[Splunk]]></category>
		<category><![CDATA[Structured documents]]></category>
		<category><![CDATA[Web analytics]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5791</guid>
		<description><![CDATA[Splunk is announcing the Splunk 4.3 point release. Before discussing it, let&#8217;s recall a few things about Splunk, starting with: Splunk is first and foremost an analytic DBMS &#8230; &#8230; used to manage logs and similar multistructured data. Splunk&#8217;s DML (Data Manipulation Language) is based on text search, not on SQL. Splunk has extended its [...]]]></description>
			<content:encoded><![CDATA[<p>Splunk is announcing the Splunk 4.3 point release. Before discussing it, let&#8217;s recall a few things about Splunk, starting with:</p>
<ul>
<li>Splunk is first and foremost an analytic DBMS &#8230;</li>
<li>&#8230; used to manage logs and similar multistructured data.</li>
<li>Splunk&#8217;s DML (Data Manipulation Language) is based on text search, not on SQL.</li>
<li>Splunk has extended its DML in natural ways (e.g., you can use it to do calculations and even some statistics).</li>
<li>Splunk bundles some (very) basic, Splunk-specific business intelligence capabilities.</li>
<li>The paradigmatic use of Splunk is to monitor IT operations in real time. However:
<ul>
<li>There also are plenty of non-real-time uses for Splunk.</li>
<li>Splunk is proudest of its growth in non-IT quasi-real-time uses, such as the marketing side of web operations.</li>
</ul>
</li>
</ul>
<p>As in any release, a lot of Splunk 4.3 is about &#8220;Oh, you didn&#8217;t have that before?&#8221; features and <a href="../../../../../2009/08/21/bottleneck-whack-a-mole/">Bottleneck Whack-A-Mole</a> performance speed-up. One performance enhancement is Bloom filters, which are a very hot topic these days. More important is a switch from Flash to HTML5, so as to accommodate mobile devices with less server-side rendering. Splunk reports that its users &#8212; especially the non-IT ones &#8212; really want to get Splunk information on the tablet devices. While this somewhat contradicts <a href="../../../../../2012/01/04/some-issues-in-business-intelligence/">what I wrote a few days ago pooh-poohing mobile BI</a>, let me hasten to point out:</p>
<ul>
<li>Splunk is used for a lot of (quasi) real-time monitoring.</li>
<li>Splunk&#8217;s desktop user interfaces are, by BI standards, quite primitive.</li>
</ul>
<p>That&#8217;s pretty much the ideal scenario for mobile BI: Timeliness matters and prettiness doesn&#8217;t.</p>
<p><span id="more-5791"></span><em>Hmm. Maybe <a href="../../../../../2011/11/10/streambase-liveview-push-based-real-time-bi/">StreamBase LiveView</a> needs a mobile option as well &#8230;</em></p>
<p>Splunk&#8217;s basic use is to take the text string that is a log and make sense of it. But Splunk now also supports JSON structures. It does this via something called spath, which as you might guess from the name has XPath similarities. That probably bore more discussion than we found the time to have.</p>
<p><em>By the way: If you&#8217;re interested in BI over XML, that&#8217;s what my former clients at Skytide were founded to do, before they pivoted a bit. I don&#8217;t think those capabilities have disappeared from the product</em>.</p>
<p><a href="http://www.monash.com/uploads/Splunk-4-3.pdf">Splunk has graciously allowed me to post a slide deck</a>. More stuff in there, including quotes from a customer &#8212; Expedia &#8212; that has 2700 Splunk users.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2012/01/10/splunk-update/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>Some issues in business intelligence</title>
		<link>http://www.dbms2.com/2012/01/04/some-issues-in-business-intelligence/</link>
		<comments>http://www.dbms2.com/2012/01/04/some-issues-in-business-intelligence/#comments</comments>
		<pubDate>Thu, 05 Jan 2012 00:57:08 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business Objects]]></category>
		<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Gooddata]]></category>
		<category><![CDATA[Software as a Service (SaaS)]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5763</guid>
		<description><![CDATA[In November I wrote two parts of a planned multi-post series on issues in analytic technology. Then I got caught up in year-end things and didn&#8217;t blog for a month. Well &#8230; Happy New Year! I&#8217;m back. Let&#8217;s survey a few BI-related topics. Mobile business intelligence &#8212; real business value or just a snazzy demo? [...]]]></description>
			<content:encoded><![CDATA[<p>In November I wrote <a href="../../../../../2011/11/21/analytic-trends-in-2012-qa/">two</a> <a href="../../../../../2011/11/21/big-vendor-execution-analytics/">parts</a> of a planned multi-post series on issues in analytic technology. Then I got caught up in year-end things and didn&#8217;t blog for a month. Well &#8230; Happy New Year! I&#8217;m back. Let&#8217;s survey a few BI-related topics.</p>
<p><strong>Mobile business intelligence &#8212; real business value or just a snazzy demo?</strong></p>
<p>I discussed some <a href="../../../../../2010/07/15/mobile-business-intelligence/">mobile BI use cases</a> in July 2010, but I&#8217;m still not convinced the whole area is a legitimate big deal. BI has a long history of snazzy, senior-exec-pleasing demos that have little to do with substantive business value. For now, I think mobile BI is another of those; few people will gain deep analytic insights staring into their iPhones. I don&#8217;t see anything coming that&#8217;s going to change the situation soon.</p>
<p><strong>BI-centric collaboration &#8212; real business value or just a snazzy demo?</strong></p>
<p>I&#8217;m more optimistic about <a href="../../../../../2011/11/16/qlikview-collaborative-business-intelligence/">collaborative business intelligence</a>. QlikView&#8217;s direct sharing of dashboards will, I think, be a feature competitors must and will imitate. Social media BI collaboration is still in the &#8220;mainly a demo&#8221; phase, but I think it meets a broader and deeper need than does mobile BI. Over the next few years, I expect numerous enterprises to establish strong cultures of analytic chatter (and then give frequent talks about same at industry conferences).   <span id="more-5763"></span></p>
<p><strong>Business intelligence for mid-market enterprises is problematic</strong></p>
<p>Given the saturation of the large-enterprise BI market with supposed enterprise-standard BI systems, it would seem that smaller enterprises comprise a large part of the BI growth opportunity. However, the large-enterprise and mid-range BI markets are very different. For example:</p>
<ul>
<li>Large enterprises typically have tough challenges in data integration; smaller enterprises may truly start out with their data in only a few systems.</li>
<li>There are many reasons for large enterprises not to do their BI in the cloud, such as bandwidth, internal politics, or the unsuitability of most cloud infrastructure for analytic DBMS scale-out. Smaller enterprises, however, may prefer SaaS (Software as a Service) BI.</li>
<li>The BI market for smaller enterprises is heavily OEM. But unless you&#8217;re buying some kind of data/analytics bundle, the large enterprise BI market still seems overwhelmingly standalone.</li>
<li>Large-enterprise BI tools incorporate much of a DBMS-like technology stack; at smaller enterprises, BI can often stick to its specialized-application-development-tool knitting. But on the other hand &#8230;</li>
<li>&#8230; large enterprises almost always already have a data warehousing infrastructure. Mid-range BI buyers may not have a separate analytic DBMS. Therefore &#8230;</li>
<li>&#8230; BI/DBMS bundles make more sense in the mid-market than they do at large enterprises.</li>
<li>Each large enterprise has a unique infrastructure, and  commonly a unique competitive situation as well. Thus, the idea that you&#8217;ll pre-build most of an analytic application for a large enterprises &#8212; because you know what data model they need to do their BI &#8212; usually turns out to be silly. But smaller enterprises can be more homogeneous, and so for them pre-built analytic applications can actually work.</li>
</ul>
<p>I don&#8217;t know of anybody who&#8217;s really cracked the code on mid-market BI. Crystal Reports (long owned by SAP Business Objects) has huge OEM share, but somehow hasn&#8217;t parlayed that into a comprehensive mid-market BI presence. Various SaaS or on-premise vendors have cool product ideas &#8212; e.g. <a href="../../../../../2009/12/27/introduction-to-gooddata/">Gooddata</a>, <a href="../../../../../2011/10/18/oracle-is-buying-endeca/">Endeca</a>, or my clients at PivotLink &#8212; but none seems to have set the world on fire to this point.</p>
<p><strong>Departmental BI is doing better</strong></p>
<p>The news is happier in a related market &#8212; business intelligence for departments of larger enterprises. However, this is a hard market to analyze, for at least two reasons. First &#8212; <a href="http://www.strategicmessaging.com/no-market-categorization-is-ever-precise/2011/03/01/">as is often the case</a> &#8212; the distinction among large-enterprise-wise, smaller-enterprise-wide, and departmental BI is not a clear one.* Second, &#8220;departmental BI&#8221; has at least two major strains:</p>
<ul>
<li>Simple, pedestrian BI, implemented quickly.</li>
<li><a href="../../../../../2011/03/03/investigative-analytics/">Investigative analytics</a>.</li>
</ul>
<p><em>*In particular, it has been the case since the 1990s that BI tools first get sold to departments, hopefully for fast implementations &#8212; think 4-6 weeks as a base case &#8212; and then spread out internally after their initial successes. I am frequently amused by vendors who claim to have pioneered that sales model sometime over the past decade, or even within the past few years.</em></p>
<p>That said, there are two main kinds of reason to do your BI departmentally, at arm&#8217;s length from central IT.</p>
<ul>
<li>Perhaps, for good reason or bad, <strong>IT is being insufficiently helpful at managing the data.</strong>
<ul>
<li>This can be a straightforward matter of politics and priorities &#8212; IT controls the data, but is slow about giving you access.</li>
<li>Also, you may want to include data that&#8217;s outside IT&#8217;s purview, be it third-party or just purely departmental.</li>
</ul>
</li>
<li>Further, you may want <strong>functionality that corporate-standard BI doesn&#8217;t offer.</strong> Potential examples include:
<ul>
<li>Cool analytic visualization.</li>
<li>&#8220;Real-time&#8221; data visualization.</li>
<li>The ability to play nicely with particular kinds of data sets.</li>
</ul>
</li>
</ul>
<p>I have a lot more to say about those points &#8212; but not in a post that&#8217;s already as long as this one. <img src='http://www.dbms2.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2012/01/04/some-issues-in-business-intelligence/feed/</wfw:commentRss>
		<slash:comments>10</slash:comments>
		</item>
		<item>
		<title>Some big-vendor execution questions, and why they matter</title>
		<link>http://www.dbms2.com/2011/11/21/big-vendor-execution-analytics/</link>
		<comments>http://www.dbms2.com/2011/11/21/big-vendor-execution-analytics/#comments</comments>
		<pubDate>Mon, 21 Nov 2011 11:01:20 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Cognos]]></category>
		<category><![CDATA[Columnar database management]]></category>
		<category><![CDATA[Data warehouse appliances]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[Exadata]]></category>
		<category><![CDATA[HP and Neoview]]></category>
		<category><![CDATA[Hadoop]]></category>
		<category><![CDATA[IBM and DB2]]></category>
		<category><![CDATA[In-memory DBMS]]></category>
		<category><![CDATA[Investment research and trading]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[Netezza]]></category>
		<category><![CDATA[NoSQL]]></category>
		<category><![CDATA[Oracle]]></category>
		<category><![CDATA[SAP AG]]></category>
		<category><![CDATA[Vertica Systems]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5704</guid>
		<description><![CDATA[When I drafted a list of key analytics-sector issues in honor of look-ahead season, the first item was &#8220;execution of various big vendors&#8217; ambitious initiatives&#8221;.  By &#8220;execute&#8221; I mean mainly: &#8220;Deliver products that really meet customers&#8217; desires and needs.&#8221; &#8220;Successfully convince them that you&#8217;re doing so &#8230;&#8221; &#8220;&#8230; at an attractive overall cost.&#8221; Vendors mentioned [...]]]></description>
			<content:encoded><![CDATA[<p>When I drafted a list of key analytics-sector issues in honor of <a href="http://www.dbms2.com/2011/11/21/analytic-trends-in-2012-qa/">look-ahead season</a>, the first item was &#8220;execution of various big vendors&#8217; ambitious initiatives&#8221;.  By &#8220;execute&#8221; I mean mainly:</p>
<ul>
<li>&#8220;Deliver products that really meet customers&#8217; desires and needs.&#8221;</li>
<li> &#8220;Successfully convince them that you&#8217;re doing so &#8230;&#8221;</li>
<li>&#8220;&#8230; at an attractive overall cost.&#8221;</li>
</ul>
<p>Vendors mentioned here are Oracle, SAP, HP, and IBM. Anybody smaller got left out due to the length of this post. Among the bigger omissions were:</p>
<ul>
<li>salesforce.com (multiple subjects).</li>
<li><a href="../../../../../2011/04/21/sas-hpa-does-make-sense-after-all/">SAS HPA</a>.</li>
<li><a href="../../../../../2011/08/21/hadoop-evolution/">The evolution of Hadoop</a>.</li>
</ul>
<p><span id="more-5704"></span><strong>A (lingering) issue for SAP and Oracle alike</strong></p>
<p>As I noted in January of this year, <a href="../../../../../2011/01/03/the-six-useful-things-you-can-do-with-analytic-technology/">integration of business intelligence into operational apps is making very slow progress</a>. Even so, it&#8217;s a huge part of the apparent strategy at SAP and Oracle alike, as well it should be. Much of the benefit from automating routine desk work has already happened. The areas ripest for exploitation are the ones where analytics are part of the equation.</p>
<p>Given the lack of tangible progress, why do I think this is a genuine area of Oracle and SAP emphasis? Three reasons of many are:</p>
<ul>
<li>Why else did SAP buy Business Objects?</li>
<li>If they&#8217;re not trying to <a href="../../../../../2011/03/30/short-request-and-analytic-processing/">integrate operational apps and analytics</a>, why else does SAP&#8217;s emphasis on HANA make sense?</li>
<li>Without business intelligence in the picture, how does Oracle&#8217;s integrated-stack story promise any direct user benefits?*</li>
</ul>
<p><em>*As opposed to IT concerns &#8212; integration, administration, TCO (Total Cost of Ownership), etc.</em></p>
<p>After so many years of disappointment, I&#8217;m not going to forecast 2012 as a pivotal year for <strong>the integration of business intelligence into operational applications.</strong> But if one of SAP or Oracle ever does get a significant BI/operational app integration advantage over the other, it could be a major competitive advantage in those application market segments that are still up for grabs. It also is an opportunity for both vendors to gain BI market share in their respective application customer bases.</p>
<p><strong>A more urgent issue for SAP</strong></p>
<p>SAP has put huge amounts of credibility on the line for HANA, the integration of two different and not particularly mature in-memory database technologies. So far, it is difficult to find evidence that HANA is robust enough for widespread adoption. Whether or not SAP can fix that is a huge open question, which could have significant impact on the course of several technology areas: applications, business intelligence, in-memory DBMS, and maybe even hardware.</p>
<p>Based on current information, which is admittedly partial, I&#8217;m a short-term pessimist on HANA. Longer-term, I&#8217;m on record as saying that <a href="../../../../../2011/05/23/databases-ram/">traditional databases will eventually wind up in RAM</a>. SAP will surely get that technology right some day, whether or not the way it does so has anything to do with present-day HANA code.</p>
<p><strong>Four more issues for Oracle </strong></p>
<p>Oracle&#8217;s ambitions are near-endless, and so also therefore is its list of execution challenges. Four in the analytics area that I find particularly interesting are:</p>
<ul>
<li><strong>True hybrid columnar DBMS.</strong> <a href="../../../../../2011/09/22/teradata-columnar-compression/">I was guessing that Oracle, like Teradata, would announce true hybrid columnar the week of Oracle OpenWorld</a>. I was wrong. But if Oracle can&#8217;t bring out true hybrid columnar DBMS functionality relatively soon, Exadata will lose credibility as a competitor to more specialized analytic DBMS.</li>
<li><strong>Oracle Exalytics.</strong> With Exalytics in the mix, Oracle&#8217;s technology stack has HANA-like potential. But will Exalytics even ship in 2012? (I think so.) Will it be good for much in the first release? (I&#8217;m skeptical.)</li>
<li><strong>Oracle&#8217;s Big Data Appliance</strong>. I&#8217;m skeptical both about <a href="../../../../../2011/10/20/more-notes-on-oracle-nosql/">Oracle&#8217;s NoSQL product</a> &#8212; <a href="http://www.infoworld.com/d/data-explosion/first-look-oracle-nosql-database-179107">a favorable InfoWorld review</a> notwithstanding &#8212; and <a href="../../../../../2011/09/23/hadoop-appliances/">Hadoop appliances</a>. But if I&#8217;m wrong, and Oracle can successfully embrace/extend the new non-relational paradigms, then it really might regain control over the evolution of data management.</li>
<li><strong><a href="../../../../../2011/10/18/oracle-is-buying-endeca/">Oracle&#8217;s Endeca acquisition</a></strong> &#8212; will Oracle prove me wrong and integrate Endeca effectively into its overall analytic product line? If it does, we might finally see effective text (and eventually speech) navigation of enterprise software. (But as with all Oracle issues cited here, this is something that probably won&#8217;t amount to much in 2012 even if it does later go well.)</li>
</ul>
<p><strong>Three issues for IBM</strong></p>
<p>Like Oracle, IBM is a huge company with many ambitions and hence many execution challenges. The biggest of those is surely: <strong>How effective can IBM be at selling outside its existing customer base?</strong> I don&#8217;t hear as much competitively about IBM DataStage, IBM SPSS or now IBM Netezza as I did when their vendors were independent companies. Even Cognos may not be much of an exception to the rule, although it has its own large customer base outside of IBM&#8217;s traditional one. (To lesser extents , the same is of course true of Netezza and numerous other IBM acquisitions.)</p>
<p>Another general issue for IBM is <strong>substantively integrating its various product lines,</strong> at least to the extent that makes sense. DB2/Netezza integration sounds good, but even that is a matter more of product marketing (the admirable part of that discipline) more than of actual technology. Other integrations (e.g. Cognos/DB2 in various bundles) have tended toward the dubious side.*</p>
<p><em>*I&#8217;m still waiting for IBM to get back to me with examples of how Cognos/DB2 joint tuning amounts to anything. It&#8217;s been more than a year, so I&#8217;m glad I didn&#8217;t hold my breath.</em></p>
<p>In a somewhat narrower vein, I wonder: <strong><a href="../../../../../2011/11/10/cep-streaming-catchup/">Will IBM be able to gain traction for InfoSphere Streams</a>? </strong>And if so, when and where will the traction be?</p>
<p><strong>Will HP screw up Vertica?</strong></p>
<p>Vertica has a very attractive product offering. It&#8217;s perhaps <a href="../../../../../2011/06/20/columnar-dbms-vendor-customer-metrics/">the most scalable analytic DBMS outside of Teradata</a>, running on the hardware of your reasonable choice.  It&#8217;s also the one I recommend most often to clients in the 1-50 terabyte range.</p>
<p>So far HP doesn&#8217;t seem to have done much to leadfoot Vertica. (About all I&#8217;ve heard from competitors is that Vertica seems to have faded somewhat in the financial services market, and there could be multiple explanations if that is indeed true.) But if HP Vertica does somehow manage to botch things, opportunities will open up for a range of columnar analytic DBMS competitors.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/11/21/big-vendor-execution-analytics/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Analytic trends in 2012: Q&amp;A</title>
		<link>http://www.dbms2.com/2011/11/21/analytic-trends-in-2012-qa/</link>
		<comments>http://www.dbms2.com/2011/11/21/analytic-trends-in-2012-qa/#comments</comments>
		<pubDate>Mon, 21 Nov 2011 11:00:23 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Cloud computing]]></category>
		<category><![CDATA[Data warehouse appliances]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[Greenplum]]></category>
		<category><![CDATA[HP and Neoview]]></category>
		<category><![CDATA[QlikTech and QlikView]]></category>
		<category><![CDATA[SAP AG]]></category>
		<category><![CDATA[Software as a Service (SaaS)]]></category>
		<category><![CDATA[Tableau Software]]></category>
		<category><![CDATA[Vertica Systems]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5692</guid>
		<description><![CDATA[As a new year approaches, it&#8217;s the season for lists, forecasts and general look-ahead. Press interviews of that nature have already begun. And so I&#8217;m working on a trilogy of related posts, all based on an inquiry about hot analytic trends for 2012. This post is a moderately edited form of an actual interview. Two [...]]]></description>
			<content:encoded><![CDATA[<p>As a new year approaches, it&#8217;s the season for lists, forecasts and general look-ahead. Press interviews of that nature have already begun. And so I&#8217;m working on a trilogy of related posts, all based on an inquiry about hot analytic trends for 2012.</p>
<p>This post is a moderately edited form of an actual interview. Two other posts cover analytic trends to watch (planned) and <a href="http://www.dbms2.com/2011/11/21/big-vendor-execution-analytics/">analytic vendor execution challenges to watch</a> (already up).</p>
<p><span id="more-5692"></span><strong>Question</strong>: What do you think will happen next year with the Tableaus of the world?</p>
<p><strong>Answer:</strong></p>
<ul>
<li>I think adoption of flexible-visualization business intelligence tools will continue to be rapid.</li>
<li>I think enterprise-friendly features will be increasingly important as a basis of competition.</li>
</ul>
<p><strong>Question</strong>: What do you mean by &#8220;enterprise-friendly&#8221;?</p>
<p><strong>Answer</strong>: An example would be <a href="http://www.dbms2.com/2011/11/16/qlikview-collaborative-business-intelligence/">QlikTech no longer forcing you to use their native ETL</a>, but rather working with Informatica and soon other third-party products. Also important can be:</p>
<ul>
<li>Database size.</li>
<li>Concurrency.</li>
<li>A full-featured development cycle for analytic applications.</li>
</ul>
<p><strong>Question</strong>: What does HP have to do to be relevant in analytics/data warehousing?</p>
<p><strong>Answer</strong>: Avoid stupidity. HP Vertica is already relevant.</p>
<p><strong>Question</strong>: OK. But what can HP do to build on Vertica?</p>
<p><strong>Answer</strong>: HP &#8212; which botched Exadata 1 hardware &#8212; could do a good job with SAP HANA or other kinds of appliance products.</p>
<p>However:</p>
<ul>
<li>I don&#8217;t think trying to force Vertica beyond its natural growth &#8212; <a href="http://www.dbms2.com/2011/04/16/unpacking-the-emc-greenplum-q1-sales-disaster-rumors/">the way EMC is with Greenplum</a> &#8212; is necessarily a good idea. Natural growth in Vertica&#8217;s case is plenty fast anyway.</li>
<li>Obviously, making good Vertica hardware would be nice. But being hardware-independent is crucial to Vertica, not least because of cloud deployment, an option many buyers want to at least have in their hip pockets.</li>
</ul>
<p><strong>Question</strong>: You expressed some skepticism toward mobile BI/use cases. Why so?</p>
<p><strong>Answer</strong>: The form factor hurts functionality a lot, so it&#8217;s only worthwhile in cases where timeliness is key.</p>
<p>And without more refined alert-setting functionality, it&#8217;s hard to think of that many cases.</p>
<p><em>Note: My views on mobile BI haven&#8217;t changed much since <a href="../../../../../2010/07/15/mobile-business-intelligence/">July, 2010</a>.</em></p>
<p><strong>Question</strong>: What about the idea of an enterprise being able to pay-per-drink to run jobs on an analytic cluster. Do you expect that concept to have any legs in 2012?</p>
<p><strong>Answer</strong>: While other kinds of SaaS (Software as a Service) BI might make sense, remote computing BI that focuses on hardware cost sharing is problematic. Moving data in and out of the cluster is a big part of the overall cost, at least if you plan to process it only occasionally once it gets there. I haven&#8217;t seen a plan yet that gets around that point.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/11/21/analytic-trends-in-2012-qa/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>QlikView 11 and the rise of collaborative BI</title>
		<link>http://www.dbms2.com/2011/11/16/qlikview-collaborative-business-intelligence/</link>
		<comments>http://www.dbms2.com/2011/11/16/qlikview-collaborative-business-intelligence/#comments</comments>
		<pubDate>Wed, 16 Nov 2011 13:19:52 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[EAI, EII, ETL, ELT, ETLT]]></category>
		<category><![CDATA[QlikTech and QlikView]]></category>
		<category><![CDATA[eBay]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5681</guid>
		<description><![CDATA[QlikView 11 came out last month. Let me start by pointing out: As one might expect, QlikView 11 contains fairly leading-edge stuff, but also some &#8220;better late than never&#8221; features. The leading-edge stuff is concentrated in the general area of &#8220;collaboration&#8221;. Additionally, QlikTech is always pushing the QlikView user interface ahead in various ways. The [...]]]></description>
			<content:encoded><![CDATA[<p>QlikView 11 came out last month. Let me start by pointing out:</p>
<ul>
<li>As one might expect, QlikView 11 contains fairly leading-edge stuff, but also some &#8220;better late than never&#8221; features.</li>
<li>The leading-edge stuff is concentrated in the general area of &#8220;collaboration&#8221;.</li>
<li>Additionally, QlikTech is always pushing the QlikView user interface ahead in various ways.</li>
<li>The &#8220;Well, it&#8217;s about time!&#8221; feature list starts with the ability to load QlikView via third-party ETL tools (Informatica now, others coming).</li>
<li>QlikTech is generally good at putting up pretty pictures of its product. You can find some in the &#8220;What&#8217;s New in QlikView 11&#8243; document via a general <a href="http://www.qlikview.com/us/explore/resources/brochures-datasheets?language=english&amp;page=1">QlikView resource page</a>.*</li>
<li>Stephen Swoyer wrote <a href="http://tdwi.org/articles/2011/11/01/QlikView-Update-Enterprise-Makeover.aspx">a good article summarizing QlikView 11</a>.</li>
</ul>
<p><em>*One confusing aspect to that paper:  non-standard uses of the terms &#8220;analytic app&#8221; and &#8220;document&#8221;.</em></p>
<p>As QlikTech tells it, QlikView 11 adds two kinds of collaboration features:</p>
<ul>
<li>Integration with social media, which QlikTech calls &#8220;asynchronous integration.&#8221;</li>
<li>Direct sharing of the QlikView UI, which QlikTech calls &#8220;synchronous integration.&#8221;</li>
</ul>
<p>I&#8217;d add a third kind, because QlikView 11 also takes some baby steps toward what I regard as a key aspect of BI collaboration &#8212; the ability to define and track your own metrics. It&#8217;s way, way short of what <a href="../../../../../2010/07/25/alerts-metrics-dashboards/">I called for in metric flexibility in a post last year</a>, but at least it&#8217;s a small start.</p>
<p><span id="more-5681"></span>That <strong>direct sharing of user interfaces is a cool feature, which every business intelligence vendor should offer. </strong>In an era of distributed workforces, when people can&#8217;t be assumed able to huddle around the same desk, it has value even for use among close coworkers. But it also should prove useful in a variety of more naturally remote use cases, multiple examples of which can be found in each of the areas of:</p>
<ul>
<li>Support (internal or external).</li>
<li>Faceoffs &#8212; I mean collaborations <img src='http://www.dbms2.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' />  &#8212; between two or more enterprise departments. Examples might include: manufacturing and purchasing, manufacturing and sales, or accounting and anybody else.</li>
</ul>
<p>As for <strong>social media being used for BI collaboration</strong> &#8212; that&#8217;s generally in the air. For example:</p>
<ul>
<li><a href="http://www.texttechnologies.com/2011/09/14/social-technology-in-the-enterprise/">salesforce.com is pushing enterprise social media use broadly</a>, and will surely increase its emphasis on the social media/BI intersection now that Dave Kellogg is there.</li>
<li>Spotfire has announced similar features in its latest release.</li>
<li>The more cumbersome side of the feature set (portal-based collaboration, emailing of individual reports) has been available from multiple vendors for years.</li>
<li>eBay open-sourced a more dataset-centric version of the idea, just as Oliver Ratzesberger left the firm.*</li>
</ul>
<p><em>*Umm &#8212; does anybody have a link to the project, or at least a name for it? <img src='http://www.dbms2.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </em></p>
<p>BI has been a communication tool since the first green paper report was dumped on the first desk. And there&#8217;s been collaboration in doing analysis at least since it&#8217;s been possible to email .XLS file attachments. Still<strong>, BI is too often used as bludgeon rather than binocular. Hopefully, the current generation of technology will finally serve to change that.</strong></p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/11/16/qlikview-collaborative-business-intelligence/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
		</item>
		<item>
		<title>StreamBase LiveView &#8212; push-based real-time BI</title>
		<link>http://www.dbms2.com/2011/11/10/streambase-liveview-push-based-real-time-bi/</link>
		<comments>http://www.dbms2.com/2011/11/10/streambase-liveview-push-based-real-time-bi/#comments</comments>
		<pubDate>Fri, 11 Nov 2011 03:38:53 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Complex event processing (CEP)]]></category>
		<category><![CDATA[Data warehousing]]></category>
		<category><![CDATA[Memory-centric data management]]></category>
		<category><![CDATA[StreamBase]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5631</guid>
		<description><![CDATA[My clients at StreamBase are coming out with a new product line called LiveView, and I agreed they could launch it via this blog. Key points about StreamBase LiveView Version 1.0 include: LiveView is a business intelligence and alerting suite built on/in the rest of StreamBase&#8217;s technology, meant to operate on streaming data. LiveView is [...]]]></description>
			<content:encoded><![CDATA[<p>My clients at StreamBase are coming out with a new product line called LiveView, and I agreed they could launch it via this blog. Key points about StreamBase LiveView Version 1.0 include:</p>
<ul>
<li>LiveView is a business intelligence and alerting suite built on/in <a href="http://www.dbms2.com/2011/11/10/streambase-catchup/">the rest of </a><a href="http://www.dbms2.com/2011/11/10/streambase-catchup/">StreamBase&#8217;s technology</a>, meant to operate on streaming data.</li>
<li>LiveView is positioned by StreamBase as having a true push event-driven architecture rather than pull/poll.</li>
<li>StreamBase LiveView is designed to query in-memory data and then have the results change in real time as the data set changes.</li>
<li>The LiveView user interface is a rapidly changing work in progress.</li>
<li>LiveView has other Version 1 limitations as well</li>
<li>LiveView is targeted squarely at StreamBase&#8217;s financial trading core market until some of the Version 1 limitations are lifted.</li>
</ul>
<p>The basic StreamBase LiveView pipeline goes something like:   <span id="more-5631"></span></p>
<ul>
<li>Data comes into the system via multiple streams.</li>
<li>Transformations upon data arrival can include but are not limited to:
<ul>
<li>Aggregations.</li>
<li>Joins to reference data.</li>
<li>Joins to other streams.</li>
</ul>
</li>
<li>The streams (transformed or perhaps otherwise) are output to tables &#8230;</li>
<li>&#8230; which are continuously updated as more data streams through.</li>
<li> The data in the resulting table can be consumed:
<ul>
<li>Via LiveView-provided BI capabilities.</li>
<li>Via an API.</li>
</ul>
</li>
</ul>
<p>When wearing my vendor consultant hat, I warmly encourage StreamBase to emphasize the lack of a batch step anywhere in this process. As an analyst, however, I&#8217;m more restrained about a claim like &#8220;We uniquely free you from batch.&#8221; I agree that avoiding batch jobs is a Very Nice Thing. But you also are spared most batch-cycle processing if you stream updates from your short-request database to an analytic DBMS, e.g. via some kind of near-real-time replication.</p>
<p>That said, the push-versus-pull continuous filtering part of the StreamBase LiveView story seems pretty real. I think having sub-second display updates is cool in all sorts of BI use cases, and seriously useful in some number of them. While I don&#8217;t have a clear opinion as to whether the StreamBase approach offers huge performance advantages for that kind of latency over &#8220;pull&#8221; alternatives, my guess is in the direction of &#8220;yes&#8221;.</p>
<p>Version 1 limitations on StreamBase LiveView include:</p>
<ul>
<li>You consume data one table at a time, with no possibility of a join after the data has originally been put into a LiveView table.</li>
<li>While LiveView in principle offers rich alerting potential, you get at it via an API rather than much in the way of alerting-specific tools.</li>
<li>The first LiveView UI StreamBase put together looks a lot like 1980s stock quote machines. The next one it added looks a lot like Panopticon. Much cool-looking enhancement remains to be done.</li>
</ul>
<p><em>One competitive (non)-note: This all sounds something like what TIBCO has been pushing for years, but in fact I don&#8217;t have much knowledge of TIBCO&#8217;s efforts in the area. I had a meeting set up to learn about it some time ago, but it got canceled because TIBCO&#8217;s PR people:</em></p>
<ul>
<li><em>Didn&#8217;t want to let any kind of meeting happen without them, even though a serious CTO-type representative seemed happy to talk, but also &#8230;</em></li>
<li><em>&#8230; didn&#8217;t want to work at dinner time.</em></li>
</ul>
<p><em>I haven&#8217;t had substantive contact with TIBCO since.</em></p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/11/10/streambase-liveview-push-based-real-time-bi/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Very brief CEP/streaming catchup</title>
		<link>http://www.dbms2.com/2011/11/10/cep-streaming-catchup/</link>
		<comments>http://www.dbms2.com/2011/11/10/cep-streaming-catchup/#comments</comments>
		<pubDate>Fri, 11 Nov 2011 03:29:37 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Complex event processing (CEP)]]></category>
		<category><![CDATA[IBM and DB2]]></category>
		<category><![CDATA[StreamBase]]></category>
		<category><![CDATA[Sybase]]></category>
		<category><![CDATA[Truviso]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5632</guid>
		<description><![CDATA[When I agreed to launch the StreamBase LiveView product via DBMS 2, I planned to catch up on the whole CEP/streaming area first. Due to the power and internet outages last week, that didn&#8217;t entirely happen. So I&#8217;ll do a bit of that now, albeit more cryptically than I hoped and intended. The upshot of [...]]]></description>
			<content:encoded><![CDATA[<p>When I agreed to launch the StreamBase LiveView product via <em>DBMS 2,</em> I planned to catch up on the whole CEP/streaming area first. Due to the power and internet outages last week, that didn&#8217;t entirely happen. So I&#8217;ll do a bit of that now, albeit more cryptically than I hoped and intended.</p>
<ul>
<li>The upshot of my <a href="../../../../../2011/08/25/renaming-cep-or-not/">what to call CEP thread</a> in August was that &#8220;streaming&#8221; and &#8220;event processing&#8221; are not the same concept, but it so happens that they have the most traction where they intersect. That said, I both observe and endorse an apparent shift from &#8220;event&#8221; to &#8220;stream&#8221; as the core of the terminology, in <a href="../../../../../2008/03/19/what-to-call-cep/">a reversal of my opinion of several years ago</a>.</li>
<li>IBM continues to throw a lot of resources at its <a href="../../../../../2009/05/13/ibm-system-s-infosphere-streams-processing/">System S/ InfoSphere Streams</a> product, but I haven&#8217;t heard yet of much marketplace success. That said, I believe IBM is still pretty serious about Streams, as one would expect from an effort whose code name so cheekily references <a href="http://www.softwarememories.com/2008/10/02/a-bit-of-db2-history-per-ibm/">System R</a>. In particular, Streams shows up prominently on IBM&#8217;s top-level analytic architecture slide.</li>
<li>Sybase recently released its ESP (Event Stream Processor) 5.0, which it says is the full merger of the Aleri and Coral8 predecessors. You can still get Sybase ESP without buying into the full <a href="../../../../../2010/02/05/sybase-aleri-rap/">Sybase RAP</a> stack, and Sybase has no plans to change that.</li>
<li>Sybase has discontinued all <a href="../../../../../2009/03/25/aleri-update/">the business intelligence types of products Aleri and Coral8 were developing</a>. Rather, Sybase is OEMing Panopticon, which it reports has been well received. Other than the discontinuation of the BI efforts, there seem to be few Aleri or Coral8 features missing from the merged Sybase ESP product.</li>
<li>Truviso continues to be <a href="../../../../../2010/05/04/truviso-evidently-reinvents-itself/">out of the picture</a>.</li>
<li>I have more to say about <a href="http://www.dbms2.com/2011/11/10/streambase-catchup/">StreamBase</a> separately.</li>
<li>I have more to say about Sybase and IBM, which I&#8217;ll get to when I can.</li>
<li>I have nothing new on Progress Apama. I also know little about any of the open source efforts.</li>
</ul>
<p>Meanwhile, if you want to see technically nitty-gritty posts about the CEP/streaming area, you may want to look at <a href="../../../../../category/memory-centric-data-management/event-stream-processing/page/4/">my CEP/streaming coverage circa 2007-9</a>, based on conversations with (among others) <a href="../../../../../2007/06/18/mike-stonebraker-on-financial-stream-processing/">Mike Stonebraker</a>, <a href="../../../../../2007/08/03/a-deeper-dive-into-apama/">John Bates</a>, and <a href="../../../../../2007/08/10/the-essence-of-cep-according-to-coral8/">Mark Tsimelzon</a>.</p>
<p><strong> </strong></p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/11/10/cep-streaming-catchup/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Terminology: Operational analytics</title>
		<link>http://www.dbms2.com/2011/11/08/terminology-operational-analytics/</link>
		<comments>http://www.dbms2.com/2011/11/08/terminology-operational-analytics/#comments</comments>
		<pubDate>Tue, 08 Nov 2011 07:10:03 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Analytic technologies]]></category>
		<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Predictive modeling and advanced analytics]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5614</guid>
		<description><![CDATA[It&#8217;s time for me to try to define &#8220;operational analytics&#8221;. Clues pointing me to that need include: The term investigative analytics has gotten considerable traction. I generally contrast &#8220;investigative&#8221; and &#8220;operational&#8221; analytics, for example in the last line of the post linked above, or in my recent introduction to Odiago WibiData. It&#8217;s clear that I&#8217;m [...]]]></description>
			<content:encoded><![CDATA[<p>It&#8217;s time for me to try to define &#8220;operational analytics&#8221;. Clues pointing me to that need include:</p>
<ul>
<li>The term <a href="../../../../../2011/03/03/investigative-analytics/">investigative analytics</a> has gotten considerable traction.</li>
<li>I generally contrast &#8220;investigative&#8221; and &#8220;operational&#8221; analytics, for example in the last line of the post linked above, or in my recent introduction to <a href="../../../../../2011/11/02/5576/">Odiago WibiData</a>.</li>
<li>It&#8217;s clear that I&#8217;m conflating several different things in the term. (See for example the operational analytics sections of my posts on <a href="../../../../../2011/07/05/eight-kinds-of-analytic-database-part-2/">eight kinds of analytic database</a> or <a href="../../../../../2010/12/28/evolving-definitions-and-technology-categories-for-2011/">definitional challenges for 2011</a>.)</li>
<li>I&#8217;m pretty negative about the utility of alternate terms such as &#8220;operational BI&#8221;.</li>
</ul>
<p>But as in all definitional discussions, please remember that <a href="http://www.strategicmessaging.com/no-market-categorization-is-ever-precise/2011/03/01/">nothing concise is ever precise</a>.</p>
<p>Activities I want to call &#8220;operational analytics&#8221; include but are not limited to (and some of these overlap):   <span id="more-5614"></span></p>
<ul>
<li>A lot of things that happen at the time of customer interaction:
<ul>
<li>Ad serving, web page personalization, and so on.</li>
<li>On-the-fly fraud assessment.</li>
<li>In general, much of what might be called &#8220;Next Best Action&#8221;.</li>
</ul>
</li>
<li>Most of automated price re-setting.</li>
<li>Most of automated risk analysis.</li>
<li>Algorithmic and/or high-frequency trading.</li>
<li>Human beings taking specific actions as part of reasonably well-defined business processes, in response to exception conditions that they notice via something resembling a business intelligence tool.</li>
</ul>
<p>However, I think it is usually unhelpful to stretch the term &#8220;business process&#8221; to include technical control kinds of activities (whether human or wholly automated) such as network security, network operations, power plant operations, etc. So I&#8217;m inclined to leave those areas out of &#8220;operational analytics&#8221; as well, although I&#8217;m not sure whether that distinction will hold up &#8212; and even it does, there surely will be border cases that are hard to exclude.</p>
<p>In simplest terms, what I mean by <strong>operational analytics</strong> is <strong>analytics being done on the fly as part of operational business processes.</strong> By way of contrast, investigative analytics is done at the speed of research, not the speed of operational business processes. But naturally there are border cases in this version of the dichotomy too, such as when the analytics are highly urgent yet otherwise investigative in nature.</p>
<p>To get to a somewhat more rigorous version, let&#8217;s start by recalling my definition of <strong>investigative analytics</strong> as</p>
<blockquote><p>seeking (previously unknown) patterns in data.</p></blockquote>
<p>The key concept there is that the patterns aren&#8217;t known until you investigate and find them.</p>
<p>By way of contrast, most of what passes for cognition and programmed behavior alike is the recognition of and response to <strong>known patterns.</strong> Indeed, when we consider what happens in microelectronics and neurons alike, it&#8217;s &#8220;pattern response all the way down.&#8221;* Machines and humans alike monitor situations, detect exceptions, and make decisions based on known patterns. So I&#8217;m going to say that the essence of operational analytics is</p>
<blockquote><p><em>analytic pattern response included in operational business processes.</em></p></blockquote>
<p><em>*For some years I&#8217;ve believed &#8220;pattern response&#8221; is a better way of putting the concept than just &#8220;pattern recognition&#8221;; the latter phrase says both too much and too little at once. Otherwise, I was referencing the meme &#8220;turtles all the way down&#8221;.</em></p>
<p>For now, I&#8217;ll take the <a href="../../../../../2011/09/11/big-data-has-jumped-the-shark/#comment-240338">Justice Stewart</a> approach to defining &#8220;operational business processes&#8221; &#8212; we know them when we see them, and no further elucidation is needed. Even so, it might be helpful to observe that the processes can be:</p>
<ul>
<li><strong>Wholly automated</strong> &#8212; examples included automated trading or web page ad serving.</li>
<li><strong>Primarily automated</strong> &#8212; for example, software might tell a call center employee what offer to make next.</li>
<li><strong>At considerable human discretion</strong> &#8212; for example, a human being automatically notified of an exception could have freedom to decide what to do next.</li>
</ul>
<p>The technologies for identifying a pattern match are also varied. You can write an ordinary database application. You can use a &#8220;rules engine&#8221;. Something like PMML (Predictive Modeling Markup Language) can be in the mix. Or, especially in human-discretion cases, various forms of business intelligence tool (broadly defined) can be involved, either standalone or integrated with more transactional applications.</p>
<p><em>So what do you think? Is the definition of &#8220;operational analytics&#8221; sufficiently clear? Is it accurate? Is it useful?</em></p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/11/08/terminology-operational-analytics/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>Where Datameer is positioned</title>
		<link>http://www.dbms2.com/2011/10/25/where-datameer-is-positioned/</link>
		<comments>http://www.dbms2.com/2011/10/25/where-datameer-is-positioned/#comments</comments>
		<pubDate>Tue, 25 Oct 2011 21:53:31 +0000</pubDate>
		<dc:creator>Curt Monash</dc:creator>
				<category><![CDATA[Business intelligence]]></category>
		<category><![CDATA[Datameer]]></category>
		<category><![CDATA[EAI, EII, ETL, ELT, ETLT]]></category>
		<category><![CDATA[Hadoop]]></category>

		<guid isPermaLink="false">http://www.dbms2.com/?p=5514</guid>
		<description><![CDATA[I&#8217;ve chatted with Datameer a couple of times recently, mainly with CEO Stefan Groschupf, most recently after XLDB last Tuesday. Nothing I learned greatly contradicts what I wrote about Datameer 1 1/2 years ago.  In a nutshell, Datameer is designed to let you do simple stuff on large amounts of data, where &#8220;large amounts of [...]]]></description>
			<content:encoded><![CDATA[<p>I&#8217;ve chatted with Datameer a couple of times recently, mainly with CEO Stefan Groschupf, most recently after XLDB last Tuesday. Nothing I learned greatly contradicts <a href="http://www.dbms2.com/category/products-and-vendors/datameer/">what I wrote about Datameer 1 1/2 years ago</a>.  In a nutshell, Datameer is designed to let you do simple stuff on large amounts of data, where &#8220;large amounts of data&#8221; typically means data in Hadoop, and &#8220;simple stuff&#8221; includes basic versions of a spreadsheet, of BI, and of EtL (Extract/Transform/Load, without much in the way of T).</p>
<p>Stefan reports that these capabilities are appealing to a significant fraction of enterprise or other commercial Hadoop users, especially the EtL and the BI. I don&#8217;t doubt him.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.dbms2.com/2011/10/25/where-datameer-is-positioned/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

