Comments on: 37 Ways To Get More From Analytics http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/ Choices in data management and analysis Mon, 01 Mar 2010 19:09:32 -0500 http://wordpress.org/?v=2.8.4 hourly 1 By: 37 Ways To Get More From Analytics, Version 2.0 | DBMS2 -- DataBase Management System Services http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119912 37 Ways To Get More From Analytics, Version 2.0 | DBMS2 -- DataBase Management System Services Mon, 04 May 2009 12:03:47 +0000 http://www.dbms2.com/?p=769#comment-119912 [...] I hoped, there were some very helpful responses to my post listing ways to improve analytic effectiveness. Here’s a second draft incorporating them. Comments continue to be very welcome. I need to [...] [...] I hoped, there were some very helpful responses to my post listing ways to improve analytic effectiveness. Here’s a second draft incorporating them. Comments continue to be very welcome. I need to [...]

]]> By: Hans http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119601 Hans Sat, 02 May 2009 15:39:22 +0000 http://www.dbms2.com/?p=769#comment-119601 @michele I think you're over simplifying the situation. I usually warn people that it's very easy to advocate for cutting edge analytics everywhere, it seems like something that couldn't possibly be wrong. But it's not so easy to make that work in practice. Infusing advanced analytics is a slow process and with good reason. There are some well tested self-correcting analytics out there, but still quite often advanced analytics seem to either start producing bad results or be used in a completely wrong way, the moment you've decided they're stable and pull the statistician off to another project. Before infusing advanced analytics, any organization needs a clear path (process, people, senior management support) to maintaining a clear understanding of the meaning, monitoring effectiveness and maintaining them. @michele I think you’re over simplifying the situation. I usually warn people that it’s very easy to advocate for cutting edge analytics everywhere, it seems like something that couldn’t possibly be wrong. But it’s not so easy to make that work in practice.

Infusing advanced analytics is a slow process and with good reason. There are some well tested self-correcting analytics out there, but still quite often advanced analytics seem to either start producing bad results or be used in a completely wrong way, the moment you’ve decided they’re stable and pull the statistician off to another project.

Before infusing advanced analytics, any organization needs a clear path (process, people, senior management support) to maintaining a clear understanding of the meaning, monitoring effectiveness and maintaining them.

]]> By: michele http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119485 michele Fri, 01 May 2009 22:33:59 +0000 http://www.dbms2.com/?p=769#comment-119485 How about the infusing of advanced analytics into operational applications to raise the bar throughout the enterprise? That makes analytics accessible and delivers value repeatedly. How about the infusing of advanced analytics into operational applications to raise the bar throughout the enterprise? That makes analytics accessible and delivers value repeatedly.

]]> By: Jerome Pineau http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119448 Jerome Pineau Fri, 01 May 2009 15:50:28 +0000 http://www.dbms2.com/?p=769#comment-119448 Thanks for the pointer Joe! Thanks for the pointer Joe!

]]> By: Joe Hellerstein http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119272 Joe Hellerstein Thu, 30 Apr 2009 15:05:43 +0000 http://www.dbms2.com/?p=769#comment-119272 The paper @dave referred to is up at http://databeta.wordpress.com/2009/03/20/mad-skills/ The paper @dave referred to is up at http://databeta.wordpress.com/2009/03/20/mad-skills/

]]> By: Hans http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119265 Hans Thu, 30 Apr 2009 14:36:15 +0000 http://www.dbms2.com/?p=769#comment-119265 Definitely a good point made earlier about enabling experimentation over large data sets. This would fall under "Get and exploit better performance" although it's not limited to statistics uses. I would rephrase "Give your financial and stats users a very flat view of the data" to "customize views of data to the user" or "get to know how users think and provide them with views of data that they understand". This is definitely not new in the DBMS world but is actually fairly new in the big data world. Many users of big data previously had to patch together many pieces of the data puzzle rather than getting a view that is customized to their needs. Since I approach this from the view of a statistician, the first thing that comes to my mind is a cross cutting category: "Lower the technical barrier for implementing (and modifying) analytics". That would be stuff ranging from improved ability to experiment, better views of data, different and better engines, centralized repositories of analytics logic, etc. Definitely a good point made earlier about enabling experimentation over large data sets. This would fall under “Get and exploit better performance” although it’s not limited to statistics uses.

I would rephrase “Give your financial and stats users a very flat view of the data” to “customize views of data to the user” or “get to know how users think and provide them with views of data that they understand”. This is definitely not new in the DBMS world but is actually fairly new in the big data world. Many users of big data previously had to patch together many pieces of the data puzzle rather than getting a view that is customized to their needs.

Since I approach this from the view of a statistician, the first thing that comes to my mind is a cross cutting category: “Lower the technical barrier for implementing (and modifying) analytics”. That would be stuff ranging from improved ability to experiment, better views of data, different and better engines, centralized repositories of analytics logic, etc.

]]> By: Curt Monash http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119255 Curt Monash Thu, 30 Apr 2009 13:03:48 +0000 http://www.dbms2.com/?p=769#comment-119255 Peter, Hmm. I wonder whether I should have a whole category for data integration ... Thanks, CAM Peter,

Hmm. I wonder whether I should have a whole category for data integration …

Thanks,

CAM

]]> By: Peter Sollimo http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119253 Peter Sollimo Thu, 30 Apr 2009 12:58:29 +0000 http://www.dbms2.com/?p=769#comment-119253 Curt, How about the shift from ETL to ELT and the shrinking (and in some cases elimination of) the nightly batch window? Curt,
How about the shift from ETL to ELT and the shrinking (and in some cases elimination of) the nightly batch window?

]]> By: Curt Monash http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119216 Curt Monash Thu, 30 Apr 2009 09:25:22 +0000 http://www.dbms2.com/?p=769#comment-119216 Jerome, It seems as if the events are three weeks apart. So I'm not sure I'm seeing the travel synergies ... ;) CAM Jerome,

It seems as if the events are three weeks apart. So I’m not sure I’m seeing the travel synergies … ;)

CAM

]]> By: Jerome Pineau http://www.dbms2.com/2009/04/29/37-ways-to-get-more-from-analytics/comment-page-1/#comment-119189 Jerome Pineau Thu, 30 Apr 2009 04:27:23 +0000 http://www.dbms2.com/?p=769#comment-119189 You know, Lyon to London is pretty easy -- Since you're in the UK early September, be a shame not to kill 2 birds with one stone :) You know, Lyon to London is pretty easy — Since you’re in the UK early September, be a shame not to kill 2 birds with one stone :)

]]>