Comments on: Multiple approaches to memory-centric analytics http://www.dbms2.com/2008/10/07/multiple-approaches-to-memory-centric-analytics/ Choices in data management and analysis Thu, 09 Feb 2012 13:48:12 +0000 hourly 1 http://wordpress.org/?v=3.0.3 By: Alex http://www.dbms2.com/2008/10/07/multiple-approaches-to-memory-centric-analytics/#comment-98995 Alex Fri, 10 Oct 2008 19:35:47 +0000 http://www.dbms2.com/?p=596#comment-98995 IBM has had in-database data mining for a while now as part of InfoSphere Warehouse, so you can count us into your "parallel analytics" camp. We can't rely on all data being present in main memory when we create the mining models - "memory-centric" analytics would actually be a bad idea here. But when applying your model to new data, this model better be in memory to achieve the performance requirements for scoring new, unseen records. IBM has had in-database data mining for a while now as part of InfoSphere Warehouse, so you can count us into your “parallel analytics” camp.
We can’t rely on all data being present in main memory when we create the mining models – “memory-centric” analytics would actually be a bad idea here. But when applying your model to new data, this model better be in memory to achieve the performance requirements for scoring new, unseen records.

]]> By: Curt Monash http://www.dbms2.com/2008/10/07/multiple-approaches-to-memory-centric-analytics/#comment-98855 Curt Monash Wed, 08 Oct 2008 16:46:43 +0000 http://www.dbms2.com/?p=596#comment-98855 Luis, I don't know of any big differences for Neoview in that regard vs. Netezza, Greenplum, Oracle Exadata, whoever. Are you basing this on the claim "Teradata materializes intermediate result sets to disk but some other systems have better pipelining?", or are you talking about something else? CAM Luis,

I don’t know of any big differences for Neoview in that regard vs. Netezza, Greenplum, Oracle Exadata, whoever.

Are you basing this on the claim “Teradata materializes intermediate result sets to disk but some other systems have better pipelining?”, or are you talking about something else?

CAM

]]> By: Luis http://www.dbms2.com/2008/10/07/multiple-approaches-to-memory-centric-analytics/#comment-98839 Luis Wed, 08 Oct 2008 09:59:27 +0000 http://www.dbms2.com/?p=596#comment-98839 I think HP Neoview does much of its mpp in an in-memory style, am I right? I think HP Neoview does much of its mpp in an in-memory style, am I right?

]]>