February 25, 2009
Partial overview of Ab Initio Software
Ab Initio is an absurdly secretive company, as per a couple of prior posts and the comment threads on same. But yesterday at TDWI I actually found civil people staffing an Ab Initio trade show booth. Based on that conversation and other tidbits, I think it’s fairly safe to say:
- Ab Initio sells high-end data integration software.
- Ab Initio commonly costs $1/2 million or so.
- Ab Initio’s core claims include:
- “It just works”
- Ab Initio has great performance, even on big tasks.
- Unlike many competitors, Ab Initio has an integrated product line written from scratch. (Hence the “Ab Initio” name.)
- Like most data integration software – Talend is an exception – Ab Initio includes an execution engine.
- Everybody agrees that Ab Initio’s software has great performance, although Talend claims to come close and Expressor claims to be faster yet. But rivals assert that besides having high license fees, Ab Initio’s software is also very consumptive of hardware resources. Certainly I’d suggest checking that aspect carefully if you ever get into an Ab Initio POC. Perhaps that’s what Ab Initio means by saying its software uses any and all hardware resources.
) - Price isn’t the only regard in which Ab Initio is hard to do business with. Another is secretive business practices. For example, Ab Initio – confident in the quality of its software – pushes prospects toward POCs (Proofs-Of-Concept). But it wraps so many NDA requirements around these that some prospects walk away.
- Not surprisingly, Ab Initio has added lots of features over the years, especially in response to prospect or customer requests. Examples I was given include:
- IBM OS/390 support (including COBOL copybooks, etc.)
- SOAP/XML support. Associated with that is a story that boils down to “With great encapsulation, one can change a complex system of data integration processes incrementally without going crazy.”
- A compressed file system that can directly store 100s of TBs of user data, with very fast query performance. Apparently, this is not at the extremes of inflexibility, as it is realistic to have up to 5-6 keys on a table (at least). Associated with that is a story that boils down to “Hey, if you’re only getting at something via web services, you’re limited in how you can query it anyway. Worst case – your needs expand and you decide to put the data back in a true DBMS after all.”
- Similarly, Ab Initio claims that its software is easier to use than rival, cobbled-together products. While Ab Initio may not dispute the existence of products that can get data integration tasks done more simply, it argues that these products do a lot less than Ab Initio does.
Categories: Ab Initio Software, Analytic technologies, Benchmarks and POCs, Data integration and middleware, EAI, EII, ETL, ELT, ETLT, Expressor, Pricing, Talend
Subscribe to our complete feed!
Comments
7 Responses to “Partial overview of Ab Initio Software”
Leave a Reply
Having used AbInitio, Talend and almost every other ETL/ELT product on the market. I would very much doubt such a claim by Talend that they come close to AbInitio in performance. AbInitio has an amazing capacity to squeeze out every ounce of performance from the hardware it is running on. I do understand why they are so secret, their approach is elegant and simple but could be easily copied.
ab initio’s secrecy has since 1995 always been part of their marketing strategy. I.e., generate buzz in inside circles. That being said, they had some sharp technologists at the outset focusing on building a very scaleable high performance platform bundled with professional services to ensure successful deployment.
That being said, it will be interesting to see where mapreduce-based ETL solutions will be in perhaps 5 years. I think parity is at least that far off given the lack of pipelining and the significant investment in application-layer tools for data hygiene, precedence, conflict resolution, change management, etc. But I never bet long term against the power of an open-source movement with momentum.
Clover ETL is as good as Ab Initio at a fraction of cost. It is also very easy to use (if not easier than Ab Initio)
A book on Ab Initio for those want a head start – http://www.lulu.com/product/paperback/ab-initio-etl-made-easy/11920613
Evidently that book on Ab Initio is gone– the Secrecy Squad must have gotten to them…
The Clover ETL guys reached out to me, then didn’t follow up.
Sometimes I think the whole ETL industry is screwy. (Just kidding … partly.)
The book is here
http://www.lulu.com/product/paperback/ab-initio-etl-made-easy/15145817