Aster Data has put up a blog post embedding and summarizing a video about its MySpace account. Basic metrics include:
The combined Aster deployment now has 200+ commodity hardware servers working together to manage 200+ TB of data that is growing at 2-3TB per day by collecting 7-10B events that happen on one of the world.
I’m pretty sure that’s counting correctly (i.e., user data).*
*That said, simple multiplication makes me wonder why the database isn’t bigger yet. Aster’s MySpace relationship is over a year old, although the MySpace Music piece is newer. Perhaps some of that 2-3 TB per day is eventually being thrown away.
The blog post and video feature some ringing endorsements by MySpace, with key points including:
- Aster supports a data warehouse and a bunch of data marts.
- MySpace regards the Aster installation as mission-critical.
- A huge Aster data warehouse got up and running in weeks.
- Aster survived a node hardware failure seamlessly.
- Requirements planning for the data warehouse was included in the MySpace Music project design from the getgo. MySpace raves over this strategy as a “blueprint” for future data warehousing success.
If you want to watch the whole video, it’s mercifully short — 4:18 — although the annoying background music makes those 4:18 feel longer than they really are.
Fox Interactive Media’s multi-hundred terabyte database running on Greenplum (coming soon)