Moving out of Amazon is no small feat.
After a couple of months preparation we finally moved out of Amazon Web Services ([AWS], aka. the Roach Motel) on December 12th, 2011. And not a moment too soon. In the end, after a trial run, we successfully moved out of AWS in less than three hours. This was no small feat considering we had to transfer and maintain synchronization of terabytes of data from a source on the other side of the country.
Our new installation is fantastic. It is excellent blend of carrier class technology and commodity hardware. This delicate balance gives us fabulous data handling capabilities while maintaining very low operating costs.
Why is platform so special?
- It is built on OpenIndiana of course.
- It leverages ZFS to the max.
- DDRdrive X1s for logzilla — blazing fast synchronous write performance.
- Aggregrated gigE links utilizing jumbo frames every where.
- Each LACP member connects to a separate physical switch within a virtual chassis. If a physical switch chassis fails, the servers connected to that physical chassis continue to operate on the other chassis at gigE speeds.
- Full tilt on DRAM. Every slot is used with the maximum size.
- Gobs of 15K RPM SAS disks per data storage device leveraging multiple Sanima-SC/Newisys NDS-2241 storage chassis per server.
- Since we are on ZFS, we can hot swap the disks to SSDs when suitable enterprise grade devices come available.
- There is more SSD based cache (L2ARC)per server than the size of the existing data set, so there is plenty of room to grow in read ops.
- Obviously remote out of band management, KVM, SMASH interface, with all the bells and whistles.
- Fully redundant power, every where.
- Should a server fail, the disks owned by that server can be imported on a partner system (thank you SAS!), and a zone booted to continue operating the services provided by the down partner. Genius!