This talk will be an intro to database sharding with a slight bias towards SQL-like databases. We will present several alternatives for DB admins and designers to consider prior to attempting sharding, and discuss what it is about sharding that makes it such a difficult architecture to implement. We will conclude with how one should approach both the design and implementation of sharded architectures to best avoid both immediate and future pitfalls.
Taysir Tayyab is a Project Manager at SevOne. He has traditionally been a front-end/UI engineer, however has been increasingly involved in the data layer, with expertise in MySQL. He has undergraduate degrees in EE and Mathematics and is a recent migrant to Philadelphia (from Texas). His professional experience with databases comes immediately from his current position as one of the senior engineers in the data layer of the SevOne network management solution (which is built on a sharded architecture).
To give a sense of scale that Taysir and SevOne engineer around, their clusters (as measured 2 years ago) sustain burst ~16M QPS (200k/shard), ~150 billion writes per day (1.8 billion/shard), and store 1TB of integer data points per day. All the whilst having each shard double as an application server as well.
We hope to see you there!
PhillyDB will meet on the 16th floor of the MSB. Note that the meeting may be listed at the front desk under the name 'Philly Tech Groups' or 'Technically Philly Groups'.
6:00 - pizza and socializing
6:30 - presentations
8:00 - beverages (and more socializing) at Nodding Head Brewpub