Practical Postgres Sharding: Scaling to the Horizon

Talk Type: 
45 Minute Talk
Technical Level: 
Creative Commons - Attribution Only

This talk will present sharding as a solution to horizontal scalability for OLTP databases. After going over what problems sharding does and does not solve, we will look at a case study using as an example of a high transaction volume application running PostgreSQL that has experienced incredible amounts of growth in the past 5 years. In particular we will talk about:

  • Cluster management (Schema and data invariants)
  • Connection management (Many apps to many databases)
  • Key hashing and data/load balancing
  • Failure modes
  • Replication for high availability
  • Operation and upgrades
  • Adding capacity

Download Presentation Notes