November 21, 2013 · 6:30 PM
NYCPUG is going international! We gladly welcome Alvaro Hernandez Tortosa, CTO of NOSYS and visiting NYC from Spain. While he is in NYC, Alvaro offered to come present about the "Billion Tables Project" or in other words, how to create very, very, VERY large databases.
The Billion Tables Project explores how to have large PostgreSQL database installations and explores the metadata required to maintain such an installation. Even while looking at this extreme example, there is a lot of practicality to understanding how PostgreSQL manages its meta-information for your day-to-day operations. In his talk, Alvaro will be exploring:
• The catalogue structure and its storage requirements
• Table creation speed
• Durability tradeoffs to achieve the desired goal
• Strategy to be able to create the 1B tables
• Scripts / programs used.How the database behaves under such a high table count
• Differences in table creation speed and other shortcuts between different PostgreSQL versions
• How the storage media and database memory affects the table creation speed and the feasibility of the task
• If it makes sense to have such a database
Our meetup space will be at Yodle's new office on the 5th Floor of 50 W 23rd St. We look forward to seeing you there!