Greg from Automattic has graciously agreed to present on how Automattic uses Elasticsearch. Automattic is the company behind WordPress.com
We're also going to take advantage of the Elasticsearch training that's going on in Boulder the 24th and 25th and meetup. Lee and Uri from Elasticsearch will be at the meetup to answer any questions anyone has about ES.
Level 3 has agreed to host in Broomfield, making it pretty equidistant from Boulder and Denver.
WordPress.com is now running Elasticsearch to handle over 25 million queries a day for suggesting related posts (http://en.blog.wordpress.com/2013/11/11/related/) from over 600 million documents. This presentation will cover the problems we ran into while scaling out our Elasticsearch cluster, including:
- Scaling real time indexing
- Partitioning data for scalability
- Balancing global queries and localized (routed) queries
- Optimizing queries for high performance.
Greg is a Data Wrangler at Automattic (http://automattic.com/) on the WordPress.com (http://wordpress.com) Data Team. He writes code, juggles servers, and occasionally inserts some machine learning and natural language processing into the mix. He occasionally blogs about these topics at http://gibrown.wordpress.com