Realtime Analytics using MongoDB/Python/Gevent/ZeroMQ- Rick Copeland, Geek.net
Hosted by Atlanta MongoDB User Group
Details
With over 180,000 projects and over 2 million users, SourceForge has tons of data about people developing and downloading open source projects. Until recently, however, that data didn't translate into usable information, so Zarkov was born. Zarkov is system that captures user events, logs them to a MongoDB collection, and aggregates them into useful data about user behavior and project statistics. This talk will discuss the components of Zarkov, including its use of Gevent asynchronous programming, ZeroMQ sockets, and the pymongo/bson driver.
Rick Copeland is a software engineer at Geeknet, the company that owns the websites SourceForge, Slashdot, ThinkGeek, FreshMeat, Ohloh, and Geek.com. Rick is the primary author of Ming, a Python object mapper for MongoDB, and has been on two of three major initiatives at SourceForge using MongoDB. Prior to GeekNet, Rick worked in fields from retail analytics to hardware chip design. He holds MS in Electrical and Computer Engineering and Bachelor of Computer Engineering degrees from Georgia Tech and a Bachelor of Computer Science degree from Eckerd College.
