Real-Time Streaming Data
Details
Pizza, beer, and mingling.
Lightning talk: "Realtime by Proxy"
Justin Karneges (http://www.linkedin.com/pub/justin-karneges/32/86a/1a6) - Founder, Fanout.io
“Real-time Stream Processing platform on Hadoop”
Amol Kekre (http://www.linkedin.com/in/amolkekre) - CTO, Data Torrent
Chetan Narsude (http://www.linkedin.com/in/chetannarsude) – Chief Architect, Data Torrent
Pavel Hardak (http://www.linkedin.com/in/pavelhardak) – Director of Product Management, DataTorrent
"Realtime Streaming using Autobahn Websockets"
Tom Sheffler (http://www.linkedin.com/pub/tom-sheffler/1/993/a10) - Chief Scientist, Sensr.net
"'A Globally Distributed Real-Time Network' - Millions of Messages per Second World-Wide"
Stephen Blum (http://www.linkedin.com/in/stephenlb) - Founder/CTO, PubNub
----
For certain kinds of information, we always crave up-to-the-minute updates. Examples include stock tickers and sports scores, and even the age-old chat client.
But how do we do this at scale? Maintaining open network connections for all of your active users is no easy feat.
The earliest formal attempts at doing this in a browser used comet (http://en.wikipedia.org/wiki/Comet_(programming))-style requests to achieve "push" capabilities. Most web servers aren't terribly good at maintaining lots of open connections, so this could be expensive (in terms of computing resources) to do. The latest and greatest version of this technique is web sockets (http://en.wikipedia.org/wiki/WebSocket), which many browsers support, and for which there are a number of servers, packages, and services.
For our June event, I'm looking for talks about real-time and streaming data applications built with web sockets, comet, or similar technology. What are you using in your application, and how did you choose it? What does your application use it for? Is it working well for you? How many users can you handle per server? Do you use any special tricks to detect idle browsers when people leave their computers on all the time? How do you make the user experience resilient in the face of failures? How do you scale this (maintain all those open network connections) in an economical fashion?
I'm lookingfor 2-4 20-25 minute talks. If you can give a talk, please contact me, Chris Westin, through meetup.
As well as the evening's theme talks, we can fit in 2-3 five minute lightning talks at the beginning of the evening; any topic that would be interesting to the #lspe audience is welcome. If you're interested in giving a lightning talk, contact me, Chris Westin, through meetup.