Skip to content

Processing streaming events in real-time using Malhar

Processing streaming events in real-time using Malhar

Details

The next wave of Big Data is processing data in real time or near real time.

In this talk, DataTorrent architects Chetan Narsude and Thomas Weise will discuss the open source framework Malhar.
Malhar allows processing streaming events in real time.

https://github.com/datatorrent/malhar

About the Speakers:

Chetan Narsude -Chief Architect

Chetan has been passionately architecting and developing scalable web applications for the past 15 years. The applications he developed at Yahoo! Finance, Yahoo! Shopping, and Microsoft adCenter 5-10 years ago are still serving millions of concurrent requests every second today. Before DataTorrent, as Director of Engineering for Yahoo! Messenger, he guided development of the real-time technology stack catering to a billion users. He also served as the CTO for Monvia Inc., an incubator where he personally helped 30+ startups architect, develop, and operate the technology stack during his 3 year tenure.

Thomas Weise – Principal Engineer Thomas has developed and architected distributed systems, middleware and web applications since 1997. Before joining DataTorrent at inception, he served as principal engineer in the Hadoop Services team at Yahoo! and contributed to several of the ecosystem projects, including Pig, Hive and HCatalog. Porting of the batch oriented infrastructure to Hadoop 2.x gave motivation to explore alternative, more interactive and real-time processing capabilities based on the new YARN architecture. Earlier, he worked on enterprise software for network/device management, e-commerce and search engine marketing.

Photo of ODSC Santa Clara Data Science group
ODSC Santa Clara Data Science
See more events