Going from .Net SQL to Hadoop+MongoDB on Linux and Java

Robert Vandehey, Senior Director at Rovi Corporation, will share Rovi's experience in migrating .Net/memcache/SQL to Java/Linux/Hadoop/Mongo.

Agenda

1) Greetings, Intros, Announcements

2) Current architecture and problems

a. ETL + cache loading process takes far too long

b. Transformations too complex. Costly to research problems.

c. Scaling web services to handle growth

3) Solution

a. Convert from Windows/.NET to Linux/Java

b. Implement Hadoop to replace ETL/cache loading

c. Replace memcached/memcachedb with MongoDB

4) Lessons learned

5) Next steps

Robert Vandehey is a Senior Director at Rovi Corporation. Robert has been solving enterprise problems in the banking and entertainment space for over 15 years. At Rovi, he leads the Cloud Services Platform group which is responsible for creating web services for delivering entertainment metadata from one of the world's largest collections available, offering a comprehensive catalog of high-quality editorial, descriptions and rich images—all optimized for multiple platforms. When Robert isn’t working, he enjoys running, biking, golfing and was training for an Ironman triathlon before breaking his leg in a bicycle accident in June.

Links:

Rovi Corporation (http://www.rovicorp.com/)

Rovi Cloud Services (http://www.rovicorp.com/solutions-for/developers.htm)

Robert on LinkedIn (http://www.linkedin.com/in/bvandehey)

---

Parking and Directions:

We're in the Gateway West building, next to the Westfield Century City mall on the east side. It's the only building with big red "Westfield" signs on top.

We recommend you park at the mall. You get 3 hours free at the mall, and our building is a short easy walk: Exit from the mall parking garage up to ground level, head east, pass the Lens Crafters, and you'll be able to enter the west side of 1801. Then just hit the elevators to go all the way up to floor 14, and we're in Suite 1450.

In a pinch, if you park in the parking garage for Gateway West, we may be able to score you parking validation. However, we cannot promise it and therefore prefer you use the mall parking.