April 2013 - Continuous Delivery with ETL Systems

With Dave Nolan (@davenolan, Lonely Planet) and Pete Sinden (Dr Foster Intelligence)

Hosted by SkillsMatter: http://skillsmatter.com/podcast/agile-testing/continuous-delivery-with-etl-systems

Continuous Delivery and Agile methodologies tend to focus on product value which manifests itself in discrete end-user features. However, for data-heavy software applications - such as those using ETL - functionality value is typically bound up with delivering a large data set against which the application can operate.

Lonely Planet and Dr Foster Intelligence both make heavy use of ETL in their products, and both organisations have applied the principles of Continuous Delivery to their delivery process.

Some of the Continuous Delivery norms need to be adapted in the context of ETL, and some interesting patterns emerge, such as running Continuous Integration against data, as well as code.

 

About Lonely PlanetWhen people think about travel and adventure, they think about Lonely Planet; from Argentina to Zimbabwe, Lonely Planet has unmatched coverage for thousands of places around the world. Lonely Planet helps hundreds of the world’s leading brands develop innovative content and marketing solutions that deliver results, drive customer loyalty and put their brand front and centre in the travel space.

About Dr Foster Intelligence: Dr Foster exists to make healthcare data better and help healthcare organisations improve the quality of care. They are the leading provider of healthcare information and benchmarking solutions in England – and increasingly, worldwide. They enable healthcare organisations to benchmark and monitor performance against key indicators of quality and efficiency.


Join or login to comment.

  • Matthew S.

    Slides from Pete Sinden of Dr Foster Intelligence are now available here for #londoncd members:
    http://www.meetup.com/London-Continuous-Delivery/files/

    July 11, 2013

  • Amy P.

    Thanks, guys. I enjoyed the session and am using your wise words to try and drive our test strategy. Any pointers to other good presentations, meet ups, blogs etc would be much appreciated.

    1 · April 18, 2013

    • Matthew S.

      Hi Amy, for test strategy, I really recommend GOOS (Growing Object-Oriented Software, Guided by Tests) by Steve Freeman and Nat Pryce; their approach fits will with automated/pipelined CD-style test automation. There is also XtC every Tuesday near Farringdon where some great (and friendly!) people meet to talk about TDD etc.

      Matthew

      April 26, 2013

    • Amy P.

      Thanks, Matthew. I'll take a look at the book. You can certainly expect to see at future events :)

      1 · April 26, 2013

  • Richard S.

    thanks guys, enjoyed the meetup the other night. At the pub, I forgot to ask Dave about "operations as a consultancy" and how this helps with getting operational requirements outed! I wondered if you'd be good enough to share this over email or a beer sometime? (although I'm in Cambridge!)...

    April 18, 2013

  • Suresh K.

    could it be possible to upload in youtube ?

    1 · April 17, 2013

  • Matthew S.

    The fab guys at SkillsMatter have posted the video here:
    http://skillsmatter.com/podcast/agile-testing/continuous-delivery-with-etl-systems

    1 · April 17, 2013

  • Sergey T.

    I'm not a data guy, but recently I was involved into the ETL processes automation, so it is a really good timing for me to hear and see, what challenges other people had implementing CD for that kind of applications. I quite enjoyed both presentations, although it would've been nice to hear some technical details.

    1 · April 16, 2013

    • Dave N.

      Hi Sergey, I sure would - get me on dave DOT nolan AT lonelyplanet.com with whatever you're interested in.

      April 17, 2013

    • Sergey T.

      Matthew, I didn't want to sound complaining, there was enough information to process, just not the technical kind :) certainly would love to hear more on CD with ETL

      Dave, thanks for your presentation, I'll get in touch.

      1 · April 17, 2013

  • Banos

    Great to hear data driven projects use the same principles. Too much resistance around databases. Now I have some examples to quote. Many thanks guys.

    3 · April 17, 2013

  • Emese B.

    I only do E and T (others do L) but it was very interesting to hear how Lonely Planet and Dr Foster Intelligence have subdued obstacles and improved their processes. Definitely a lot for me to learn, I am at the very beginning of the journey.

    1 · April 17, 2013

  • Julien

    Really interesting. Thanks

    1 · April 17, 2013

  • Richard B.

    Apologies, other requirements have popped up

    April 15, 2013

  • Kishore

    Sorry, not able to make this time.

    April 15, 2013

Suggested Donations

GBP1.00 or more per person (voluntary)

This covers: The cost of the Meetup.com fees

Payment is accepted using:

  • PayPal

Your organizer will refund you if:

  • You have not received value for money

Our Sponsors

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy