add-memberalign-toparrow-leftarrow-rightbellblockcalendarcamerachatchevron-leftchevron-rightchevron-small-downchevron-upcircle-with-crosscomposecrossfacebookflagfolderglobegoogleimagesinstagramkeylocation-pinmedalmoremuplabelShape 3 + Rectangle 1pagepersonpluspollsImported LayersImported LayersImported LayersshieldstartwitterwinbackClosewinbackCompletewinbackDiscountyahoo

Speaker: Dan Bartow on Testing in the Cloud

  • Dec 6, 2011 · 6:30 PM
  • Wayfair Offices - 4 Copley Place

Achieving real performance on the web begins with realistic testing and an understanding of the application and it's infrastructure.  Testing realistically and for real results across web & mobile applications means leveraging the cloud.  Agile development processes, complex multi-tier architectures, and the potential for massive (and sudden) load all require a different approach than historical apps.  Come hear from Soasta, the makers of the CloudTest platform and CloudTest Lite, about their experiences and why companies need to change their expectations about what "testing" means.

Dan Bartow is Vice President and CloudTest Evangelist at SOASTA, the leader in performance testing from the cloud. Prior to joining SOASTA he was Senior Manager of Engineering at Intuit, where his team was responsible for the speed and stability of TurboTax Online, the #1 rated, best-selling online tax software. Over the past decade he has been responsible for the speed and scalability of websites for such well-known brands as American Eagle Outfitters, AT&T, Best Buy, Finish Line, J.Crew, Neiman Marcus and Sony Online Entertainment, among others. Dan has set multiple industry precedents including launching the worlds largest stateful JBoss cluster and using over 2000 cloud computing cores to generate load against a live web site.  Dan is a frequent industry presenter and has spoken at leading testing and cloud computing conferences such as Software Test & Performance (STP), O'Reilly's Web2.0 Expo, Amazon Web Services Road Show, and SYS-CON’s Cloud Computing Expo.

Cloud Testing Bill of Rights:

  • The flexibility to generate load both internally and externally
    • Cloud and internal load servers, unlimited VUs, self deployed or managed on demand
  • The ability to build and modify complex tests within hours
    • Visual test creation, automated page creation, transaction definition, same tests for lab and production, wizard-based Session Templates (variable "correlation"), object based conditional logic, javascript editor
  • Support for dynamic web and mobile technologies and protocols
    • AJAX, HTML5, Flash, FLEX (AMF), Silverlight, SOAP, REST, WFC
  • Elastic, globally distributed test environment
    • Minimum of 10 major metro locations supporting at least 10,000 VUs per location
  • Dynamic and fully automated test grid provisioning
    • Deploy, monitor and manage internal and external cross-cloud load generators on demand and within minutes
  • Control test sessions to start, pause, stop, modify, re-start and analyze
    • Pause the load, pause the ramp, fast stop, modify, edit tests and scenarios, supplement load on demand and restart as often as needed during a single session
  • Single integrated view of performance and monitoring metrics
    • Source, aggegate and correlate application, system, network & mobile device monitoring data on the same timeline directly from existing monitors such as CA (Wily) Introscope, IBM Tivoli, AppDynamics and Device Anywhere
  • Rapidly isolate performance issues in real time at any scale
    • Drill into TBs of correlated metrics during test sessions to identify issues spanning web page elements, network, load balancers, firewalls, web and application servers, databases, 3rd party services and CDNs
  • Test platform that allows functional and load testing from lab to production
    • Functional and performance test automation; test assets that easily transfer as environments change; easily integrated to build management systems; cross-project, cross-test reporting.
  • Affordable enough for high iteration, everyday testing at Agile speeds

Street View:


6:30-7:15 Eat pizza and meet other members
7:15-8:15 Presentation
8:15-9:00 Q&A, general socializing and more pizza eating

Join or login to comment.

  • Andrew C.

    Thank you to everyone. It was terrific to start the conversation and Dan and I loved the feedback. We did a follow-up on session in New York where we dove into CloudTest Lite (our free tool) and built on the discussion from Boston. It was GREAT. Thanks everybody -- see you at the next meetup!

    December 9, 2011

  • Maura W.

    Dan is an enthusiastic speaker and the topic of production testing from servers on the cloud was very interesting.

    December 7, 2011

  • Bill W.

    Dan spoke with clarity and passion on load testing in the cloud. I appreciate the insights, lessons learned, tips & tricks, and war stories regarding why we should care and how we can make it happen. Especially interesting insights on the trend of load testing in production. Great talk!

    December 7, 2011

  • Eugene B.

    Excellent meetup, as always. The speaker, Dan Bartow, was very knowledgeable and entertaining. He highlighted quite a few overlooked areas of Web Performance testing and even presented a few surprising points, quite correctly identified. Time well spent.

    December 7, 2011

  • William T.

    Great talk. No doubt Dan Bartow is a worldwide expert in production and scale testing websites and web applications. His insight into what to look for, what usually goes wrong and how to setup a test was insightful. The cloud opens new methods for testing and SOASTA and CloudTest are taking advantage of that.

    December 7, 2011

25 went

Our Sponsors

  • Wayfair

    Wayfair hosts our meetups, and is looking to hire great engineers!

  • Akamai

    Any experience. Any device. Anywhere.

  • Instart Logic

    Cloud application delivery

  • New Relic

    New Relic makes sense of billions of metrics a day in real time.

  • Catchpoint

    10% off to Members + "Complete Web Monitoring" ebooks


    Web and mobile app test automation solution.

  • O'Reilly

    O'Reilly provides discounts to all members, and free books

  • AppDynamics

    Next generation application performance management

  • Yottaa

    Yottaa provides a selection of books on Web Performance for each Meetup

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy