Boston AWS Meetup, June 9th, 2014. 6:30 to 8:30pm.
PLEASE NOTE THE EARLIER START TIME!!
Thank you to JumpCloud for sponsoring the food and drink for this event.
Thank you to Threat Stack Inc. for Hosting the event in their Cambridge location (in the hack/reduce space).
We know you’ve automated spinning up new servers as well as configuring those servers with your applications. You are well versed with AWS, Chef, Puppet, and the like. But, what about those manual admin tasks that happen after your servers are up and configured. What about multi-step operational tasks to make sure that your databases are operating properly, that you’ve indexed everything properly, or manipulated data for analysis? What about making sure that based on your log files you are taking the right steps to optimize your servers? Server orchestration takes many forms for each organization and largely these tasks in the cloud have been done manually. Sure some people script a step or two, but when it comes to scripting a whole workflow, that ends up being far more challenging.
In this talk, we’ll show you how to automate after Chef and Puppet. We’ll show you ways that you can orchestrate with open source tools and give you options on other approaches. We’ll walk through a few examples of how organizations are orchestration critical tasks and provide the code. Tasks such as running database backups, post-processing data, securing your infrastructure based on attacks, getting a list of all cron jobs on all servers simply and easily, and a few others. Further, we’ll show you how to product logs and data that you can use to track down what’s happened in your environment and for compliance. We’ll take a look at open source tools such as Jenkins, Luigi, RunDeck, and others to see how they can help you automate your server management tasks.
Topher Marie, CTO and Co-Founder of JumpCloud.
Previously Topher spent five years at Symplified as its lead engineer holding a variety of titles including Architect and Development Manager. The bulk of his time was spent wrestling with the concepts and mechanisms of provable identity – SAML, IWA/Kerberos, PKI, OAuth, OpenID, and multi-factor authentication to name a few. He also had ample opportunity to get his hands dirty with protocol level internet communication and to use his skills in the area of cloud security. Prior to Symplified, Topher was a senior engineer at Ping Identity where he was first baptized into the world of Internet security, with particular emphasis on Identity and Access Management. He has also had stints at Spatial, MatchLogic, and Lucent Technologies. Topher holds Bachelor and Master of Science degrees from the Colorado School of Mines in the area of Math with emphasis in Computer Science. He also spent several subsequent years at that university as a part-time professor for both computer science and pure math courses.
A Deep Dive on Amazon Kinesis for Real-time Stream Processing
Many data analytic workflows can benefit from a reduction in time to results. With powerful compute resources and virtually infinite storage solutions offered affordably via the cloud it is now possible to build systems capable of pulling in & processing real-time data streams. However, many of these workflows still require custom development and custom builds.
Amazon has released Kinesis, a Managed Service to ingest, process and store endless real-time data streams and do so even at massive scale. The movement from batch processing to real-time streams has already begun for many applications. Ad-tech, Gaming, Mobile App, Web App and Internet of Things (connected device) customers as well as plain old IT infrastructure are already generating endless data streams and leveraging Kinesis to generate new intelligence and competitive advantage by processing those streams in near real-time.
We will provide an overview of Kinesis, the problems it can help you to solve, the architecture of Kinesis and how it can be applied to common use cases. Integration with other Amazon services will be covered. Please join us for an open and lively discussion on next generation stream processing.
Matt Yanchyshyn is a Solutions Architect at Amazon Web Services based out of New York City. He helps AWS Technology partners architect secure and high-performance applications for the cloud and has over a decade of international digital media and cloud computing experience. Matt has helped hundreds of customers bring compelling, AWS-backed products to market.
Please Email the Moderator with Suggestions, Recommendations, or Comments.
Thank you. All the best!
- Mark Annati