• The Data Game

    SportsEngine

    The Data Game Given the data in your environment, think of a question. A question you know that can be answered by the data. How hard is it to get the answer? Often times the level-of-effort to get the answer is prohibitive. Many of us face this scenario every day as we're swimming in data, but not answers. As we push to be more data-driven, lowering the level-of-effort to get answers is critical to our success. In this session we'll examine a data source and then start asking questions of it. Hypothetical questions at first, but we'll bring in Elastic to turn theory into practice as we ingest the data and leverage Elastic's search & analytics capabilities. We'll explore different options and their tradeoffs during the process. You'll leave feeling confident that you can do the same with your data. Scott Gose is a Solutions Architect for Elastic. He's focused on helping companies unlock answers in their data by using Elastic. Prior to Elastic, Scott did two tours at Endeca, which was a company that helped pioneer the field of faceted search & navigation. He's also worked professionally as a software developer building iPhone applications and writing back-end services in Go. Scott has a Computer Science degree from the University of Illinois. In (Elastic)search of Multi-Tenancy Learn from the story of how SportsEngine built a member management product of over 260 million documents on top of ElasticSearch. Relive their harrowing journey through tens of thousands of shards, crushed clusters, mountains of pending tasks, and never-ending snapshots. Hear how they went from disaster to delight. They made all the mistakes, so you don't have to! Andy Fleener is a Humanist and a New View Safety Nerd who believes software is as much about the people building and running it as it is the people using it. He is the Senior Platform Operations Manager at SportsEngine where he’s been doing a mix of development and operations since 2011. Andy enjoys music, football, sushi, oxford commas, and laughing at all the things millennials are ruining. AJ Stuyvenberg Lead Software Engineer focused on building, deploying, and maintaining highly scalable systems. Avid BASE jumper, wingsuiter, and general aviation nerd. Empowering teams and individuals.

    2
  • Integrating Heartbeat into your Monitoring Story

    Renaissance Minneapolis Hotel, The Depot

    Integrating Heartbeat into your Monitoring Story The Elastic stack is often used for logging and monitoring services. Did you know it can also proactively monitor endpoints via Heartbeat? In this talk Andrew Cholakian will demonstrate how to monitor both internal and external services with heartbeat and integrate that information with other Elastic stack data, like log data. You’ll learn best practices and hear some tips and tricks as well. Andrew Cholakian is a software developer on Elastic’s Beats team focusing on Heartbeat. Previously, he worked on Logstash. In his free time he enjoys reading, especially history. OSFI is Optum’s next generation container hosting and cloud service solution. It is a secure, self-service platform built on open standards, with a multi-datacenter footprint, container aware storage solutions, and tenant isolation. Currently offering two major container orchestration platforms - OpenShift Origin and Kubernetes on bare metal. Kubernetes on bare metal platform is proposed as a platform to host various data services such as Kafka, Cassandra, MongoDB and Elasticsearch. In this talk we will be sharing our experience running Elasticsearch on Kubernetes using helm package manager and Kubeapps. Bosky Mathew, Distinguished Engineer in Enterprise Engineering Services within Optum/UHG is responsible for defining and establishing enterprise architecture and direction for big data, AI and private cloud programs. She is currently serving as Chief Architect of OSFI - Optum private cloud platform and focused on Cloud, GPU technologies and modernization of Big Data technologies. Madhusudhana R, Enterprise Architect in Enterprise Engineering Services within Optum/UHG is responsible for defining Cloud, Big Data and AI architecture, tools and best practices. Lightning Talk Hard Learned Lessons Nicole is currently a DevOps Engineer at Fastenal. Prior to joining DevOps, she has held positions as a software developer and DBA during her 11 year career. Her primary focus is being the Elastic Stack admin. She enjoys working with data and open source software to solve complex problems. Make sure to attend our Elastic{ON} Minneapolis Tour Stop on September 20th. Feel free to use the code Meetup10 for 10% off until September 17th. https://www.elastic.co/elasticon/tour/2018/minneapolis If you’re interested in Elastic trainings [there is a fee], our team is coming to Minneapolis on September 18-19. You can register here: https://training.elastic.co/location/Minneapolis

    4
  • Updates in Elastic 6.x

    Industrious Minneapolis North Loop

    Michael will talk about what’s new in Elastic Stack 6.x, including the latest release of 6.3 with features like Rollups, SQL support for Elasticsearch, and opening of X-Pack. Michael Heldebrant architects the world’s most interesting projects. He has 15+ years of experience in information technology spanning biomedical research, logistics, digital Hollywood production, and electronic health records. Michael Heldebrant is a Solutions Architect at Elastic where he works with customers on architecting real-time data ingest, search, and analytics solutions using the Elastic Stack. He also is very happy to be in Minneapolis as he considers this place home.

    4
  • It's About TIME!

    WeWork Capella Tower

    Reminder to bring your ID to check in with the front desk at Capella Tower tonight. Also an agenda update below, Mike H from Elastic gets to show lots of things tonight! Elastic{ON} 2018 was quite an event this year, accompanied by lots of big news from Elastic. There are many new features, both released and in development. Notably: the X-Pack has been "opened" (https://www.elastic.co/products/x-pack/open)! There has never been a better time to be an Elasticsearch enthusiast and expert. So, it is about TIME for a meetup. Rather, this meetup is about TIME itself: 1. More tools for analyzing Time Series Data 2. Saving Time with Elastic's ever-easier automation 3. Passing the time that Elastic can save us on pursuits like competitive locksport, whittling or plastic welding (all fine skills). IN THIS MEETUP We'll have Elastic team and technical reps on hand. Mike H will provide an Elastic{ON} recap and demo Kibana+Canvas+Vega (visualization!) as well as Machine Learning. (There is an agenda update: Elastic Machine Learning Group Lead and Minneapolis local, Tom Grabowski, will be joining us for a full discussion about Machine Learning and Elastic Stack in the near future. James B will also present the EIX.org monitoring solution at a future meetup. More meetups on the horizon!) WHERE WE'LL BE The WeWork office is 39th floor of the Capella Tower in Minneapolis. Bring your ID to get into the building. Must be 21+ to drink beer, which along with food will be provided. There is on-street and ramp parking nearby (no validations).

    1
  • Nuts and Bolts of Product Search

    Concur (Previously Moneygram) tower

    We hope you can join us for our upcoming meetup on Tuesday, December 5 at Concur. The agenda for the evening is: 6:00 pm - Doors open (food and beverages will be provided) 6:30 pm - Talks start by Fastenal 8:00 pm - We'll wrap things up How Fastenal Refreshes Large Indexes Nightly Fastenal.com has about 381,000 products on the www.fastenal.com (https://www.fastenal.com/) website and 118,000 products on the www.fastenal.ca (https://www.fastenal.ca/) website. These public websites contain only a small subset of their entire product lists that store employees and some customers order against. All of the products and related details are stored in Elasticsearch to support product search. Learn how Fastenal builds their indexes nightly. Fastenal's IT department has multiple members who work with the Elasticsearch instances. A number of people from both the development and system administration teams will be presenting one of their uses of Elasticsearch. Fastenal is an international NASDAQ-100 company that employees about 20,000 people with about 300 within IT. Directions to building: From the parking ramp attached to the 1550 Tower, walk straight across the lobby, pas the water feature and the conference room is next to the “T Sharp Hair and Nail Co”. We are NOT allowed to park in the lot in front of the building (on Utica Avenue. S.) as the lot belongs to Health Partners and violators will be towed.

    5
  • Beat It!

    Location visible to members

    Beat It! In the olden days, pulling log data and metrics from different sources (computers, networks, applications...) often required ACTUALLY pulling out log data and metrics from different sources. We had to programmatically configure and/or request that different systems first generate the data...then, we had to move this data from one place to another. Cron jobs, ftp, hot folders and programming tricks were key gears pushing our data conveyor belts. Getting all the data we wanted in a timely fashion was a holy grail indeed. Ever seen a Rube Goldberg machine? Yeah, that's how old school monitoring data flow works... As we know, Elastic has aimed to simplify this endeavor. Enter "Beats": Part of Elastic's monitoring automation platform. How many beats do you need? Several, probably...one beat per data shipment. So, what can be beaten in this fashion? As Elastic says, beats provides "All kinds of shippers for all kinds of data": https://www.elastic.co/products/beats In this meetup, Elastic's Mike Heldebrandt will present and answer questions about File beat and Metric beat modules. He's seen many organizations putting beats into action, so it's a great chance to hear about the state of the art. As concepts evolve for modern methods to transfer, ingest and convert or process raw log data, we Elastic enthusiasts need to know how to apply the different components of the stack. What is your overall reporting requirement from the log data? Where do you get the data, and what is your indexing strategy? Chances are, Beats will figure fundamentally into that conversation. Food and Soda will be supplied by Elastic. Join us!

    3
  • Logstash

    Best Buy Corporate Office

    Once the hoopla and bizziness of the annual Elastic{ON}17 user conference settles, it will be back to real life... "Real life" means using -- or figuring out, or continuing to use -- the Elastic Stack to store data, analyze and transform it, and turn it into actionable information. As we know, the work horse for moving data into ES is Logstash. Nowadays, we have beats as well as ways to put JSON directly into our ES clusters...but Logstash remains a critically useful and important tool. Add some scripting and configuring and wizardry, and Logstash becomes an invisible hand, moving logs and goodies to ES for the triggers, reports, percolators, dashboards and such. Join us to discuss Logstash with one of the top Logstash minds in the world. Twin Cities based Elastic developer, Andrew Cholakian, works on Logstash. He eats, sleeps, and breathes Logstash. His clothes smell like Logstash. (Wha?!). I attended one of the Elasticsearch trainings, where Andrew was a trainer, and he sure knows his stuff! Andrew's Talking Points: 1. What Logstash does 2. Using Logstash for data enrichment 3. Using Logstash for logging 4. Logstash performance tuning 5. What's coming up in Logstash 6.0 Join us for a presentation and then real tech stuff! Bring your questions. A round of applause to anyone who can stump Andrew with a Logstash question that he can't answer!

    6
  • Elastic Thinking Tournament of Champions

    The News Room

    UPDATE: I've reserved a large table for us in one of the quieter rooms at The News Room for 6pm. I'm capping the reservation limit at 25, based on interest so far and the benefits of not being an enormous group. Parking Note: I typically park at the Harmon Place ramp 25 S 11th St, Minneapolis, MN 55403 -- I have 10 free parking passes to give away if you park in this ramp after 4pm. Meetup Details This meetup will be a celebration of gaudy and outrageous displays of your brainpower. Shiny and sharp, Elastic Search (ES) provides potent capabilities, and there are problems to solve. But, success requires focus and plotting paths thoughtfully. The mission is daunting but worthwhile: Make the world better. Are you in? In this meetup, we’ll discuss one particular organization (a non-profit) and how it is using Elastic currently. Then, as a group, we’ll brainstorm and practice designing specific use cases with Elastic Stack components and automation in order to help the organization be better. There will be some rules and a fun, social format. But, really, it’s a chance to zap our Elastic synapses and articulate how to apply Elastic in ways that can deliver real ROI and impact for an important goal. What is the challenge? EIX.org is a non-profit philanthropic initiative by the Richard M. Schulze Family Foundation and hosted at the University of St. Thomas Schulze School of Entrepreneurship. Disclosure: I serve as the Managing Editor of EIX. The outreach and mission of EIX.org is to support the teaching and learning of entrepreneurship and innovation, so that more business ventures end up being successful (from big corporations to small business and companies of one). Entrepreneurial thinking also benefits our ability to govern ourselves smartly and to grow prosperous communities. More, Better, Faster... EIX has two current use cases for Elastic Search: (1) web log analytics and (2) web content search. So, let’s just call those two flags planted. Territory earned. In this meetup, I will demonstrate those systems. Importantly, if having TWO of something is good, then having FIVE must be awesome, right? That’s a 150% improvement right there. So, the challenge is to have 5 compelling organizational use cases for Elastic. I will provide information, review the EIX user groups and programs, and answer scoping questions, so that you may analyze different opportunities and make smart recommendations for Elastic applications. Hmm…OK…and what is this about a PRIZE? Based on rounds of applause, cheers, and peer envy, the champion that creates the crowd favorite Elastic Search application idea for EIX.org will be showered with trinkets and baubles. If two or more people have the same idea…bauble fight! Just kidding. Seriously: I’m a Raspberry Pi enthusiast, and for the grand tournament champion, there will be a brand new custom starter kit with a Raspberry Pi 3B and some essential goodies, such as sensors and connectors. It’s perfect for automating something…and pretty geeky. Raspberries are awesome. For everyone else, there is the satisfaction of a good fight, scars to show the grand children, and maybe some fame.

    6
  • Go Big or Go Bigger... Scaling & Maintaining HA ES Clusters

    We're past the prototypes... We've launched... Users are using. Lots of users. Oodles of users, who keep arriving in throngs for the promise of real-enough-time, ES-powered search and insights. Once they get a bite of the goodness, they just want more. They demand it noisily, as if speedy information has become a birth right. The organization is now better, faster, stronger. Take ES away for a few seconds, and there's rioting. In this meetup, we'll focus on more "mature" ES production clusters that are seeing large amounts of use and/or are processing large amounts of data with quality of service expectations that are "higher than normal" (the definition of HA). A bullet list of discussion points is below. More Meetup Description: Enjoy the momentary glory: we've become mission critical! Systems are hooked into our ES end points. We're part of high level status reports. Business executives click and browse our systems while they sip tea and munch crumpets. All seems good, but we know there's more to the story. If our cluster were an old timey wooden ship, we'd hear the creaking of wood as waves and torsion stress the hull. The sails would be taut and bulging in the wind, stretched to nearly ripping. Dribbles of water would leak into the cargo hold below as planks bend. The ship has made many stops; it's overloaded with treasures. And, we're just about to glide between Scylla and Charybdys -- on the course to home and fame. A grizzled, leathery old sea hand calls out, "Captain, we're sow bellied and taking on water -- we won't make it!" Changing Metaphors: In response to overwhelming load and expectations, we have turned up the ES cluster volume knob to "11" and now the bass is clipping and the high end is raked. So we add power amps, woofers, and tweeters. Lots of them, like stacking lego blocks. The sound becomes crisp and authoritative. Everyone is dancing. Then, bus loads of new folks arrive and the sound needs to reach further. So we freely add more gear, more people, more power: And the party is epic. Long meetup descriptions aside, we invite you to join us for a discussion of: • High Availability ES Architecture • Considerations for Growth and Maintenance • Issues that Impact High Scale Performance • Dynamic Provisioning Concepts • Key Metrics to Monitor • When/How to Get Help See you there!

    3