• November Elastic San Diego Meetup

    Google Cloud

    Join us for our November meetup on Tuesday, Nov. 13. Thanks to Google Cloud for hosting us! The agenda for the evening is: 6:00pm - doors open, food & beverage will be provided 6:30pm - Talk #1 starts 7:00pm - Talks #2 starts 7:30pm - Q&A 8:00pm - We'll wrap things up Abstracts: Talk #1: In this talk we'll discuss ways to run Elastic on Google Kubernetes Engine and how to integrate Logstash and Beats with various Google Cloud services. Dan is a Solution Architect at Google based in Irvine, CA. He focuses on making cloud easier by automating all the things with tools like Kubernetes and Terraform. Talk #2: Yes, certificate expiration dates do matter (or how I recovered after unintentionally killing the Winlogbeat & Filebeat pipelines, and no one noticed for several days). In this talk we'll discuss how I solved this problem with a somewhat innovative method of getting those logs into Elastic without creating duplicates. Timothy Harryman is the senior operations technician for the ARRIS Security Engineering department, and oversees the installation, care and feeding of nearly 200 identity servers in production facilities for ARRIS, Motorola, Lenovo, Broadcom and Trident Micro located in over 50 locations around the globe. Eight years ago he got tired of logging onto the individual servers to monitor and troubleshoot and began using Splunk. In 2014, realizing that his logging volume had outgrown his budget he turned to Elasticsearch 1.2.4. ARRIS has been a licensed (Gold) user of Elastic since 2016. Timothy hopes to complete his Elastic Certified Engineer certification before the end of the year.

  • Elastic Meetup at Cordial: Machine Learning

    Join us for the next Elastic meetup at Cordial. The agenda for the evening is: **We're looking for another speaker, if you're interested, send us a note a [masked]** 6:00pm - Doors open, food & beverages will be provided 6:30pm - Talk starts with q&a 7:15pm - Talk #2 starts 8:00pm - We'll wrap things up Bots, Outliers and Outages… Do you Know What's Lurking in Your Data? With the mass amounts of data that are being ingested daily it is nearly impossible by traditional means to understand what is hidden in your data. How do you separate the ordinary from the un-ordinary in a timely fashion? Unsupervised machine learning on time series data enables real-time discovery of those interesting and possibly costly data anomalies. Stephen will describe, build and run several types of machine learning jobs in Elasticsearch that can detect and alert on these anomalies and outliers in real time. Stephen Brown is currently a Solutions Architect at Elastic. He came up through the software engineering ranks and ended up as Vice President of Software Engineering at the data and analytics company CoreLogic where he built a core dev team as part of the Innovations Lab to deliver cloud native apps and services. Now at Elastic he gets to indulge in his some of his favorite pastimes… brewing a tasty cup of espresso and ingesting, analyzing and visualizing interesting data sets. **Notes about the venue** - There are a few parking lots around the venue - If you are planning to arrive after 7pm, someone will need to meet you to let you in. Please comment on the event page if you think you'll arrive after that time.

  • Elastic meetup at Qualcomm: Managing Growing Elastic Clusters

    Qualcomm - Building R

    Join us for our upcoming meetup at Qualcomm. The agenda for the evening is: 6:00pm: Doors open. Food & beverages will be provided 6:30pm: Talk #1 starts - How to manage growing Elastic clusters: A multi-cloud/use case deployment story by Elastic's Josh Biol 7:00pm: Talk #2 starts - IT at Qualcomm is using Elasticsearch in a rather unique configuration to accelerate IT operations by Paul Krizak 8:00-8:30pm: We'll wrap things up Abstract Over the years, Elastic has evolved to more than just Elasticsearch. In this session we'll go over the journey of Elastic Stack, the different use cases that grew out of it, and how to manage the stack as the number of use cases and clusters grow in your organization. Bio Josh is a Consulting Engineer for Elastic helping customers solve their problems and getting the most out of the stack. He is a local here in San Diego, CA. Abstract Elasticsearch is normally used to store and search through time-series data (e.g. logs). But as a search engine at its heart, it’s also good at storing other things. This presentation will review how IT at Qualcomm is using Elasticsearch in a rather unique configuration to accelerate IT operations. Not only is Elasticsearch being used for non-time-series data, but it’s also being run in Docker containers. On VMs. On NFS storage. The horror!! We’ll discuss how this architecture was developed, why it works for us, and identify the pitfalls we found. Bio Paul Krizak is a Sr. Staff IT Engineer at Qualcomm, in the Unix Configuration Management team, who have been doing “devops” since before it had a name. He and his colleagues develop configuration management, OS imaging, and reporting tools used by the IT Operations group to maintain tens of thousands of systems across nearly every continent.

  • Elastic meetup at Certona –– Elastic Stack Alerting & 6.0 is coming

    Join us for our upcoming meetup on November 8 in San Diego. Thank you to Certona for hosting us! Agenda: 6:00pm - doors open, food & beverages available 6:30pm - Introduction from Certona 6: 45pm - Elastic Stack Alerting by Nick Peterson with Q&A 7:15pm - 6.0 is coming by Henry Pak with Q&A 8:00-8:30pm - wrap things up. Elastic Stack Alerting Alerting in the Elasticsearch X-Pack is incredibly powerful but the learning curve can be intimidating. In this session we'll go over the basics of Alerting to get you up and running with simple threshold alerts and also dip our toes into a few more advanced use cases to demonstrate the full flexibility of Alerting. Nick Peterson is an Engineering Lead at Veyo Logistics in downtown San Diego. Veyo is a Non-Emergency Medical Transportation company that uses Elasticsearch throughout it's stack for both logging and alerting. 6.0 is coming To help our awesome community prepare we will be doing a run through of the major changes that will land with the Elastic Stack in 6.0. We have things like rolling-major version upgrades, even more Lucene data structure optimisations, sequence IDs, saying farewell to _types, dashboard modes, automated cluster alerts, Logstash pipelines and a pipeline viewer, Beats integration with kubernetes and a whole raft of new Beats modules. Our Pioneer Program (https://www.elastic.co/blog/elastic-pioneer-program-6-0) also makes a return, so if you are already using the beta releases of the stack and are submitting issues, you're a winner! Henry Pak is a Solutions Architect for Elastic based out of Los Angeles, CA. With a focus on data analytics and integration, Henry has been helping enterprises across a wide range of verticals more easily access and derive meaningful information from their data Directions: 1. Entrance to 10431 from Wateridge Circle will guide you to the parking lot 2. You'll take a set of stairs up to the building 3. The building is under construction, so you'll enter through the wooden covered area to the front entrance 4. You can take the elevator up to the 2nd floor or use the stairs by the "Hello" sign. 5. Enter through the glass doors, and someone will be there to meet you. If you have any issues with accessing the building please contact Alex at 858. [masked] x205.

  • Elastic Stack - Machine Learning


    Join us for our upcoming meetup on Thursday, August 17 at Verve. Doors open at 6pm (food & beverages will be provided), and we'll have the talk start around 6:30pm. Elastic Stack - Machine Learning Data sets keep growing in size and complexity. Spotting infrastructure problems, cyber attacks, or business issues using only dashboards or rules become increasingly difficult as your data grows. Learn how the X-Pack Machine Learning feature can model the typical behavior of your time series data in real time to identify anomalies, streamline root cause analysis, and reduce false positives using an unsupervised approach. Henry Pak is a Solutions Architect for Elastic based out of Los Angeles, CA. With a focus on data analytics and integration, Henry has been helping enterprises across a wide range of verticals more easily access and derive meaningful information from their data. Directions to the venue: From the 5 South: Exit Palomar Airport road Left on Palomar Airport Rd Right on Avenida Encinas 5600 Avenida Encinas on your left From the 5 North: Exit Cannon Right onto Cannon Immediate Left on Avenida Encinas 5600 Avenida Encinas on your right

  • Elastic Meetup with Verve


    Join us for our upcoming meetup on Thursday, February 2 at Verve. Doors open at 6pm, and we'll have the talk start around 6:30pm. Geospatial Data Analytics at scale with Elasticsearch and Apache Spark This meetup will provide instruction for getting up and running with Elasticsearch and Apache Spark for big data analysis and visualization. We will cover: • Building an optimized Elasticsearch cluster for big data and massive aggregations • Getting up and Running with Apache Spark and Zeppelin on Amazon EMR. We will cover the es-hadoop package for transporting data • New Features in Elasticsearch 5.0 Presenters: Jonathan Spooner is the Head of Innovation at Verve and has been leveraging Elasticsearch since version 1.0. Most recently when Verve couldn’t find a scalable and cost effective geospatial mapping solution they looked to their innovation team to prototype a solution. The teams prototype leveraged Elasticsearch, Apache Spark, Ruby on Rails and Inferno.js. After finding value in the prototype Verve founded a new engineering department dedicated to data visualization. Chris Miller is a Sr. Software engineer at Verve with a background ranging from startups, small businesses to large enterprises. He has been focused on building scalable web applications and reactive interfaces. Leveraging Elasticsearch along with Spark to ingest, aggregate and query large sets of data allows him to visualize the results however he wishes. In his spare time, Chris has taken to tinkering with his Raspberry Pi and Alexa. Dave Hines versed in Ruby, Javascript, Python, PHP, Go. Right now he's working on building an API to sit between a front-end JavaScript App and an Elasticsearch Datastore. His specialization/focus while working with Elasticsearch has been schema design and query generation/optimization. Directions to the venue: From the 5 South: Exit Palomar Airport road Left on Palomar Airport Rd Right on Avenida Encinas 5600 Avenida Encinas on your left From the 5 North: Exit Cannon Right onto Cannon Immediate Left on Avenida Encinas 5600 Avenida Encinas on your right

  • Elastic Meetup with ThreatSTOP


    Join us for an Elastic meetup on June 8 in the Carlsbad area, we'll have a talk from: • ThreatSTOP's Brad Sacks on "Our journey migrating our log analytics application from a SQL database to Elasticsearch - from POC to Prod." Food, beverages, and good conversation will be provided! ------------------------------------------------------------------ We'll discuss: POC phase: • The first ElasticSearch cluster: 3 Nodes, 16 GB Ram, 8 CPUs, 250GB spinning disks • Fun with analyzed strings • GC errors • Up to 32 GB Ram • Testing on AWS with SSDs Development phase: • The new cluster: 8 nodes - 3 masters, 5 data nodes, 64 GB Ram, 8 CPUs, 1TB SSDs • Better schema - no analyzed strings • Nested path aggregations Getting ready for production • Hand ringing • QA testing • Load testing (locust) Production! • How are we doing? • The state of the cluster • The performance of the reports Issues we have encountered • Where are we going from here? Brad Sacks is a Development Manager for Web and API team at ThreatStop Inc. He has primarily been working on our RESTful API, Next Generation Reporting and Web platform. Whether you're new to the Elastic Stack or an experienced user, this user group will have good, technical conversations, and offer immediately-usable tactical tips. We focus on technical tutorials and real world use cases in these meetups. So, please come ready to ask the hard questions and learn how the Elastic Stack can help you and your team! We are on the lookout for speakers, hosts, and community organizers. If you are interested in getting more involved with this user group, please reach out to us at [masked].

  • Elastic Meetup at Qualcomm


    Join us for a meetup at Qualcomm on November 18th! Our speaker line-up for the night includes, Sachin Parikh who will talk about how Illumina uses the Elastic stack, and Elastic's Antoine Girbal who will present on the new capabilities of Elasticsearch 2.0. Great conversation, food, and beverages will be provided. Elasticsearch 2.0 is hot off the press! In this talk we will take a look at the exciting new features that come with it including pipeline aggs, simplified query DSL, better compression, hardened security and durability, performance, and many more. We will also touch on updates for the rest of the stack: Kibana 4.2, Logstash 2.0, the Beats platform, and exciting new apps. Antoine Girbal is part of the Solutions Architecture team at Elasticsearch, helping users build solutions using the most innovative and advanced open source distributed search engine. He previously worked at MongoDB where he held a variety of roles since the early days of NoSQL, from core database developer to Principal Solutions Engineer. He also spent many years in the CDN industry, designing and developing some of the largest and fastest Content Delivery and Application Acceleration systems still in production today. How Illumina is using ElasticSearch for understanding and interpretation of human genomic data. Sachin Parikh is a Lead Developer at Illumina building enterprise applications for genomic analysis.

  • Meetup at Mitchell International

    Mitchell International Inc

    Join us for the September 9 meetup! We've got Xavier Lange speaking about using Elasticsearch in a corporate logging project to scale from two manually administered servers to over 20. Food and beverages will be provided. Thank you to Mitchell International for hosting! Scaling with Elasticsearch Elasticsearch has been the core of a new corporate logging infrastructure project at ViaSat, Inc., a telecommunications company based in Carlsbad, CA. This talk will go over how we scaled from 2 manually administered hosts to 20+ plus servers. We'll also go over some of the tools and techniques used to keep tabs on Elasticsearch and maintain high uptime. Xavier Lange runs a full-stack software consultancy based in San Diego, CA. His current interests are SOA architectures and implementations, scaleable storage/indexing architectures and building correct software. Building CivicArchive Jerry brings the perspective of a client in the midst of building an information-rich repository centered on Elastic technologies and focused on multiple market sectors — each with a variety of information needs. He'll discuss his current prototype, his v2 MVP, and his long-term vision how his startup will be built with Elastic at it's core. By day, Jerry Hall is a serial entrepreneur, and by night a community activist and blogger focused on public safety issues. His startup, CivicArchive (http://civicarchive.com) focuses on helping make sense of large volumes of local government meeting records from America's county, city and school district councils and boards. Sorry for the short notice, hopefully you can make it! In the future we will try to provide at least two weeks notice before an event.

  • Elastic Intro

    Location visible to members

    1st Group Meet and greet, with a quick intro to the ELK Stack. Snacks and Drinks will be provided. Looking forward to meeting everyone. One Startup's Use of Geospatial Searching with Elasticsearch Shout to Me is a San Diego startup in the process of building an audio-based social networking platform. Part of the technology includes geospatial searching so that users only receive "shouts" from other nearby users. In this talk we will see how the Shout to Me team ended up with Elasticsearch despite having an initial start and reaching subsequent limitations with a NoSQL database and a competing search index. In addition we will look at some of the actual code evolution that took place. Speaker bio: Tracy Rojas is a Developer and Co-founder of Shout to Me, an audio based social networking platform. He has worked in the San Diego software community for almost 20 years. His main expertise is in Internet based applications and services. He has worked in companies ranging from ground floor startups to large corporations. Tracy has a B.S. in Finance and an M.S.B.A. in Information Systems, both from San Diego State University. Elasticsearch at Qualcomm This talk will focus on how we use Elasticsearch at Qualcomm for engineering TEST data, and possibly touch on other cases where it is used internally.