Name: Better Together: Elasticsearch and the Dremio Lakehouse
Start: 2024-06-07T00:30:00.000Z
End: 2024-06-07T02:30:00.000Z
Location: Dremio Corporation

🚀 **Welcome to Elastic Observability Day!** 🚀

Join us for an exhilarating day of exploration into the world of observability with industry experts and practitioners. Discover how the Elastic Stack empowers you to unlock unprecedented insights, streamline log analysis, bolster security measures, and elevate your observability practices to new heights.

**NOTE:**
We have already rolled out the confirmations for this event.
To clarify, I kindly request you to check your RSVP status on meetup.com for the most accurate information.
**If your status is ‘Going’, then please consider this as your confirmation for the event.**
**However, if your status is ‘Not Going’, then unfortunately, you have not been confirmed for the event.**

**Agenda:**

**Session 1: Exploring the ELK Stack with KQL & Simplified Log Analysis, and Security & Alert**

* **Speaker:** Nikita Shinde, DevOps Engineer at Jio
* **Time:** 11:15 AM - 12:00 PM
* **Topic Description:** Dive deep into the implementation of the ELK (Elasticsearch, Logstash, Kibana) Stack with Nikita Shinde. Learn how to harness the power of KQL (Kibana Query Language) for smart log data querying and gain unique insights. Explore crucial security aspects such as role-based access control and proactive alerting mechanisms, all while witnessing live demos on effective logging setup. Gain practical techniques through hands-on demonstrations to optimize observability and fortify security within your infrastructure.

**Session 2: Elastic Observability Maturity Model**

* **Speaker:** Nachiket Vartak, Consulting Architect at Elastic
* **Time:** 12:00 PM - 12:45 PM
* **Topic Description:** Embark on a journey towards observability maturity with Nachiket Vartak. Assess your organization's current observability practice and understand the key components of a mature observability model. Delve into the people, process, and technology considerations necessary for achieving observability excellence. Gain insights into defining a roadmap tailored to your organization's unique needs, guiding you towards a mature observability practice that fuels innovation and operational efficiency.

**Session 3: OpenTelemetry with Elastic Observability**

* **Speaker:** Ashish Tiwari, Senior Developer Advocate at Elastic
* **Time:** 12:45 PM - 1:30 PM
* **Topic Description:** Unlock the full potential of observability with Ashish Tiwari as he explores OpenTelemetry integration with the Elastic Stack. Discover how OpenTelemetry provides a standardized approach to instrumenting applications with a unified telemetry format. Witness firsthand how Elastic seamlessly integrates OpenTelemetry data into its open and extensible Elasticsearch platform. Learn how to leverage Elastic's powerful analytics and visualization capabilities at scale by pulling in logs, metrics, and traces across multiple languages, empowering you to achieve unparalleled observability insights.

**Session 4: Continuous Monitoring with Elastic: Beyond Logs and Metric**

* **Speaker:** Mangesh Jadhav, Sr. Technical Engineer at Ashnik
* **Time:** 1:30 PM - 2:15 PM
* **Topic Description:** Join Mangesh as he takes you on a journey through the world of continuous monitoring with Elastic. Discover how to go beyond traditional logs and metrics to gain a comprehensive view of your system’s performance. Learn about the advanced features of Elastic that allow for real-time monitoring and analysis. Through hands-on examples, understand how to effectively use Elastic to monitor your infrastructure, identify potential issues, and ensure optimal system performance. This session promises to equip you with practical knowledge and techniques to enhance your monitoring capabilities.

**Networking & Lunch**

* **Time:** 2:15 PM - 3:00 PM
\- Engage in interactive networking sessions with fellow attendees and speakers\. Pose your burning questions\, share insights\, and collaborate to deepen your understanding of observability practices and Elastic solutions\.

**Location:** Microsoft Office, Mumbai

Don't miss this opportunity to revolutionize your observability journey! Reserve your spot now and embark on a path towards enhanced visibility, security, and operational excellence. Let's unlock the full potential of observability together! 🌟

Mumbai Elastic User Group

Abhishek Sharma

Ashish Tiwari

Nilesh Shinde

Elastic Observability Day Mumbai

Microsoft Corporation India Private Limited

The Elastic Seattle User Group is kicking off Microsoft Build with a meetup on **Monday, May 20!** We will have presentations by Anahita Afshari (Cloud Solution Architect at Microsoft) and Hemant Malik (Senior Principal Solutions Architect at Elastic), followed by networking, refreshments, and pizza.

**Date and time:**
Monday, May 20th, from 5:30 - 7:30 pm PDT

**Location:**
2505 3rd Ave Suite 324, Seattle, WA 98121

**Arrival Instructions:**
The venue is locked to the public, so please arrive on time, as we'll have a team member letting in guests at the start of the meetup. If you arrive late, we'll leave a sign with a phone number to call/text for access.

**Directions & Parking:**

* Metered street parking
* Book a parking spot with [SpotHero](https://spothero.com/search?kind=address&latitude=47.6160177&longitude=-122.3477292&search_string=2505+3rd+Ave+%23324%2C+Seattle%2C+WA+98121%2C+USA&view=dl)

**Agenda:**

* 5:30 pm: Doors open; say hi, grab a seat, and eat some food.
* 6:00 pm: Boost Developer Productivity: Streamlining Generative AI with Elastic & Azure's OpenAI Integration with Anahita Afshari (Cloud Solution Architect at Microsoft) and Hemant Malik (Senior Principal Solutions Architect at Elastic)
* 6:45-7:30 pm: Networking & refreshments
* 7:30 pm: Event ends

🎤 **Talk Abstract:** Boost Developer Productivity: Streamlining Generative AI with Elastic & Azure's OpenAI Integration

Anahita Afshari (Cloud Solution Architect at Microsoft) and Hemant Malik (Senior Principal Solutions Architect at Elastic) - will share invaluable details about integrations with Artificial Intelligence. Learn about new features and stay relevant in an era of rapid technological evolution.

Elastic Seattle User Group

Elastic Meetup Team

Harry

Venson Shaw

Streamlining Generative AI with Elastic & Azure's OpenAI Integration 

2505 3rd Ave suite 324

Meet us for a Göteborg User Group Meetup at Recorded Future! Doors open at 17.15 and the presentations begin at 17.45. Food, refreshments and networking to follow.

**Address:** Recorded Future's office, Hvitfeldtsplatsen 7, 411 20 Göteborg

**Agenda:**
17.15 Doors open, food, networking and drinks
17.45 Exploring Vector Search: Unleashing the Power of Elasticsearch
18.15 Getting to the root cause quicker: AI Ops in Elastic Observability
18.45 Break
19.00 Your Cluster is Slow. Now What?
19:30 Networking

**Talks:**
**Exploring Vector Search: Unleashing the Power of Elasticsearch**
Unleashing the Power of Elasticsearch: See How Elasticsearch's Vector Search makes finding similar Images faster and more accurate to unleash the power of data!

*Speaker: Pragya Singh, Software Engineer, Analytics*

**Getting to the root cause quicker: AI Ops in Elastic Observability**
Learn how the power of search and machine learning are helping our customers' Observability teams.

*Speaker: Stuart Moorhouse, Senior Solution Architect @Elastic*

**Your Cluster is Slow. Now What?**
Usually, your Elasticsearch cluster runs fine, but every once in a while, it turns into a slow mess that takes what feels like a year to respond to /_health.

In this scenario, you probably want to look under the hood of your cluster. What is it doing? Have the queries clogged up some virtual pipe? Probably yes.

But where to look?

Do you take a peek at the slow query logs?
Consider the profile option for queries?
How are the disks spinning (hopefully not at all with SSDs)?
Can the JVM tell us anything? What is this Flight Recorder thing, anyway?
How intimidating is the Elasticsearch and Lucene source code?

Let's learn what to look at, and how you can assist your cluster and make it happy!

*Speaker: Anton Hägerstrand, Founder at Blunders.io*

*A big thank you to the host for this evening, Recorded Future!*

Elastic Göteborg User Group

Simone Sciarrati

Rohan Goel

Elastic meetup @ Recorded Future

Recorded Future

Join us on **Thursday, May 30th** for a new meetup with the **Elastic Helsinki User Group** in **collaboration with our partner Nordicmind**!

We'll meet each other at Putte's Pizza again: doors open at 17.30 and the presentations begin at 18.00. Pizza's, refreshments, and networking to follow. We wrap up at 20.30.

**Address:** Putte's Bar & Pizza (downstairs), Kalevankatu 6, Helsinki

**Agenda:**
17.30 Doors open
18\.00 Talk \#1 Elasticsearch Query Language \(ES\|QL\)
18\.45 Talk \#2 Operationalizing ES\|QL for security use cases
19:15 Q&A
19.30 Networking, pizza and drinks
20.30 Wrap up

**Talks:**
**Elasticsearch Query Language \(ES\|QL\)**
Elasticsearch and Kibana added a new query language: ES\|QL — coming with a new endpoint \(_query\) and a brand new syntax\. It let's you refine your results one step at a time and adds new features like data enrichment and processing right in your query\. And you can use it across the Elastic Stack — from the Elasticsearch API to Discover and Alerting in Kibana\. But the biggest change is behind the scene: Using a new compute engine that was built with performance in mind\.

Join us for a quick overview and look at syntax and internals.

*Speaker:* *Anna-Maria Modee (Sr. Solutions Architect, Elastic)*

**Operationalizing ES\|QL for security use cases**
This talk will focus on how you can make use of ES\|QL in the Elastic security solution\. Particularly\, we will focus on how you can use ES\|QL to:

1. Create detection rules
2. Execute investigations via timeline
3. Threat hunt for indicators of compromise

The talk will also include a demo of how you can use the Elastic AI assistant to generate ES\|QL queries for example security use cases\.

*Speaker:* *Marvin Ngoma (Sr. Security Architect, Elastic)*

Elastic Helsinki User Group

Dhaivat Dave

Muhammad Azhar Munir

Elasticsearch Query Language (ES|QL) | Elastic & Nordicmind meetup

Putte's Bar and Pizza

Join us on **Thursday, June 6th**, for a Silicon Valley Elastic User Group meetup with Dremio. Alex Merced (Developer Advocate at Dremio) and Sherry Ger (Principal Customer Enterprise Architect at Elastic) will give presentations, followed by networking, light bites, and refreshments.

**Date and time:**
Thursday, June 6th, from 5:30 - 7:30 pm PDT

**Location:**
Dremio Office: 3970 Freedom Cir #110, Santa Clara, CA 95054

**Agenda:**

* 5:30 pm: Doors open; say hi, grab a seat, and eat some food.
* 6:00 pm: Better Together: Elasticsearch and the Dremio Lakehouse - Alex Merced (Developer Advocate at Dremio)
* 6:30 pm: Building blazing fast customer search experience with Elasticsearch and self hosted Foundation Model - Sherry Ger (Principal Customer Enterprise Architect at Elastic)
* 7:00-7:30 pm: Networking & refreshments
* 7:30 pm: Event ends

**Talk Abstracts:**

*Better Together: Elasticsearch and the Dremio Lakehouse* \- Alex Merced \(Developer Advocate at Dremio\)

The synergy between Elasticsearch and the Dremio Lakehouse emerges as a transformative approach for analytics. This talk, titled "Better Together: Elasticsearch and the Dremio Lakehouse," delves into the innovative integration of Elasticsearch as a dynamic source within Dremio’s platform. By harnessing Elasticsearch's powerful search capabilities alongside Dremio’s efficient data lakehouse architecture, organizations can achieve a seamless, high-performance analytics environment.

The integration supports Elasticsearch versions 6.x and 7.x, with Dremio. This collaboration enables users to plan and execute queries efficiently by leveraging Elasticsearch’s rich metadata, including dataset discovery and details for enhanced query planning and execution.

Furthermore, Dremio’s elastic connector provides a user-friendly perspective of Elasticsearch indices and mappings, simplifying data access and analysis.
Key highlights include exposing data through Elastic aliases, support for synthetic tables via wildcards, and the parallelization of queries to optimize data retrieval speeds.

The talk will cover Dremio’s list promotion rules, special handling for geoshape data types, and how it maintains mapping consistency through schema learning and automatic discovery of new fields. Additionally, we will explore the extensive pushdown capabilities that allow for efficient query execution directly in Elasticsearch, reducing data movement and accelerating insights.

This session aims to provide attendees with practical knowledge on configuring and optimizing the Elasticsearch source within Dremio, ensuring a unified and efficient analytical platform. We will also touch on the technical considerations for integrating Elasticsearch with Dremio, including configuration specifics, debugging, logging, and working with Elasticsearch and x-pack.

By the end of the talk, participants will be well-equipped to leverage the combined strengths of Elasticsearch and Dremio, creating a robust foundation for their data lakehouse analytics endeavors.

*Building blazing fast customer search experience with Elasticsearch and self hosted Foundation Model* \- Sherry Ger \(Principal Customer Enterprise Architect at Elastic\)

While GenAI services have exploded in popularity, many users are hesitant to adopt them due to privacy, security concerns, and the high cost. Open source LLMs offer a compelling alternative, showcasing impressive capabilities.

In this talk, we will explore:

1. Set up and run open source foundation model locally
2. Use a foundation model and Elasticsearch to extract knowledge, build blazing fast retrieval, and perform data analytics from unstructured text.

Elastic Silicon Valley User Group

Sandeep

Manoj Jha

Better Together: Elasticsearch and the Dremio Lakehouse

Dremio Corporation

Elastic

{networkName}を検索する

グループ

{PRO_NETWORK_NAME}はMeetup Proに登録しており、世界中の{PRO_GROUP_COUNT}のMeetupで{PRO_MEMBER_COUNT}人以上のメンバーが参加しています。Meetup Proは、ユーザー、パートナー、コントリビューター、メンバーのネットワークを管理できるプロフェッショナルなコミュニケーションツールです。

We’re delighted to have you join the Elastic global community!

This group is for anyone interested in making data usable in real-time and at scale for use cases like security, observability, enterprise search, and many more, using our Elasticsearch, Kibana, Logstash, and Beats products (https://www.elastic.co/products/).

Elastic

Elastic Fantastics

Elastic

私たちについて

Elasticを検索する

今後のイベント

グループ