OTel Collector for Log Collection + Elasticsearch in the United States House

Join us at Plug and Play Tech Center on Wednesday, May 15th, for a Silicon Valley Elastic User Group meetup. We'll have presentations from Ari Hershowitz and Shaunak Kashyap (Engineer at Elastic), followed by networking, light bites, and refreshments.

Date and time:
Wednesday, May 15th, from 5:30 - 7:30 pm PDT

Location:
Plug and Play Tech Center - Silicon Valley Room
440 N Wolfe Rd, Sunnyvale, CA 94085

Arrival Instructions:
Attendees will need to check in at the Plug and Play lobby upon arrival.

Agenda:

• 5:30 pm: Doors open; say hi, grab a seat, and eat some food.
• 6:00 pm: Elasticsearch in the United States House - Ari Hershowitz
• 6:30 pm: Exploring the OTel Collector for log collection - Shaunak Kashyap (Engineer at Elastic)
• 7:00-7:30 pm: Networking & refreshments
• 7:30 pm: Event ends

Talk Abstracts:

Elasticsearch in the United States House - Ari Hershowitz

The Parliamentarian of the United States House stores more than two hundred years of precedents. These were written down on index cards and eventually transferred to SQL Server. The search was done with a SQL query, and -- even though there are only a few thousand records -- it could take up to a minute to retrieve a result. We built a customized user interface and index using Elasticsearch, that brought down search latency to milliseconds. As an application, it is pretty run-of-the-mill. But it wholly transformed the workflow in the office and allowed the Parliamentarian to do much more extensive research than before on their records. There are small applications like this throughout government, where indexing alone can make a big difference. I'll discuss this opportunity, and the challenges of building a custom UI and facets for the Parliamentarian and similar use cases.

Exploring the OTel Collector for log collection - Shaunak Kashyap (Engineer at Elastic)

Recently, my colleague Christos Markou (https://github.com/chrsmark) and I (https://github.com/ycombinator) began evaluating the OpenTelemetry Collector for log collection. Join me as I delve into our findings and the collaborative efforts underway within the OpenTelemetry community to enhance the Collector's robustness and user-friendliness in collecting and shipping logs.

Speaker Bio:
Shaunak Kashyap (Engineer at Elastic)

Shaunak Kashyap, a backend software developer with over two decades of experience, has crafted diverse projects: from a poker search engine, to tracking jail populations, and controlling earth-imaging satellites.
Currently at Elastic, he's on the Ingest team, focussing on the Elastic Agent and Beats products. Shaunak recently started getting involved with the OpenTelemetry community, and seeks to deepen his contributions.