Name: A Data Engineer trying to do something actually useful with GenAI
Start: 2025-05-24T10:30:00+05:30
End: 2025-05-24T12:30:00+05:30
Location: Equal Experts India Pvt Ltd

As a Data Engineer, you're likely familiar with the buzz around Generative AI (GenAI) and its potential to revolutionize data processing and analysis. But how can you actually leverage GenAI to drive tangible business value? Here is a fellow data engineer trying to unlock practical, on-the-job value with Generative AI in our field (This goes beyond replacing Stackoverflow and google with ChatGPT)

This talk and the demos are based on open or local LLMs and using your regular dev tools. The session aims to get the audience familiar with general concepts on GenAI, followed by application of these concepts and frameworks for data operations. In the end we will talk about the big question - how to (and do have to) actually productionise data systems using Gen AI.

**Talk Outline:**

**Introduction to LLMs (10 minutes)**

* Overview of all the concepts and buzzwords from a fellow lay-engineer
* Suggestions (opinionated) on the best tools and frameworks for local development

**Data Operations / Day in the life of a DE (5 minutes)**

* Data acquisition
* Data modelling
* Reporting
* Building Data pipelines
* Quality check on data and pipelines
* Governance

**How can LLMs help (20 minutes)**

* Generating synthetic data
* SQL and structuring
* Visualizations
* Analysis
* Quality checks and testing

**Challenges and future work (5)**

* New(er) kids on the block
* Building real world products - tests, scale and monitoring
* Are we as DE replaceable by AI?

Tanay Prabhudesai

Prathap RV

Prasanth

ExpertTalks Bengaluru

ExpertTalks

Technology

Java

Open Source

Software Development

Extreme Programming

JavaScript

Web Development

Functional Programming

Test Driven Development

Knowledge Sharing

Behavior-Driven Development

Technology Startups

MongoDB

Refactoring

Clean Code

Artificial Intelligence

Aastha is a Senior Data Engineer in Equal Experts. She has 12+ years of experience in software development after having graduated in Computer Science Engineering in 2012 from NIT Allahabad. Over the course of her career she has worked across multiple aspects of software systems like building data systems from scratch to scale, MLOps, backend and also working for a bit in SRE and Machine Learning. She has worked with many early age startups  giving her a good learning on building things from scratch, and also in crash, burn and firefighting. She has also worked in larger setups like Yelp where she led the project on data observability and in Microsoft where she was one of the engineers working on the knowledge graph that Bing used for its search results. On the side, she is keen on learning about new open source systems.

Aastha Rai

A Data Engineer trying to do something actually useful with GenAI

Equal Experts India Pvt Ltd

Share

ExpertTalks Bengaluru

A Data Engineer trying to do something actually useful with GenAI

ExpertTalks Bengaluru

Details

Members are also interested in