REMOTE BBC Tech Meetup - Doing data right for the BBC, Elasticsearch, BQ logs
Details
May's BBC Tech Meetup has a data theme. Join us on 13th May, from 6pm.
Speakers:
# Doing Data Right for The BBC (and everyone else) – Bill Thompson and Rhianne Jones – @billt and @reejo1
Effective use of data is at the heart of the BBC’s plans for making the most of the opportunities the internet offers. However, if we don’t put responsibility and ethics at the forefront, we also run the risk of acting in ways that do not reflect BBC values. We have been exploring what people expect from trustworthy services, and how to deliver them using personal data store technologies.
Bill Thompson is head of public value research in BBC Research & Development where he leads research into ways the BBC can deliver additional value to audiences and society. He appears regularly on Digital Planet on World Service radio.
Dr Rhianne Jones leads a programme of research in BBC Research & Development focused on responsible development and use of data-driven media technology and the impacts for people, communities and society.
# Demystifying the Elasticsearch - Madhusudhan Konda – @mkonda007
Elasticsearch is a de-facto standard in search and analytics. Its near-realtime search, analytic offerings and top class advanced features are mind-blowing. Having a solid understanding of Elasticsearch is surely a must-have career changing skill! A feather in your IT cap!
You will learn:
- Overview of Elastic Stack
- Fundamentals of Elasticsearch,
- Architecture and APIs
- Creating and managing Indices
- Search and aggregations
- And more!
# BQ-Logs: Making over 2 billion access log lines per day queryable – Neil Craig – @tdp_org
When I started working at the BBC, we wrote all our website access logs to a storage bucket as raw log files. Using the logs in this form was unbelievably frustrating, slow and error-prone but we had no staff available to build anything better, so I did it myself. To cut a long story short, we now have a 100% automated, highly-scalable, low-latency, low-cost log processing pipeline which gives us the ability to query our access logs via SQL.
Neil is Lead Architect in BBC Distribution, focussing on website traffic management and supporting technologies.
__________________________________________________________________
The event will be streamed live on YouTube and questions can be asked throughout via sli.do - go to https://app.sli.do and enter the code #BBCTechMeetup.
RSVP is open! Sign up now if you'd like to join.
This meetup is kindly sponsored by BBC iPlayer & BBC Sounds (BBC Design + Engineering).
Interested in working with us? Take a look at the current vacancies at https://bbc.in/hiring
Find out more about our meetups, including our Code of Conduct, on the BBC website - https://bit.ly/bbc-tech-meetup
Disclaimer: views and opinions expressed by speakers, including the content of their talks, are their own and do not necessarily reflect the position of the BBC.
All comments on this event page must adhere to the aforementioned Code of Conduct.
