Skip to content

Data Engineering Workshop

Photo of Roman Golovnya
Hosted By
Roman G. and Jakub J.
Data Engineering Workshop

Details

Hi All,

We would like to invite you for another informative and coding Saturday morning.

Agenda:

9:30 - 10:00 Installation, Q&A and Networking

10:00 - 11:45 Packer and Terraform - Building Cloud Environments using Python by Jakub Jarosz.

Description:
Packer is an open source tool for creating identical host images for multiple platforms (Linux, Windows).
The machines are created from a single source configuration (code).
A host image is a single static unit that contains a pre-configured operating system and installed software which is used to quickly create new running machines. Machine image formats change for each platform. Some examples include AMIs for EC2, VMDK/VMX files for VMware, OVF exports for VirtualBox, etc.
Terraform enables to safely and predictably create, change, and improve cloud infrastructure. It is an open source tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

In this mini-workshop we will create re-usable EC2 (AMI) machines and other elements of cloud infrastructure. After the workshop you will be able to create and share your working environments in an automatic fashion.

All source code used during the workshop will ba available on GitHub.

Pre-requisites for the workshop:
• Installed: Packer, Terraform, Ansible, AWS CLI
• Setup Amazon (AWS) Account (to be able to follow the workshop)

11:45 - 12:00 Break

12:00 - 12:15 Project proposal - Group coordinated access to social networks by Marc

Abstract : Most social networks propose APIs to retrieve information and automate actions. For example a couple of Python scripts contributed to my twitter audience close to 3500 followers. Alas companies restrict APIs to sell premium accesses to our data and to force us into specific usages. Would some group be interested in crafting coordinated use of APIs to enhance our impact on social networks or to unlock some barriers. I may contribute my twitter scripts but the action of the group may lead us on any social network where we find volunteers in the group to develop and share scripts.

12:15 - 12:45 Networking

Bio:
Jakub currently works for Salesforce as a System Engineer. He focuses on Python and Go development and infrastructure automation. Over last 12 years he worked for various Irish tech companies where he helped to develop test and system automation solutions.
Jakub enjoys lifelong learning and solving technical and business problems. His current interests include: cloud computing, microservices, Docker and Kubernetes.

Let Roman Golovnya know if you keen to present at this or future meetups. You can contact him via meetup messages or email roman.golovnya@gmail.com.

Photo of Data Science and Engineering Club group
Data Science and Engineering Club
See more events
Bank of Ireland Trinity branch,
Hamilton Building, Trinity Campus Dublin · Dublin