November Meetup: Hadoop Security

I know--it's a Friday, but we have a special guest in town.

And there will be beer. So think of it as a thinking nerd's happy hour... ;-)

Protecting Hadoop data at rest with HDFS encryption, Eddie Garcia, Cloudera

Data encryption is a requirement for many business sectors dealing with confidential information, such as finance, healthcare, and government. To meet these requirements, transparent, end-to-end encryption was added to HDFS. Once configured, data read from and written to certain HDFS directories is transparently encrypted and decrypted without requiring any changes to user application code. This encryption is also end-to-end, meaning that data is protected both in-flight and at-rest, and can only be encrypted and decrypted by the client. This improves security since HDFS itself never handles unencrypted data or data encryption keys.

During this talk, we will cover the design, implementation, and usage of transparent encryption in HDFS.

Building a Data Lake on AWS, Jonathan

Key concepts for a data lake and present aspects related to its implementation. We will discuss critical success factors, pitfalls to avoid as well as operational aspects such as security, governance, search, indexing and metadata management. We will also provide insight on how AWS enables a data lake architecture.