#ThinkBigActFaster Hackathon - Fast Big Data/Hadoop/Cloud (Real-Time) Apps
Details
Details :
Intended audience : Data engineers, Folks interested in learning big data applications development.
Pre-requisite : Prior knowledge about hadoop, big data ecosystem will be useful.
Agenda :
Morning session -
Basics about the Apache apex platform, How to build your custom big data app using pre-existing libraries.
Afternoon - evening session -
Participants will form groups of 3-4 and develop their own apps for real time big data processing pipeline.
Participants can come up with their own theme/problem statement for app development. DataTorrent team will give some sample problem statements for reference.
Snacks/lunch will be sponsored by the organizers.
Attractive prizes for winners and T-shirts for all the participants!
Entry FREE!
Prior registration required. Please RSVP on the meetup page for this event.
Speakers :
Tushar Gosavi - Engineer at DataTorrent, Committer at Apache Apex
Yogi Devendra - Engineer at DataTorrent, Committer at Apache Apex
Francis Fernandes - Engineer at DataTorrent, Contributor at Apache Apex
Apex and DataTorrent RTS is being actively used in use cases relating to Big Data, Cloud, IOT, CyberSecurity, Real-Time Anomaly detection, etc. This conf will help us understand how Apex can be used in these use cases.
To reduce time to market and total cost of ownership, look at operable solutions factory (https://www.datatorrent.com/apphub/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links) - that you can quickly import and launch. Examples: HDFS to HDFS (https://www.datatorrent.com/apphub/hdfs-sync/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links) & HDFS-Line-Copy (https://www.datatorrent.com/apphub/hdfs-to-hdfs-line-copy/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links) (back-up, replication, disaster-recovery, distcp replacement); Kafka to HDFS (https://www.datatorrent.com/apphub/kafka-to-hdfs-sync/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links) (ingest, transform); S3 to HDFS (https://www.datatorrent.com/apphub/s3-to-hdfs-sync/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links) (cloud to on-prem); HDFS to Kafka (https://www.datatorrent.com/apphub/hdfs-to-kafka-sync/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links) (data lake to event stream, big data log streaming); Database to HDFS (https://www.datatorrent.com/apphub/?utm_source=meetup&utm_medium=meetup_links&utm_campaign=links_in_description#/com.datatorrent.apps/database-to-hdfs) (db offload); Database to Database (https://www.datatorrent.com/apphub/?utm_source=meetup&utm_medium=meetup_links&utm_campaign=links_in_description#/com.datatorrent.apps/database-to-database-sync) (change data capture, customer 360); Kafka to Database (https://www.datatorrent.com/apphub/?utm_source=meetup&utm_medium=meetup_links&utm_campaign=links_in_description#/com.datatorrent.apps/kafka-to-database-sync) (ingest, transform & load); Kinesis to S3 (https://www.datatorrent.com/apphub/#/com.datatorrent.apps/kinesis-to-s3) (Cloud ingest, transform, & load).
Templates include ability to parse, error check, transform, and act on before loading. Additionally, You can add/modify your custom logic on transform, alerts, and actions. Templates include real-time dashboarding for instant views and historical views.
Free DataTorrent Enterprise Edition for qualifying startups. Check it out (https://www.datatorrent.com/products-services/start-up-accelerator/?utm_source=meetup&utm_campaign=links_in_description_startup_accelerator&utm_medium=links)!
Free DataTorrent Enterprise Edition for Universities. Check it out! (https://www.datatorrent.com/university-incubator/?utm_source=meetup&utm_medium=links&utm_campaign=links_in_description_university_incubator)
Brought to you by DataTorrent (https://www.datatorrent.com/?utm_source=meetup&utm_campaign=links_in_description&utm_medium=meetup_links), creators of Apache Apex.