Scale your Python Code with PySpark in Apache Spark

Abstract:

In this session, you will learn how to leverage PySpark to scale up your data analysis using Apache Spark. Spark is a massively parallel processing system that's gaining popularity for everything from data engineering to machine learning. We will learn how to use Databricks and PySpark to interact with the Spark API for fast and scalable data processing. Whether you are a Python expert or a newbie, the PySpark dialect is very easy and useful to learn!

Speaker Bio:

Colby Ford, Ph.D., is a three-time alumnus of UNC-Charlotte, having completed an undergraduate degree in Mathematics, a master's in Data Science, and a Ph.D. in Bioinformatics and Computational Biology. Colby currently splits his time between working in the Department of Bioinformatics and Genomics here at UNCC in human genomics and infectious diseases and as an artificial intelligence consultant, creating Microsoft Azure cloud-based machine learning and data platform solutions for organizations across the US. He also teaches the Cloud Computing for Data Analysis graduate course for the Data Science Initiative. Colby currently resides in the Southpark area of Charlotte.

Venue Sponsor:

A huge thanks to UNC Charlotte - Data Science Initiative https://dsi.uncc.edu for hosting us!

Event Parking:

There are a number of pay-to-park options within walking distance of Center City. Seventh Street Parking Deck is a short walk through First Ward Park. Visitors can pay to park by the hour. Additional pay-to-park options can be found on the Preferred Parking website. The closest of these is 422 E 9th Street on the corner of 9th and Brevard Street. Other
nearby lots are at 8th & College, 9th & College, and 9th & Tryon. There are metered spaces on Brevard and 8th Street to pay during the day. These meters are free after 6 pm weekdays and all day on weekends.

Light Rail:

Visitors are encouraged to take advantage of light rail options when visiting Center City. Center City is a half a block from the 9th Street Station. Free parking is available at nine of the eleven light rail Park and Ride locations. Sugar Creek Station and Scaleybark Park and Ride locations are the closest to 9th Street Station. Standard CATS rates apply.

Contact:

For questions about this meetup, please message through the Meetup site or email contact@pydatacharlotte.com