Instructor-Led Spark Hackathon

  • 24 hours of instructor-led Hackathon including 7.5 hours of presentations and demos
  • Hands-on learning of development, test and deployment of scalable applications.
  • Learn main features of the latest version of Spark
  • Follow-ups are included
1 instructor per 7 students 70% of time is spent on challenges2 End-to-end projects

Main Objectives

Fundamentals
Why use distributed computing.
Overview Apache Spark and Mapreduce
Main Functionality
RDDs
DataSets
Actions
Main Functions
Spark SQL
Use of Spark SQL in combination with Python and Java
Working with Data
Use of JSON, Parquet, Avro to do complex transformations and joins
Streaming
Spark Streaming
Structured Streaming
Deployment and Troubleshooting
Sbt, CI tools and different types of deployments

Duration

Three days

Requirements

Basic knowledge of Java, Scala or Python is required.

Topics Covered

  • Overview of Distributed Computing
  • Overview Apache Spark
  • Comparison of Spark with MapReduce
  • Partitioning in Spark
  • Working with RDDs
  • Actions in Spark
  • Aggregations
  • Using DataFrames
  • DataSets
  • Broadcast variables
  • Working with CSV, JSON, Parquet
  • Useful functions
  • Overview
  • Windowing Operation
  • Sbt
  • Deployment Using CI Tools
  • Spark vs Alternatives
  • Deployment Strategies
  • Troubleshooting

Register for Public Hackathon

Private

Contact Us to schedule a hackathon at your company.

Related Courses

Apache Hadoop for IT and Business
Python Basics
Data Exploration and Statistics

Why Our Hackathon?

Get Hands-on Skills

1/3 of the time is spent on lectures
2/3 is spent practicing!

Get Help

Several helpers are ready to assist anyone who is stuck at a challenge, not sure where to start or has other questions . The head instructor provides guidance to the participants, explains the main concepts.

Online or In-Person

We run both online and in-person hackathons. The material doesn’t change, the challenges are the same. We can adjust the hours for the online hackathon to make sure that everyone is actively engaged.

Learn more about how we’re different

Multiple Locations

We run hackathons in Canada, US and Mexico. Recent locations:

Canada

  • Toronto
  • Montreal
  • Vancouver
  • Calgary

US

  • New York
  • Washington
  • Houston
  • Salt Lake City

Certificate

Every participant gets a verifiable certificate at the end of the hackathon.

Follow-Ups

One follow-up for every day of hackathon is included. It will help you with setting up best practices in the team and refreshing your knowledge. We will also answer any of your questions.

Hackathon Schedule

Hackathon is a full day event. It runs from 8:30 to 5 with a break for lunch. Usually 1 to 2:30 hours is spent on lectures, the rest of the day is devoted to challenges.

No Installation Required

Challenges are done using our environment. Participants only need a computer with a browser.

Other Hackathons

Please check available hackathons page