Building Data Pipelines with PySpark
Free Beginner course · 10 lessons · 2 weeks · Certificate on completion
Write your first production-style batch pipelines in PySpark, step by step. Across 10 lessons you'll move from fundamentals to a portfolio-ready outcome — at your own pace, with quizzes after each lesson and a final exam to certify your mastery.
What you'll learn
- Setting up PySpark locally
- Reading CSV, JSON and Parquet
- Selecting, filtering, aggregating
- Window functions
- User-defined functions and their cost
- Handling nulls and bad records
Skills you'll pick up
- Setting up PySpark locally
- Reading CSV, JSON and Parquet
- Selecting, filtering, aggregat
- Window functions
- User-defined functions and the
- Handling nulls and bad records
Tools covered
- PySpark
- Real-world projects
- Quizzes
- Final exam
Course modules
Module 1: Setting up PySpark locally
Module 1 of Building Data Pipelines with PySpark. 3 lessons · 3h
Module 2: Window functions
Module 2 of Building Data Pipelines with PySpark. 3 lessons · 3h
Module 3: Writing partitioned output
Module 3 of Building Data Pipelines with PySpark. 2 lessons · 2h
Module 4: Scheduling a daily job
Module 4 of Building Data Pipelines with PySpark. 2 lessons · 2h
Lessons in this course
- Setting up PySpark locally
- Reading CSV, JSON and Parquet
- Selecting, filtering, aggregating
- Window functions
- User-defined functions and their cost
- Handling nulls and bad records
- Writing partitioned output
- Testing PySpark code
- Scheduling a daily job
- Project: clickstream pipeline
Instructor
Sofia Lindqvist — Analytics Engineering Lead
Sofia Lindqvist is a Analytics Engineering Lead with years of hands-on experience teaching PySpark to thousands of learners worldwide.
Certificate
Finish every lesson and pass the final exam to earn a free, verifiable Learnera certificate for Building Data Pipelines with PySpark. It can be downloaded as a PDF and shared on LinkedIn.
Career outcomes
Median global salary $120,000 per year · median India salary ₹16,80,000 per year · 77,351 open roles worldwide
- PySpark Specialist
- Senior PySpark Lead
- PySpark Consultant
Frequently asked questions
Is the Building Data Pipelines with PySpark course free?
Yes. Every Learnera course, including Building Data Pipelines with PySpark, is completely free — lessons, quizzes, the final exam, and the certificate.
How long does Building Data Pipelines with PySpark take?
10 lessons, typically completed in 2 weeks at a comfortable pace.
Do I get a certificate?
Yes — pass the final exam and you receive a free, verifiable certificate you can share on LinkedIn.