Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Spark Performance Tuning with Scala
Warmup
Welcome & Setup (17:06)
Scala Recap (24:47)
Spark Recap (27:10)
Foundation
Core (16:00)
Spark Job Anatomy (25:01)
Query Plans (27:25)
The Spark UI and DAGs (21:35)
A Tale of Two Spark APIs (23:58)
Deploying & Configuring Spark Applications (27:06)
Catalyst (19:10)
Tungsten (16:50)
Memory, Caching and Checkpointing
Executor Memory Architecture (5:31)
Caching (28:33)
Checkpointing (21:14)
Partitioning
Repartition & Coalesce (11:05)
Partitioning Problems (22:32)
Shuffle Partitioning (10:10)
Custom Partitioners (25:45)
Performance Tuning, Problems and More
Optimizing Cluster Resource Allocation (18:37)
Fixing Data Skews and Straggling Tasks (29:37)
Serialization Problems, Part 1 (22:06)
Serialization Problems, Part 2 (12:36)
Kryo (17:35)
Epilogue
You ROCK! (0:41)
Repartition & Coalesce
Complete and Continue