Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Spark Optimization with Scala
Welcome
Welcome (16:09)
Scala Recap (24:47)
Spark Recap (27:10)
Spark Performance Foundations
Core (16:00)
Spark Job Anatomy (25:01)
Reading Query Plans (27:25)
Reading DAGs (21:35)
The Different Spark APIs (23:58)
Deploying and Configuring Spark Apps (27:06)
Optimizing DataFrame Transformations (Mostly Joins)
General Join Mechanics (9:01)
Joins Recap (optional) (19:22)
Broadcast Joins (19:34)
Column Pruning (22:27)
Pre-Partitioning (23:24)
Bucketing (23:53)
Skewed Joins (24:12)
Optimizing RDD Transformations (Mostly Joins)
Optimizing RDD Joins (24:38)
Cogrouping (20:30)
Broadcast Joins (14:46)
Skewed Joins (31:26)
Optimizing Key-Value RDDs
RDD Transformations (5:06)
By Key Functions (23:10)
Reusing JVM Objects, Part 1 (24:57)
Reusing JVM Objects, Part 2 (12:11)
Iterator-to-iterator Transformations (21:19)
Iterator-to-iterator Transformations - Exercises (9:40)
Epilogue
You ROCK! (0:41)
Broadcast Joins
Complete and Continue