Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Spark Streaming with Scala
Prologue
Welcome (18:04)
Introduction
Scala Recap (25:05)
Spark Recap (27:10)
Spark Streaming First Principles (8:28)
Structured Streaming
Streaming DataFrames (27:16)
Streaming Aggregations (15:57)
Streaming Joins (25:23)
Streaming Datasets (26:45)
Low-Level Streaming with DStreams
Discretized Streams (DStreams) (31:56)
DStreams Transformations (28:39)
DStreams Window Functions (32:10)
Spark Streaming Integrations
Kafka & Structured Streaming (25:07)
Kafka & DStreams (29:56)
JDBC with Postgres (11:50)
Akka and Akka Streams (28:57)
Cassandra (21:54)
Twitter Sentiment Analysis
Setting up a Twitter App (8:15)
Our First Custom Receiver (15:44)
Reading Tweets (20:04)
Reading Tweets: Exercises (15:21)
Sentiment Analysis on Tweets using NLP (20:49)
Advanced Spark Streaming
Event Time Windows (31:19)
Event Time Windows: Exercises (14:53)
Processing Time Windows (11:15)
Watermarks (25:15)
Watermarks, Part 2 (25:21)
Arbitrary Stateful Computation (25:39)
Arbitrary Stateful Computation (16:35)
The Science Project
Setting up the REST Server and the Kafka Broker (27:50)
Integrating Spark Structured Streaming, Test, Run! (33:53)
Epilogue
You Rock! (0:30)
DStreams Transformations
Complete and Continue