Articles tagged with 'spark'
ALL the Joins in Spark DataFrames
7 min read • • Explanation
Spark supports more types of table joins than you might expect: discover the different join options in this article
Founder | Rock the JVM
Broadcast Joins in Apache Spark: An Optimization Technique
7 min read • • Explanation
Broadcast joins in Apache Spark are a highly effective technique for boosting performance and avoiding memory issues, offering great value for optimization
Founder | Rock the JVM
Comparing Akka Streams, Kafka Streams and Spark Streaming
14 min read • • Guide
Explore how Akka Streams, Kafka Streams, and Spark Streaming stack up and find out which one is best for your use case
Founder | Rock the JVM
Compile-time data contracts in Scala 3
38 min read • • Guide
Build Scala compile-time data contracts with macros, TypeInspector patterns, and policy-driven validation so schema drift fails at compile time instead of midnight in production
Repartition vs Coalesce in Apache Spark
5 min read • • Explanation
Clarifying the differences between two essential repartitioning operations in Apache Spark
Founder | Rock the JVM
Streaming Analytics with Apache Pulsar and Spark Structured Streaming
13 min read • • Explanation
Explore Apache Pulsar's role in event streaming and computing: discover practical use cases and learn when to integrate advanced computing engines for sophisticated stream processing
Founder | Rock the JVM
Understanding Spark DAGs (Directed Acyclic Graphs)
6 min read • • Guide
Discover the essential skill for optimizing Spark performance: mastering the Spark UI and understanding the job execution graph
Founder | Rock the JVM
Understanding Spark Query Plans
6 min read • • Guide
In this article, you'll learn one of the most important Spark skills: reading how your job will run, which is foundational for any further Spark optimization
Founder | Rock the JVM