// the find
databricks/LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
The companion code repository for the O'Reilly book 'Learning Spark, 2nd Edition' by Databricks engineers. It contains chapter-by-chapter Scala and Python examples covering Spark SQL, Structured Streaming, MLlib, and Delta Lake. This is a book supplement, not a library — its value is entirely tied to whether you're reading that specific book.
The examples cover both Scala and Python side-by-side for most chapters, which is genuinely useful for teams working in mixed environments. The structured streaming and Delta Lake chapters reflect real Databricks production patterns, not toy examples. A build script (`build_jars.py`) handles the multi-module SBT setup so you're not manually wrangling each chapter's dependencies.
The repo hasn't been meaningfully updated since 2021 — the book targets Spark 3.0 and Delta Lake 1.x, both of which are multiple major versions behind. The README is three sentences; there's no guidance on which Spark version to run locally or how to configure a working environment. The dataset directory is bloated with hundreds of raw JPEG frames from a CCTV dataset that have no business being in a git repo. If you're not following the book chapter-by-chapter, nothing here stands on its own.