Generating Coding Tests for LLMs: A Focus on Spark SQL

Build Compound AI Systems Faster with Databricks Mosaic AI

Primary Key and Foreign Key constraints are GA and now enable faster queries

DLT pipeline development made simple with notebooks

Announcing General Availability of Ray on Databricks

PySpark in 2023: A Year in Review

Simplify PySpark testing with DataFrame equality functions

A Deep Dive into the Latest Performance Improvements of Stateful Pipelines in Apache Spark Structured Streaming

Performance Improvements for Stateful Pipelines in Apache Spark Structured Streaming

Announcing Ray Autoscaling support on Databricks and Apache Spark™