Training LLMs at Scale with AMD MI250 GPUs

A Pattern for the Lightweight Deployment of Distributed XGBoost and LightGBM Models

Making Spark Accessible: My Databricks Summer Internship

Apache Spark 3 Apache DataSketches: New Sketch-Based Approximate Distinct Counting

Introducing the Support of Lateral Column Alias

Introducing Apache Spark™ 3.5

Introducing MLflow 2.7 with new LLMOps capabilities

Best Practices for LLM Evaluation of RAG Applications

What’s New for Shared Clusters in Unity Catalog

Efficient Fine-Tuning with LoRA: A Guide to Optimal Parameter Selection for Large Language Models