Databricks AI Runtime

Headlines · 4

1. 1d
   Databricks details how its AI research team uses AI Runtime for agent-led training

   Databricks published a post describing how its AI research team uses its own AI Runtime (AIR) to train and evaluate the models behind products such as Genie, Smart Routing and AI Functions. The team cites AIR capabilities including GPU preflight checks and health monitoring, cordoning off unhealthy nodes, the AIR CLI with custom Docker containers, automatic MLflow experiment tracking, governed data access through Unity Catalog FUSE mounting, and workload prioritization and preemption to share GPUs across projects. Databricks says agent-led "autoresearch" workflows have driven an 8x increase in the number of training jobs for its AI Functions research, with models ranging from a few billion to nearly a trillion parameters trained on NVIDIA H100 or B300 GPUs, and the largest runs using hundreds of GPUs over days or weeks.

   Databricks Blog · 🔥 4
2. 2d
   FactSet cuts model training and deployment from days to hours with Databricks AI Runtime

   A Databricks blog case study says FactSet's Text-to-Formula (TTF) system, which converts natural-language requests into FactSet Query Language formulas, initially relied on retrieval-augmented generation but hit a quality ceiling as queries grew more specialized, so the team added fine-tuned open models to its Compound AI architecture. FactSet says earlier fine-tuned models cut end-to-end latency by about 60%, and the team now fine-tunes models roughly every two to three weeks; using Databricks AI Runtime's serverless GPUs, it reduced the time to set up, train and deploy a custom TTF model from days to hours. The workflow runs alongside MLflow tracking and Lakehouse governance, with a reusable fine-tuning pipeline built on Lakeflow Jobs and Pipelines.

   Databricks Blog · 🔥 0
3. 5d
   Flo Health fine-tunes open models with Databricks to boost medical safety and usefulness

   A Databricks blog post describes how Flo Health, a women's health app with 81 million monthly active users, built safer and more useful custom open models on Databricks AI Runtime. Flo first created an evaluation system of 26 AI judges (12 medical-safety, 6 micro-behavior, 8 usefulness) to turn medical standards into a training signal, generated more than 15,000 privacy-first synthetic questions, then ran supervised fine-tuning and DPO on 32 NVIDIA H100 GPUs using LLM Foundry and Compose-RL with MLflow tracking. Flo reports medical safety rising from 34% to about 61%, usefulness from 42% to 76%, and the share of responses meeting both from 16% to 47%, and estimates tailored models can cut inference costs by an order of magnitude versus frontier APIs; it plans to apply the pipeline to newer open-weight models such as Gemma, Qwen and Kimi.

   Databricks Blog · 🔥 0
4. Oct 9
   TinyFish runs its web-native agent model on Databricks AI Runtime

   TinyFish is developing a specialized web-native model for enterprise agents that work across the live web, and has consolidated its post-training, evaluation and production serving on Databricks: managed GPUs via AI Runtime, evaluation with MLflow, and deployment through Model Serving. The team started with supervised fine-tuning and is moving toward Direct Preference Optimization. On its internal go/no-go benchmark, the model completed 1,691 of 2,178 web-agent tasks for a 77.6% task-success rate, with a separate LLM judge reviewing the request, action history and final result; partial completion or incorrect answers count as failures. Over a recent 15-day period, TinyFish recorded 294,781 agent runs involving the model across 6.4 million tool steps, at an estimated serving cost of $0.088 per run and $0.0040 per tool step — covering only that model, not the full agent stack. TinyFish already serves its search reranker and query rewriter on Databricks and uses Unity Gateway to centralize access to external foundation models.

   Databricks Blog · 🔥 0

Experience and discussion from the community

Share my Databricks AI Runtime experienceAsk about Databricks AI Runtime