← Back
Databricks Blog

How FactSet cut model training and deployment from days to hours with Databricks AI Runtime

•6 min read•
#deployment#compute
Level:Advanced
For:ML Engineers
✦TL;DR

FactSet accelerated its Text-to-Formula (TTF) pipeline by moving model training and deployment onto Databricks AI Runtime, shrinking the end‑to‑end cycle from multiple days to just a few hours. The new runtime leverages Databricks‑optimized Spark clusters and integrated model serving, enabling rapid iteration on large‑scale financial text data. Engineers can now retrain and push updated formula‑generation models on a shared platform without bespoke infrastructure. This shift dramatically reduces time‑to‑value for financial analytics applications.

⚡ Key Takeaways

  • Training and deployment time reduced from days to hours after adopting Databricks AI Runtime.
  • Uses Databricks‑optimized Spark clusters for distributed model training.
  • Achieves faster iteration cycles, cutting operational latency for model updates.
  • Integration is done via Databricks AI Runtime’s built‑in model serving APIs.
  • Requires migration of data pipelines to Databricks environment; on‑prem setups are not compatible.

🔧 Tools & Libraries

Databricks AI Runtime
💡 Why It Matters

Cutting model turnaround from days to hours lets financial data teams iterate quickly, keeping formula generation models up‑to‑date with market changes and delivering fresher insights to end users.

✅ Practical Steps

  1. Migrate your training data and code to a Databricks workspace and configure a Spark cluster with the Databricks AI Runtime.
  2. Use the Databricks AI Runtime model serving API to deploy the trained TTF model directly from the training notebook.
  3. Monitor training and serving metrics via Databricks’ built‑in dashboards to validate performance gains.

Want the full story? Read the original article.

Read on Databricks Blog ↗

More like this

New in AWS Quick: More capable flows, an updated web experience, and agents that work together

AWS ML Blog•#agents

Three insights you may have missed from theCUBE’s coverage of the Dell Technologies New York Symposium

SiliconANGLE AI•#deployment

Welcome Inkling 2 Mini, Cutting-edge Performance for your Local Setup

Hugging Face Blog•#llm

NVIDIA and Microsoft Expand Accelerated Computing From Azure to Windows PCs

NVIDIA Blog•#compute

EXPLORE AI NEWS

Daily hand-picked stories on LLMs, RAG, agents and production AI — curated for engineers who ship.

BROWSE NEWS

GET THE WEEKLY DIGEST

Join engineers getting the Monday signal-over-noise AI breakdown. No spam, unsubscribe anytime.

LEARN AI ENGINEERING

Curated courses, research papers, repos and tutorials built for engineers leveling up in AI.

START LEARNING