Databricks walks through real-time fraud detection with Feature Views
Databricks Blog presents a code-driven walkthrough for building a real-time fraud detection system with Feature Views, covering Kafka streams, historical training data, model serving and online feature materialization. The tutorial shows how one registered feature definition can produce point-in-time-correct training data and managed online-inference pipelines, while Unity Catalog governs definitions, permissions and lineage.
The walkthrough gives practitioners a concrete implementation pattern for reducing training-serving skew and data leakage across batch, streaming and on-demand features, although the capability claims come from Databricks.
Real-time fraud detection depends on three kinds of features: what a customer did seconds ago, how they normally spend and how the current payment compares. Those features have to be computed the same way for model training and for live scoring — otherwise data leakage and training-serving skew quietly erode model quality. Feature Views, part of Databricks Feature Store, address this. You define each feature once, and that definition produces both point-in-time training data and the managed pipelines for online inference.
A $900 payment may be routine for one customer and unusual for another. When it arrives, a fraud model has only a moment to decide whether it looks normal, needs review or should be blocked. Approving a fraudulent transaction can cost the customer money. Blocking a legitimate one disrupts their payment experience and erodes their trust in the platform.
The transaction alone doesn't tell the whole story. The model also needs to know how this customer normally transacts and what they did seconds, minutes, days or weeks ago. During training, features must use only information available when each payment occurred. During live scoring, they must reflect recent transactions quickly enough to catch suspicious activity. If the two paths implement the logic separately, small differences between them creep in.
#Databricks#Databricks Feature Views#Databricks Feature Store#Unity Catalog#Databricks Model Serving#Kafka#Lakebase