The Question
ML Design
Scalable ML Evaluation Framework
Design a comprehensive evaluation system for a high-scale recommendation engine. The system should address the gap between offline proxy metrics and online business objectives, handle selection bias in historical data, and provide a robust framework for A/B testing and long-term model performance monitoring.
MMoE
IPS
NDCG
AUC
PSI
Two-Tower
ScaNN
Kafka
Spark
Tecton
ONNX
MurmurHash
March 14, 2026