Scalable A/B Testing and Experimentation Platform
Design an experimentation system capable of supporting millions of concurrent users. The system should allow product managers to define experiments with specific targeting rules (geo, device, etc.) and enable developers to retrieve variation assignments with sub-millisecond latency. Address the challenges of bucket consistency (ensuring a user stays in their assigned group), mutually exclusive experiments, and high-volume event ingestion for real-time result analysis. Explain your choice of evaluation logic (client-side vs server-side) and how you handle the massive scale of conversion event data.
PostgreSQLRedisKafkaClickHouseMurmurHash3FlinkCDCgRPC
01