The Question
DesignDistributed Log Collection System
Design a distributed log collection system that aggregates server logs from multiple global data centers. The system should ingest high-volume log streams in real time, support structured and unstructured log formats, and make logs searchable for debugging, monitoring, and alerting purposes.
Kafka
ClickHouse
S3
Fluent Bit
Redis
February 6, 2026