Distributed Cron Job Scheduler
Design a highly available and scalable distributed system to schedule and execute millions of recurring jobs (cron tasks). The system must support high-precision triggering (within seconds of the scheduled time), handle massive execution spikes at specific time boundaries (e.g., top of the hour), and ensure that jobs are triggered even in the event of partial system failure. Detail your strategy for job metadata storage, the mechanism for polling or triggering due jobs, and how you ensure tasks are distributed to workers efficiently while maintaining at-least-once execution guarantees.
PostgreSQLKafkaEtcdTiming WheelCDCgRPCDocker
01