Design a high-scale personalized music recommendation engine capable of serving hundreds of millions of users. The system should handle discovery (Discover Weekly style), real-time session updates, and effectively manage the balance between recommending popular content and discovering niche artists while maintaining strict sub-second latency requirements.