Introducing Auto-Scaling Event Drivers for Background Processing
Introducing Auto-Scaling Event Drivers for Background Processing

Introducing Auto-Scaling Event Drivers for Background Processing

Author
Shiv Bade
Tags
scaling
event-driven
Published
November 27, 2017
Featured
Slug
Tweet
Event-driven processing gives you decoupling. But scaling workers dynamically is often neglected.
We wrote a wrapper to: - Monitor queue depth in Kafka - Trigger horizontal pod autoscaler adjustments - Handle warmup and cooldown periods intelligently
This reduced costs significantly during off-peak and absorbed traffic spikes more gracefully.