Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
EspressoGPT
on Jan 18, 2024
|
parent
|
context
|
favorite
| on:
Queues don't fix overload (2014)
> Queues Don't Fix Overload
If the queue can withstand more simultaneous load than the processing service, they basically do.
kevincox
on Jan 18, 2024
[–]
Queues mitigate short-term overload. They don't fix overload. Even in the short term there are likely detrimental effects (as latency rises) and if your long term average input is higher than your average output then you are still overloaded.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
If the queue can withstand more simultaneous load than the processing service, they basically do.