* In terms of taks processing, frontend is "opening" tasks and backend is "closing" them.
* Latency of the backend may fluctuate wildly. To avoid backend running out of open tasks,
* there should be a queue of requests frontend can add to.
* In terms of taks processing, frontend is "opening" tasks and backend is "closing" them.
* Latency of the backend may fluctuate wildly. To avoid backend running out of open tasks,
* there should be a queue of requests frontend can add to.