Celery

Селери — это не только ценный мех сельдерей. Это еще и 3-4 килограмма диетического мяса система распределения вычислительных задач. Да, на Python.

Celery: Distributed Task Queue

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.

The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

celeryproject.org

docs.celeryproject.org/en/latest/getting-started/introduction

Before you can use Celery you need to choose, install and run a broker. The broker is the service responsible for receiving and delivering task messages.

There are several choices available, including:

Using RabbitMQ

RabbitMQ is feature-complete, safe and durable. If not losing tasks is important to you, then this is your best option.

docs.celeryproject.org/en/latest/getting-started/first-steps-with-celery

Все чуть более чем серьезно. Для больших мальчиков.

Про очереди сообщений доступно написано тут

insight-it.ru/tekhnologii/soobshheniya/rabbitmq

На русском про сельдерей

habrahabr.ru/search/?q=[celery]