Repository navigation
Reload param disables --no-configure-logging on docker #472
Description
Maybe is a misconfiguration option or I don't know docker or maybe both
When you enable --no-configure-logging with --reload in docker the no configure get disabled or some strange bug allows to logs to be duplicated.
entrypoint: [ "taskiq", "worker", "app.tkq:broker","--reload", "--fs-discover", "--tasks-pattern", "**/task_*.py" ,"--no-configure-logging"]
Making this call
❯ uv run python -m app.main
2025-06-19 16:03:27 [debug ] Settings loaded settings={'ENVIRONMENT': 'pytest', 'RELOAD': False, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'localhost', 'REDIS_PORT': 6378}
Task execution took: 0.0 seconds.
Returned value: 2
Outside docker works the reload print some logs unprocessed but thatch all
❯ uv run taskiq worker app.tkq:broker --reload --fs-discover --tasks-pattern **/task_*.py --no-configure-logging
WARNING:root:Reload on change enabled. Number of worker processes set to 1.
INFO:taskiq.process-manager:Started process worker-0 with pid 56310
2025-06-19 16:03:21 [debug ] Settings loaded settings={'ENVIRONMENT': 'pytest', 'RELOAD': False, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'localhost', 'REDIS_PORT': 6378}
2025-06-19T14:03:21.919787Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 process_id=56310
2025-06-19T14:03:21.924531Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 process_id=56310
2025-06-19T14:03:27.240208Z [info ] Executing task app.task_test:add_one with ID: ebcfea492d854f278bbfd45b61ef0db4 [taskiq.receiver.receiver] filename=receiver.py func_name=callback lineno=136 process_id=56310
2025-06-19T14:03:27.240463Z [info ] Adding one to the value [app.task_test] filename=task_test.py func_name=add_one lineno=10 process_id=56310 value=1
INFO:taskiq.process-manager:Scheduled workers reload.
2025-06-19T14:04:26.261532Z [info ] Stopping prefetching messages... [taskiq.receiver.receiver] filename=receiver.py func_name=prefetcher lineno=390 process_id=56310
2025-06-19T14:04:26.262691Z [info ] The runner is stopped. [taskiq.receiver.receiver] filename=receiver.py func_name=runner lineno=453 process_id=56310
2025-06-19T14:04:26.263817Z [warning ] Shutting down the broker. [taskiq.worker] filename=run.py func_name=shutdown_broker lineno=44 process_id=56310
INFO:taskiq.process-manager:Process worker-0 restarted with pid 56734
2025-06-19 16:04:26 [debug ] Settings loaded settings={'ENVIRONMENT': 'pytest', 'RELOAD': False, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'localhost', 'REDIS_PORT': 6378}
2025-06-19T14:04:26.528194Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 process_id=56734
2025-06-19T14:04:26.532697Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 process_id=56734
2025-06-19T14:04:29.468868Z [info ] Executing task app.task_test:add_one with ID: 5c681d7d3128455aa88f6a076e3eff7d [taskiq.receiver.receiver] filename=receiver.py func_name=callback lineno=136 process_id=56734
2025-06-19T14:04:29.469146Z [info ] Adding one to the value [app.task_test] filename=task_test.py func_name=add_one lineno=10 process_id=56734 value=1
Inside docker the Adding one to the value is printed twice.
taskiq-worker-1 | WARNING:root:Reload on change enabled. Number of worker processes set to 1.
taskiq-worker-1 | INFO:taskiq.process-manager:Started process worker-0 with pid 10
taskiq-worker-1 | 2025-06-19 16:05:11 [debug ] Settings loaded settings={'ENVIRONMENT': 'development', 'RELOAD': True, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'redis', 'REDIS_PORT': 6379}
taskiq-worker-1 | INFO:taskiq.worker:Importing tasks from module app.task_test
taskiq-worker-1 | 2025-06-19T14:05:11.896849Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 message='Importing tasks from module app.task_test' process_id=10
taskiq-worker-1 | INFO:taskiq.receiver.receiver:Listening started.
taskiq-worker-1 | 2025-06-19T14:05:11.903600Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 message='Listening started.' process_id=10
taskiq-worker-1 | INFO:taskiq.process-manager:Scheduled workers reload.
taskiq-worker-1 | INFO:taskiq.process-manager:Scheduled workers reload.
taskiq-worker-1 | INFO:taskiq.receiver.receiver:Stopping prefetching messages...
taskiq-worker-1 | 2025-06-19T14:05:20.138003Z [info ] Stopping prefetching messages... [taskiq.receiver.receiver] filename=receiver.py func_name=prefetcher lineno=390 message='Stopping prefetching messages...' process_id=10
taskiq-worker-1 | INFO:taskiq.receiver.receiver:The runner is stopped.
taskiq-worker-1 | 2025-06-19T14:05:20.140885Z [info ] The runner is stopped. [taskiq.receiver.receiver] filename=receiver.py func_name=runner lineno=453 message='The runner is stopped.' process_id=10
taskiq-worker-1 | WARNING:taskiq.worker:Shutting down the broker.
taskiq-worker-1 | 2025-06-19T14:05:20.144858Z [warning ] Shutting down the broker. [taskiq.worker] filename=run.py func_name=shutdown_broker lineno=44 message='Shutting down the broker.' process_id=10
taskiq-worker-1 | INFO:taskiq.process-manager:Process worker-0 restarted with pid 13
taskiq-worker-1 | INFO:taskiq.process-manager:Scheduled workers reload.
taskiq-worker-1 | INFO:taskiq.process-manager:Scheduled workers reload.
taskiq-worker-1 | INFO:taskiq.process-manager:Scheduled workers reload.
taskiq-worker-1 | 2025-06-19 16:05:20 [debug ] Settings loaded settings={'ENVIRONMENT': 'development', 'RELOAD': True, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'redis', 'REDIS_PORT': 6379}
taskiq-worker-1 | INFO:taskiq.worker:Importing tasks from module app.task_test
taskiq-worker-1 | 2025-06-19T14:05:20.355692Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 message='Importing tasks from module app.task_test' process_id=13
taskiq-worker-1 | INFO:taskiq.receiver.receiver:Listening started.
taskiq-worker-1 | 2025-06-19T14:05:20.363378Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 message='Listening started.' process_id=13
taskiq-worker-1 | INFO:taskiq.receiver.receiver:Stopping prefetching messages...
taskiq-worker-1 | 2025-06-19T14:05:22.511636Z [info ] Stopping prefetching messages... [taskiq.receiver.receiver] filename=receiver.py func_name=prefetcher lineno=390 message='Stopping prefetching messages...' process_id=13
taskiq-worker-1 | INFO:taskiq.receiver.receiver:The runner is stopped.
taskiq-worker-1 | 2025-06-19T14:05:22.512937Z [info ] The runner is stopped. [taskiq.receiver.receiver] filename=receiver.py func_name=runner lineno=453 message='The runner is stopped.' process_id=13
taskiq-worker-1 | WARNING:taskiq.worker:Shutting down the broker.
taskiq-worker-1 | 2025-06-19T14:05:22.514522Z [warning ] Shutting down the broker. [taskiq.worker] filename=run.py func_name=shutdown_broker lineno=44 message='Shutting down the broker.' process_id=13
taskiq-worker-1 | INFO:taskiq.process-manager:Process worker-0 restarted with pid 15
taskiq-worker-1 | 2025-06-19 16:05:22 [debug ] Settings loaded settings={'ENVIRONMENT': 'development', 'RELOAD': True, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'redis', 'REDIS_PORT': 6379}
taskiq-worker-1 | INFO:taskiq.worker:Importing tasks from module app.task_test
taskiq-worker-1 | 2025-06-19T14:05:22.713711Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 message='Importing tasks from module app.task_test' process_id=15
taskiq-worker-1 | INFO:taskiq.receiver.receiver:Listening started.
taskiq-worker-1 | 2025-06-19T14:05:22.720927Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 message='Listening started.' process_id=15
taskiq-worker-1 | INFO:taskiq.receiver.receiver:Executing task app.task_test:add_one with ID: 57efc0b38db94e77b482527526ebea18
taskiq-worker-1 | 2025-06-19T14:05:31.856240Z [info ] Executing task app.task_test:add_one with ID: 57efc0b38db94e77b482527526ebea18 [taskiq.receiver.receiver] filename=receiver.py func_name=callback lineno=136 message='Executing task app.task_test:add_one with ID: 57efc0b38db94e77b482527526ebea18' process_id=15
taskiq-worker-1 | INFO:app.task_test:{'value': 1, 'event': 'Adding one to the value', 'logger': 'app.task_test', 'process_id': 15, 'level': 'info', 'timestamp': '2025-06-19T14:05:31.856929Z', 'filename': 'task_test.py', 'func_name': 'add_one', 'lineno': 10}
taskiq-worker-1 | 2025-06-19T14:05:31.856929Z [info ] Adding one to the value [app.task_test] filename=task_test.py func_name=add_one lineno=10 process_id=15 value=1
Removing the --reload param fixes the bug.
❯ docker compose up
[+] Running 2/2
✔ Container temp-redis-1 Running 0.0s
✔ Container temp-taskiq-worker-1 Recreated 0.6s
Attaching to redis-1, taskiq-worker-1
taskiq-worker-1 | 2025-06-19 16:11:51 [debug ] Settings loaded settings={'ENVIRONMENT': 'development', 'RELOAD': True, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'redis', 'REDIS_PORT': 6379}
taskiq-worker-1 | 2025-06-19 16:11:51 [debug ] Settings loaded settings={'ENVIRONMENT': 'development', 'RELOAD': True, 'WORKERS': 1, 'LOG_LEVEL': <LogLevel.INFO: 'INFO'>, 'LOG_JSON_FORMAT': False, 'REDIS_HOST': 'redis', 'REDIS_PORT': 6379}
taskiq-worker-1 | 2025-06-19T14:11:51.775917Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 process_id=8
taskiq-worker-1 | 2025-06-19T14:11:51.776023Z [info ] Importing tasks from module app.task_test [taskiq.worker] filename=utils.py func_name=import_from_modules lineno=62 process_id=7
taskiq-worker-1 | 2025-06-19T14:11:51.782418Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 process_id=8
taskiq-worker-1 | 2025-06-19T14:11:51.782547Z [info ] Listening started. [taskiq.receiver.receiver] filename=receiver.py func_name=listen lineno=333 process_id=7
taskiq-worker-1 | 2025-06-19T14:11:55.379090Z [info ] Executing task app.task_test:add_one with ID: f4d71462534e454eb494b8922f618a42 [taskiq.receiver.receiver] filename=receiver.py func_name=callback lineno=136 process_id=8
taskiq-worker-1 | 2025-06-19T14:11:55.379927Z [info ] Adding one to the value [app.task_test] filename=task_test.py func_name=add_one lineno=10 process_id=8 value=1
Repo to check the code and reproduce error https://github.com/MonsignorEduardo/multiple-errors/tree/Reload-disabled---no-configure-logging-on-docker
Activity
[-]Reload disabled --no-configure-logging on docker[/-][+]Reload param disables --no-configure-logging on docker[/+]