Aug 01 00:10:18 ofp poetry[1249174]: 2024-08-01 00:10:18 [ERROR] [messenger] Trying to publish to subject 'tic.status.zb08.fits.pipeline.zdf' failed. Message msg-1301 publish error: nats: timeout
Aug 01 00:10:18 ofp poetry[1249174]: 2024-08-01 00:10:18 [ERROR] [task_manager] Task task-stats-stats_2-33 failed: nats: timeout
Aug 01 00:10:18 ofp poetry[1249174]: Traceback (most recent call last):
Aug 01 00:10:18 ofp poetry[1249174]: File "/usr/lib/python3.10/asyncio/tasks.py", line 456, in wait_for
Aug 01 00:10:18 ofp poetry[1249174]: return fut.result()
Aug 01 00:10:18 ofp poetry[1249174]: asyncio.exceptions.CancelledError
Aug 01 00:10:18 ofp poetry[1249174]: The above exception was the direct cause of the following exception:
Aug 01 00:10:18 ofp poetry[1249174]: Traceback (most recent call last):
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/nats/aio/client.py", line 1061, in _request_new_style
Aug 01 00:10:18 ofp poetry[1249174]: return await asyncio.wait_for(future, timeout)
Aug 01 00:10:18 ofp poetry[1249174]: File "/usr/lib/python3.10/asyncio/tasks.py", line 458, in wait_for
Aug 01 00:10:18 ofp poetry[1249174]: raise exceptions.TimeoutError() from exc
Aug 01 00:10:18 ofp poetry[1249174]: asyncio.exceptions.TimeoutError
Aug 01 00:10:18 ofp poetry[1249174]: During handling of the above exception, another exception occurred:
Aug 01 00:10:18 ofp poetry[1249174]: Traceback (most recent call last):
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/src/oca-fits-proc/fits_proc/modules/stats.py", line 233, in _run
Aug 01 00:10:18 ofp poetry[1249174]: ps = await self.process_stats()
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/src/oca-fits-proc/fits_proc/modules/stats.py", line 200, in process_stats
Aug 01 00:10:18 ofp poetry[1249174]: await self.fm.nats_conn.status_fits_zdf_pub.publish(
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_single_pub.py", line 18, in publish
Aug 01 00:10:18 ofp poetry[1249174]: return await super().publish(data, meta=meta, **kwargs)
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_publisher.py", line 61, in publish
Aug 01 00:10:18 ofp poetry[1249174]: raise e
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_publisher.py", line 47, in publish
Aug 01 00:10:18 ofp poetry[1249174]: await self.connection.js.publish(self.subject, bdata, **kwargs)
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/nats/js/client.py", line 181, in publish
Aug 01 00:10:18 ofp poetry[1249174]: msg = await self._nc.request(
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/nats/aio/client.py", line 1021, in request
Aug 01 00:10:18 ofp poetry[1249174]: msg = await self._request_new_style(
Aug 01 00:10:18 ofp poetry[1249174]: File "/home/poweruser/.cache/pypoetry/virtualenvs/oca-fits-proc-ra1OpwlD-py3.10/lib/python3.10/site-packages/nats/aio/client.py", line 1063, in _request_new_style
Aug 01 00:10:18 ofp poetry[1249174]: raise errors.TimeoutError
Aug 01 00:10:18 ofp poetry[1249174]: nats.errors.TimeoutError: nats: timeout
This error is blocked ofp (second time):
@majkelx