No device uplink data published to MQTT (gateways communicate fine)

Viewed 10

About 10/5 my standard chirpstack installation stopped getting gateway messages and stopped sending application messages to MQTT. MQTT is working OK with chirpstack-gateway-bridge. gateway messages show up on MQTT. No application messages. I don't think I changed anything that would cause that. Debug logs are not helpful. No errors and no messages being sent to MQTT. Now running Chirpstack 4.15.0. No change. Any help on troubleshooting this problem? Read all the docs as far as I know. It was working perfectly previously.

Kevin

1 Answers

Good questions. Activity in the gateway LoRaWAN frames tab also stopped before 10/6. No application/xxx/device/xxx/event/up on MQTT. Lots of gateway messages on MQTT however. No messages on the Events tab of the devices. As I mentioned, logs have not been helpful. Without log messages I'm lost as to what has gone wrong. See below, no application messages at all. My own gateway is shown as connected and receiving events. Chirpstack doesn't see anything.

192.168.2.223
gateway
2f8e59802eb7f497
715095fb124cab5d
477e6973c1d6ad62
b827ebfffe721c8a
state
event
stats = �Ŵ� �dp��E@i:;�Q�_@ (�b827ebfffe721c8a
up = 4�����+���P��ߪ�Q���Ԓݲ0HY(�j�������!mȋd�2r
�|-"���� �� (*> b827ebfffe721c8a� �Ĵ�����0���������=33A@jx��T�
b73e349f5744cc96
7dd4d42118809f86

Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.027497Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=19.344054ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.029817Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=22.14889ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.033440Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=21.572172ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.096038Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=14.000373ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.097092Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=13.342927ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.097935Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=14.839329ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.101485Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=15.682243ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.103409Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=16.054949ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.105713Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=19.11395ms
Oct 13 12:10:52 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:10:52.157121Z INFO gRPC{uri=/api.GatewayService/List}: chirpstack::api: Finished processing request status="200" latency=10.138302ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.266244Z INFO gRPC{uri=/api.InternalService/Login}: chirpstack::api: Finished processing request status="200" latency=3.78978ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.335388Z INFO gRPC{uri=/api.InternalService/Profile}: chirpstack::api: Finished processing request status="200" latency=6.970759ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.414577Z INFO gRPC{uri=/api.TenantService/List}: chirpstack::api: Finished processing request status="200" latency=14.791099ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.469612Z INFO gRPC{uri=/api.InternalService/GetVersion}: chirpstack::api: Finished processing request status="200" latency=2.48921ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.493281Z INFO gRPC{uri=/api.InternalService/GetVersion}: chirpstack::api: Finished processing request status="200" latency=2.716293ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.542725Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=3.613999ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.569023Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=5.188734ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.580530Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=6.60701ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.591545Z INFO gRPC{uri=/api.InternalService/GetVersion}: chirpstack::api: Finished processing request status="200" latency=5.722065ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.676301Z INFO gRPC{uri=/api.InternalService/GetGatewaysSummary}: chirpstack::api: Finished processing request status="200" latency=23.708622ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.686781Z INFO gRPC{uri=/api.GatewayService/List}: chirpstack::api: Finished processing request status="200" latency=17.206924ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.689458Z INFO gRPC{uri=/api.InternalService/GetDevicesSummary}: chirpstack::api: Finished processing request status="200" latency=27.933191ms
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.799461Z INFO gRPC{uri=/assets/markers-soft@2x-5qZIy0Cz.png}: chirpstack::api: Finished processing request status="200" latency=665.154µs
Oct 13 12:12:48 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:48.807135Z INFO gRPC{uri=/assets/fa-solid-900-CTAAxXor.woff2}: chirpstack::api: Finished processing request status="200" latency=667.654µs
Oct 13 12:12:49 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:49.194753Z INFO gRPC{uri=/assets/fa-regular-400-BjRzuEpd.woff2}: chirpstack::api: Finished processing request status="200" latency=531.873µs
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.189397Z INFO gRPC{uri=/api.InternalService/GetVersion}: chirpstack::api: Finished processing request status="200" latency=5.748471ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.196135Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=13.40152ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.202668Z INFO gRPC{uri=/api.ApplicationService/List}: chirpstack::api: Finished processing request status="200" latency=16.214635ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.205743Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=7.917735ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.215231Z INFO gRPC{uri=/api.GatewayService/List}: chirpstack::api: Finished processing request status="200" latency=29.58277ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.284581Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=15.789533ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.286493Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=16.095261ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.288112Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=18.443951ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.288081Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=17.231612ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.293444Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=16.935154ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.351935Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=10.95986ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.357483Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=13.816935ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.362032Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=16.944113ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.364623Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=16.956613ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.364775Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=15.701356ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.367503Z INFO gRPC{uri=/api.MulticastGroupService/List}: chirpstack::api: Finished processing request status="200" latency=16.846665ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.426167Z INFO gRPC{uri=/api.FuotaService/ListDeployments}: chirpstack::api: Finished processing request status="200" latency=13.595217ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.431153Z INFO gRPC{uri=/api.GatewayService/List}: chirpstack::api: Finished processing request status="200" latency=16.219948ms
Oct 13 12:12:51 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:51.434387Z INFO gRPC{uri=/api.GatewayService/List}: chirpstack::api: Finished processing request status="200" latency=17.743641ms
Oct 13 12:12:53 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:53.215600Z INFO gRPC{uri=/api.InternalService/GetVersion}: chirpstack::api: Finished processing request status="200" latency=5.353056ms
Oct 13 12:12:53 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:53.216788Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=7.259039ms
Oct 13 12:12:53 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:53.224449Z INFO gRPC{uri=/api.GatewayService/Get}: chirpstack::api: Finished processing request status="200" latency=13.69006ms
Oct 13 12:12:53 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:53.312953Z INFO gRPC{uri=/api.GatewayService/GetMetrics}: chirpstack::api: Finished processing request status="200" latency=11.030902ms
Oct 13 12:12:53 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:53.315602Z INFO gRPC{uri=/api.GatewayService/GetDutyCycleMetrics}: chirpstack::api: Finished processing request status="200" latency=13.073083ms
Oct 13 12:12:54 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:54.772537Z INFO gRPC{uri=/api.InternalService/GetVersion}: chirpstack::api: Finished processing request status="200" latency=3.499468ms
Oct 13 12:12:54 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:54.775392Z INFO gRPC{uri=/api.TenantService/Get}: chirpstack::api: Finished processing request status="200" latency=6.95128ms
Oct 13 12:12:54 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:54.780685Z INFO gRPC{uri=/api.GatewayService/Get}: chirpstack::api: Finished processing request status="200" latency=8.81768ms
Oct 13 12:12:54 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:54.781038Z INFO gRPC{uri=/api.InternalService/StreamGatewayFrames}: chirpstack::api: Finished processing request status="200" latency=10.254186ms
Oct 13 12:12:55 cytron-lora-gw chirpstack[548663]: 2025-10-13T16:12:55.100888Z INFO gRPC{uri=/api.InternalService/StreamGatewayFrames}: chirpstack::api: Finished processing request status="200" latency=2.84447ms

Chirpstack seems to be running but nothing gets in or out.

Kevin