LoRa packet forwarder – failed to start the concentrator

[Fredrik]

Hi,

I have the Multitech LoRa Conduit IP67 with AEP software. I didn’t get the packet forwarder to start so I upgraded AEP to 1.7.2 hoping that would help.

Now the packet forwarder does not log anything in /var/log (the previous version did), but the problem with it not starting remains.

If I kill the process /sbin/angel /var/run/lora/1/lora_pkt_fwd and start cd /var/run/lora/1; /var/run/lora/1/lora_pkt_fwd manually I get the following:

*** Beacon Packet Forwarder for Lora Gateway ***
Version: 4.0.1
*** Lora concentrator HAL library version info ***
Version: 5.0.1;
***
INFO: Little endian host
INFO: found global configuration file global_conf.json, parsing it
INFO: global_conf.json does contain a JSON object named SX1301_conf, parsing SX1301 parameters
INFO: lorawan_public 1, clksrc 0
INFO: LBT is disabled
INFO: antenna_gain 0 dBi
INFO: Configuring TX LUT with 16 indexes
INFO: radio 0 enabled (type SX1257), center frequency 868500000, RSSI offset -162.000000, tx enabled 1, tx_notch_freq 129000
INFO: radio 1 enabled (type SX1257), center frequency 867500000, RSSI offset -162.000000, tx enabled 0, tx_notch_freq 0
INFO: Lora multi-SF channel 0>  radio 0, IF -400000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 1>  radio 0, IF -200000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 2>  radio 0, IF 0 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 3>  radio 1, IF -400000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 4>  radio 1, IF -200000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 5>  radio 1, IF 0 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 6>  radio 1, IF 200000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 7>  radio 1, IF 400000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora std channel> radio 0, IF -200000 Hz, 250000 Hz bw, SF 7
INFO: FSK channel> radio 0, IF 300000 Hz, 125000 Hz bw, 50000 bps datarate
INFO: global_conf.json does contain a JSON object named gateway_conf, parsing gateway parameters
INFO: gateway MAC address is configured to 00800000A0003D69
INFO: server hostname or IP address is configured to "<masked>"
INFO: upstream port is configured to "1780"
INFO: downstream port is configured to "1782"
INFO: downstream keep-alive interval is configured to 10 seconds
INFO: statistics display interval is configured to 20 seconds
INFO: upstream PUSH_DATA time-out is configured to 100 ms
INFO: packets received with a valid CRC will be forwarded
INFO: packets received with a CRC error will be forwarded
INFO: packets received with no CRC will be forwarded
INFO: Reference latitude is configured to 0.000000 deg
INFO: Reference longitude is configured to 0.000000 deg
INFO: Reference altitude is configured to 0 meters
INFO: GPS is enabled
INFO: Auto-quit after 60 non-acknowledged PULL_DATA
INFO: [main] GPSD polling open for GPS synchronization
INFO: FPGA supported features: [TX filter]  [Spectral Scan]
ERROR: [main] failed to start the concentrator

Any pointers on where to start trouble shooting?

[Jason Reiss]

The LoRaWAN > Network Settings page should display the FPGA version.
If it is showing 255 then the system was not able to read the version info from the FPGA.

See sections 5.1.4 to see that the FPGA is accessible via SPI.
http://www.multitech.net/developer/search_gcse/?q=troubleshooting+guide

[Fredrik]

Thank you for your reply Jason. In LoRaWAN->Network Settings through the web gui it says that the FPGA version is 31.

[Jason Reiss]

Try to reset the card via command line and start the packet forwarder manually.

[Fredrik]

Same result. 🙁

admin@mtcdt:/var/run/lora/1# mts-io-sysfs store lora/reset 0
admin@mtcdt:/var/run/lora/1# mts-io-sysfs store lora/reset 1
admin@mtcdt:/var/run/lora/1# ./lora_pkt_fwd
*** Beacon Packet Forwarder for Lora Gateway ***
Version: 4.0.1
*** Lora concentrator HAL library version info ***
Version: 5.0.1;
***
INFO: Little endian host
INFO: found global configuration file global_conf.json, parsing it
INFO: global_conf.json does contain a JSON object named SX1301_conf, parsing SX1301 parameters
INFO: lorawan_public 1, clksrc 0
INFO: LBT is disabled
INFO: antenna_gain 0 dBi
INFO: Configuring TX LUT with 16 indexes
INFO: radio 0 enabled (type SX1257), center frequency 868500000, RSSI offset -162.000000, tx enabled 1, tx_notch_freq 129000
INFO: radio 1 enabled (type SX1257), center frequency 867500000, RSSI offset -162.000000, tx enabled 0, tx_notch_freq 0
INFO: Lora multi-SF channel 0>  radio 0, IF -400000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 1>  radio 0, IF -200000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 2>  radio 0, IF 0 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 3>  radio 1, IF -400000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 4>  radio 1, IF -200000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 5>  radio 1, IF 0 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 6>  radio 1, IF 200000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora multi-SF channel 7>  radio 1, IF 400000 Hz, 125 kHz bw, SF 7 to 12
INFO: Lora std channel> radio 0, IF -200000 Hz, 250000 Hz bw, SF 7
INFO: FSK channel> radio 0, IF 300000 Hz, 125000 Hz bw, 50000 bps datarate
INFO: global_conf.json does contain a JSON object named gateway_conf, parsing gateway parameters
INFO: gateway MAC address is configured to 00800000A0003D69
INFO: server hostname or IP address is configured to "<masked>"
INFO: upstream port is configured to "1780"
INFO: downstream port is configured to "1782"
INFO: downstream keep-alive interval is configured to 10 seconds
INFO: statistics display interval is configured to 20 seconds
INFO: upstream PUSH_DATA time-out is configured to 100 ms
INFO: packets received with a valid CRC will be forwarded
INFO: packets received with a CRC error will be forwarded
INFO: packets received with no CRC will be forwarded
INFO: Reference latitude is configured to 0.000000 deg
INFO: Reference longitude is configured to 0.000000 deg
INFO: Reference altitude is configured to 0 meters
INFO: GPS is enabled
INFO: Auto-quit after 60 non-acknowledged PULL_DATA
INFO: [main] GPSD polling open for GPS synchronization
INFO: FPGA supported features: [TX filter]  [Spectral Scan]
ERROR: [main] failed to start the concentrator

[Jason Reiss]

What is the result of toggling creset and reading cdone through mts-io-sysfs?

[Fredrik]

I think these are the commands you wanted me to run?

admin@mtcdt:/var/run/lora/1# mts-io-sysfs store lora/creset 0
admin@mtcdt:/var/run/lora/1# mts-io-sysfs show lora/cdone
0
admin@mtcdt:/var/run/lora/1# mts-io-sysfs store lora/creset 1
admin@mtcdt:/var/run/lora/1# mts-io-sysfs show lora/cdone
1

[Jason Reiss]

Can you try these gateway utilities?

cd /opt/lora/gateway-utils

./test_loragw_spi
./util_spi_stress

[Fredrik]

Sure!

admin@mtcdt:/var/run/lora/1# cd /opt/lora/gateway-utils
admin@mtcdt:/opt/lora/gateway-utils# ./test_loragw_spi
Beginning of test for loragw_spi.c
data received (simple read): 0
End of test for loragw_spi.c
admin@mtcdt:/opt/lora/gateway-utils# ./util_spi_stress
INFO: Starting LoRa concentrator SPI stress-test number 1
INFO: FPGA supported features: [TX filter]  [Spectral Scan]
Cycle 0 > did 1000 R/W on an 8 bits reg with no error
Cycle 1 > did 1000 R/W on an 8 bits reg with no error
Cycle 2 > did 1000 R/W on an 8 bits reg with no error
Cycle 3 > did 1000 R/W on an 8 bits reg with no error
Cycle 4 > did 1000 R/W on an 8 bits reg with no error
Cycle 5 > did 1000 R/W on an 8 bits reg with no error
Cycle 6 > did 1000 R/W on an 8 bits reg with no error
Cycle 7 > did 1000 R/W on an 8 bits reg with no error
Cycle 8 > did 1000 R/W on an 8 bits reg with no error
Cycle 9 > did 1000 R/W on an 8 bits reg with no error
Cycle 10 > did 1000 R/W on an 8 bits reg with no error
Cycle 11 > did 1000 R/W on an 8 bits reg with no error
Cycle 12 > did 1000 R/W on an 8 bits reg with no error
Cycle 13 > did 1000 R/W on an 8 bits reg with no error
Cycle 14 > did 1000 R/W on an 8 bits reg with no error
Cycle 15 > did 1000 R/W on an 8 bits reg with no error
Cycle 16 > did 1000 R/W on an 8 bits reg with no error
Cycle 17 > did 1000 R/W on an 8 bits reg with no error
Cycle 18 > did 1000 R/W on an 8 bits reg with no error
Cycle 19 > did 1000 R/W on an 8 bits reg with no error
Cycle 20 > did 1000 R/W on an 8 bits reg with no error
Cycle 21 > did 1000 R/W on an 8 bits reg with no error
Cycle 22 > did 1000 R/W on an 8 bits reg with no error
Cycle 23 > did 1000 R/W on an 8 bits reg with no error
Cycle 24 > did 1000 R/W on an 8 bits reg with no error
Cycle 25 > did 1000 R/W on an 8 bits reg with no error
Cycle 26 > did 1000 R/W on an 8 bits reg with no error
Cycle 27 > did 1000 R/W on an 8 bits reg with no error
Cycle 28 > did 1000 R/W on an 8 bits reg with no error
Cycle 29 > did 1000 R/W on an 8 bits reg with no error
Cycle 30 > did 1000 R/W on an 8 bits reg with no error
(...)
Cycle 507 > did 1000 R/W on an 8 bits reg with no error
Cycle 508 > did 1000 R/W on an 8 bits reg with no error
Cycle 509 > did 1000 R/W on an 8 bits reg with no error
Cycle 510 > did 1000 R/W on an 8 bits reg with no error
Cycle 511 > did 1000 R/W on an 8 bits reg with no error
^CCycle 512 > did 1000 R/W on an 8 bits reg with no error
INFO: Exiting LoRa concentrator SPI stress-test program
admin@mtcdt:/opt/lora/gateway-utils#

I aborted it after 512 cycles.

[Jason Reiss]

Everything looks to be functioning.

There are no other running processes using the card.
$ ps aux | grep lora

Please open a ticket at support.multitech.com.
We may need to share a packet forwarder binary with lower level debug messages enabled.

The lgw_start function is not returning OK.
https://github.com/Lora-net/lora_gateway/blob/master/libloragw/src/loragw_hal.c

[Fredrik]

There are no other running processes using the card.
$ ps aux | grep lora

No processes were listed (except grep).

Please open a ticket at support.multitech.com.
We may need to share a packet forwarder binary with lower level debug messages enabled.

Ok – I’ll do that. Thank you for your support!

[akarunakaran@mindlogic.com]

I have been facing the same issue. I tried running the below commands,

cd /opt/lora/gateway-utils
./test_loragw_spi
./util_spi_stress

for which i got the following results

admin@mtcdt:/opt/lora/gateway-utils$ ./test_loragw_spi
Beginning of test for loragw_spi.c
data received (simple read): 0
End of test for loragw_spi.c
admin@mtcdt:/opt/lora/gateway-utils$ ./util_spi_stress
INFO: Starting LoRa concentrator SPI stress-test number 1
ERROR: lgw_connect() did not return SUCCESSadmin@mtcdt:/opt/lora/gateway-utils$

[Jason Reiss]

Try using sudo if on mPower 5.0.x or higher.

admin@mtcdt:/opt/lora/gateway-utils$ sudo ./util_spi_stress

[akarunakaran@mindlogic.com]

Thank you. I used sudo and it worked.

Also used

sudo ./lora_pkt_fwd

and i was able to start the concentrator manually.

I have installed LoRa gateway bridge in my system and to make sure the packet forwarder send data to the bridge i used the below command

sudo tcpdump -AUq port 1700

but no response. I followed the below link for trouble shooting

https://www.loraserver.io/guides/troubleshooting/gateway/

• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.
• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.
• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.
• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.

[akarunakaran@mindlogic.com]

The command

sudo ./lora_pkt_fwd

gives the following response

##### 2019-10-16 05:51:00 GMT #####
### [UPSTREAM] ###
# RF packets received by concentrator: 2
# CRC_OK: 100.00%, CRC_FAIL: 0.00%, NO_CRC: 0.00%
# RF packets forwarded: 2 (46 bytes)
# PUSH_DATA datagrams sent: 3 (523 bytes)
# PUSH_DATA acknowledged: 0.00%
### [DOWNSTREAM] ###
# PULL_DATA sent: 2 (0.00% acknowledged)
# PULL_RESP(onse) datagrams received: 0 (0 bytes)
# RF packets sent to concentrator: 0 (0 bytes)
# TX errors: 0
# BEACON queued: 0
# BEACON sent so far: 0
# BEACON rejected: 0
### [JIT] ###
# SX1301 time (PPS): 182520464
src/jitqueue.c:449:jit_print_queue(): INFO: [jit] queue is empty
### [GPS] ###
# Invalid time reference (age: 1571205060 sec)
# no valid GPS coordinates available yet
##### END #####

JSON up: {"stat":{"time":"2019-10-16 05:51:00 GMT","rxnb":2,"rxok":2,"rxfw":2,"ackr":0.0,"dwnb":0,"txnb":0}}

INFO: Received pkt from mote: D002382E (fcnt=46037)

JSON up: {"rxpk":[{"tmst":210834980,"chan":7,"rfch":1,"freq":903.700000,"stat":1,"modu":"LORA","datr":"SF10BW125","codr":"4/5","lsnr":8.0,"rssi":-26,"size":23,"data":"AC44AtB+1bNweOow//8kr/g1+StzNmY="}]}

• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.
• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.
• This reply was modified 4 years, 6 months ago by akarunakaran@mindlogic.com.

[Author]

Posts