Reply
New Member
Posts: 10
Registered: ‎04-26-2018

Accesspoint looses connection after FW update 4.x

Hello,

 

after I updated some access points (UniFi AP-AC-Pro) to 4.0.10.9653 they stall every 6..8 seconds for 1..2 seconds. SSH console stalls, every traffic on every WLANS stalls. See icmp (on wired interface):

 

64 bytes from 172.16.137.21: icmp_seq=2 ttl=64 time=0.243 ms
64 bytes from 172.16.137.21: icmp_seq=3 ttl=64 time=0.241 ms
64 bytes from 172.16.137.21: icmp_seq=4 ttl=64 time=1463 ms
64 bytes from 172.16.137.21: icmp_seq=5 ttl=64 time=458 ms
64 bytes from 172.16.137.21: icmp_seq=6 ttl=64 time=0.196 ms
64 bytes from 172.16.137.21: icmp_seq=7 ttl=64 time=0.242 ms
64 bytes from 172.16.137.21: icmp_seq=8 ttl=64 time=0.222 ms
64 bytes from 172.16.137.21: icmp_seq=9 ttl=64 time=0.245 ms
64 bytes from 172.16.137.21: icmp_seq=10 ttl=64 time=0.248 ms
64 bytes from 172.16.137.21: icmp_seq=11 ttl=64 time=0.218 ms
64 bytes from 172.16.137.21: icmp_seq=12 ttl=64 time=1383 ms
64 bytes from 172.16.137.21: icmp_seq=13 ttl=64 time=380 ms
64 bytes from 172.16.137.21: icmp_seq=14 ttl=64 time=0.239 ms
64 bytes from 172.16.137.21: icmp_seq=15 ttl=64 time=0.242 ms
64 bytes from 172.16.137.21: icmp_seq=16 ttl=64 time=0.237 ms
64 bytes from 172.16.137.21: icmp_seq=17 ttl=64 time=0.241 ms
64 bytes from 172.16.137.21: icmp_seq=18 ttl=64 time=0.243 ms
64 bytes from 172.16.137.21: icmp_seq=19 ttl=64 time=0.259 ms
64 bytes from 172.16.137.21: icmp_seq=20 ttl=64 time=1284 ms

After every delay I can see a lot of lines (20..40) in messages like this:

 

Thu Dec 27 14:03:55 2018 kern.warn kernel: [ 4536.016954] [wifi1] FWLOG: [4664210] BEACON_EVENT_SWBA_SEND_FAILED (  )
Thu Dec 27 14:03:55 2018 kern.warn kernel: [ 4536.016964] [wifi1] FWLOG: [4664223] WAL_DBGID_RX_LOCAL_BUFS_LWM ( 0x8 )

The value in the brackets changes (0x8, 0x7, 0x9).

 

After downgrade to 3.9.54.9373 all works fine. But I dont want to downgrade 300 access points manualy Man Sad(

 

 

Senior Member
Posts: 13,055
Registered: ‎08-04-2017
Kudos: 2217
Solutions: 640

Re: Accesspoint looses connection after FW update 4.x

Hello @fukzde,

 

I can't replicate this on my UAP AC PRO.

Could you try downgrading and than upgrading again?

 

You can use group config to downgrade/upgrade multiple UAPs.

Devices > APS ( top left ) > Gears ( top right ) > Enable Group Config

 

 

Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation/Easy Update Scripts | UniFi-VoIP Installation Scripts
USG-4-PRO • USG
USW-48-500W • USW-24-POE-250W 2x • USW-16-POE-150W 3x • USW-24 • USW-8-150W • USW-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M
UCK-G2-PLUS • UCK-G2 • UCK
Regular Member
Posts: 559
Registered: ‎01-10-2014
Kudos: 544
Solutions: 2

Re: Accesspoint looses connection after FW update 4.x

You can downgrade multiple APs simultaneously using the 'group config' option (switch to the AP view, enable group config, select multiple APs of the same type and perform a manual firmware "upgrade" with the correct URL).

 

For the problem itself, could you provide more details on how you've configured the APs? (channels, channel widths, band steering, airtime fairness, ...) How many clients are connected? What memory and CPU usage are you seeing in the APs?

New Member
Posts: 10
Registered: ‎04-26-2018

Re: Accesspoint looses connection after FW update 4.x

Hello

 

@AmazedMender16, after downgrade and upgrade the problem is back again.

 

 

@Steltek, Ok, I know the "group config" function. I did not realized that I can use them to downgrade access points, thanks.

 

Some more informations about aps:

 

channels: I'm using 4 channel plan (1-5-9-13). No matter what channel, all channels are affected.

channel widths: 20 MHz

band steering: Don't know how to activate? I think no.

 

There are 0 to 5 clients connectet, this does not affect. But it seems not all ap have this problem. CPU usage on affected APs is ~30%, all others ~10%. The load is >2.

 

 

 

Senior Member
Posts: 13,055
Registered: ‎08-04-2017
Kudos: 2217
Solutions: 640

Re: Accesspoint looses connection after FW update 4.x

Hello @fukzde,

 

Can you try to factory reset 1 unit?

 

Could you post your system config?

Settings > Maintenance > Support Info > Show System Config

 

 

Regards,

Glenn R.


CC @UBNT-BenBuckley

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation/Easy Update Scripts | UniFi-VoIP Installation Scripts
USG-4-PRO • USG
USW-48-500W • USW-24-POE-250W 2x • USW-16-POE-150W 3x • USW-24 • USW-8-150W • USW-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M
UCK-G2-PLUS • UCK-G2 • UCK
New Member
Posts: 10
Registered: ‎04-26-2018

Re: Accesspoint looses connection after FW update 4.x

@AmazedMender16, I tryed factory reset, still the same problem.

 

system configuration (sorry for the screen shoot, but the download button in system information crashes by browser):

 
d2092214-1280-4cd5-ac54-ac934efea9b8.png

 

system configuration not affected ap:

 

26729c8d-643d-49ac-84a1-5943b7d04ce7.png

 

system configuration affected ap:

 

 253f3293-6268-4581-aa2d-4ce36764b323.png

 

It seems all affected access points are in the same area.

New Member
Posts: 10
Registered: ‎04-26-2018

Re: Accesspoint looses connection after FW update 4.x

Forget the last, there are accesspoints in other areas with same problem. I had set a filter Man Wink
Senior Member
Posts: 13,055
Registered: ‎08-04-2017
Kudos: 2217
Solutions: 640

Re: Accesspoint looses connection after FW update 4.x

[ Edited ]

Hello @fukzde,

 

Try decreasing the amount of SSIDs.

Disable the Uplink Connectivity Monitor if you're not using wireless uplinks

Settings > Site > Uplink Connectivity Monitor

 

Also recommend the following Radio Settings

 

2.4 GHz
Channel width: HT20
Chanel: 1/6/11 | Choose one of these channels, a RF scan will help you choose the most clean one.
Transmit Power: Low ( Medium )

5GHz
Channel width: VHT40 | Optional VHT80/VHT160 might decrease wireless stability
Chanel: 36/44 | Optional (149/157) Choose one of these channels, a RF scan will help you choose the most clean one. Avoid using DFS Channels
Transmit Power: Medium ( High )

 

 

Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation/Easy Update Scripts | UniFi-VoIP Installation Scripts
USG-4-PRO • USG
USW-48-500W • USW-24-POE-250W 2x • USW-16-POE-150W 3x • USW-24 • USW-8-150W • USW-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M
UCK-G2-PLUS • UCK-G2 • UCK
New Member
Posts: 10
Registered: ‎04-26-2018

Re: Accesspoint looses connection after FW update 4.x

Hello,

 

I'm using wireless uplinks on two access points. And I'm using a 4 channel plan (1-5-9-13) since years. I used them befor Unifi with Extreme APs and I'm using it since I have Unifi APs. This was never a problem. But I'll try a 3 channel plan on a area with problems. I can not decreasing SSIDs because they all in use. The users will kill me. There is no problem with 3.9.54.9373 FW. If I downgrade -> no problem. If I upgrade the CPU runns >30% and the access point is stall even in wired link. So I dont think its a configuration problem.

 

I'll try different bandwith and power settings tomorrow.

 

Has anyone informations about the meaning of the messages?

 

[  726.482122] [wifi1] FWLOG: [763756] BEACON_EVENT_SWBA_SEND_FAILED (  )
[  726.482132] [wifi1] FWLOG: [763770] WAL_DBGID_RX_LOCAL_BUFS_LWM ( 0x7 )
[  726.482142] [wifi1] FWLOG: [763782] BEACON_EVENT_SWBA_SEND_FAILED (  )
[  726.482152] [wifi1] FWLOG: [763790] WAL_DBGID_RX_LOCAL_BUFS_LWM ( 0x7 )
[  726.482163] [wifi1] FWLOG: [763809] BEACON_EVENT_SWBA_SEND_FAILED (  )
[  726.482172] [wifi1] FWLOG: [763811] WAL_DBGID_RX_LOCAL_BUFS_LWM ( 0x7 )
[  726.482183] [wifi1] FWLOG: [763831] WAL_DBGID_RX_LOCAL_BUFS_LWM ( 0x7 )
[  726.482193] [wifi1] FWLOG: [763835] BEACON_EVENT_SWBA_SEND_FAILED (  )

 

 

Senior Member
Posts: 13,055
Registered: ‎08-04-2017
Kudos: 2217
Solutions: 640

Re: Accesspoint looses connection after FW update 4.x

Hello @UBNT-BenBuckley,

 

Could you take a look at this?

 

 

Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation/Easy Update Scripts | UniFi-VoIP Installation Scripts
USG-4-PRO • USG
USW-48-500W • USW-24-POE-250W 2x • USW-16-POE-150W 3x • USW-24 • USW-8-150W • USW-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M
UCK-G2-PLUS • UCK-G2 • UCK
New Member
Posts: 10
Registered: ‎04-26-2018

Re: Accesspoint looses connection after FW update 4.x

[ Edited ]

@AmazedMender16@all

Hello,

 

some updates on my stall problem. It seems the messages I postet have nothing to do with the problem. It was a consequence of the actual problem. But I found the cause:

 

I have a (V)LAN tagged to the same port as the access point. This is a very big lan with a lot of broadcast, specially ARP. The traffic is 802.1Q tagged but the accesspoints seems to have a problem with it. If I switched off this vlan all works fine after two or three minutes. But again, this problem occurs only in firmware >=4.x not in 3.9xx!

 

 

Ubiquiti Employee
Posts: 1,325
Registered: ‎12-16-2015
Kudos: 299
Solutions: 10

Re: Accesspoint looses connection after FW update 4.x

@fukzde those messages happen when the AP cannot transmit a beacon because it has to buffer the packet's for too long.  Saturated airtime can cause this, and it sounds like that is the issue you're running into.

 

broadcast traffic on a large LAN will take down airtime quickly.  

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Emerging Member
Posts: 72
Registered: ‎02-10-2016
Kudos: 30
Solutions: 3

Re: Accesspoint looses connection after FW update 4.x

@UBNT-BenBuckley unifi it is not suitable for large network deploys? becouse I am getting stability problems with 4.x FW

Regular Member
Posts: 559
Registered: ‎01-10-2014
Kudos: 544
Solutions: 2

Re: Accesspoint looses connection after FW update 4.x


@vilpalu wrote:

@UBNT-BenBuckley unifi it is not suitable for large network deploys? becouse I am getting stability problems with 4.x FW


You should probably open a separate thread about your stability problems.

 

Plenty of people use Unifi with large networks, but as @UBNT-BenBuckley points out, lots of broadcasts can quickly occupy all your airtime (regardless of which AP manufacturer you use) so you need to make sure you manage your broadcast domains (segment your network) or otherwise filter broadcasts from the Wi-Fi network.

Reply