Scheduled maintenance: Community will be offline Monday June 17th, 1:00 AM - 6:00 AM (PT)
Reply
New Member
Posts: 15
Registered: ‎11-16-2018

High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

[ Edited ]

Hi All,

 

I just wanted to check if anyone else has seen a CPU usage jump on their APs since installing F/W 3.9.54.9373

 

In my case it's jumped from about 2% to 15%~20%, image below of the CPU usage from the Controller Software.

 

Has anyone else seen a jump in CPU usage since installing this F/W version?

(I upgraded a new AP from a 3.7.x version that is came preinstalled with)

 

Thanks

Josh

AP: UniFi AP-AC-LR
Controller: 5.9.29
unifi-ap-lr.3.9.54.9373.week.png
Senior Member
Posts: 25,913
Registered: ‎08-04-2017
Kudos: 4861
Solutions: 1284

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hello @starkjs,

 

Welcome to the community!

 

How many clients are connected to your UAP?

What features are you running on the UAP?

 

 

Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation Scripts | UniFi-VoIP Installation Scripts
USG-XG-8 • USG-4-PRO • USG
US-XG-16 • US-48-500W • US-24-POE-250W 2x • US-16-POE-150W 3x • US-24 • US-8-150W • US-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD 2x • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M • UAP-AC-M-PRO 2x
UAS-XG • UCK-G2-PLUS • UCK-G2 • UCK
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hi @AmazedMender16

 

It's a single access point with 2 to 6 clients connected. (Controller stats below)

 

Running two WLANs (2.4G and 5G)

Uplink Connectivity Monitor: disabled.

Fast Roaming: disabled

Multicast and Broadcast Filtering: disabled

Hide SSID: disabled

UAPSD: disabled

Multicast Enhancement: disabled

MAC address filtering: enabled

 

Not sure which other features you may be thinking about.

 

The previous F/W version before upgrade was factory delivered with 3.7.x

 

Thanks

Joshua

AP: UniFi AP-AC-LR
Controller: 5.9.29
unifi-ap-lr.3.9.54.9373.week.users.png
Senior Member
Posts: 25,913
Registered: ‎08-04-2017
Kudos: 4861
Solutions: 1284

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hello @starkjs,

 

Hmmm... Did you downgrade the UAP again?

Could you for giggles factory reset the UAP?

 


Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation Scripts | UniFi-VoIP Installation Scripts
USG-XG-8 • USG-4-PRO • USG
US-XG-16 • US-48-500W • US-24-POE-250W 2x • US-16-POE-150W 3x • US-24 • US-8-150W • US-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD 2x • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M • UAP-AC-M-PRO 2x
UAS-XG • UCK-G2-PLUS • UCK-G2 • UCK
Senior Member
Posts: 2,811
Registered: ‎04-21-2015
Kudos: 420
Solutions: 112

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

@AmazedMender16 good shot with the downgrade.  Also worth to check "top" command output before and after the downgrade. (grab the screenshots).

Thanks,
Myky
CWSP
--------------------------------------------------------------------------------------------------------------------------------------------------
Don`t blame the device as it`s always doing what you have asked it to do, this is not always the same as what you want.
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hi @AmazedMender16

 

Yes, I tried to go back to a 3.7.x version and it failed and took about 20min for the AP to recover. I was not pushing logs to my syslog server at that stage, so I have since lost the /var/log/messages.

 

Since being on 3.9.54.9373 I have tried (in the first 24hrs after the upgrade).

 - power cycle,

 - resetting to factory defaults

and still no change in the stats on the controller.

 

@myky

I think there is something a little off with the stats from the new version, looking at a 'top', there is something a little off, it doesn't show the level from the controller software, so I am not sure which one is correct (AP or Controller software). - top stats here in another post: https://community.ubnt.com/t5/UniFi-Wireless/FIRMWARE-3-9-54-9373-for-UAP-USW-has-been-released-Stab...

 

Talking about downgrading F/W.

I did that a few hours ago and downgraded to 3.9.42.9152 which applied, I will see how the CPU stats looks in a few hours.

 

Thanks

Josh

 

AP: UniFi AP-AC-LR
Controller: 5.9.29
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hi @AmazedMender16 @myky

 

Looks like a downgrade to 3.9.42.9152 has fixed the CPU usage graphs on the Controller (image attached)

 

unifi-ap-lr-01-BZ.v3.9.42# top -d 3 -n 10 -b | grep "^CPU"
CPU:   9% usr   9% sys   0% nic  81% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  97% idle   0% io   0% irq   2% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
unifi-ap-lr-01-BZ.v3.9.42# top -d 5 -n 20 -b | grep "^CPU"
CPU:   0% usr   9% sys   0% nic  90% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   1% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   1% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  97% idle   0% io   0% irq   1% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   1% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  99% idle   0% io   0% irq   0% sirq
CPU:   0% usr   0% sys   0% nic  98% idle   0% io   0% irq   0% sirq

 

I wonder what has changed in the firmware from .42 to .54 to cause this one little thing.

 

Thanks

Josh

 

AP: UniFi AP-AC-LR
Controller: 5.9.29
unifi-ap-lr.3.9.42.9152.png
Senior Member
Posts: 25,913
Registered: ‎08-04-2017
Kudos: 4861
Solutions: 1284

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hello @starkjs,

 

Can you take a screenshot of the following command? ( on both firmware versions )

top -SH

 

 

Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation Scripts | UniFi-VoIP Installation Scripts
USG-XG-8 • USG-4-PRO • USG
US-XG-16 • US-48-500W • US-24-POE-250W 2x • US-16-POE-150W 3x • US-24 • US-8-150W • US-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD 2x • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M • UAP-AC-M-PRO 2x
UAS-XG • UCK-G2-PLUS • UCK-G2 • UCK
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hi @AmazedMender16

 

The command is not avalaible, it's running BusyBox v1.19.4 and the commands avaliable are limited

 

unifi-ap-lr-01-BZ.v3.9.42# top -SH
top: invalid option -- S
BusyBox v1.19.4 (2018-07-09 23:13:24 MDT) multi-call binary.

Usage: top [-b] [-nCOUNT] [-dSECONDS]

Provide a view of process activity in real time.
Read the status of all processes from /proc each SECONDS
and display a screenful of them.
Keys:
        N/M/P/T: sort by pid/mem/cpu/time
        R: reverse sort
        Q,^C: exit

Options:
        -b      Batch mode
        -n N    Exit after N iterations
        -d N    Delay between updates

AP: UniFi AP-AC-LR
Controller: 5.9.29
Senior Member
Posts: 25,913
Registered: ‎08-04-2017
Kudos: 4861
Solutions: 1284

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hello @starkjs,

 

Just TOP then Man Happy ( my bad )

 


Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation Scripts | UniFi-VoIP Installation Scripts
USG-XG-8 • USG-4-PRO • USG
US-XG-16 • US-48-500W • US-24-POE-250W 2x • US-16-POE-150W 3x • US-24 • US-8-150W • US-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD 2x • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M • UAP-AC-M-PRO 2x
UAS-XG • UCK-G2-PLUS • UCK-G2 • UCK
Senior Member
Posts: 2,811
Registered: ‎04-21-2015
Kudos: 420
Solutions: 112

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hey,

 

Not sure what has changed between the firmware releases. If nothing obvious in the "top" output (e.g like additional service was added etc) then only developers of the code will be able to answer this question.

 

Anyway, 25% of the CPU utilization on the AP usually won't cause any service disruption. 

Thanks,
Myky
CWSP
--------------------------------------------------------------------------------------------------------------------------------------------------
Don`t blame the device as it`s always doing what you have asked it to do, this is not always the same as what you want.
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hi @AmazedMender16

 

There is a loop of CPU usage summary in the post above which ran every 5sec for 20 iterations

top -d 5 -n 20 -b | grep "^CPU"

 

It will not show all processes individual usage, but at least it's the summary that should match the controller graph

 

Looking at a single point in time, the list of things running are below.

unifi-ap-lr-01-BZ.v3.9.42# top b -n 1
Mem: 64648K used, 61624K free, 0K shrd, 0K buff, 26868K cached
CPU:   0% usr   0% sys   0% nic 100% idle   0% io   0% irq   0% sirq
Load average: 0.00 0.01 0.05 1/42 5690
  PID  PPID USER     STAT   VSZ %VSZ %CPU COMMAND
 5690  5109 ubnt     R     1544   1%   0% top b -n 1
  636     1 ubnt     S     8776   7%   0% /usr/bin/ubntevent
  878     1 ubnt     S     8776   7%   0% /usr/bin/wevent
  886     1 ubnt     S     8772   7%   0% /bin/utermd
  883     1 ubnt     S     6328   5%   0% /bin/mcad
  884     1 ubnt     S     6136   5%   0% /bin/mca-monitor
  877     1 ubnt     S     6120   5%   0% /bin/reset-handler
  885     1 ubnt     S     5816   5%   0% /bin/stamgr -i 1 -c 30 -K
    1     0 ubnt     S     1552   1%   0% init
  879     1 ubnt     S     1552   1%   0% /sbin/udhcpc -f -i br0 -V ubnt -A 10 -s /etc/udhcpc/udhcpc -p /var/run/udhcpc.br0.pid -h unifi-ap-lr-01
  875     1 ubnt     S     1552   1%   0% init
  887     1 ubnt     S     1548   1%   0% /usr/bin/syslogd -n -O /var/log/messages -l 7 -s 200 -b 0 -L -R syslog.my_domain:514 -p "U7LR,fcecdae5fad9,v3.9.42.9152"
 5109  5108 ubnt     S     1544   1%   0% -sh
  876     1 ubnt     S     1536   1%   0% /usr/bin/klogd -c 8 -n
  510     1 ubnt     S <   1532   1%   0% /bin/watchdog -t 1 /dev/watchdog -m 512
  888     1 ubnt     S     1416   1%   0% /bin/hostapd /etc/aaa1.cfg
  890     1 ubnt     S     1412   1%   0% /bin/hostapd /etc/aaa2.cfg
 5108  1033 ubnt     S     1224   1%   0% /bin/dropbear -F -d /var/run/dropbear_dss_host_key -r /var/run/dropbear_rsa_host_key -p br0:22
 1033     1 ubnt     S     1188   1%   0% /bin/dropbear -F -d /var/run/dropbear_dss_host_key -r /var/run/dropbear_rsa_host_key -p br0:22
  941     1 ubnt     S     1116   1%   0% /sbin/ntpclient -i 86400 -n -s -c 0 -l -h 0.ubnt.pool.ntp.org
  505     1 ubnt     S      816   1%   0% /sbin/hotplug2 --persistent --set-rules-file /etc/hotplug2.rules
    3     2 ubnt     SW       0   0%   0% [ksoftirqd/0]
  189     2 ubnt     SW       0   0%   0% [kswapd0]
    4     2 ubnt     SW       0   0%   0% [kworker/0:0]
  304     2 ubnt     SW       0   0%   0% [kworker/0:1]
    2     0 ubnt     SW       0   0%   0% [kthreadd]
    5     2 ubnt     SW       0   0%   0% [kworker/u:0]
    6     2 ubnt     SW<      0   0%   0% [khelper]
    7     2 ubnt     SW       0   0%   0% [kworker/u:1]
   84     2 ubnt     SW       0   0%   0% [sync_supers]
  280     2 ubnt     SW       0   0%   0% [mtdblock4]
  285     2 ubnt     SW       0   0%   0% [mtdblock5]
  290     2 ubnt     SW       0   0%   0% [mtdblock6]
  275     2 ubnt     SW       0   0%   0% [mtdblock3]
  444     2 ubnt     SW       0   0%   0% [khubd]
   86     2 ubnt     SW       0   0%   0% [bdi-default]
   88     2 ubnt     SW<      0   0%   0% [kblockd]
   20     2 ubnt     SW       0   0%   0% [irq/10-ath79-gp]
  238     2 ubnt     SW       0   0%   0% [fsnotify_mark]
  260     2 ubnt     SW       0   0%   0% [mtdblock0]
  265     2 ubnt     SW       0   0%   0% [mtdblock1]
  270     2 ubnt     SW       0   0%   0% [mtdblock2]

 

The issue I have is, if I run top over and over, it still doesn't correlate higher CPU usage with individual processes.

ie, from the post: https://community.ubnt.com/t5/UniFi-Wireless/FIRMWARE-3-9-54-9373-for-UAP-USW-has-been-released-Stab...

 

This one example below (on firmware 3.9.54.9373) I can see 82% idle and has 13% system usage, but it's not showing up in the process list

 

Mem: 69120K used, 57152K free, 0K shrd, 0K buff, 26828K cached
CPU:   3% usr  13% sys   0% nic  82% idle   0% io   0% irq   0% sirq
Load average: 0.16 0.20 0.16 2/47 8377
  PID  PPID USER     STAT   VSZ %VSZ %CPU COMMAND
  883     1 ubnt     S     8804   7%   1% /bin/utermd
 5951  8206 ubnt     R     1544   1%   0% top
  874     1 ubnt     S     8808   7%   0% /usr/bin/wevent
  624     1 ubnt     S     8808   7%   0% /usr/bin/ubntevent
  878     1 ubnt     S     6376   5%   0% /bin/mcad
  879     1 ubnt     S     6168   5%   0% /bin/mca-monitor
  873     1 ubnt     S     6152   5%   0% /bin/reset-handler
  881     1 ubnt     S     5840   5%   0% /bin/stamgr -i 1 -c 30 -K
  888     1 ubnt     S     3248   3%   0% /bin/hostapd /etc/aaa2.cfg
  886     1 ubnt     S     3248   3%   0% /bin/hostapd /etc/aaa1.cfg
 8052   874 ubnt     S     1728   1%   0% {syswrapper.sh} /bin/sh /usr/etc/sysw
 8206  8205 ubnt     S     1560   1%   0% -sh
    1     0 ubnt     S     1552   1%   0% init
  871     1 ubnt     S     1552   1%   0% init
  875     1 ubnt     S     1552   1%   0% /sbin/udhcpc -f -i br0 -V ubnt -A 10
 8229  8228 ubnt     S     1544   1%   0% {mca-custom-aler} /bin/sh /usr/bin/mc
  885     1 ubnt     S     1540   1%   0% /usr/bin/syslogd -n -O /var/log/messa
 8228  8052 ubnt     S     1540   1%   0% sh -c /usr/bin/mca-custom

 

As I have rolled the firmware back now and the Controller stats show everything looking ok.

What I can also try is to upgrade to the newer version and see if the high CPU usage comes back.

 

Thanks

Josh




 

AP: UniFi AP-AC-LR
Controller: 5.9.29
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Thanks @myky

 

It is odd, yes, I can't see any process in a top using CPU, but I do see the system using load, so wonder what below the hood has changed and if it's just me or others are also seeing this.

 

Josh

AP: UniFi AP-AC-LR
Controller: 5.9.29
Senior Member
Posts: 25,913
Registered: ‎08-04-2017
Kudos: 4861
Solutions: 1284

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hello @starkjs,

 

Strange... the UAP is running fine besides the higher CPU usage?

 

 

Regards,

Glenn R.

 

CC @UBNT-BenBuckley

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation Scripts | UniFi-VoIP Installation Scripts
USG-XG-8 • USG-4-PRO • USG
US-XG-16 • US-48-500W • US-24-POE-250W 2x • US-16-POE-150W 3x • US-24 • US-8-150W • US-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD 2x • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M • UAP-AC-M-PRO 2x
UAS-XG • UCK-G2-PLUS • UCK-G2 • UCK
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Hi @AmazedMender16

 

Yep, very odd. The AP worked perfectly fine, no issues that I saw.

 

I will leave it on 3.9.42.9152 for a week and see if the rest of the stats in the Controller look consistant.

 

Thanks

Josh

AP: UniFi AP-AC-LR
Controller: 5.9.29
Highlighted
New Member
Posts: 15
Registered: ‎11-16-2018

Re: High CPU usage on UniFi AP-AC-LR after F/W upgrade to 3.9.54.9373

Looks like the downgrade fixed the issue in this case.

 

As a side affect now, I am seeing 100's of 'DHCP Timeout/Failure'

AP: UniFi AP-AC-LR
Controller: 5.9.29
unifi-ap-lr.3.9.42.9152.downgrade.png
Reply