Reply
Senior Member
Posts: 10,063
Registered: ‎08-04-2017
Kudos: 1631
Solutions: 493

Re: AP-Pro keeps rebooting / disconnecting every day

Hello @steveclarke0703,

 

I recommend trying the BETA builds...

 

 

Regards,

Glenn R.

Cloud Hosted Controllers | Glenn R. | UniFi Installation/Easy Update Scripts | UniFi-Video Installation/Easy Update Scripts | UniFi-VoIP Installation Scripts
USG-4-PRO • USG
USW-48-500W • USW-24-POE-250W 2x • USW-16-POE-150W • USW-24 • USW-8-150W • USW-8
UAP XG • UAP-SHD • UAP-HD • UAP-NanoHD • UAP-AC-PRO 2x • UAP-AC-LITE • UAP-AC-IW • UAP-AC-M
UCK-G2 • UCK
New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

Hi @UBNT-BenBuckley,

 

This evening it rebooted again by itself. The logging shows nothing but a gap between a normal message and the first message after reboot with the AP's IP number ...Firmware installed is the latest Beta (4.0.6.9572). Is there a way to test the internals of the AP?

 

Thanks for all your efforts ...

New Member
Posts: 17
Registered: ‎07-25-2018

Re: AP-Pro keeps rebooting / disconnecting every day

Will consider it.

 

Turned off my mac controller and my APs are stable.

 

So I think my controller is dodgy and need to wipe my mac server and start again. Migrating the controller from one Mac to another doesn't seem to have worked. Looks like the controller keeps informing the APs and they get taken from the current network.

 

 

Ubiquiti Employee
Posts: 1,286
Registered: ‎12-16-2015
Kudos: 292
Solutions: 9

Re: AP-Pro keeps rebooting / disconnecting every day

@steveclarke0703 if you have two controllers running L2 at the same time (which it sounds like you do), they will fight for controll of the AP's.  You need to turn the unused controllers off, or forget the devices from the unused controller, so that only one single controller things it's responsible for the UniFi devices.

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
New Member
Posts: 17
Registered: ‎07-25-2018

Re: AP-Pro keeps rebooting / disconnecting every day

I think you're right. Symptoms seem consistent with two controllers vying to inform each AP into their networks. 

 

When running on a mac server, how can I tell how many are running ?

 

I seem to think there is only one running but for some reason, an old one seems to be hanging around.


Anyone know where, on the OS, the configs are stored (e.g. plist file or something similar) ???? Would like to investigate. 

New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

Hi @UBNT-BenBuckley,

 

Past night the AP crashed again, leaving the unit unresponsive, but powered on, the ring looks green to me, but being colorblind I'm not sure about that color Man Happy I removed all clients from this unit and will leave him for at least 24 hours powered on to see what happens without clients. At this moment 13 hours past since then. If this goes fine, I will add client by client to see where it goes wrong ... (and maybe first on 2.4GHZ, then 5GHz, then both the same time).

 

This will take time, I will keep you informed.

 

Beste regards,

New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

Hi @UBNT-BenBuckley,

 

Today, the unit crashed again, without any users on it. Just running ... The logging shows the same as earlier crashes ... How can I figure out if there is a hardware issue with it?

 

Thanks again!

 

 

Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] CPU 0 Unable to handle kernel paging request at virtual address 00000004, epc == 8001b94c, ra == 80014050
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Oops[#1]:
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Cpu 0
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $ 0 : 00000000 00000000 00000004 801fad00
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $ 4 : fffffffc 04a10002 9080002c 000c44a0
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $ 8 : 1100ff01 807e0000 00000000 00000002
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $12 : 00062250 00000000 d4fd8aca 00000000
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $16 : 2ab3f6e4 80200000 84b5ff30 04a10002
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $20 : 2ab3f6e4 84b79010 0049e3e0 00000000
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $24 : 00000000 2ab3f6c0
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] $28 : 84b5e000 84b5fe70 00000000 80014050
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Hi : 00000000
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Lo : 000044a0
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] epc : 8001b94c fpu_emulator_cop1Handler+0x11c/0x1e80
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Tainted: P
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] ra : 80014050 do_cpu+0x218/0x270
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Status: 1100ff03 KERNEL EXL IE
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Cause : 00800008
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] BadVA : 00000004
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] PrId : 0001974c (MIPS 74Kc)
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Modules linked in: ath_pktlog(P) umac ath_dev(P) ath_spectral(P) ath_dfs(P) ath_rate_atheros(P) ath_hal(P) adf(P) asf(P) athrs_gmac pktgen fuse sd_mod scsi_mod sha1_generic michael_mic md5 hmac des_generic arc4 aes_generic ecb cbc gpiodev(P) ubnthal(P) ubnt_common(P)
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Process mcad (pid: 5754, threadinfo=84b5e000, task=84b78dd0, tls=00000000)
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Stack : 855f4870 87050384 8705036c 800b5738 84beb900 87050360 874c60d0 87050390
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] 84b2497c 84b24960 84b5fef0 84b5fec0 84b5fec0 84b78dd0 0000000d 80037bcc
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] 87050360 84b500e0 00000000 00000000 00001000 00000000 7fc636e0 84b5ff18
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] 2ab3f6e8 00000000 00000000 00000001 2ab3f6e4 00000001 807e0000 84b5ff30
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] 00000000 00000000 00000000 00000000 0049e3e0 00000001 00000000 80014050
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] ...
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Call Trace:
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] [<8001b94c>] fpu_emulator_cop1Handler+0x11c/0x1e80
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] [<80014050>] do_cpu+0x218/0x270
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] [<80002420>] ret_from_exception+0x0/0xc
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000]
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000]
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.042000] Code: 3c038020 2463ad00 00431021 <8c440000> 00800008 00000000 30a2003f 2442fff8 2c420002
Nov 14 14:58:44 10.0.0.112 ("U7P,0418d680dd2a,v4.0.6.9572") kernel: [28820.045000] Fatal exception: panic in 5 seconds

Ubiquiti Employee
Posts: 1,286
Registered: ‎12-16-2015
Kudos: 292
Solutions: 9

Re: AP-Pro keeps rebooting / disconnecting every day

@rozenberg sorry for the delay.  Thansk for the log, looking into it.

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Ubiquiti Employee
Posts: 1,286
Registered: ‎12-16-2015
Kudos: 292
Solutions: 9

Re: AP-Pro keeps rebooting / disconnecting every day

@steveclarke0703 you shouldn't be able to run multiple controllers on the same computer unless you're running VM's or something.

 

 

Do you have another controller runnig somewhere on the network, perhaps on a different device?

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Ubiquiti Employee
Posts: 1,286
Registered: ‎12-16-2015
Kudos: 292
Solutions: 9

Re: AP-Pro keeps rebooting / disconnecting every day

@rozenberg do your reboots go away if you go back to 3.9.27?

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Ubiquiti Employee
Posts: 3,775
Registered: ‎01-11-2016
Kudos: 1142
Solutions: 29

Re: AP-Pro keeps rebooting / disconnecting every day

@rozenberg Was there a FW version that did not exhibit this behavior on that unit?
Want to try out new features or fixes before they're released as Stable? Sign up for Beta here: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Signup-for-Beta-Access
Having connectivity issues? See: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

[ Edited ]

@UBNT-BenBuckley wrote:

@rozenberg do your reboots go away if you go back to 3.9.27?



Ehhhhhh, don't know. I checked 3.9.54, 3.9.42 and the latest Beta, all with the same result. The other unit (exact same one) I own runs flawless on the latest Beta. I will revert back to 3.9.27 to check, but why this specific version? Thanks for your time / effort!

 

>> Runs on 3.9.27.8537 since a few seconds, keep you posted!

New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

[ Edited ]

@UBNT-jeff wrote:
@rozenbergWas there a FW version that did not exhibit this behavior on that unit?



Not in my knowledge. I bought two units a few weeks ago, one works great, and one is helping my learning curve Man Happy

Ubiquiti Employee
Posts: 1,286
Registered: ‎12-16-2015
Kudos: 292
Solutions: 9

Re: AP-Pro keeps rebooting / disconnecting every day

@rozenberg both AP's are the same model?

 

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

[ Edited ]

@UBNT-BenBuckley wrote:

@rozenberg both AP's are the same model?

 



Exactly the same, even the MAC address is only slightly different. I'm starting to suspect a RAM failure, or something in the onboard power circuit. Today - now 19:15pm here, central european time - the unit rebooted this morning (approx 12 hours ago) en later today it crashed again leaving the unit in a disconnected state. 3.9.27 is installed since yesterday evening ...

Ubiquiti Employee
Posts: 3,775
Registered: ‎01-11-2016
Kudos: 1142
Solutions: 29

Re: AP-Pro keeps rebooting / disconnecting every day

@rozenberg One other thing, can you swap the two units with each other, to ensure that the problem follows the unit?
Want to try out new features or fixes before they're released as Stable? Sign up for Beta here: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Signup-for-Beta-Access
Having connectivity issues? See: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
New Member
Posts: 15
Registered: ‎10-26-2018
Solutions: 1

Re: AP-Pro keeps rebooting / disconnecting every day

[ Edited ]

@UBNT-jeff wrote:
@rozenbergOne other thing, can you swap the two units with each other, to ensure that the problem follows the unit?


Forget to mention that I'm a tech guy myself. Did that already. Changed POE injectors, cables, isolated the unit in the network without users, isolated it with another SSID, etcetera. The problem moves with the unit ... As fas as I can see, a squasfs runs on the box running in RAM. Is there maybe a firmware version that only tests RAM in a loop and nothing more? Or maybe already available in the bootsector? Using a TTL to RS232 converter is standard practice here, but I don't know if there is something available to check/test...

New Member
Posts: 17
Registered: ‎07-25-2018

Re: AP-Pro keeps rebooting / disconnecting every day

I'm getting reboots, re-adoping, reconnects several times a day. Its pretty random.

 

Ubiquiti don't seem to want to explain why despite me sending them loads of data - logs, screen shots, event logs, etc. 

Screenshot 2018-12-02 at 10.28.25.png
Screenshot 2018-12-02 at 10.28.17.png
Screenshot 2018-12-02 at 10.28.08.png
Screenshot 2018-12-02 at 10.28.02.png
Screenshot 2018-12-02 at 10.27.55.png
Ubiquiti Employee
Posts: 3,775
Registered: ‎01-11-2016
Kudos: 1142
Solutions: 29

Re: AP-Pro keeps rebooting / disconnecting every day

@steveclarke0703 Interesting that they all rebooted at 2:03am. Is your switch rebooting? How are you powering these?
Want to try out new features or fixes before they're released as Stable? Sign up for Beta here: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Signup-for-Beta-Access
Having connectivity issues? See: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
New Member
Posts: 17
Registered: ‎07-25-2018

Re: AP-Pro keeps rebooting / disconnecting every day

Yes, when they reboot, ALL of the AP's reboot at the same time.

 

So its not one particular AP that is the issue.

 

The issue seems to be the switch.

 

All the AP's are powered over POE. 

 

All the cables are authentic cables so its defintiely not a cable issue.


Occasionally, rather than a reboot, the event log shows the AP's being reconnected or readopted, so there's no loss of wifi. But when there's a reboot, the wifi drops out until they've come back up.

 

Been back and forth with this over the last 3 weeks with UBNT Support (Tiers 1-3) and they seem to think its the switch that is the issue. I suspected originally it was the controller but I've since ruled that out as the main cause although i wonder if its not helping matters sometimes. 

 

I don't think its a temperature issue as the switch seems to run at around 68c or thereabouts but its something worth monitoring.

 

Only other thing it can be is a firmware / power management issue. 

 

The reboot times are random. Sometimes the AP's will be up for 19 hours, sometimes 7-8 hours, somtimes less than 20 minutes. Seems to be no real pattern to it. The longest they've been up is 23 hours. 

 

All suggestions welcomed. 

Reply