Scheduled maintenance: Community will be offline Monday June 17th, 1:00 AM - 6:00 AM (PT)
Reply
Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

I do not find that phrase in my /var/log/messages.

 

BUT 

 

Currently, 2 of my 3 APs are dropped, and they have been dropped for quite some time, which is atypical.  Will try the other two should they decide to grace me with functioning again.

 

Member
Posts: 188
Registered: ‎05-31-2018
Kudos: 25
Solutions: 4

Re: TONS of errors, and frequent service drops Mesh network

Hi @UBNT-BenBuckley 

 

My /var/log/messages only covers the last 17 hours, and the AP has not fallen off in that time, so the grep returns nothing.

 

I have a syslogd running on my network - would you like me to see if there is anything on there for the last fall-over (which was ~3 days ago)?

Ubiquiti Employee
Posts: 1,471
Registered: ‎12-16-2015
Kudos: 310
Solutions: 10

Re: TONS of errors, and frequent service drops Mesh network

[ Edited ]

@Pian wait, what FW are you on?  I should have clarified that I would only expect to see the issues if you're on `4.0.x`, which I think you've been avoiding?

 

If you're on 4.0.x, then yes please check your log server.  If you see nothing, just wait for another disconnect/reconnect.

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

MAC Address78:8a:20:20:c0:b8
ModelUniFi AP-AC-Mesh
Version4.0.21.9965
Board Revision11
 
Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

The two that are down have been down for an extended period of time, like 90 mins.   they seem to jump between isolated and disconnected every so often.  I guess I'm going to have to go manually reboot them

 

Member
Posts: 188
Registered: ‎05-31-2018
Kudos: 25
Solutions: 4

Re: TONS of errors, and frequent service drops Mesh network

@UBNT-BenBuckley As I mentioned ^^^ I'm on 4.0.21 atm Man Happy

 

I just ssh'ed in to the machine running syslogd and have found that nothng has been logged for the last few weeks - I think it may have run out of space because of not rotated logs, maybe.

 

Sorry - not going to be any help right now. FWIW, I will be back there in a few weeks.

Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

just rebooted both down sites, and they came back up.  No evidence returned from 

grep 'received packet on' /var/log/messages

 

Does it wipe the /var/log/messages on power loss?

 

Ubiquiti Employee
Posts: 1,471
Registered: ‎12-16-2015
Kudos: 310
Solutions: 10

Re: TONS of errors, and frequent service drops Mesh network

@robpatton yes the power cycle will wipe out /var/log/messages

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

Ok, dug deeper in my logs, must have typoed or splunk was angry today.

 

Odd set of results,   Not many...

 

 

Apr 24 19:51:31 10.0.1.16 Apr 24 19:51:31 U7MSH,fcecdae5c90e,v4.0.21.9965: kernel: [174343.331439] br0: received packet on ath3 with own address as source address
Apr 21 10:56:30 10.0.1.16 Apr 21 10:56:30 U7MSH,fcecdae5c90e,v4.0.21.9965: kernel: [526371.864207] br0: received packet on ath3 with own address as source address
Apr 22 01:18:37 10.0.1.15 Apr 22 01:18:37 U7MSH,788a2070b66e,v4.0.21.9965: kernel: [580060.613035] br0: received packet on ath3 with own address as source address
Apr 4 06:59:10 10.0.1.15 Apr 4 06:59:09 U7MSH,788a2070b66e,v4.0.21.9965: kernel: [58994.320123] br0: received packet on ath3 with own address as source address
Mar 1 11:59:58 10.0.1.15 Mar 1 11:59:57 U7MSH,788a2070b66e,v4.0.21.9965: kernel: [1196095.622929] br0: received packet on ath3 with own address as source address
Mar 1 11:59:58 10.0.1.15 Mar 1 11:59:57 U7MSH,788a2070b66e,v4.0.21.9965: kernel: [1196095.610500] br0: received packet on ath3 with own address as source address
Jan 3 09:37:11 10.0.1.15 Jan 3 09:37:10 U7MSH,788a2070b66e,v4.0.15.9872: kernel: [ 1058.749824] br0: received packet on ath3 with own address as source address
Dec 21 11:05:42 10.0.1.14 Dec 21 11:05:41 U7MSH,788a2020c0b8,v4.0.10.9653: kernel: [865746.404188] br0: received packet on ath3 with own address as source address
Nov 30 20:35:02 10.0.1.14 Nov 30 20:35:02 ("U7MSH,788a2020c0b8,v3.9.54.9373") kernel: [2871281.880000] br0: received packet on ath3 with own address as source address
Nov 26 12:30:14 10.0.1.14 Nov 26 12:30:14 ("U7MSH,788a2020c0b8,v3.9.54.9373") kernel: [2496593.760000] br0: received packet on ath3 with own address as source address
Nov 24 16:52:43 10.0.1.14 Nov 24 16:52:43 ("U7MSH,788a2020c0b8,v3.9.54.9373") kernel: [2339542.280000] br0: received packet on ath3 with own address as source address
Oct 28 06:40:44 10.0.1.14 Oct 28 06:40:43 ("U7MSH,788a2020c0b8,v3.9.54.9373") kernel: [2378902.580000] br0: received packet on ath3 with own address as source address
Oct 4 04:30:08 10.0.1.14 Oct 4 04:30:08 ("U7MSH,788a2020c0b8,v3.9.54.9373") kernel: [297468.070000] br0: received packet on ath3 with own address as source address
May 18 00:21:26 10.0.1.14 May 18 00:21:23 ("U7MSH,788a2070b66e,v3.9.19.8123") kernel: [2280798.460000] br0: received packet on ath2 with own address as source address
May 18 00:18:58 10.0.1.14 May 18 00:18:54 ("U7MSH,788a2070b66e,v3.9.19.8123") kernel: [2280649.430000] br0: received packet on ath2 with own address as source address
May 18 00:07:01 10.0.1.14 May 18 00:06:51 ("U7MSH,788a2070b66e,v3.9.19.8123") kernel: [2279927.170000] br0: received packet on ath2 with own address as source address

New Member
Posts: 22
Registered: ‎10-06-2017
Kudos: 1

Re: TONS of errors, and frequent service drops Mesh network

I am having this same issue I am currently on 4.0.15 firmware in all APs.  The APs are AP-Mesh-Pro with 11 switches (8-POE-60W) running same version firmware.  This was stable for a peoriod of time but is now unstable with random drops multiple times through out the day.  This system is for CCTV cameras with a max of 2 cameras connected to a switch.  I will be on site Wednasday from 8:30a on Wednesday 1 May 2019 all day until the problem is resolved @UBNT-BenBuckley if you would like access during that time I can make that happen.

New Member
Posts: 20
Registered: ‎01-11-2019
Kudos: 1

Re: TONS of errors, and frequent service drops Mesh network

@marshall1367Can you provide the hardware revisions and if you are using 24v or 48v PoE?

New Member
Posts: 19
Registered: ‎03-10-2017
Kudos: 7

Re: TONS of errors, and frequent service drops Mesh network

Meshing in general has gone to crap since 4.x. I was just getting over the Meshv3 change too.....

 

I have non been able to wirelessly adopt ANY reset UAP-M devices on ANY 4.x release. I always have to hardwire to adopt and check the "Allow Meshing" feature before I can get wireless to work. Why does it have to be this way? Ironically, I mostly bought a fleet of radios just for this purpose and the features have been declining ever since. Ive had to resort to 'scripting hacks' to compensate for feature loss (from my prespective and use case of course). I like UniFi mostly but the decline of the meshing feature is having me consider switching to an alternative.

 

 

Ubiquiti Employee
Posts: 1,471
Registered: ‎12-16-2015
Kudos: 310
Solutions: 10

Re: TONS of errors, and frequent service drops Mesh network

@robpatton that is actually good news, because it means we have an idea on what is causing your issue.  For some reason, the AP is receiving a packet with it's own mac address as the destination IP address, which looks like a loop to the AP and makes it think that the ENET is available.  It subsequently takes down the wireless uplink interface, and has to re-figure out that it needs the uplink.

 

I have a debug build I'd like you to install, which will help us find out what packet(s) are triggering the loop detection logic.  Are you willing to try it out?  Note that it won't stop the issue from happening, it will just capture information about it when it does happen.

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Ubiquiti Employee
Posts: 1,471
Registered: ‎12-16-2015
Kudos: 310
Solutions: 10

Re: TONS of errors, and frequent service drops Mesh network

@stormp being unable to wirelessly adopt is not something we've seen (I wireless adopt on the regular and it works fine).  Maybe you're fighting a corner case or something.

 

Is wireless adoption the only issue you have, or are you also fighting frequent disconnects (which is the main point of discussion in this thread)?

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Ubiquiti Employee
Posts: 1,471
Registered: ‎12-16-2015
Kudos: 310
Solutions: 10

Re: TONS of errors, and frequent service drops Mesh network

@marshall1367 can you check grep  'receive pack on'  /var/log/messages on one of your AP's after it disconnects and then re-connects and let me know?  If you see the messages as well, running the debug firmware will help.

 

Also, do you know if you see the issue on 3.9.54?

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

If its a task that leads towards solving this problem, I'm all for it. Beta code...

Emerging Member
Posts: 44
Registered: ‎01-10-2017
Kudos: 3

Re: TONS of errors, and frequent service drops Mesh network

Be advised, these mac address errors are not as common as the drops, but an interesting anomoly to mention.   This weekend one of the aps dropped and didnt reconnect for the better part of a day.

 

New Member
Posts: 22
Registered: ‎10-06-2017
Kudos: 1

Re: TONS of errors, and frequent service drops Mesh network

The hardware is 48v PoE do not know the hardware version

New Member
Posts: 22
Registered: ‎10-06-2017
Kudos: 1

Re: TONS of errors, and frequent service drops Mesh network

@UBNT-BenBuckley I do not know if the issue was there for 3.9.54.  I can try to get that information this afternoon

Ubiquiti Employee
Posts: 1,471
Registered: ‎12-16-2015
Kudos: 310
Solutions: 10

Re: TONS of errors, and frequent service drops Mesh network

@robpatton I sent you a message with details on the debug firmware. 

 

 

If you'd like to try our latest features, consider signing up for beta: https://help.ubnt.com/hc/en-us/articles/204908664-How-To-Sign-Up-for-Beta-Access

If you're trying to debug a network issue, take a look at this help article: https://help.ubnt.com/hc/en-us/articles/221029967-UniFi-Debugging-Intermittent-Connectivity-Issues-on-your-UAP
Reply