10G Home Data Center

by 3 weeks ago

I couldn't figure out how to cross-post, so I duplicated (also in video).  If someone can do that, this can be deleted.

 

This is an update to a previous story.  I moved, and seriously upgraded my home network to a full on 10G dual fiber Data Center.  The full story is on my wiki, but I took a spare 17'x11' room in the basement, UniFi'ed the crap out of it, added a bunch of power and AC, and below is the result.

 

It's a biggish house, and I wanted to go all out, no compromises with this build since this is our "forever" home.  I'm also going big into home automation, so I wanted a very reliable network with as many things on Ethernet as I could to free up WiFi spectrum.  I'm very pleased with the outcome, my WiFi is providing 400Mbps download speeds.

 

* Cincinnati Bell 1G down/250M up FTTH primary, 200M/6M Spectrum cable fail-over WAN

* XG-8 10G Router with full IPS/IDS enabled

* 4 XG-16 core switches, dual 10G SFP+ LAG uplinks

* 3 US-48 (1 750W POE, 1 48-L2-POE, 1 US-48) + 1 US-16 POE Distribution switches

* 8 US-8 (some POE, some powered by POE) local switches

* 6 UAP-AC-HD WiFi access points

* 1 UAS-XG UniFi and UVC server

* 5 UVC-Pro

* 4 UVC-G3 Cameras

* 5 UVC-Micro cameras

* 5 Ring Floodlight cameras

* 2 Ring Doorbell cameras

* 7 Sonos Connect Amp for audio

* 3 Tivo Bolt for TV

* 2 HD HomeRun for local TV

* 3 Dell rack mount severs (Proxmox and FreeNAS)

* 1 Rack mount Mac Mini server

* 7 VLAN

* All private services (web, email, wiki, Plex, NextCloud)

* Sonnet 10G copper NIC for local PCs

* Dual 10G fiber to 4 PC locations

* Cat6a cabling throughout (80 drops)

* 1.5 ton mini-split AC

* 6 1500VA CyberPower UPS 

 

Network_top.jpgNetwokring Top

 

 

 

 

 

Network_bottom.jpgNetworking Bottom

 

 

Server_top.jpgServer Top

 

 

Entertain_bottom.jpgEntertainment Bottom

 

Entertain_top.jpgEntertainment top

 

Server_bottom.jpgServer bottom

 

Rack_front.jpgFront of Racks

 

Wire_patch15.jpgCable trough

 

Door6.jpgEntrace to my lair

 

 

 

Cameras_status.jpgCamera StatusCameras_all.jpgUVC Cameras

 

My old setups

https://community.ubnt.com/t5/UniFi-Stories/UniFi-house-network-large-with-FTTH-Fioptics-USG-XG-US-8...

https://community.ubnt.com/t5/UniFi-Stories/Ubiquiti-Upgrades-for-my-Fioptics-Installation/cns-p/170...

 

 

{"location":{"title":"Glendale, OH 45246, USA","placeId":"ChIJ5ZpHE-BNQIgROs400sOI628"},"addedProducts":[{"id":"unifi-video-camera-g3","count":1},{"id":"unifi-video-g3-micro","count":1},{"id":"unifi-video-g3-pro-camera","count":1}],"solved":"","numbers":"","description":"","mainImage":"192423i91AA3D85F80BE225"

 

 

{"location":{"title":"Glendale, OH 45246, USA","placeId":"ChIJ5ZpHE-BNQIgROs400sOI628"},"addedProducts":[{"id":"unifi-video-camer

{"location":{"title":"Glendale, OH 45246, USA","placeId":"ChIJ5ZpHE-BNQIgROs400sOI628"},"addedProducts":[{"id":"l2-managed-poe-gigabit-switch-with-sfp","count":1},{"id":"unifi-application-server","count":1},{"id":"unifi-switch-8-60w-b","count":1},{"id":"unifi-switch-8-150w","count":1},{"id":"unifi-security-gateway-xg","count":1},{"id":"unifi-switch-16-150w","count":1},{"id":"unifi-switch-16-xg-beta","count":1},{"id":"unifi-switch-48","count":1},{"id":"unifiswitch-48-750w","count":1},{"id":"unifi-ac-hd","count":1},{"id":"unifi-switch-8-beta","count":1}],"solved":"","numbers":"","description":"","mainImage":"192426i2ED0A8D0118FD447"}

Comments
by
3 weeks ago

What kind of wattage does your data center pull?

by
3 weeks ago

Not sure yet overall.  I should get a Neurio or something, as I did put in a new subpanel to power it (including the AC mini split unit).  Each of my 4 servers has an Eve Energy, though, and seem to draw about 150W each, and the 48 port POE about 200W.

by
3 weeks ago

dang...thats some crazy setup. must be hella expensive.

 

nextcloud?? why you choose that over owncloud. just curious. owncloud is slow and thinking of switching .

by
3 weeks ago

Yea, it's a little pricey.

 

My understanding is the guys that started NextCloud left OwnCloud and started this up, and all the real development is over there now.  I could be wrong.

 

https://civihosting.com/blog/nextcloud-vs-owncloud/

 

https://serenity-networks.com/goodbye-owncloud-hello-nextcloud-the-aftermath-of-disrupting-open-sour...

by
3 weeks ago - last edited 3 weeks ago

I really want to setup one like yours .Mines smaller and servers and switch sitting on cost co shelfs.

 

I run share out my net to 11 other houses . Comcast fiber 

 

Just curious. How many devices online with such a monster setup like yours? 

10G isn't that a bit over kill if its just for your house ?

 

 

 

 

Screenshot_20190131-203259.pngScreenshot_20190131-203206.pngScreenshot_20190131-202833.png

by
3 weeks ago

Hats of to you my friend. A room like that in my house with the blue lights and "data center" on the door with never be wife approved in a million years lol.

by
3 weeks ago - last edited 3 weeks ago

@Bellows - Thanks, someone has to do it, like the shining city on a hill...

 

@cardins2u - Right now I have between 140-150 clients on the network at an "average" time.  I haven't finished my home automation though.  10G might be a bit overkill for my current needs, but I figured it this way.  I wanted to have really good throughput between my servers and my desktops as I fill out my Plex library, and this let's me copy an HD movie in about 1-3 minutes instead of 15.  It also allowed me to learn about fiber and SFP+, which I have some responsibility for at work but don't get to really "do", so that's a plus.  Also, I needed to make sure the core network can handle the traffice.  I have 16 HD cameras on my network, and although I put them in their own VLAN (to the NVR), for me to access them they have to talk to another VLAN, and in UBNT gear that means it has to go to the router, so I wanted to leave plenty of overhead for the other traffic.  Plus, I plan on living here for a long time, so I was trying to future proof.  I ran OM4, which can do 40/100G later.

clients.jpg150 clients typical

by
2 weeks ago

I just wanted to say thanks for posting this.  I'm an overkill at home type of guy, especially since I do ISP scale networks as my day job.  Seeing this gives me something to look forward to doing in my next house which will be our "forever" home.

 

I'm glad you posted the client page within the controller.  This actually has led me to reevaluate the naming on mine.  Just curious to if you have made any sort of Visio diagram or how it may be documented for reference?

by
2 weeks ago

Yes, I do!  Let me santize it just a bit and I'll come back and post it

by
2 weeks ago - last edited 2 weeks ago

Outstanding!  I just adopted your camera naming scheme on my home as well as my grandparents' and parents' homes.  Absolutely helped get those in a proper order.

 

All or my clients are named similar to yours although by category, then manufacturer, model, etc.

 

I have a half finished drawing that I never finished. Somehow I work in Visio every single day designing networks and when it came time it do my own I just procrastinate. I've got my popcorn ready for when you post yours. 

 

I'm also showing the wife that the next home also needs a proper data center room and not this 12u rack I have beside my desk holding our networking gear and server.

by
2 weeks ago

So, looks like it doesn't want to let me add these attachments, so I put them on my Wiki page.  If you have thoughts on improving my naming scheme I'm open to input, I've tried to number the switches and things in a sensible manner.  The diagram got a little busy, but I plan to go back and put port numbers on the lines, but trying to get them to visually connect to the right port was just too much work.

 

Network_Diagrams

by
2 weeks ago - last edited 2 weeks ago

@bferrell Amazing setup!  Very clean.

 

I have been looking for a 1U brush cable management panel that matches the Ubiquiti Unifi gear.

 

Would you mind telling me where you purchased yours?  Or did you customize a stock panel?

 

I am also looking for blank panels that match the Unifi coloring as well.

by
2 weeks ago

Yea, I did my own, after seeing someone else who had done it, so I just got regular blanks and brush plates and some "Aluminum" colored spray paint at the hardware store.

by
2 weeks ago

@bferrell 

 

Thank you!  Your panels are the closest color-matched panels I’ve seen. 

 

Do you recall which brand or which “aluminum” color you used?

by
2 weeks ago

@bferrell Visio looks top notch as expected.  Any chance you can tell me where you got those UBNT icons/svg/whatever they are?  I grabbed some posted on the forum but they aren't that clean.  Seeing yours gives me something to work off of for mine.

by
2 weeks ago

Its a fair question.  I don't honestly remember.  I got a starter set by googling UBNT visio or somesuch, and then for the newer things I think I just grabbed a image from Google and resized it to be honest.  Again, if folks have feedback I'm all ears, I struggle with the right way to show 10G versus 1G and fiber versus copper, and keep it all readable.  As you know, if it's not documented it's not maintainable, and it's not easy to read, well, maintenance is misery...

by
2 weeks ago

 

sub-buzz-7145-1509409754-1

 

Now that's one hell of a crazy setup, Love it!!

 

by
2 weeks ago

I believe the set in this posting are the Visio symbols I ended up starting with.

 

https://community.ubnt.com/t5/EdgeRouter/VISIO-shapes-stencils/td-p/834416

 

I'm pretty sure this is the Krylon Aluminum colored paint I used.

https://www.lowes.com/pd/Krylon-Fusion-All-in-one-General-Purpose-Gloss-Aluminum-Metallic-Spray-Pain...

 

Crazy like a Fox!

by
2 weeks ago

Is each dell server running their own instance of Proxmox or are they workign in a cluster mode?

by
2 weeks ago

They're both running proxmox, but in cluster mode, which is a little awkward as it wants 3 for a quorum.  I plan to get redundant hardware for both so I have a cluster of 4 and can setup high availability.

by
2 weeks ago

Why do you have so many Sonos Connect AMP sitting together? Are you running your audio cables from your racks?

With that much 10GB and POE, how did you decide to handle ground?

by
2 weeks ago

Quite some setup. Well done! Love it.

by
2 weeks ago

What a dream of a setup!

 

Out of interest, which UniFi cameras have you got that run on WiFi? I thought all their solutions were wired?

 

And how are you finding the Security Gateway XG? Do you know if it can handle multuple WAN IPs?

by
2 weeks ago

@ACarneiro The USG-Micro cameras are WiFi only cameras. They do have the option of being powered via POE but they still send there "signal" over WiFi.

 

@bferrell How do you like the Sonos Connect AMPS? I've been thinking about using them in a house that I had wired up.

by
2 weeks ago

@demonmaestro I love the Amps, they're expensive, and they're not getting Airplay2 (at least the classic version, the new ones might), so I picked up some second hand on eBay to get a little savings, but I think it's a really good way (maybe the 'right way' even) to do whole-house audio, at least for me.  They allow for each room to be a zone, and any device (iOS/Mac/whatever) to adjust the source, volume, group and ungroup into as many unique groups as you want.   So, the basement units could all be playing music, and I could have the first floor on the Superbowl from my Tivo (they have optical out, which I route to a TOSLINK to RCA converter to the RCA input of the Amps).  I have a hardwired volume knob in each room in case someone gets punky with the volume control in another part of the house as well.  The grouping feature works really well, and keeps the sound very well sync'ed.  I have another set of 4 from the "existing" part of the house in a separate room from the remodel, so I get pretty full coverage.

 

@ACarneiro I like the USG, it has multiple WAN input, but I haven't gotten that to fully work in the versions I'm running (5.8.30 and firmware 4.4.29 - I'm a little leary of both upgrades to 5.9 and 5.10 based on folk's feedback and how rare the XG-8 is still).  I can't seem to get dyndns to work on both WAN ports if you try to use the same provider for both, and although WAN2 does fail over to the cable backup, it does not properly reroute my incoming port forward rules.  I assume it will come, and other than that I'm pretty happy.  Setting it up was a chore early on but they've dealt with most of that.

 

@BrianAker They're together because I think it's a cleaner install.  Yes, all of the 4 wire audio cables from the indivdiual room volume controls are routed to a patch panel on the wall, and then to the racks.  I also have an RCA cable from a TOSLINK/optical for each from Tivos around the house so I can feed TV audio to the in ceiling speakers for like Superbowl or World Series/Olympics parties.  This keeps me from having to have a separate "audio closet" around the house with power/AC/networking for the Sonos'.

 

I probably haven't thought about grounding as much as I should, but I have Belden 6a cable throughout, and the patches are 6a with grounding straps and the racks have grounding straps as well.  I installed 8 new circuits into a subpanel to power the data center, so I can ground to that common location, and both incoming WANs are connected to APC PNET1GB isolators for surge protection, and everyting in the rack is fed from one of several CyberPower 1500VA UPS/surge protectors.  If there's more I should consider I would be interested in your thoughts.  Right now I don't think the network gear or wire is limiting me on speed, I think my computers are.  On iPerf3 I get a bit under 7Gbps on my SSD based MacOS devices, and my QNAP NAS accepts transfers at about 250MBps, but even copying a movie to it saturates it about 1/2 through and it drops to aboue 120MBps sustained (it as 10GB Seagate Iron Wolf Pro NAS drives, so they're good quality, but not particularly fast).  On the POE, although I can drive a lot of power, I'm not really.  I have 6 US-8 switches, and I'll have 8 AC-HD access points, one POE Ring doorbell and 9 UVC POE cameras, I'm powering the Micros locally.

by
2 weeks ago

@bferrell How are your PowerEdge servers. Do they sound like a jet taking off or did you do the fan mod?

I use to have a couple of the PowerEdge 2950s... Well all I got to say is if I wanted to stay warm all I needed to do was to sit behind the rack for a short period of time.Out

by
2 weeks ago

@demonmaestro Yea, when they boot they are really, really loud.  Or, if I remove the side cover from the rack (or open the case!).  And they generate a lot of heat.  I do have the room conditioned to the mid 60's F, though, so that keeps the fan speed reasonable, and my desk is in the "warm aisle", so it's kind of nice if I'm in there for awhile to get some of the heat.  I actually used to think some of the UBNT gear was a little noisy, but I have to admit the server room isn't as loud as I expected.  At work we're required to wear hearing protection to go into the data center, but I don't think mine is anywhere near noisy enough for that.

by
2 weeks ago

@bferrell heat protection?! Idea

by
2 weeks ago - last edited 2 weeks ago

Hearing protection (ear plugs)... not heat..  but I sometimes take a jacket, so... kind of.  Smiley Happy  The jacket is optional.

by
2 weeks ago

Oh.. Got talking about thermals and I had heat on the mind.. lol

Yea, A jacket in a datacenter can be useful. Although the last datacenter I went into seemed a wee bit warm to me. From what I've hear is that some datacenters are raising the temps to 75F-80F.

by
2 weeks ago

I was relooking at the post and noticed that your fiber connection isn't symmetrical. I thought that all fiber was symmetrical. Are you using there modem?

by
2 weeks ago

@demonmaestro I think a lot of is, but not Cincinnati Bell.  There isn't really a "modem", it's an ONT (Optical Network Interface) that converts from GPON to Ethernet, and yes, if you look at the Wiki, that's the Alcatel-Lucent box, and its theirs.  They mount them outside now, so they can service or replace them without getting access to the house, or having someone bend the optic, and just punch the Ethernet and a small power wire through the exterior.  I have that on my outside wall, along with the cable modem, the surge isolator, and a small UPS.  I think I didn't post pictures of that, but I will. 

 

But unfortunately 1G/250M is the top tier offering.  Once the WAN2 fail-over works fully/properly I'll upgrade my cable to the top 300M/60M offering there as well, right now I just have 100M/5M with them.  There's talk of a 1G cable offering too, but I don't think I'm eligble either, and they don't do the highspeed upstream.  I think 60M is their best.

 

https://www.cincinnatibell.com/shop-cincinnati-bell/internet/plans-pricing

 

by
2 weeks ago

Yeah I am familure with the ONT.  I was thinking with your type of setup that you might have fiber to fiber going straight into the USG-XG-8.

Coax uplinks are never fast when talking on a gigabit level.

by
2 weeks ago

@demonmaestro Yea, I'd like to bring the fiber to my XG-8, and they essentially admitted it was techincally possible, but they don't currently support it.  I meant to mention, the want you to take their Zyxel router/wifi access unit too, which they call "the modem", but I don't use it, I run the ONT output to the surge-surppressor (which is unlikely on the fiber, but can happen on the coax), direct to the USG...

by
2 weeks ago

Brilliant, I recently discussed having a 10G backbone with the wife for our next house, which, admittedly may be a few years away. Learnt some sweet ideas from your setup, especially the running of OM4 and dual 10G NICs on desktops! Nice work.

 

Some Qs, what were your options for 10G NICs and what made you choose Sonnet?

Did you run into Linux vs Win driver issues that affected your choice of NICs?

Why not Intel - copper or fiber 10G NICs?

Did you test max file transfer speeds with a decent NVMe SSDs in RAID0 at both ends?

by
2 weeks ago - last edited 2 weeks ago

@AviHD On the OM4, I really like the armored type in the wall, much more durable.  I got pre-terminated lengths that were pretty close to my needs so I wouldn't have to mess with the (very expensive) terminating tools.  I looked at the "composite" cable first, with a couple of Ethernet, a couple of fiber, maybe coax too, but you always end up with the wrong number of cables, and I couldn't find any with 6a Ethernet and OM4.

 

I use Macs for my desktops (which have pretty vanilla SSDs), so they don't have regular PCI slots, pushing me to look at NICs that were Thunderbolt comatible.  I'm sure some of them just have Intel PCI cards inside, but it's not always clear what you're really getting.  There may be others, but the only ones that I really found that fit the bill were the Akito Thudner 2 and the Sonnet Twin10G (links below).  Honestly, I tried the Akitio first, because it didn't require a power connection and was smaller/cleaner to install (and cheaper), even though it only has one 10G port.  But, I couldn't get the speed through it.  I filed bug reports and actually got some responses from them, but nothing was able to get me even moderately acceptable speeds.  So, I returned those and got the Sonnets, and have been pretty happy even though they're big and have a power brick.

 

I don't run Windows, except my work laptop which I don't do support for, so I don't really have thoughts there.  I got my Dell Rx20's from Orange Computer, and I have not had any driver issues with those.  I'm running Proxmox, which is basically Debian as I understand it, and FreeNAS and aside from getting one dead card (no lights) on my first order haven't had any issues, and they're all generic Broadcom cards.  The QNAP has SFP+, but honestly that machine has been a disappointment from a performance standpoint from day one.  I used to run Plex and Nextcloud on it, but it just wasn't up to the task (it as a Core i7 and 32GB of ram), and even the raw drive throughput is less than I'd hope for.  Long term I'll probably continue to build out FreeNAS storage on 720XD units and retire that QNAP.

 

And no, all of my tests to date have just been generic iperf3 to/from my Macs, just to make sure I was getting "much better than 1G" speeds, I haven't spent any time tweaking that at all, trying jumbo frame or anything.  I haven't even tried iperf to me VMs yet.  The data center is part of a bigger renovation of the new house, so there's a lot going on and that just hasn't bubbled to the top yet.

 

https://www.amazon.com/Thunder2-10G-network-adapter-T2NA-TLITS-AKT/dp/B014VAMBAQ/ref=sr_1_4?ie=UTF8&...

 

https://www.sonnettech.com/support/kb/kb.php?cat=490#position_content

by
2 weeks ago

@AviHD Maybe I can poke in this alittle. I use the 10GTek and haven't had any driver issues yet from both a Linux and Windows side. Granted they are using an Intel chipset.

by
2 weeks ago - last edited 2 weeks ago

@bferrell 

 

Have you thought about replacing the QNAP with a Synology NAS?

by
2 weeks ago

@Aldiallo-Ubt Well, no, not really, if I replace the QNAP I'll just go with a 'real' server at this point. 

 

I'd looked at QNAP and Synology because they provided a "friendlier" management interface on sort of commodity hardware, with good storage sizes.  I'd considered both QNAP and Synology at the time, and they both had pluses and minuses, and maybe Synology would've been a better choice, but the Dell rack hardware I'm now familiar with is so much more powerful, and now that I have experience with FreeNAS and Proxmox, I would personally go that route.  Maybe Synology would've been better, but none of the reviews I saw said there were any significant performance differences between the two, it was mostly the interface, openess, flexibililty, etc.

by
2 weeks ago - last edited 2 weeks ago

@bferrell also check out UnRaid by lime-technology for your NAS. You still have the option for VMs and you can mix and match your HDDs for storage. It has the option for NFS file storage if that's your thing.

 

*Edit spelling*

by
2 weeks ago

Wow, great setup!

 

Not sure if it's too late, but you'll get much better power efficiency if you power your stuff by 240V. Will need different UPSes of course...

You won't see real data centers with 120V PDUs down to racks, it's mostly three phase 240 or 208.

 

If I may suggest something for Home Automation - try UDI ISY + Insteon Man Happy

by
2 weeks ago

Forgive me if this is self evident, but what the is the purpose/need for "Dual 10G fiber to 4 PC locations" ?  

port redundancy? something else?

by
2 weeks ago - last edited 2 weeks ago

@FlyHappy ##Yea, not exactly, the idea is that I would link aggreagate them into a single 20G link to a local distribution switch.  LAG does double the overall pipe to the core switch, but a single stream cannot use both links, but if I have a local PC with a 10G NIC it could use 1/2 of LAG uplink, and the rest of the local users (printers, Tivo, Apple TV, etc.) can share the other 10G link.  Also, it does provide redudancy to that switch so that if either link goes down or is broken, the switch still has a 10G link to the core.

 

So, since the offices are the places where I'm likely to have 10G capable computers, and the latency is lower on fiber versus copper, I've allowed for these fiber links, the rest of the house is just Cat 6a copper.  I also ran dual copper to the offices, and right now have the computers connected to 1 and a 1G copper (US-8 typically) switch for the rest of the users as the Unifi 10G switches are still relatively expensive.

by
2 weeks ago

@apevnev For me it's too late.  I realize that 240V would be preferrble in some significant ways, and although I do have a 'home data center', that was bit further than I wanted to go.

by
a week ago

Man that is some serios setup! Congrats mate. It's a dream come true.

by
a week ago

@bferrell I'm not sure if anyone else has mentioned this or not. But regarding what you asked about differentiating between copper vs fiber, 1G vs 10G, this is what I use on my diagrams at work: black=1G copper, orange=1G MM fiber, yellow=1G SM fiber, red=10G SM fiber, aqua=10G MM. Also usually use violet for 40/100G links and/or just to identify OM3/OM4 fiber runs if I'm doing a physical cable map.

 

With that setup and two really good connections, that i assume aren't cheap, why do you do WAN failover and not some active/active load-balancing? Preference or is the functionality not really there with the router?

 

Did you do any sound proofing to that room? I ran a 1U R610 in my garage for a bit and it was like a small jet that I could hear inside.

 

Also, sorry for multiple post/notifications. I kept getting errors that it couldn't post but apparently was.

by
a week ago

@jasonb113083 No worries, and thanks for the thoughts on diagramming.

 

Sound proofing - that room is kind of unique in that it's in a basement hallway that leads to a garage, so it has mostly to exterior walls that are inuslated and bricked, then one short end is the garage, the other end is a closet, and above is a hallway.  So, there's not much to be bothered by the noise, but yes, the main door side and all of that assoicated wall was fully insulated, mostly since it's conditioned to a different temperature, and an exterior grade door was installed, so I don't note any noise when outside the room.  The servers are quite loud when booting, but I have to say that once running, at least at the temps I keep the room at (mid 60's F) the fans don't run really fast/loud.

 

On the WAN, there are a couple of things.  First, I think I mentioned elsewhere that the current cable download is quite a bit less than the Fiber (200M versus 1,000M), but the main reasons are:

  1. The router doesn't (at least for me, I'm open to the possiblity I'm doing it wrong, but I believe it's a documented bug) doesn't properly handle port forwarding for the servers I host on WAN2
  2. The upload speed on cable is 5M versus 250M on the fiber, and so the cable is not suitable for Plex or some of my other important services outbound

My current cable offering is basically "free" - my family wanted CATV so the internet is in the "package".  When I can get the failover working properly I'll pursue their 1G offering, but the upload on that is still weak, the Cable Company really thinks people only consume data.

 

Brett

 

Note:  to be fair, there seems to be some documentation here on how to properly configure WAN2 that I hadn't seen yet (looks like it was published a couple of weeks ago), so I will try this later.  But the point on the crappy cable upload speeds stands on why I don't load balance versus fail-over.  If the fiber is available, I want to use it.  If I could figure out how to load balance only the download side, I might try that.

by
a week ago

Nice setup!  Standing by for the Visio diagaram!  Can't wait.  (This may be a sign that I need to get out more...).

 

 

by
a week ago

@wrightts You're a little contrained in what you can post here, but you can see my vizio on my blog.

 

https://wiki.bdfserver.com/index.php/Camp_Kiwi_Data_Center#Network_Diagrams

by
Thursday

Awesome setup!

I can see you've used colour-coded patch cables.

Did you follow any standard, or decide yourself what colours to allocate each?

by
Thursday

@Scud I just made it up, so that it would trigger my memory, so Red is WAN, Yellow is network interconnect, orange are security cameras, green are UPS, blue standard users, purple are GUEST.

by
Friday

Question for you, Are you running a Cloud Key on this setup? and if not what are you running it off of and are you able to access it remotely off-site? 

by
Friday - last edited Friday

@PHNetworks1 If you check out the blog post I reference you can see it all, but I'm running the controller on the UAS-XG application server, and yes, I can access it offsite.  I ran the gen 1 cloud key for a long time (actually I had a pair that I kept up to date with one as a cold spare for a long time).  Mostly upgraded so I could have a reliable UVC (video server) for my 16 camera setup, otherwise I'd run the controller on a VM probably.

by
Friday

Where did you get white racks?  Did you paint them?  Very cool setup.  Must've taken a dog year to fully configure, run wire, and finish out the installation.  Your home data center is more on point than some enterprise data centers I know.

by
Friday

@JuicyMetal Yea, check the blog entry I posted above for more details, but they're Great Lakes racks, from their "sound and security" line, and came white.  I got it from my brother in law who is in the surplus business.  I think it was originally in a Walgreen's or CVS.  I would've rather that they be black, but mostly I wish they had space for PDUs and cable management, but I got a good deal on them.  :-)

by
Friday - last edited Friday

@bferrell  Do you have to pay the subscription from unifi for having the remote access? 

by
Friday

@PHNetworks1 No, there is no subscription for UniFi that I'm aware of, and I've used UBNT for years now on mulitple sites.  Are you talking about their "Elite" support/service?  I do not subscribe to that, no.