Pages:
Author

Topic: Data Center Mining Garage and Man Mining Cave ( PART 2 !!!!!!!!) - page 43. (Read 106695 times)

legendary
Activity: 4326
Merit: 8950
'The right to privacy matters'
@ Citronik, since it's 1 Warehouse, I think it's best to have 1 big Core switch like Bhugatti's recommendation of the 48 Gigabit Cisco.  I have that switch but the older 10/100 which great but I think the Gigabit one is much better as it can handle negotiation better with newer switches.  It does P.O.E as well so you can power your security camera via Ethernet which is anothe plus.  Put it in a location where it is easy to run to other devices.  If your warehouse is not massive, the distance should be well within the latency range.  I run from garage to Shed which is over 100 ft wires, and no latency issues.  Best part is that it's super Cheap and is Enterprise class even better than Biz class.

Yes, people are reporting great results with SRR.  Mine is coming soon and I can't wait.  Right now I'm trying to see when the Expansion pack will be available.  My goals is to use multiple SRR bases.  One for each of my Rack so that if a client wants to reboot or work with their Rack, they can do so without asking for my assistance.  For my Shed it would require just 1 base SRR and 1 Expansion pack.  The APC haven't help me save any money, if anything, it cost me over $600 more for the 6 APC over using my more powerful Dell PDUs that I already have.  The more rigs you have, the more likely 1 of them is going to act up.  SRR will pay for itself very fast.  

@ darkshaddows - I do everything myself as it's too expensive to buy prebuilt nor would that solution meet my need for the Furies.  One man show.  However I break it down to assembly line type style where even my kids and wife can help move the line and I get things done in 1/4 the average time someone else would do these.  I will discuss that assembly line in later.    I do have a demanding full time job so efficiency is a must because at the end of the day, I must still leave some time to enjoy dinner with my kids and wife plus walk my wonderful Dog.  

What kind of Dog?

I lived at my Aunt's house near stony brook college. I help her car for 5 dogs while i went to college.

1 Bulldog ----------------------------- Alfie
1 Poodle ------------------------------ Mitzy
1 German Short Haired Pointer ----- Albertina
2 Pointer/lab Mixes------------------- M&Ms, Francis

Walking all five of them was fun until they see a rabbit Grin
hero member
Activity: 662
Merit: 500
I do have a demanding full time job so efficiency is a must because at the end of the day, I must still leave some time to enjoy dinner with my kids and wife plus walk my wonderful Dog.  

Kudos to you!! That´s the hardest but most important part  Wink if you have a full time job + aren´t retired or do mining as a full time job
sr. member
Activity: 414
Merit: 251
@ Citronik, since it's 1 Warehouse, I think it's best to have 1 big Core switch like Bhugatti's recommendation of the 48 Gigabit Cisco.  I have that switch but the older 10/100 which great but I think the Gigabit one is much better as it can handle negotiation better with newer switches.  It does P.O.E as well so you can power your security camera via Ethernet which is anothe plus.  Put it in a location where it is easy to run to other devices.  If your warehouse is not massive, the distance should be well within the latency range.  I run from garage to Shed which is over 100 ft wires, and no latency issues.  Best part is that it's super Cheap and is Enterprise class even better than Biz class.

Yes, people are reporting great results with SRR.  Mine is coming soon and I can't wait.  Right now I'm trying to see when the Expansion pack will be available.  My goals is to use multiple SRR bases.  One for each of my Rack so that if a client wants to reboot or work with their Rack, they can do so without asking for my assistance.  For my Shed it would require just 1 base SRR and 1 Expansion pack.  The APC haven't help me save any money, if anything, it cost me over $600 more for the 6 APC over using my more powerful Dell PDUs that I already have.  The more rigs you have, the more likely 1 of them is going to act up.  SRR will pay for itself very fast.  

@ darkshaddows - Rosewill cases.  I do everything myself as it's too expensive to buy prebuilt nor would that solution meet my need for the Furies.  One man show.  However I break it down to assembly line type style where even my kids and wife can help move the line and I get things done in 1/4 the average time someone else would do these.  I will discuss that assembly line in later.    I do have a demanding full time job so efficiency is a must because at the end of the day, I must still leave some time to enjoy dinner with my kids and wife plus walk my wonderful Dog.  
sr. member
Activity: 462
Merit: 258
Small Time Miner, Rig Builder, Crypto Trader
Thanks guys for the sharing of network gear.

This odd network issue is very recent and the only 2 things I added into the environment : SRR and 10 more X11 ASICs for one of my group members.

TPlink, Linksys and Cisco are the 3 brands in the warehouse and in fact ALL of them are switches (so I dont have any old routers - pheww!)

A call to my network security buddy explained to me over the phone the following points:

1. Don't mess with cheapo network gear. Those XYZ brands from China even had built in backdoors to get into your system! He mentioned something about a hacked Motorola chip that every network gear uses...

2. He okayed TPlink, Linksys and Cisco but encouraged me to use all Gigabit class switches because they can do all the hard work; ie. do the "auto negotiation between switches and they actually learn all the pathways, packet type, share them with the other switches and write it to a master table in the switch". He told me to get HP Procurve... LOL... yeah right.

3. Limit up to 4 levels of cascading between switches. Thats the rule of thumb to avoid bottlenecks but since mining is not heavy duty, he advise to focus on redundancy instead of buying good to have enterprise class network gear - at this point we agreed I dont need Procurves. He further explained that I should get 1 or 2 spare switches, a bunch of network cables - a few long ones, on site just in case for emergencies, since mining downtime is money down the drain.

We also chatted for awhile on whats what on security... he said big issue on that Cloudflare hack recently. Its fixed now but he said change passwords, etc etc just in case. There are lot of bad guys out there.

OK thats all for now.

SRR... 22 rigs now on SRR, I have 11 more to go.

never hurts to have:
spare router---------   your entire network could be down
spare switch -------- a 16 size means 16 pcs are not down
spare cables -------- cheap prices for a 10 pack

so whats this SRR that I keep hearing about?
newbie
Activity: 47
Merit: 0
Hi,

Love your thread!
What cases are you using for the rigs to mount them into the rack?

Are you getting them pre-configured(to install GPU Rigs) or do all the stuff yourself ?

Thanks

legendary
Activity: 1027
Merit: 1005
Replying to get the updates here as well. Good work, cant wait to see whats next!
hero member
Activity: 686
Merit: 500
Dahm that is an immense setup you've got there.
Little bit jealous here  Tongue
legendary
Activity: 4354
Merit: 3614
what is this "brake pedal" you speak of?

never hurts to have:
spare router---------   your entire network could be down
spare switch -------- a 16 size means 16 pcs are not down
spare cables -------- cheap prices for a 10 pack

cable tester cant hurt either.
legendary
Activity: 4326
Merit: 8950
'The right to privacy matters'
Thanks guys for the sharing of network gear.

This odd network issue is very recent and the only 2 things I added into the environment : SRR and 10 more X11 ASICs for one of my group members.

TPlink, Linksys and Cisco are the 3 brands in the warehouse and in fact ALL of them are switches (so I dont have any old routers - pheww!)

A call to my network security buddy explained to me over the phone the following points:

1. Don't mess with cheapo network gear. Those XYZ brands from China even had built in backdoors to get into your system! He mentioned something about a hacked Motorola chip that every network gear uses...

2. He okayed TPlink, Linksys and Cisco but encouraged me to use all Gigabit class switches because they can do all the hard work; ie. do the "auto negotiation between switches and they actually learn all the pathways, packet type, share them with the other switches and write it to a master table in the switch". He told me to get HP Procurve... LOL... yeah right.

3. Limit up to 4 levels of cascading between switches. Thats the rule of thumb to avoid bottlenecks but since mining is not heavy duty, he advise to focus on redundancy instead of buying good to have enterprise class network gear - at this point we agreed I dont need Procurves. He further explained that I should get 1 or 2 spare switches, a bunch of network cables - a few long ones, on site just in case for emergencies, since mining downtime is money down the drain.

We also chatted for awhile on whats what on security... he said big issue on that Cloudflare hack recently. Its fixed now but he said change passwords, etc etc just in case. There are lot of bad guys out there.

OK thats all for now.

SRR... 22 rigs now on SRR, I have 11 more to go.

never hurts to have:
spare router---------   your entire network could be down
spare switch -------- a 16 size means 16 pcs are not down
spare cables -------- cheap prices for a 10 pack
legendary
Activity: 1834
Merit: 1080
---- winter*juvia -----
Thanks guys for the sharing of network gear.

This odd network issue is very recent and the only 2 things I added into the environment : SRR and 10 more X11 ASICs for one of my group members.

TPlink, Linksys and Cisco are the 3 brands in the warehouse and in fact ALL of them are switches (so I dont have any old routers - pheww!)

A call to my network security buddy explained to me over the phone the following points:

1. Don't mess with cheapo network gear. Those XYZ brands from China even had built in backdoors to get into your system! He mentioned something about a hacked Motorola chip that every network gear uses...

2. He okayed TPlink, Linksys and Cisco but encouraged me to use all Gigabit class switches because they can do all the hard work; ie. do the "auto negotiation between switches and they actually learn all the pathways, packet type, share them with the other switches and write it to a master table in the switch". He told me to get HP Procurve... LOL... yeah right.

3. Limit up to 4 levels of cascading between switches. Thats the rule of thumb to avoid bottlenecks but since mining is not heavy duty, he advise to focus on redundancy instead of buying good to have enterprise class network gear - at this point we agreed I dont need Procurves. He further explained that I should get 1 or 2 spare switches, a bunch of network cables - a few long ones, on site just in case for emergencies, since mining downtime is money down the drain.

We also chatted for awhile on whats what on security... he said big issue on that Cloudflare hack recently. Its fixed now but he said change passwords, etc etc just in case. There are lot of bad guys out there.

OK thats all for now.

SRR... 22 rigs now on SRR, I have 11 more to go.
full member
Activity: 224
Merit: 100
CryptoLearner
@Bhugatti - Yeah the one in my garage is 10/100.  It does the job well and I only need a spare.  But for anyone else, I think it's better to pay a little extra and get the 1gb version, hoping the newer one doesn't require crossover connections like my 10/100 version did.  These switch are SOLID and for $100, getting a used NetGear ProSafe or the Cisco is the best money you can spend.  Skip those little Personal switch, it's going to give you headache in the longer run and the cost saving is not much.    

It's important indeed to get good switch when your installation is becoming decent sized, a network derp equal alot of mining time lost. You can find as you demonstrated cheap used switchs. No need to go for super pro ones but good brand & good quality is a must.

I recommend for a good switch, very stable, and can be chained with optical fiber for a low cost, also rackable.

https://www.netgear.com/business/products/switches/smart/GS724Tv4.aspx they cost around 150$ and they're rock solid. You can also find v2 or v3 that are still rock solid (used ones MTBF on those is like forever and they also benefit from a LIFETIME warranty) for half this price. there is also the 50 port one, but it's hard to centralise everything on a 50 port switch even with racks, and they cost about twice the price, so it's preferable to go for the 25 port one Smiley

I use 8 of those throughout my whole home, all linked with dual optical fibers, bought them at bulk price (i got v2/v3) for about 1000$, they're rock solid, never one derp, like ever.
sr. member
Activity: 414
Merit: 251
@kryptonite - Newegg.com, from other members, Ebay, Amazon, Jet.com.  You can always have friends or family order for you.  Amazon and Newegg QTY limits resets after 48hrs, rinse, repeat.

@Bhugatti - Yeah the one in my garage is 10/100.  It does the job well and I only need a spare.  But for anyone else, I think it's better to pay a little extra and get the 1gb version, hoping the newer one doesn't require crossover connections like my 10/100 version did.  These switch are SOLID and for $100, getting a used NetGear ProSafe or the Cisco is the best money you can spend.  Skip those little Personal switch, it's going to give you headache in the longer run and the cost saving is not much.   
full member
Activity: 154
Merit: 100
@Bhughatti - Incredible find!!!  Wow, they're like $700 on Amazon but used for $40 Plus $7 shipping.  I just ordered 1.  Thanks!

https://www.amazon.com/gp/offer-listing/B0001LFZV2/ref=sr_1_2_olp?ie=UTF8&qid=1488170824&sr=8-2&keywords=Cisco+WS-C3560-48PS&condition=used

The one you just linked is the 10/100 version, still a good buy but it is not 1gb.  Think the one I linked was the 1gb.  Since the miners dont send alot of data the 10/100 will probably work fine though.  Glad you picked one up Smiley
sr. member
Activity: 414
Merit: 251
@Bhughatti - Incredible find!!!  Wow, they're like $700 on Amazon but used for $40 Plus $7 shipping.  I just ordered 1.  Thanks!

https://www.amazon.com/gp/offer-listing/B0001LFZV2/ref=sr_1_2_olp?ie=UTF8&qid=1488170824&sr=8-2&keywords=Cisco+WS-C3560-48PS&condition=used
newbie
Activity: 42
Merit: 0
@ melfice123 - The Solution I'm getting from Finksy, the PICO will be powered by the server PCI cable via barrel pigtail so both will always be powered on at the same time.  I'm just waiting for the unit.  It's going to be at least another 2-4 weeks before I get them.

@ Citronick - I had the same exact issue.  My network spans out multiple directions from my office to living room switch, to kids play room switch, to garage and then split again in the garage etc.  The more switches I added, the more likely 1 of them wont' play nice with each other.  They are all dumb switches so you can't hard set the port at 10/100 or gigabit.  My guess is 1 of them are dumb and don't auto negotiate well and creating a lot of unnecessary traffic.  Surprisingly I found my 16 and 24 ports caused more issues then my cheap 4 and 8 port switch. 

My problematic switches.

Netis - 24 ports
Linksys - 24 ports. 

This is when I upgraded to the following switches

NetGear ProSafe

The Cisco (OLD) I got for free also don't play well with some switches as it does need a Crossover cable to work with some switches.  I just use the NetGear to act as the crossover for it. I would recommend not using any Linksys / Dlink / Netis or non Business class switch as they work in the beginning but will have interaction issues or congestion issues later.  Reduce the number of switch and invest in Business class one, they seem to have bigger backplane and better traffic control even though both would be dumb not managed switch.  I like the NetGear Prosafe, no issues so far and it seems to play well with all the switches.



Thank you Yun, your project is awesome!
full member
Activity: 154
Merit: 100
OK ... first new topic from me...

I have been meaning to ask the team on their network infrastructure - I am no expert in this field but enough skills to supply Internet access to all my rigs.

I dont use any network analysis tool - not needed because broadband speed is quite good.

But.... I think I am beginning to have some network congestions in the farm.

I have divided my warehouse into 5 zones.

Broadband Internet
As provided by ISP
            I
            I
MASTER: TPlink 48-port Switch (Zone 2, Zone 3, test area)
            I
            I
---> Zone 1 - TPlink 16 port switch x 1 + TPlink 8 port switch x 2 (basic cascade) - 100% used
                                                                        
---> Zone 4 - TPlink 16 port switch x 1 - 90% used
                                                                        
---> Zone 5 - Cisco 24 port router x 2 (basic cascade) - 90% used

Now the issue is Zone 1 and Zone 4 will intermittently disappears from network at random intervals at least once a day.

All switches and routers are 100/10 - no Gigabit and all switches are cheap unmanaged ones.
Got most of them during sales and recycled from previous projects.

All rigs are wired. No rigs have wireless connection even though WIFI is available.

Any good simple troubleshooter app out there?                                                                                                      


With the ability that we all can buy expensive GPU's I would suggest looking at something like this

http://www.ebay.com/itm/Refurbished-Cisco-WS-C3560G-48TS-S-Ethernet-Switch-90-Day-Warranty-QTY-Available-/322205858210?hash=item4b04f739a2:g:ZZgAAOSweXhXl3uy

It is a good gigabit switch and cheap from ebay or amazon.  It is what I use.  I have a 16 port tp link off of it and I have 4 netgear 8 port switches off it.  I have had no issues for 3 to 4 years running.  I would never go more than 1 unmanaged switch deep off of a business managed switch.  You also want to make sure you are not creating any network loops.  Sometimes having that many switches it can get confusing what is plugged into what.

If you want to get deeper into troubleshooting I suggest find a free network monitoring tool, here are a few from a 2015 blog just doing a random search
https://techtalk.gfi.com/the-top-20-free-network-monitoring-and-analysis-tools-for-sys-admins/
I have used Zenoss and nagios before.  If you really wanted to go crazy you could setup something like rsyslog on each rig (Windows and Linux) and send data to a syslog server.  When you have an outage you could parse the logs for the timestamp and see what is causing the issue.
sr. member
Activity: 414
Merit: 251
@ melfice123 - The Solution I'm getting from Finksy, the PICO will be powered by the server PCI cable via barrel pigtail so both will always be powered on at the same time.  I'm just waiting for the unit.  It's going to be at least another 2-4 weeks before I get them.

@ Citronick - I had the same exact issue.  My network spans out multiple directions from my office to living room switch, to kids play room switch, to garage and then split again in the garage etc.  The more switches I added, the more likely 1 of them wont' play nice with each other.  They are all dumb switches so you can't hard set the port at 10/100 or gigabit.  My guess is 1 of them are dumb and don't auto negotiate well and creating a lot of unnecessary traffic.  Surprisingly I found my 16 and 24 ports caused more issues then my cheap 4 and 8 port switch. 

My problematic switches.

Netis - 24 ports
Linksys - 24 ports. 

This is when I upgraded to the following switches

NetGear ProSafe

The Cisco (OLD) I got for free also don't play well with some switches as it does need a Crossover cable to work with some switches.  I just use the NetGear to act as the crossover for it. I would recommend not using any Linksys / Dlink / Netis or non Business class switch as they work in the beginning but will have interaction issues or congestion issues later.  Reduce the number of switch and invest in Business class one, they seem to have bigger backplane and better traffic control even though both would be dumb not managed switch.  I like the NetGear Prosafe, no issues so far and it seems to play well with all the switches.

hero member
Activity: 735
Merit: 500
★YoBit.Net★ 350+ Coins Exchange & Dice
commenting to continue to watch the dev
legendary
Activity: 1834
Merit: 1080
---- winter*juvia -----
OK ... first new topic from me...

I have been meaning to ask the team on their network infrastructure - I am no expert in this field but enough skills to supply Internet access to all my rigs.

I dont use any network analysis tool - not needed because broadband speed is quite good.

But.... I think I am beginning to have some network congestions in the farm.

I have divided my warehouse into 5 zones.

Broadband Internet
As provided by ISP
            I
            I
MASTER: TPlink 48-port Switch (Zone 2, Zone 3, test area)
            I
            I
---> Zone 1 - TPlink 16 port switch x 1 + TPlink 8 port switch x 2 (basic cascade) - 100% used
                                                                        
---> Zone 4 - TPlink 16 port switch x 1 - 90% used
                                                                        
---> Zone 5 - Cisco 24 port router x 2 (basic cascade) - 90% used

Now the issue is Zone 1 and Zone 4 will intermittently disappears from network at random intervals at least once a day.

All switches and routers are 100/10 - no Gigabit and all switches are cheap unmanaged ones.
Got most of them during sales and recycled from previous projects.

All rigs are wired. No rigs have wireless connection even though WIFI is available.

Any good simple troubleshooter app out there?                                                                                                      
Pages:
Jump to: