From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp105.iad3a.emailsrvr.com (smtp105.iad3a.emailsrvr.com [173.203.187.105]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by huchra.bufferbloat.net (Postfix) with ESMTPS id DFB1421F622 for ; Sat, 6 Sep 2014 12:05:37 -0700 (PDT) Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp6.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id 1C3F5180177; Sat, 6 Sep 2014 15:05:36 -0400 (EDT) X-Virus-Scanned: OK Received: from app5.wa-webapps.iad3a (relay-webapps.rsapps.net [172.27.255.140]) by smtp6.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id EB596180162; Sat, 6 Sep 2014 15:05:35 -0400 (EDT) X-Sender-Id: dpreed@reed.com Received: from app5.wa-webapps.iad3a (relay-webapps.rsapps.net [172.27.255.140]) by 0.0.0.0:25 (trex/5.2.10); Sat, 06 Sep 2014 19:05:36 GMT Received: from reed.com (localhost.localdomain [127.0.0.1]) by app5.wa-webapps.iad3a (Postfix) with ESMTP id D477018005A; Sat, 6 Sep 2014 15:05:35 -0400 (EDT) Received: by apps.rackspace.com (Authenticated sender: dpreed@reed.com, from: dpreed@reed.com) with HTTP; Sat, 6 Sep 2014 15:05:35 -0400 (EDT) Date: Sat, 6 Sep 2014 15:05:35 -0400 (EDT) From: dpreed@reed.com To: "Dave Taht" MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_20140906150535000000_18077" Importance: Normal X-Priority: 3 (Normal) X-Type: html In-Reply-To: References: Message-ID: <1410030335.867711670@apps.rackspace.com> X-Mailer: webmail7.0 Cc: "cerowrt-devel@lists.bufferbloat.net" Subject: Re: [Cerowrt-devel] =?utf-8?q?10GigE_nics_and_SFP+_modules=3F?= X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 06 Sep 2014 19:06:06 -0000 ------=_20140906150535000000_18077 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable =0AI have been happy with the PicoPSU power supplies which are tiny ATX PSU= 's that go up to 160 W.=0AThey take 12V input, which can be supplied by an = external brick or a small 12V power supply of the sort used to supply power= to lighting circuits (I use a Meanwell NES-350-12 to power 3 boards with i= ndividual PicoPSU's.=0A =0AFor home experiments I have been using the less = expensive X520-DA2 Dual copper Cat6 10 GigE boards from Intel, at about $50= 0 per card. They are well supported in Linux. SFP+ is the way to go for fi= ber.=0A =0AAlso, Netgear sells a small 8 port copper interface 10 GigE swit= ch for < $1000. http://www.netgear.com/business/products/switches/unmanaged= -plus/10g-plus-switch.aspx It's an 8-port "desktop" switch, which means unm= anaged, etc. I haven't tried that. For various reasons my home machines a= re connected directly with each other, without a switch, but you want a swi= tch, and this is far less pricey.=0A =0AI think the copper option might get= you 100m of distance, but I'm not sure.=0A =0AAll that said, if you want h= igh end stuff, you might want to go for the X540 fiber product line and swi= tches that seem to be $5,000 or more, plus the cost of the SFP+ cables, ...= At least a factor of 10 more expensive, for better latency in the switch,= fancy management features in the switch and more reach in the cabling for = less electrical power. Depends on what you want.=0A =0AWe use the higher e= nd stuff at work.=0A =0A =0A =0A =0A=0A=0AOn Saturday, September 6, 2014 2:= 36pm, "Dave Taht" said:=0A=0A=0A=0A> Given that the r= angeley series of processors apparently has support in=0A> openwrt already,= I picked up one last week.=0A> =0A> http://www.amazon.com/Supermicro-Atom-= C2758-Motherboards-MBD-A1SRI-2758F-O/dp/B00FM4M7TQ/ref=3Dsr_1_1?ie=3DUTF8&q= id=3Dundefined&sr=3D8-1&keywords=3DC2758=0A> =0A> I'm still looking for a g= ood case for it - the first rack-mount case I=0A> got had mini-itx mounts b= ut a non-ATX power supply, suggestions? Only=0A> need 50 watts or less of p= ower supply...=0A> =0A> Where my brain falls off a cliff is sorting through= the SFP+ options.=0A> I've been told to seek out the intel chipset cards a= s the best=0A> supported under linux, so would this be good? Are there othe= r options?=0A> =0A> http://www.amazon.com/Intel-Gigabit-Dual-Server-Adapter= /dp/B001AGFXTQ/ref=3Dsr_1_10?ie=3DUTF8&qid=3D1410027344&sr=3D8-10&keywords= =3D10GigE+nic=0A> =0A> Or these?=0A> =0A> http://www.amazon.com/Intel-Ether= net-X520-SR2-Server-Adapter/dp/B002I9JCQY/ref=3Dpd_cp_pc_0=0A> =0A> I'd lik= e single mode (20km+) fiber support, but also to try whatever=0A> mode is m= ore common in DCs... ?=0A> =0A> http://www.amazon.com/Intel-Ethernet-ETHERN= ET-MODULE-10GBase-SR/dp/B009KZNWE2/ref=3Dsr_1_1?s=3Delectronics&ie=3DUTF8&q= id=3D1410028448&sr=3D1-1&keywords=3DIntel+SFP%2B=0A> =0A> These are the mos= t expensive items (with the exception of snapon) I've=0A> ever bought on be= half of bufferbloat.net, and it feels weird to be=0A> doing this after figh= ting all month with 100mbit issues... but I've=0A> been dying to get some 1= 0GigE data, so...=0A> =0A> --=0A> Dave T=C3=A4ht=0A> =0A> https://www.buffe= rbloat.net/projects/make-wifi-fast=0A> ____________________________________= ___________=0A> Cerowrt-devel mailing list=0A> Cerowrt-devel@lists.bufferbl= oat.net=0A> https://lists.bufferbloat.net/listinfo/cerowrt-devel=0A> ------=_20140906150535000000_18077 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

I have been happy with the= PicoPSU power supplies which are tiny ATX PSU's that go up to 160 W.

= =0A

They take 12V input, which can be supplied by an extern= al brick or a small 12V power supply of the sort used to supply power to li= ghting circuits (I use a Meanwell NES-350-12 to power 3 boards with individ= ual PicoPSU's.

=0A

 

=0A

For hom= e experiments I have been using the less expensive X520-DA2 Dual copper Cat= 6 10 GigE boards from Intel, at about $500 per card. They are well sup= ported in Linux.  SFP+ is the way to go for fiber.

=0A

 

=0A

Also, Netgear sells a small 8 port copper= interface 10 GigE switch for < $1000. http://www.netgear.com/business/p= roducts/switches/unmanaged-plus/10g-plus-switch.aspx It's an 8-port "d= esktop" switch, which means unmanaged, etc.  I haven't tried that. &nb= sp;For various reasons my home machines are connected directly with each ot= her, without a switch, but you want a switch, and this is far less pricey.<= /p>=0A

 

=0A

I think the copper opt= ion might get you 100m of distance, but I'm not sure.

=0A

All that said, if you want high end stuff, = you might want to go for the X540 fiber product line and switches that= seem to be $5,000 or more, plus the cost of the SFP+ cables, ...  At = least a factor of 10 more expensive, for better latency in the switch,= fancy management features in the switch and more reach in the cabling for = less electrical power.  Depends on what you want.

=0A

 

=0A

We use the higher end stuff at work.

= =0A

 

=0A

 

=0A

 

=0A

 

=0A=0A



On Sat= urday, September 6, 2014 2:36pm, "Dave Taht" <dave.taht@gmail.com> sa= id:

=0A
=0A

= > Given that the rangeley series of processors apparently has support in=
> openwrt already, I picked up one last week.
>
>= http://www.amazon.com/Supermicro-Atom-C2758-Motherboards-MBD-A1SRI-2758F-O= /dp/B00FM4M7TQ/ref=3Dsr_1_1?ie=3DUTF8&qid=3Dundefined&sr=3D8-1&= keywords=3DC2758
>
> I'm still looking for a good case for= it - the first rack-mount case I
> got had mini-itx mounts but a n= on-ATX power supply, suggestions? Only
> need 50 watts or less of p= ower supply...
>
> Where my brain falls off a cliff is sor= ting through the SFP+ options.
> I've been told to seek out the int= el chipset cards as the best
> supported under linux, so would this= be good? Are there other options?
>
> http://www.amazon.c= om/Intel-Gigabit-Dual-Server-Adapter/dp/B001AGFXTQ/ref=3Dsr_1_10?ie=3DUTF8&= amp;qid=3D1410027344&sr=3D8-10&keywords=3D10GigE+nic
>
> Or these?
>
> http://www.amazon.com/Intel-Ethernet-= X520-SR2-Server-Adapter/dp/B002I9JCQY/ref=3Dpd_cp_pc_0
>
>= I'd like single mode (20km+) fiber support, but also to try whatever
= > mode is more common in DCs... ?
>
> http://www.amazon= .com/Intel-Ethernet-ETHERNET-MODULE-10GBase-SR/dp/B009KZNWE2/ref=3Dsr_1_1?s= =3Delectronics&ie=3DUTF8&qid=3D1410028448&sr=3D1-1&keywords= =3DIntel+SFP%2B
>
> These are the most expensive items (wi= th the exception of snapon) I've
> ever bought on behalf of bufferb= loat.net, and it feels weird to be
> doing this after fighting all = month with 100mbit issues... but I've
> been dying to get some 10Gi= gE data, so...
>
> --
> Dave T=C3=A4ht
> <= br />> https://www.bufferbloat.net/projects/make-wifi-fast
> ___= ____________________________________________
> Cerowrt-devel mailin= g list
> Cerowrt-devel@lists.bufferbloat.net
> https://list= s.bufferbloat.net/listinfo/cerowrt-devel
>

=0A
 ------=_20140906150535000000_18077--