I am trying to extract the maximum throughput over two intel
Pro1000 GigE cards between two win2k boxes and have observed some
interesting anomalies I need help with.
Quick background – I have written a kernel level (TDI) client
and server for doing diskIO; kinda like a poor-mans iSCSI in
that the data is sent over TCP (but without scsi encapsulation).
To tune the hardware configuration, I’ve been using ttcp (actually
pcattcp) from user level.
If both boxes (one is a dual P3 450, the other is a dual P3 800)
are running win2k professional, then with no
registry tuning the best I can get is around 35 MB/sec when sending
1MB packets (pcattcp -[tr] -l 131072 )
The P3 800 can be dual booted between win2k professional and win2k
server. These are fresh installations, latest service packs, no
registry tweaks.
The bottom line is running win2k server I can receive at about
67 MB/sec (ie, when the win2k server is running ‘pcattcp -r …’).
Running win2k professional I get the aforementioned 35 MB/sec.
My confusion is that I thought the tcp stacks were “essentially” the
same between the two.
When running win2k professional, I have tried the obvious suspects;
Tcp1323 opts, large windows, setting ‘NumberOfReceiveBuffers = 512’ in
hklm/ccs/services/tcp/parameters/interfaces, as well as ‘MaxIRQperSec=2500’.
I eked out about a 10% improvement, but nothing like the difference
between server and professional.
I’ve been pouring over ethereal/netmon traces, and haven’t stumbled on
to what the difference is. It seems like win2k server either has
pre-configured larger buffers for handling unsolicited input or is
able to switch faster from the stack back to the receiver.
Has anyone any suggestions for extracting better performance from
the win2k professional setup? My customers can not upgrade all
their machines to server from professional so that’s not an option.
Thanks!
On Thu, 2003-08-07 at 13:02, Peter Lawthers wrote:
The bottom line is running win2k server I can receive at about
67 MB/sec (ie, when the win2k server is running ‘pcattcp -r …’).
Running win2k professional I get the aforementioned 35 MB/sec.
My confusion is that I thought the tcp stacks were “essentially” the
same between the two.
Just out of curiosity, are the nic driver binaries identical between pro
and server?
Yep, they are identical, latest from
the intel website. The cards are also configured
identically (according to the intel proset config program).
That’s part of what has me confused.
Steve Dispensa wrote:
On Thu, 2003-08-07 at 13:02, Peter Lawthers wrote:
>The bottom line is running win2k server I can receive at about
>67 MB/sec (ie, when the win2k server is running ‘pcattcp -r …’).
>Running win2k professional I get the aforementioned 35 MB/sec.
>My confusion is that I thought the tcp stacks were “essentially” the
>same between the two.
Just out of curiosity, are the nic driver binaries identical between pro
and server?
Questions? First check the Kernel Driver FAQ at http://www.osronline.com/article.cfm?id=256
You are currently subscribed to ntdev as: xxxxx@adic.com
To unsubscribe send a blank email to xxxxx@lists.osr.com
It looks like Intel gigabit ethernet adapters do not like Jumbo frames
larger then 9K. At least on the Intel hardware I’ve seen performance drops
when Jumbo frames are set to 16K. Not so dramatically as you tell but very
well noticable. Can you try going 9K? Just in case…
Also you can try reading my postings (replies to Valery some weeks ago)
about the sender/receiver design for exactly the same task you’re dealing
with right now. Maybe you’ll find something interesting there… If not
try drop me an e-mail – maybe I’ll be able to help you. For now even
67MB/sec is something like 1/3 of what we have. With the SCSI
encapsulation. Sorry for this )
Regards,
Anton Kolomyeytsev
P.S. Steve, I’m sorry for not replying your last e-mail. My notebook died
( Yes, copper fibre channel is definitely an oxymoron )
AK
Yep, they are identical, latest from
the intel website. The cards are also configured
identically (according to the intel proset config program).
That’s part of what has me confused.
Steve Dispensa wrote:
> On Thu, 2003-08-07 at 13:02, Peter Lawthers wrote:
>
>>The bottom line is running win2k server I can receive at about
>>67 MB/sec (ie, when the win2k server is running ‘pcattcp -r …’).
>>Running win2k professional I get the aforementioned 35 MB/sec.
>>My confusion is that I thought the tcp stacks were “essentially” the
>>same between the two.
>
>
> Just out of curiosity, are the nic driver binaries identical between pro
> and server?
>
>
>
>
>
> —
> Questions? First check the Kernel Driver FAQ at http://www.osronline.com/article.cfm?id=256
>
> You are currently subscribed to ntdev as: xxxxx@adic.com
> To unsubscribe send a blank email to xxxxx@lists.osr.com
>
I probably didn’t make myself clear.
I run into the problem without any special
TDI code loaded at all. This is just using
‘ttcp’ to get a limit on the bandwidth between
two machines over gige. No special kernel component
involved whatsoever. Also, I’m not using jumbo
frames.
My question is really why the difference when
the box doing the receiving is win2k server vs
win2k professional?
Anton Kolomyeytsev wrote:
It looks like Intel gigabit ethernet adapters do not like Jumbo frames
larger then 9K. At least on the Intel hardware I’ve seen performance drops
when Jumbo frames are set to 16K. Not so dramatically as you tell but very
well noticable. Can you try going 9K? Just in case…
Also you can try reading my postings (replies to Valery some weeks ago)
about the sender/receiver design for exactly the same task you’re dealing
with right now. Maybe you’ll find something interesting there… If not
try drop me an e-mail – maybe I’ll be able to help you. For now even
67MB/sec is something like 1/3 of what we have. With the SCSI
encapsulation. Sorry for this )
Regards,
Anton Kolomyeytsev
P.S. Steve, I’m sorry for not replying your last e-mail. My notebook died
( Yes, copper fibre channel is definitely an oxymoron )
AK
>Yep, they are identical, latest from
>the intel website. The cards are also configured
>identically (according to the intel proset config program).
>That’s part of what has me confused.
>
>Steve Dispensa wrote:
>
>>On Thu, 2003-08-07 at 13:02, Peter Lawthers wrote:
>>
>>
>>>The bottom line is running win2k server I can receive at about
>>>67 MB/sec (ie, when the win2k server is running ‘pcattcp -r …’).
>>>Running win2k professional I get the aforementioned 35 MB/sec.
>>>My confusion is that I thought the tcp stacks were “essentially” the
>>>same between the two.
>>
>>
>>Just out of curiosity, are the nic driver binaries identical between pro
>>and server?
>>
>>
>>
>>
>>
>>—
>>Questions? First check the Kernel Driver FAQ at http://www.osronline.com/article.cfm?id=256
>>
>>You are currently subscribed to ntdev as: xxxxx@adic.com
>>To unsubscribe send a blank email to xxxxx@lists.osr.com
>>
>
Questions? First check the Kernel Driver FAQ at http://www.osronline.com/article.cfm?id=256
You are currently subscribed to ntdev as: xxxxx@adic.com
To unsubscribe send a blank email to xxxxx@lists.osr.com