oprofiling is much saner looking now with rc6-smoketest

Dave Taht dave.taht at gmail.com
Tue Aug 30 18:41:54 PDT 2011


This is the same test, repeated, sans firewall rules - all iptables
rules cleared. I get about 220MB/sec without oprofile running, and 208
with it running. (vs about 190MB with the iptables rules in the
previous run)

As noted earlier this is with netperf running on the router itself,
with web10g patched in. Web10g supplies some interesting statistics
(attached), and I have a tcptrace/xplot.org screenshots of the
previous run here:

http://huchra.bufferbloat.net/~d/rc6-smoke-captures/

that is also interesting. There is a knee at 30 seconds and other
somewhat odd looking behavior when you zoom in.

I further note that the laptop driving this test (via a gige pcmcia
card) has a default txqueuelen of 1000 and I don't presently know the
length of the dma tx ring, and is running the std ubuntu 11.4 kernel (
 2.6.38-11-generic), with ecn,sack,dsack enabled.

And the best performance I've got from the laptop to a pentium 4 box
was 290Mbit. I note that I'm pretty happy with 220Mbit OK! I wanted to
have a baseline value before I started fiddling with vlan and dscp
stuff....


CPU: MIPS 24K, speed 0 MHz (estimated)
Counted INSTRUCTIONS events (Instructions completed) with a unit mask
of 0x00 (No unit mask) count 100000
samples  %        app name                 symbol name
-------------------------------------------------------------------------------
17141    14.8045  vmlinux                  csum_partial
  17141    100.000  vmlinux                  csum_partial [self]
-------------------------------------------------------------------------------
17024    14.7035  vmlinux                  __copy_user
  17024    100.000  vmlinux                  __copy_user [self]
-------------------------------------------------------------------------------
8888      7.6765  nf_conntrack             /nf_conntrack
  8888     100.000  nf_conntrack             /nf_conntrack [self]
-------------------------------------------------------------------------------
4139      3.5748  vmlinux                  __do_softirq
  4139     100.000  vmlinux                  __do_softirq [self]
-------------------------------------------------------------------------------
4055      3.5023  ip_tables                /ip_tables
  4055     100.000  ip_tables                /ip_tables [self]



-- 
Dave Täht
SKYPE: davetaht
US Tel: 1-239-829-5608
http://the-edge.blogspot.com
-------------- next part --------------
Connection 64 (172.29.1.33_22 172.29.1.123_51581)
    LocalAddressType    : 1
    LocalAddress        : 172.29.1.33
    LocalPort           : 22
    RemAddressType      : 1
    RemAddress          : 172.29.1.123
    RemPort             : 51581
    SegsOut             : 2668
    DataSegsOut         : 2668
    DataOctetsOut       : 493373
    SegsRetrans         : 3
    OctetsRetrans       : 208
    SegsIn              : 4272
    DataSegsIn          : 1885
    DataOctetsIn        : 93215
    ElapsedSecs         : 6618
    ElapsedMicroSecs    : 723887
    CurMSS              : 1460
    PipeSize            : 0
    MaxPipeSize         : 4380
    SmoothedRTT         : 10
    CurRTO              : 210
    CongSignals         : 0
    CurCwnd             : 8760
    CurSsthresh         : 4294967295
    Timeouts            : 0
    CurRwinSent         : 16888
    MaxRwinSent         : 16888
    ZeroRwinSent        : 0
    CurRwinRcvd         : 293248
    MaxRwinRcvd         : 293248
    ZeroRwinRcvd        : 0
    SndLimTransRwin     : 0
    SndLimTransCwnd     : 1
    SndLimTransSnd      : 2
    SndLimTimeRwin      : 0
    SndLimTimeCwnd      : 400477716
    SndLimTimeSnd       : 4073612272
    SendStall           : 0
    RetranThresh        : 3
    NonRecovDAEpisodes  : 1
    SumOctetsReordered  : 256
    NonRecovDA          : 0
    SampleRTT           : 0
    RTTVar              : 50
    MaxRTT              : 40
    MinRTT              : 0
    SumRTT              : 9160
    CountRTT            : 2507
    MaxRTO              : 230
    MinRTO              : 210
    IpTtl               : 64
    IpTosIn             : 16
    IpTosOut            : 0
    PreCongSumCwnd      : 0
    PreCongSumRTT       : 0
    PostCongSumRTT      : 0
    PostCongCountRTT    : 0
    ECNsignals          : 0
    DupAckEpisodes      : 0
    RcvRTT              : 3134114
    DupAcksOut          : 0
    CERcvd              : 0
    ECESent             : 0
    ActiveOpen          : 0
    MSSSent             : 1460
    MSSRcvd             : 1460
    WinScaleSent        : 1
    WinScaleRcvd        : 7
    TimeStamps          : 2
    ECN                 : 3
    WillSendSACK        : 1
    WillUseSACK         : 1
    State               : 1953653102
    Nagle               : 1
    MaxSsCwnd           : 14600
    MaxCaCwnd           : 10220
    MaxSsthresh         : 5840
    MinSsthresh         : 2920
    InRecovery          : 2
    DupAcksIn           : 0
    SpuriousFrDetected  : 0
    SpuriousRtoDetected : 0
    SoftErrors          : 0
    SoftErrorReason     : 0
    SlowStart           : 2
    CongAvoid           : 41
    OtherReductions     : 0
    CongOverCount       : 0
    FastRetran          : 0
    SubsequentTimeouts  : 0
    CurTimeoutCount     : 0
    AbruptTimeouts      : 0
    SACKsRcvd           : 0
    SACKBlocksRcvd      : 0
    DSACKDups           : 0
    MaxMSS              : 1460
    MinMSS              : 1440
    SndInitial          : 2230931079
    RecInitial          : 1469570772
    CurRetxQueue        : 0
    MaxRetxQueue        : 0
    CurReasmQueue       : 0
    MaxReasmQueue       : 0
    SndUna              : 2231370872
    SndNxt              : 2231370872
    SndMax              : 2231370872
    ThruOctetsAcked     : 439793
    RcvNxt              : 1469663891
    ThruOctetsReceived  : 93119
    CurAppWQueue        : 0
    MaxAppWQueue        : 0
    CurAppRQueue        : 0
    MaxAppRQueue        : 1144
    LimCwnd             : 4294965836
    LimSsthresh         : 0
    LimRwin             : 64075
    LimMSS              : 95682560
    OtherReductionsCV   : 0
    OtherReductionsCM   : 0
    StartTimeSecs       : 1314747615
    StartTimeMicroSecs  : 690002
    Sndbuf              : 16384
    Rcvbuf              : 87380
Connection 56 (172.29.1.97_22 172.29.1.123_52588)
    LocalAddressType    : 1
    LocalAddress        : 172.29.1.97
    LocalPort           : 22
    RemAddressType      : 1
    RemAddress          : 172.29.1.123
    RemPort             : 52588
    SegsOut             : 1241
    DataSegsOut         : 1241
    DataOctetsOut       : 110645
    SegsRetrans         : 0
    OctetsRetrans       : 0
    SegsIn              : 2000
    DataSegsIn          : 914
    DataOctetsIn        : 45711
    ElapsedSecs         : 4990
    ElapsedMicroSecs    : 629033
    CurMSS              : 1460
    PipeSize            : 0
    MaxPipeSize         : 1460
    SmoothedRTT         : 10
    CurRTO              : 210
    CongSignals         : 0
    CurCwnd             : 14600
    CurSsthresh         : 4294965836
    Timeouts            : 0
    CurRwinSent         : 16888
    MaxRwinSent         : 16888
    ZeroRwinSent        : 0
    CurRwinRcvd         : 64128
    MaxRwinRcvd         : 64128
    ZeroRwinRcvd        : 0
    SndLimTransRwin     : 0
    SndLimTransCwnd     : 0
    SndLimTransSnd      : 1
    SndLimTimeRwin      : 0
    SndLimTimeCwnd      : 0
    SndLimTimeSnd       : 4171379644
    SendStall           : 0
    RetranThresh        : 3
    NonRecovDAEpisodes  : 0
    SumOctetsReordered  : 0
    NonRecovDA          : 0
    SampleRTT           : 0
    RTTVar              : 50
    MaxRTT              : 120
    MinRTT              : 0
    SumRTT              : 3280
    CountRTT            : 1114
    MaxRTO              : 230
    MinRTO              : 210
    IpTtl               : 64
    IpTosIn             : 16
    IpTosOut            : 0
    PreCongSumCwnd      : 0
    PreCongSumRTT       : 0
    PostCongSumRTT      : 0
    PostCongCountRTT    : 0
    ECNsignals          : 0
    DupAckEpisodes      : 0
    RcvRTT              : 1532633
    DupAcksOut          : 0
    CERcvd              : 0
    ECESent             : 0
    ActiveOpen          : 0
    MSSSent             : 1460
    MSSRcvd             : 1460
    WinScaleSent        : 1
    WinScaleRcvd        : 7
    TimeStamps          : 2
    ECN                 : 3
    WillSendSACK        : 1
    WillUseSACK         : 1
    State               : 1953653102
    Nagle               : 1
    MaxSsCwnd           : 14600
    MaxCaCwnd           : 0
    MaxSsthresh         : 0
    MinSsthresh         : 4294967295
    InRecovery          : 2
    DupAcksIn           : 0
    SpuriousFrDetected  : 0
    SpuriousRtoDetected : 0
    SoftErrors          : 0
    SoftErrorReason     : 0
    SlowStart           : 0
    CongAvoid           : 0
    OtherReductions     : 0
    CongOverCount       : 0
    FastRetran          : 0
    SubsequentTimeouts  : 0
    CurTimeoutCount     : 0
    AbruptTimeouts      : 0
    SACKsRcvd           : 0
    SACKBlocksRcvd      : 0
    DSACKDups           : 0
    MaxMSS              : 1460
    MinMSS              : 1440
    SndInitial          : 1838946708
    RecInitial          : 749866429
    CurRetxQueue        : 0
    MaxRetxQueue        : 0
    CurReasmQueue       : 0
    MaxReasmQueue       : 0
    SndUna              : 1839032533
    SndNxt              : 1839032533
    SndMax              : 1839032533
    ThruOctetsAcked     : 85825
    RcvNxt              : 749912140
    ThruOctetsReceived  : 45711
    CurAppWQueue        : 0
    MaxAppWQueue        : 0
    CurAppRQueue        : 0
    MaxAppRQueue        : 1144
    LimCwnd             : 4294965836
    LimSsthresh         : 0
    LimRwin             : 64075
    LimMSS              : 95682560
    OtherReductionsCV   : 0
    OtherReductionsCM   : 0
    StartTimeSecs       : 1314742638
    StartTimeMicroSecs  : 218763
    Sndbuf              : 16384
    Rcvbuf              : 87380
Connection 0 (172.29.1.97_22 172.29.1.123_55029)
    LocalAddressType    : 1
    LocalAddress        : 172.29.1.97
    LocalPort           : 22
    RemAddressType      : 1
    RemAddress          : 172.29.1.123
    RemPort             : 55029
    SegsOut             : 2927
    DataSegsOut         : 2927
    DataOctetsOut       : 563021
    SegsRetrans         : 0
    OctetsRetrans       : 0
    SegsIn              : 4394
    DataSegsIn          : 1820
    DataOctetsIn        : 93439
    ElapsedSecs         : 65542
    ElapsedMicroSecs    : 507312
    CurMSS              : 1460
    PipeSize            : 0
    MaxPipeSize         : 4380
    SmoothedRTT         : 20
    CurRTO              : 220
    CongSignals         : 0
    CurCwnd             : 14600
    CurSsthresh         : 4294965836
    Timeouts            : 0
    CurRwinSent         : 22712
    MaxRwinSent         : 22712
    ZeroRwinSent        : 0
    CurRwinRcvd         : 357760
    MaxRwinRcvd         : 357760
    ZeroRwinRcvd        : 0
    SndLimTransRwin     : 0
    SndLimTransCwnd     : 0
    SndLimTransSnd      : 1
    SndLimTimeRwin      : 0
    SndLimTimeCwnd      : 0
    SndLimTimeSnd       : 2439344612
    SendStall           : 0
    RetranThresh        : 3
    NonRecovDAEpisodes  : 0
    SumOctetsReordered  : 0
    NonRecovDA          : 0
    SampleRTT           : 0
    RTTVar              : 50
    MaxRTT              : 50
    MinRTT              : 0
    SumRTT              : 12590
    CountRTT            : 2722
    MaxRTO              : 230
    MinRTO              : 210
    IpTtl               : 64
    IpTosIn             : 16
    IpTosOut            : 0
    PreCongSumCwnd      : 0
    PreCongSumRTT       : 0
    PostCongSumRTT      : 0
    PostCongCountRTT    : 0
    ECNsignals          : 0
    DupAckEpisodes      : 0
    RcvRTT              : 644526
    DupAcksOut          : 0
    CERcvd              : 0
    ECESent             : 0
    ActiveOpen          : 0
    MSSSent             : 1460
    MSSRcvd             : 1460
    WinScaleSent        : 1
    WinScaleRcvd        : 7
    TimeStamps          : 2
    ECN                 : 3
    WillSendSACK        : 1
    WillUseSACK         : 1
    State               : 1953653102
    Nagle               : 1
    MaxSsCwnd           : 14600
    MaxCaCwnd           : 0
    MaxSsthresh         : 0
    MinSsthresh         : 4294967295
    InRecovery          : 2
    DupAcksIn           : 7
    SpuriousFrDetected  : 0
    SpuriousRtoDetected : 0
    SoftErrors          : 7
    SoftErrorReason     : 1
    SlowStart           : 0
    CongAvoid           : 0
    OtherReductions     : 0
    CongOverCount       : 0
    FastRetran          : 0
    SubsequentTimeouts  : 0
    CurTimeoutCount     : 0
    AbruptTimeouts      : 0
    SACKsRcvd           : 0
    SACKBlocksRcvd      : 0
    DSACKDups           : 0
    MaxMSS              : 1460
    MinMSS              : 1440
    SndInitial          : 1018333932
    RecInitial          : 1871301081
    CurRetxQueue        : 0
    MaxRetxQueue        : 0
    CurReasmQueue       : 0
    MaxReasmQueue       : 0
    SndUna              : 1018838413
    SndNxt              : 1018838413
    SndMax              : 1018838413
    ThruOctetsAcked     : 504481
    RcvNxt              : 1871394520
    ThruOctetsReceived  : 93439
    CurAppWQueue        : 0
    MaxAppWQueue        : 0
    CurAppRQueue        : 0
    MaxAppRQueue        : 1456
    LimCwnd             : 4294965836
    LimSsthresh         : 0
    LimRwin             : 64075
    LimMSS              : 95682560
    OtherReductionsCV   : 0
    OtherReductionsCM   : 0
    StartTimeSecs       : 1314684283
    StartTimeMicroSecs  : 261134
    Sndbuf              : 16384
    Rcvbuf              : 87380


More information about the Bloat-devel mailing list