[Bloat] quick question

Sebastian Moeller moeller0 at gmx.de
Sat Aug 26 07:48:12 EDT 2023


Dear ECN-experts,

I have a quick question, when running downloads, say x flows (with MTU ~1500), over a Y Mbps link with Zms RTT, what kind of CE rate do I need to expect?

I ask, because the kids started to play some games on steam, and when these do their multi-GB updates I accumulate quite a lot of CE marks for the respective cake tin:

Before:
qdisc cake 810a: dev ifb4pppoe-wan root refcnt 2 bandwidth 105Mbit diffserv3 dual-dsthost nat nowash ingress no-ack-filter split-gso rtt 100ms noatm overhead 34 mpu 88 memlimit 32Mb 
 Sent 21471648426 bytes 16712159 pkt (dropped 9179, overlimits 27961170 requeues 0) 
 backlog 2984b 2p requeues 0
 memory used: 864Kb of 32Mb
 capacity estimate: 105Mbit
 min/max network layer size:           28 /    1492
 min/max overhead-adjusted size:       88 /    1526
 average network hdr offset:            0

                   Bulk  Best Effort        Voice
  thresh       6562Kbit      105Mbit    26250Kbit
  target            5ms          5ms          5ms
  interval        100ms        100ms        100ms
  pk_delay        116us       2.68ms         88us
  av_delay         31us       1.29ms         18us
  sp_delay          6us         57us          6us
  backlog            0b        2984b           0b
  pkts           170434     16500879        50027
  bytes        73422115  21408109703      3480229
  way_inds           56      1320752         2152
  way_miss         3879       101928          341
  way_cols            0            0            0
  drops              12         9167            0
  marks              34          559            0
  ack_drop            0            0            0
  sp_flows            1            5            1
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len          1492         1492          192
  quantum           300         1514          801


After:

qdisc cake 810a: dev ifb4pppoe-wan root refcnt 2 bandwidth 105Mbit diffserv3 dual-dsthost nat nowash ingress no-ack-filter split-gso rtt 100ms noatm overhead 34 mpu 88 memlimit 32Mb 
 Sent 26301367224 bytes 19973069 pkt (dropped 9381, overlimits 34351737 requeues 0) 
 backlog 0b 0p requeues 0
 memory used: 1025408b of 32Mb
 capacity estimate: 105Mbit
 min/max network layer size:           28 /    1492
 min/max overhead-adjusted size:       88 /    1526
 average network hdr offset:            0

                   Bulk  Best Effort        Voice
  thresh       6562Kbit      105Mbit    26250Kbit
  target            5ms          5ms          5ms
  interval        100ms        100ms        100ms
  pk_delay        336us        238us        180us
  av_delay         62us         96us         36us
  sp_delay          2us          2us          8us
  backlog            0b           0b           0b
  pkts           171622     19760656        50172
  bytes        73494415  26237802841      3493005
  way_inds           56      1321363         2237
  way_miss         3904       102830          345
  way_cols            0            0            0
  drops              12         9369            0
  marks              34      2346888            0
  ack_drop            0            0            0
  sp_flows            1           19            1
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len          1492         1492          192
  quantum           300         1514          801

# note there was other traffic ongoing as well, so some drops/marks are unrelated, but the bulk of marks was correlated with the steam download
delta packets: (19760656 - 16500879) = 3259777
delta bytes: (26237802841 - 21408109703) / 1000^3 = 4.829693138 GB
average packet size: (26237802841 - 21408109703) / (19760656 - 16500879) = 1481.60231145
delta drops: (9369 - 9167) = 202
delta marks: (2346888 - 559) = 2346329
fraction of packets marked: 2346329 / 3259777 = 0.719782058711
percentage of packets marked: 100 * (2346329 / 3259777) = 72%

This seems like too high a marking rate to me. I would naively expect that a flow on getting a mark scale back by its cwin by 20-50% and then slowly increaer it again, so I expect the actual marking rate to be considerably below 50% per flow...
My gut feeling is that these steam flows do not obey RFC3168 ECN (or something wipes the CE marks my router sends upstream along the path)... but without a good model what marking rate I should expect this is very hand-wavy, so if anybody could help me out with an easy derivation of the expected average marking rate I would be grateful.

Regards
	Sebastian








More information about the Bloat mailing list