From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt0-x243.google.com (mail-qt0-x243.google.com [IPv6:2607:f8b0:400d:c0d::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 8C3833B2A3 for ; Sun, 12 Feb 2017 08:08:56 -0500 (EST) Received: by mail-qt0-x243.google.com with SMTP id s58so9810325qtc.2 for ; Sun, 12 Feb 2017 05:08:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=KIYR/aMZzk0LsdkJeDDp6+j1UclHBzfxzAom7y+Ovc8=; b=OYhhkGPN5a8w/5935nrWhdq8eT5besnpS4Y7aYemIO4ko6hTHYARSvKffWSRU/m/U5 0osXxc0eURAnB81IuawazgFzu/CSbo0jsPnaKV6C1wCmja9nxmZdcM5YVYMw4TmVjsDh /jAd9u5zm2ioskGY+dZHuO/Rxn+g6QdmvuIn7YhPGhqN1hOjR51F0Heg+gy/Cr7ooHWA JDQ1spZG539Uhf8icmtCiOMylgmMYUtiBvQ0EIMWsfzYN/XVaYToIGsQuwkcES9/o5p6 /DyDT+DcghbCdhxJkIHtL5Ncjs6LJ6O4xxGrvqLZ5vUjkV2VnjL57a3oq3RrRlneOHta K9DA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=KIYR/aMZzk0LsdkJeDDp6+j1UclHBzfxzAom7y+Ovc8=; b=gVG89JVtMlAW97nd7TcVMxscUZora/KmC3Wdpl0ZmByK8RpvTJI3LSc45nIJtr99Hm jJ/Io98yskH8pETQ+okPdAmphwaShsAQqCFSzeGRL5MOIhCB2GAkIb6MXmSBmyen5SEK Pn5w+lK+opA9+4KIad3fRYYTFB3DzpfkhwYnYfunDAC2dbOgz5TAoQttpNx03H7Ii6st qkH1WFCYPtVYKEbDCDkhahCTpf1L6lLpxDnAnXakK5OM92kYqyHs3vLYhcpoNrnt012h WEuZkV9Jp7ccfYapNN+GdSbBCdKGemJ0eDSvMOdJtrnKrsRGhYtbWG2HQ6Hvlxs/yPQS TcLw== X-Gm-Message-State: AMke39nWBE5HfopuJyK4Y/DAG6tnhOkp04AbnuSGafvV50pqJ4WHKexCwhFXekueTvhFndKAL+89gyn0EhBaQA== X-Received: by 10.200.42.200 with SMTP id c8mr18000467qta.156.1486904936085; Sun, 12 Feb 2017 05:08:56 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.142.132 with HTTP; Sun, 12 Feb 2017 05:08:55 -0800 (PST) In-Reply-To: <967D2491-5DB5-45CC-B4C5-E8FF48743504@gmail.com> References: <459B9F17-317F-465E-8D2F-361CF47E5F32@gmail.com> <3D9E1A43-0182-4A1F-8262-6F587A79254E@gmail.com> <830143EE-20F2-42A5-A4FC-ECE7DF50C632@gmail.com> <652AA7A2-60C5-460F-AE60-CF4CB1D1D781@gmail.com> <5BE2A225-4B9C-4F0F-ACC5-C23CCC873DF5@gmail.com> <4B18C549-4CEF-4275-B9B3-CB8A046EB4EC@gmail.com> <856BB65A-569E-4633-B104-5E3BD15B649F@gmail.com> <70520D3D-D381-44DC-A789-BB1E24FBE3F4@gmx.de> <531AF998-D1B2-43A6-A55B-F0471C0164E1@gmail.com> <967D2491-5DB5-45CC-B4C5-E8FF48743504@gmail.com> From: Dave Taht Date: Sun, 12 Feb 2017 05:08:55 -0800 Message-ID: To: Pete Heist Cc: Jonathan Morton , Cake List Content-Type: text/plain; charset=UTF-8 Subject: Re: [Cake] Cake latency update X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Feb 2017 13:08:56 -0000 Disable offloads on the sky hardware and see what happens? ethtool -K gro off tso off gso off your_device How old is the OS on that hardware - offloads have always been tricksy. as to why you might be seeing it more with cake, with this stuff on, you are not necessarily checking every packet for checksums, and flows are "finer" - more mixed up packets. capturing these events with tcpdump at various points on the path might help. Still, these are the kinds of baseline deployment issues that block progress elsewhere. The whole first stage of the rocket has to succeed in order to test the second. Doesn't matter how good your second stage is, if you RUD the first. Good digging!