From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR02-HE1-obe.outbound.protection.outlook.com (mail-eopbgr10074.outbound.protection.outlook.com [40.107.1.74]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 2ECD33B260 for ; Thu, 30 Jun 2016 15:23:54 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=darbyshire-bryant.me.uk; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=FlKN63YuG5CmpyD5UKB3mtGzT7UNnfPEojyiLvF+KcI=; b=hlyJvBY2l9nZNYXP/SW1DZ3mgTNIiwV5pcvN3IwKljUtNMmmLXypJaR6vE/aLrThxVzT131Y3avYKJCob16tLQJrp3/gvTE/vCrSGJakmY6RWclwzzvxDDOvWv6B0EUr+qeeA7wr3aqyc0NC08irFt+OzKQc3GHGBZ702kvTiro= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=kevin@darbyshire-bryant.me.uk; Received: from [IPv6:2a02:c7f:1216:da2b::4007:25d] (2a02:c7f:1216:da2b::4007:25d) by VI1PR07MB0943.eurprd07.prod.outlook.com (10.161.110.148) with Microsoft SMTP Server (TLS) id 15.1.523.12; Thu, 30 Jun 2016 19:23:51 +0000 To: Jonathan Morton References: <57501404.5010704@darbyshire-bryant.me.uk> <6A7C70EE-906E-4624-A84A-645ED4530A07@gmail.com> <5774E766.2050302@darbyshire-bryant.me.uk> CC: From: Kevin Darbyshire-Bryant Message-ID: <577571C4.2070905@darbyshire-bryant.me.uk> Date: Thu, 30 Jun 2016 20:23:48 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 8bit X-Originating-IP: [2a02:c7f:1216:da2b::4007:25d] X-ClientProxiedBy: AM3PR04CA0119.eurprd04.prod.outlook.com (10.163.180.173) To VI1PR07MB0943.eurprd07.prod.outlook.com (10.161.110.148) X-MS-Office365-Filtering-Correlation-Id: 60d43c2d-338b-4a92-47a5-08d3a11c11b9 X-Microsoft-Exchange-Diagnostics: 1; VI1PR07MB0943; 2:Pe44GYXzdSOYhag1liiR7R0cTjodEy8P3Y+p6afhBDtibNV4H3J3UdJCaLg2wPsh+juD/7wfUSA4mtbLOnRPd+eS7xhOgPPMjfg3R2pHfdcwuBePfS/0/4RsL9TVU1jxNgbAP2EcdfJuL7ErIveKw5z/fcxInZNfdb2TABbz507X4rrWJF2wCQI8+v28DqUd; 3:yzCTmMTaOdWAqbwmxCSK/73oYOzGuUu+Cdyk83YCdz5h7sUHTDUKjeKdZxDWfsoelXio3i16oZzZlzX6NtArJkz5BQl2XUB7JEsr3GAiiVncOR5GbeCztpkr+QZ09KBm; 25:W7wrHmfXo+L+ZmG1E2iU1chEgjjuz9IZI4gW7ulZaCTM4ApqT94P/2SMWkli4xhwM6NRVDE9Xfbdce8MV+LDvKCebj4Dl7qO+6L6Q6ruPZxqDjN69b6X2ofeDu3ZaqnSWmNKveQkRhO0sEI2oeZuaQ0zLh3VHeRtYDtyTFbSEzEvgjQqV8+LVeGa+pw9TlFzR1PDS9OqNJcpCi6dK1kOEdnaA4/A22hzZzr7OZMWzGBIJwklrEKGRVioAvCWXsKK0mWN7KBQWN+McheH8l3v0QiXMuS4eO1MVadjKRGrn805TAN15lGmAmZt2OZ2ei8Dthoy1RFbhSx7nvdjfBbZyuxeXK2aHnEpV2BDMi1RWFZ2ev5h97sd8yt+bNYkjDp7G5PiQiYtsb2KB27esUV9v+8G50O7C4SOQhOW604bId4= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:VI1PR07MB0943; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040130)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6041072)(6043046); SRVR:VI1PR07MB0943; BCL:0; PCL:0; RULEID:; SRVR:VI1PR07MB0943; X-Microsoft-Exchange-Diagnostics: 1; VI1PR07MB0943; 4:dy2/Y7Xk+a+wolcaO+LSUOwm1j7if3KD143ohnPY3DG9K/l4rxBV/O2NNyOjQw5jZMfE96ImXjvGj0iUHPIIX4na92YTrOYXt9SLu9JGq4U/MhPSx814NhUR7psmtDlKKF2L2VPADmzmxKcuzTlFUu8LVWFoHbf3BpwHCNVPBN5Jw9q/u14hgZuuauJ0GpVld7GQD7ceQFwY2mMQK0rxKfktCEfQ8AYrl/eT/vNTBzy8AThL87g5hs8UX9JVj8g4Y7SRzTlkSBfn35a2Kp2NNVouZGEj2LY0vA/GOHJUcg3OGCtPKIIBiVs8QxdkbG+Kh6vCXY9yeOTxgAun9D4lwWTKwfL2eeezB2v/UGuXuVBTdRjUVcs/N37koA2TBX6stum3hsx9qACTA6/CiSduD2BeHpWb64k6bsaH+UDvShg= X-Forefront-PRVS: 0989A7979C X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(7916002)(51444003)(24454002)(199003)(189002)(76176999)(65816999)(101416001)(47776003)(50466002)(50986999)(83506001)(65956001)(19580405001)(7736002)(81156014)(106356001)(81166006)(74482002)(23676002)(1411001)(68736007)(59896002)(87266999)(65806001)(80316001)(8676002)(2870700001)(54356999)(33656002)(2906002)(19580395003)(36756003)(105586002)(4326007)(7846002)(42186005)(1706002)(4001350100001)(86362001)(586003)(93886004)(92566002)(77096005)(189998001)(110136002)(64126003)(305945005)(99136001)(2950100001)(6116002)(97736004)(3826002); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR07MB0943; H:[IPv6:2a02:c7f:1216:da2b::4007:25d]; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: darbyshire-bryant.me.uk does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtWSTFQUjA3TUIwOTQzOzIzOnJ1N3dhZU9vdHF2VCtSQTZ6Y0MyRmIzbkho?= =?utf-8?B?dU9GaWNwdWRjN21lUTVMWmloZTlSRXljNFhNN3V2QVJhc1JMQjArbTZ3cGxY?= =?utf-8?B?STR2MWNiTFNmbGlBc1grdWZtSTFSU1dlYWNFalV4TGdhYTFTdkRSZFE3R296?= =?utf-8?B?NjlGZ3FXTjBLRVR0RndIczFIS3lZNmhJSlJlSUlhZ2JBZENGRkNMUHVZQlU2?= =?utf-8?B?N1NVdlFYVVRzcVBPR3E2RkxTdWZIeGk4THMzbXpRZjd3OW5oOXRhekE0cmk3?= =?utf-8?B?NHMrR1UrUjFSV0d4ZThGOFpjNEhJRXVxTTN0dEFraWFPZHAxZzczM2haOVha?= =?utf-8?B?VVNwUFVQSDZaTHFPK0ZUMkVwbFRDdUxHMTA1Wk5FSW5oWkh3bnlKQkg0dFkx?= =?utf-8?B?L2NmSUkvbXhWMHJ5d0NObU15ZHpjNDhWWlp0MHNYME8rdVFDUENqQmpYajEr?= =?utf-8?B?bnhkVkFSTDhFbWZSSmdjc0VzS1dSZjl1R3BTengwQ3dDUlZBL3YwU2hIdkVV?= =?utf-8?B?MmZLYXEvZjl5eSsvRkpFc1JMelU5d0NUd04rMk82YVcrM0lUa1hSakIwbHBq?= =?utf-8?B?TWJCT3hCRFF4TmJ4cXBkYndDcm5PY1dxbDJveU9uSTJEdEZzSTZISWZmdk0r?= =?utf-8?B?Uk91dlQ4aEtaODZMbjVkVVY0V0kzdUVoVDg2UVBiM2ZiVnI5cytsR1VmM3Jm?= =?utf-8?B?bllsOGkxalB0dkd5aXAxVXIxbFpNUGozUlhrOVNoMTh3dVRoWXVNbVdJbzBL?= =?utf-8?B?Vm93N2hjSG8wM21wMHU1N0h6V2VQVyszSWwzTENCTlRrcWJlNFVvbEhNY3Mw?= =?utf-8?B?Z0lRUjUrYzNMd2JFb3NhOWIzbnVFWUw5dGJFdG4yaDlGTlNxQWRDd2t4T01k?= =?utf-8?B?VWM4VFFCazlxY3J1bUtDRkxGZUxMWktVMzRXZjBlUm1BM1lKWG9iSkpWWHZ1?= =?utf-8?B?NllHcnJDRC9hMS9YWGJUNkZibXYvdTRqSlo1WERmSWdRZEpnK1VtOE5pckFz?= =?utf-8?B?dURnckZoRDc4MHlwTWdJZjFpRllSWTVoVWkyZkxSWVNBWkRrSHA4Z1ppZXJp?= =?utf-8?B?YTQyaXNqOGsrRnVSdW9QdUV6azdYMGJZZmJuMGg5U1YwZ20xcXhwSVJaVWdi?= =?utf-8?B?RyttUVdVeWo1VUZWWXZWUGlUUm80ZnhBZFU1ZytCbTZqaTdVQkdia1VLN1hV?= =?utf-8?B?bHJiaW1uL1JHbFBYMksrMUN3R29jQytOQmJIZUNGamhvMTBJajlBTHlzSFpI?= =?utf-8?B?N0pnd0ZVeHlTaFRZRUxRR2hTQlRta3M2QVpNa3FRMmVTM3BIeWJiVEl2YlZ6?= =?utf-8?B?SGkxU0tCd09lREhEY2NSZjNZYUpuTmdYenoyK0pEZGtBR3FHODA3SUpaMGVm?= =?utf-8?B?ckFFcGR0aXpscmp5bkxXaHgwakNNZkFoazdtSVpEM2VldVFDY2xHSXZBZHBI?= =?utf-8?B?M2JGUTZkOU5HdS9EMU9KM2U1dFVQSURXSTJxb0ltNk0yMkMwN2tnSkgwZEVk?= =?utf-8?B?dm56ajU1dGFBWXphVEpndGdCMFhvNWc0SERCN3ZlSElSbHkvK3hPSGRzRnFU?= =?utf-8?B?NFhjWmpOYnhZdjNVd1AyZFNrYlpaaDRERzBVQVg0MkozRXEyYndxZTlUZXJD?= =?utf-8?B?czRjQmx2R0FJenJMZ0xQS0I5Z2JxcGtEdlBhT0Nab0NhdXlKbE5YT1MyZ0Fk?= =?utf-8?B?NkZ6MzhPSnUwUU1QZEF4Z0Z3VnJhSFRZZXdFZEs1UURPa2dDY3NQQkxwUUVu?= =?utf-8?B?OFhINkJTbU5EVnNNbFRzMzhOMXJuOE8xUkJrRTRuZWd0T05uT2p5S3J0K0RY?= =?utf-8?B?YzNZTEU1djFsWCtEZUxUaHR6RXRyMUs5OStJVlN1UmdlYlE9PQ==?= X-Microsoft-Exchange-Diagnostics: 1; VI1PR07MB0943; 6:BxOZKK9NKOaTHH9J+VWZNhBD479UxEi0hIOQI7QrfrVBqydpUBXC4fx7yl0Ab6+uPzCMNn+MaszWHzR9mBD/XKIIzOoCFdM6YyBC1UlFk7T+dOBYJKkdHF8CBV+X52HJdRhodTAPgzrnLz4ymnYBLC5nJ0xPm/ufV8/IcRqSiwpPX7pBnGU3kJvYxbNyV6/klLOlvliWKCmKYdGtBny95Kpglt88m4yVif0IV1STatLOv9SZnaGmDE4nJs2qm6miTeZt0MMksRuWZxV4UfblstAQEKEX/FCwv2Tz1wU2O5zvsKIJKPIaLEiHPTROqJ05MD72xr+k0nXgYc3Pu0Wyhg==; 5:Jk7gtJBktOjUGQs7fLtITw0U9ftTITmEXSa/O3QmULoOrZpPV16nDWXMbdnjx2kwxFpMSLvkKB39oI46i7RRh7x+pF+jOGL9NJJLL6Ni2fpkRq54bP9ZdoHprd6LfUEfVt4L23nlbHxUXMnJfWpuKw==; 24:BFNTLUpPertxuv/SN9eWrmZ3p9hBM/TgHPs+4/qSc51Blqw8kleFqxkhB8ShJTtlfYcALIy22gt+AwUjNy+ulQfijz2J1u/y2jZv4LE7TaA=; 7:Y+evRz4JOjRdaMibagJUGLgphTen/vum54rF9CEF2iKjxxGEvEVwswBH4+Qp76KRVO9g4TLVK2PLqVwTZMhN4LbSoszoF2qEve4J2hcIwNZH8fd6bMo4iLNgzQzJAD0KLYzKPCRYJH4TsVCBTG8FMBw7EwtWHvwcCBFNJbDtHk+Ak4c5J5xaCIgf9/OVWCPhgJ/X3pQsvwxtwNP6yTJTByV9WWQi7dwXapehjbO7fMo0g56mu2w0JXFbhUZK0ur19atLcYVCDDctT9mGAkkZzw== SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: darbyshire-bryant.me.uk X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Jun 2016 19:23:51.6292 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR07MB0943 Subject: Re: [Cake] flow dissector idea/enhancement - help X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Jun 2016 19:23:54 -0000 On 30/06/16 11:27, Jonathan Morton wrote: >> On 30 Jun, 2016, at 12:33, Kevin Darbyshire-Bryant wrote: >> >> +#ifdef CONFIG_NET_SCH_ESFQ_NFCT >> + enum ip_conntrack_info ctinfo; >> + struct nf_conn *ct = nf_ct_get(skb, &ctinfo); >> +#endif > Good find. If this actually works the way we want it to, it’ll make all the host-dependent modes (including triple-isolation) much more useful on the outer side of a NAT. > > My main concern is that the conntrack state might not be sorted out until it hits the firewall or routing logic. I’ll be very pleased if it happens sooner, or is actually triggered by the query rather than passing to some specific stage of processing. > > I have other work to do on the host and flow processing, but I think that’ll be independent of the hash function, which is where you want to be looking. I knew I shouldn't have got so excited. It sort of half works-ish. I hacked something together and then added a few printk statements to help with debugging. For testing I setup 'dual-dst' on the ifb4wan (ingress) interface, and set 'dual-src' on the wan4 (egress) interface. Testing showed the input side of things hadn't got as far as conntrack association by the time it hit the qdisc. The output side of things definitely has conntrack associations. They're a bit strange and I need to do a bit more digging to see if there's anything useful here, it might be possible to do per host egress fairness. For reasons I don't understand it looks as though I'm occasionally seeing the 'reply' conntrack association and not just the 'incoming'...in other words I'm seeing 'internet' source addresses, not just internal lan. I'm beginning to think there's a reason why enhanced sfq which is where I found that code never made it upstream :-/ It's been/being an interesting little diversion...and I've modified a kernel module that so far doesn't crash :-) KDB