[Cake] cake at 8gbit

dave seddon dave.seddon.ca at gmail.com
Fri Dec 6 18:43:17 EST 2024


Thanks again for this link.  Super interesting.

Regarding monitoring socket performance with Kubernetes clusters, I've
actually been working on deploying the xTCP socket monitoring tool into
kubernetes clusters.  The intention would be to stream the tcp_diag data
out of all the PoD on a regular basis.

The challenge is that ideally from a single process, you could open a
netlink socket into every PoD on the kubernetes node.  This is not
possible, as far as I understand, because a process can only live in a
single name space at any given time.

e.g. You can't do this:

[image: image.png]

The simple solution would be too run many versions of xTCP as a "sidecar"
in each PoD, like this:

[image: image.png]

This isn't great because then xTCP would be duplicated many times, so it
would waste RAMs, and you would have lots of Kafka sockets streaming the
socket data out out each PoD.

An alternative I was thinking would be to possibly have a small unix domain
socket (UDS) to netlink proxy in each PoD.  Over the UDS, the xTCP
daemonset ( single instance per node) could read and write the tcp_diag
data.

(e.g. I was thinking of a little rust binary that would essentially open a
UDS socket and a netlink socket, and then essentially copy from one to the
other. )


[image: image.png]


I don't really know if this is a good idea, or if I'm missing some other
way to extract the socket data from many PoDs.  Happy to hear ideas please!
:)

Full xtCP slides, including these "xTCP for kubernetes" here:
https://docs.google.com/presentation/d/11rixKNfIBCdofUpPL2wOuiWJXa40x4I0A1wuTMMv4Uo/edit#slide=id.g31cb19b2f14_0_87

Thanks,
Dave Seddon

On Tue, Nov 19, 2024 at 8:07 AM Dave Taht via Cake <
cake at lists.bufferbloat.net> wrote:

> https://github.com/cilium/cilium/issues/29083#issuecomment-2485142294
>
> --
> Dave Täht CSO, LibreQos
> _______________________________________________
> Cake mailing list
> Cake at lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/cake
>


-- 
Regards,
Dave Seddon
+1 415 857 5102
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.bufferbloat.net/pipermail/cake/attachments/20241206/a5690e9d/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 129740 bytes
Desc: not available
URL: <https://lists.bufferbloat.net/pipermail/cake/attachments/20241206/a5690e9d/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 183206 bytes
Desc: not available
URL: <https://lists.bufferbloat.net/pipermail/cake/attachments/20241206/a5690e9d/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 164177 bytes
Desc: not available
URL: <https://lists.bufferbloat.net/pipermail/cake/attachments/20241206/a5690e9d/attachment-0005.png>


More information about the Cake mailing list