Another explanation for latency spikes on the order of 100ms is that a periodic (and wholly unnecessary) scan for other APs is run, which requires the wifi radio to be temporarily tuned away from the currently associated AP's frequency.
- Jonathan Morton