On 12/08/2022 7:34 am, David P. Reed via Starlink wrote: > > I'll give you another example of a serious misuse of a theorem outside > its range of applicability: > > Shannon proved a channel capacity theorem: C = W log(S / N). The proof > is mathematical, and correct. > Indeed. > > But hiding in the assumptions are some very strong and rarely > applicable conditions. It was a very useful result in founding > information theory. > > But... it is now called "Shannon's Law" and asserted to be true and > applicable to ALL communications systems. > ...and it is. But it needs to be applied correctly. > > This turns out not to be correct. And it is hardly ever correct in > practice. > Ahem ... if it's proven, it's correct, even in practice ;-) > > An example of non-correct application turns out to be when multiple > transmissions of electromagnetic waves occur at the same time. EE > practice is to treat "all other signals" as Gaussian Noise. They are > not - they never are > Therein lies the problem. Correct theorem, incorrectly applied. > > . > > So, later information theorists discovered that where there are > multiple signals received by a single receiving antenna, and only a > little noise (usually from the RF Front End of the receiver, not the > environment) the Slepian-Wolf capacity theorem applies C = W > log(\sum(S[i]. i=1,N) /W). > Note: N here isn't the noise power (just the number of signals). > > That's a LOT more capacity than Shannon's Law predicts, especially in > narrowband signalling. > Only if you lump in correlated signals with noise, which is an incorrect (or rather, over-simplified) application of the Shannon-Hartley theorem. > > And noise itself is actually "measurement error" at the receiver, > which is rarely Gaussian, in fact it really is quite predictable > and/or removable. > Noise in the Shannon sense is random and therefore not predictable or correlated. Interference can be both predictable and correlated, and therefore can sometimes be removed / to an extent. Modelling interference as noise means not exploiting its inherent properties, and yes that means ending lower capacity. But that doesn't mean that either theorem is inapplicable - Shannon's fundamental limit still holds, even in the multi-user case, as long as the noise you plug in is the "little noise" from the RF front end and leave the interference out. The point I guess is that models are just models, and the more you know about what it is that you are dealing with, the better you can model. Which, I suppose, applies to managing queues also. The more you know what's in them and how it'll respond when you manage it, the better. -- **************************************************************** Dr. Ulrich Speidel School of Computer Science Room 303S.594 (City Campus) The University of Auckland u.speidel@auckland.ac.nz http://www.cs.auckland.ac.nz/~ulrich/ ****************************************************************