<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Nyquist on Corebaseit — POS · EMV · Payments · AI · Telecommunications</title><link>https://corebaseit.com/tags/nyquist/</link><description>Recent content in Nyquist on Corebaseit — POS · EMV · Payments · AI · Telecommunications</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><managingEditor>contact@corebaseit.com (Vincent Bevia)</managingEditor><webMaster>contact@corebaseit.com (Vincent Bevia)</webMaster><lastBuildDate>Fri, 08 May 2026 12:00:00 +0200</lastBuildDate><atom:link href="https://corebaseit.com/tags/nyquist/index.xml" rel="self" type="application/rss+xml"/><item><title>Nyquist is not Shannon: why more samples does not mean more information</title><link>https://corebaseit.com/corebaseit_posts/nyquist_is_not_shannon/</link><pubDate>Fri, 08 May 2026 12:00:00 +0200</pubDate><author>contact@corebaseit.com (Vincent Bevia)</author><guid>https://corebaseit.com/corebaseit_posts/nyquist_is_not_shannon/</guid><description>&lt;p>Digital engineers are trained to treat &amp;ldquo;more&amp;rdquo; as a default win: higher clock rates, wider bandwidths, deeper bit depths. Applied to analog-to-digital conversion, the intuition follows naturally. Sample faster, capture more points per second, and the digital record should carry more information about the signal.&lt;/p>
&lt;p>That intuition breaks in a specific way. A receiver can ingest samples at gigahertz rates and still fail to recover the message. The waveform may be digitized faithfully while the symbols remain indistinguishable. Sampling governs representation. Channel capacity governs recoverable information. Those are related problems in a receiver chain, but they answer different questions.&lt;/p>
&lt;h2 id="two-limits-two-questions">Two limits, two questions
&lt;/h2>&lt;p align="center">
&lt;img src="https://corebaseit.com/diagrams/NyquistAndShannon.png" alt="Nyquist and Shannon: two limits, two questions. Nyquist path: analog signal, anti-aliasing filter, ADC sampling, digital samples — was the waveform preserved without aliasing? Shannon path: channel bandwidth, signal-to-noise ratio, modulation and coding, achievable data rate — can the message be recovered reliably?" style="max-width: 900px; width: 100%;" />
&lt;/p>
&lt;p>&lt;strong>Nyquist&lt;/strong> (more precisely, the Nyquist–Shannon sampling theorem) sets the conditions under which a bandlimited continuous-time signal can be represented by discrete samples and reconstructed without aliasing. The sampling rate \(f_s\) must exceed twice the highest frequency \(f_{\max}\) in the signal. In practice, anti-aliasing filters enforce a usable band so that energy above \(f_s/2\) never reaches the ADC.&lt;/p>
&lt;p>&lt;strong>Shannon channel capacity&lt;/strong> sets the maximum rate at which information can be transmitted reliably over a noisy channel with bandwidth \(B\) and signal-to-noise ratio \(\mathrm{SNR}\):&lt;/p>
$$
C = B \log_2(1 + \mathrm{SNR})
$$&lt;p>Nyquist is about the analog–digital boundary: sample rate, filter transition bands, and spectral folding. Shannon is about the communication path: how many bits per second the channel can support given noise.&lt;/p>
&lt;p>A system can satisfy Nyquist and still fail at the Shannon layer. An ADC may capture the passband waveform with high fidelity, but if channel SNR is too low, constellation points smear across decision boundaries. The receiver has samples. It lacks evidence to pick the correct symbol. The waveform is preserved; the message is not recoverable at the target rate.&lt;/p>
&lt;table>
&lt;thead>
&lt;tr>
&lt;th>&lt;/th>
&lt;th>Nyquist (sampling)&lt;/th>
&lt;th>Shannon (capacity)&lt;/th>
&lt;/tr>
&lt;/thead>
&lt;tbody>
&lt;tr>
&lt;td>Primary concern&lt;/td>
&lt;td>Waveform representation at the ADC&lt;/td>
&lt;td>Reliable information rate over a noisy channel&lt;/td>
&lt;/tr>
&lt;tr>
&lt;td>Key variables&lt;/td>
&lt;td>\(f_s\), anti-aliasing filter, signal bandwidth&lt;/td>
&lt;td>Channel bandwidth \(B\), \(\mathrm{SNR}\)&lt;/td>
&lt;/tr>
&lt;tr>
&lt;td>Typical failure&lt;/td>
&lt;td>Aliasing: spectral overlap in the digitized band&lt;/td>
&lt;td>Symbol errors: noise dominates decision regions&lt;/td>
&lt;/tr>
&lt;tr>
&lt;td>Fix direction&lt;/td>
&lt;td>Raise \(f_s\) or tighten the analog filter&lt;/td>
&lt;td>More power, better coding, wider channel, lower noise&lt;/td>
&lt;/tr>
&lt;/tbody>
&lt;/table>
&lt;h2 id="aliasing-is-structural-damage">Aliasing is structural damage
&lt;/h2>&lt;p>When \(f_s \le 2f_{\max}\), high-frequency content folds into lower bands. That is aliasing: distinct spectral components become indistinguishable in the sampled sequence.&lt;/p>
&lt;p>Once overlap lands inside the band you intend to process, the mixture is not invertible. DSP, blind source separation, and forward error correction operate on the samples you already have. They cannot reconstruct which energy came from which original frequency component. FEC adds redundancy to survive bit errors; it does not undo a frequency-domain fold that happened at the sampler.&lt;/p>
&lt;p>This is why the anti-aliasing filter sits at the front of the chain. Its job is to keep out-of-band energy below the ADC so the first stored sample is not already corrupted.&lt;/p>
&lt;p>&lt;strong>Confirmed:&lt;/strong> Aliasing below the Nyquist rate is a sampling-theorem violation with no post-hoc digital fix.&lt;/p>
&lt;p>&lt;strong>Nuance:&lt;/strong> If you oversample and aliased images fall entirely outside the band of interest, digital filters can remove them. The irreversibility applies when folded energy overlaps the signal band you need to recover.&lt;/p>
&lt;h2 id="the-oversampling-fallacy-about-shannon-capacity">The oversampling fallacy about Shannon capacity
&lt;/h2>&lt;p>A common mistake is to treat a higher ADC sample rate \(f_s\) as if it were extra Shannon bandwidth. It is not.&lt;/p>
&lt;p>Shannon&amp;rsquo;s \(B\) is the bandwidth of the physical channel (or the effective information-bearing band after filtering), not the converter clock. Raising \(f_s\) without increasing usable bandwidth or SNR at the channel does not raise \(C\). Sampling a 10 MHz channel at 100 GHz with poor SNR gives you a dense record of a signal buried in noise. The sample count increases. The recoverable information rate does not.&lt;/p>
&lt;p>Oversampling also does not create independent observations of the channel. Samples taken faster than the signal bandwidth are correlated. Averaging them after proper filtering can improve implementation SNR in specific architectures, but the spectral-efficiency ceiling for the band is still set by Shannon&amp;rsquo;s formula on that band&amp;rsquo;s \(B\) and \(\mathrm{SNR}\).&lt;/p>
&lt;h2 id="what-oversampling-actually-buys-you">What oversampling actually buys you
&lt;/h2>&lt;p>Oversampling is an architecture lever, not a capacity multiplier.&lt;/p>
&lt;p>At the minimum Nyquist rate, the analog anti-aliasing filter must approximate a brick wall: very sharp rolloff, tight transition band, difficult phase and group-delay control. High-order analog filters are expensive, sensitive to component tolerance, and prone to passband ripple and group-delay variation. That group-delay flatness matters when you run high-order QAM: phase distortion at band edges directly hurts EVM.&lt;/p>
&lt;p>Sampling well above Nyquist widens the gap between the signal band and the first aliased image around \(f_s - f_{\max}\). The analog filter can roll off gently. The steep rejection moves to digital filters, where coefficients are exact, repeatable, and field-updatable.&lt;/p>
&lt;p>Oversampling also buys margin in the digital domain: more samples per symbol for timing recovery, simpler interpolation in clock recovery loops, and headroom against clock jitter in mobile links. These are implementation advantages. They simplify hardware and improve robustness. They do not rewrite the Shannon limit on the RF or wired channel feeding the receiver.&lt;/p>
&lt;h2 id="quantization-noise-spread-shape-filter">Quantization noise: spread, shape, filter
&lt;/h2>&lt;p>The other major payoff appears inside the ADC itself.&lt;/p>
&lt;p>A finite-resolution quantizer injects quantization noise. For a rough first-order model, total quantization noise power is set by step size and full-scale range. When you oversample by factor \(M\), that noise power spreads across a wider Nyquist band (up to \(f_s/2\)). Noise power spectral density in the original signal band drops by approximately \(M\), giving roughly 3 dB of in-band SNR improvement per doubling of sample rate for white quantization noise. That trades sample rate for effective resolution (often quoted as ENOB improvement). This is process gain against quantization noise, not an increase in Shannon channel capacity.&lt;/p>
&lt;p>Delta–sigma converters push further. A feedback loop shapes quantization noise out of the band of interest and into high frequencies where the oversampling headroom lives. A digital decimation filter then removes the shaped noise. The analog front end can stay coarse; precision emerges from digital filtering and noise shaping rather than from an impractically linear multi-bit analog quantizer at the input.&lt;/p>
&lt;p>Typical sequence:&lt;/p>
&lt;ol>
&lt;li>&lt;strong>Oversample&lt;/strong> — spread quantization noise across a wide band.&lt;/li>
&lt;li>&lt;strong>Shape&lt;/strong> — move noise energy out of the signal band (delta–sigma loop).&lt;/li>
&lt;li>&lt;strong>Decimate and filter&lt;/strong> — keep the signal band, discard the shaped noise.&lt;/li>
&lt;/ol>
&lt;h2 id="layered-constraints-in-real-receivers">Layered constraints in real receivers
&lt;/h2>&lt;p>Modern receivers in cellular base stations, Wi-Fi access points, and satellite modems hit both layers. Nyquist failures corrupt the waveform before baseband processing starts. Shannon failures leave the waveform intact but the link rate unsupportable at the target modulation and coding scheme.&lt;/p>
&lt;p>Useful design questions stay separate:&lt;/p>
&lt;ul>
&lt;li>&lt;strong>Nyquist layer:&lt;/strong> Did we band-limit and sample so the digitized waveform preserves the intended spectrum?&lt;/li>
&lt;li>&lt;strong>Shannon layer:&lt;/strong> Given channel \(B\) and \(\mathrm{SNR}\), can this modulation and code rate operate at the target BER or BLER?&lt;/li>
&lt;/ul>
&lt;p>Confusing the two produces expensive mistakes: chasing sample rate when the link is SNR-limited, or squeezing the analog filter while ignoring aliasing risk.&lt;/p>
&lt;p>In receiver work I have seen both failure modes. A lab trace with clean time-domain samples and a constellation plot that looks like a fuzzy disk is a Shannon-layer problem. A spectrum with folded interferers sitting on top of the wanted channel is a Nyquist-layer problem. The debug path differs completely.&lt;/p>
&lt;p>Oversampling belongs in the toolkit for filter relaxation, timing margin, and quantization noise management. Shannon&amp;rsquo;s formula still defines how much information the channel can carry. Nyquist still defines whether the ADC output is a faithful starting point. Keep the layers separate and the architecture gets easier to reason about.&lt;/p>
&lt;h2 id="references">References
&lt;/h2>&lt;ol>
&lt;li>
&lt;p>H. Nyquist, &amp;ldquo;Certain topics in telegraph transmission theory,&amp;rdquo; &lt;em>Transactions of the American Institute of Electrical Engineers&lt;/em>, vol. 47, no. 2, pp. 617–644, 1928.&lt;/p>
&lt;/li>
&lt;li>
&lt;p>C. E. Shannon, &amp;ldquo;Communication in the presence of noise,&amp;rdquo; &lt;em>Proceedings of the IRE&lt;/em>, vol. 37, no. 1, pp. 10–21, Jan. 1949. (Shannon capacity formula for bandlimited AWGN channels.)&lt;/p>
&lt;/li>
&lt;li>
&lt;p>C. E. Shannon, &amp;ldquo;A mathematical theory of communication,&amp;rdquo; &lt;em>Bell System Technical Journal&lt;/em>, vol. 27, pp. 379–423, 623–656, 1948.&lt;/p>
&lt;/li>
&lt;li>
&lt;p>A. V. Oppenheim and R. W. Schafer, &lt;em>Discrete-Time Signal Processing&lt;/em>, 3rd ed. Pearson, 2010. (Sampling, aliasing, and discrete-time analysis.)&lt;/p>
&lt;/li>
&lt;li>
&lt;p>J. G. Proakis and M. Salehi, &lt;em>Digital Communications&lt;/em>, 5th ed. McGraw-Hill, 2008. (Channel capacity, modulation, and receiver performance.)&lt;/p>
&lt;/li>
&lt;li>
&lt;p>R. G. Lyons, &lt;em>Understanding Digital Signal Processing&lt;/em>, 3rd ed. Pearson, 2011. (Oversampling, decimation, and practical ADC considerations.)&lt;/p>
&lt;/li>
&lt;li>
&lt;p>R. Schreier and G. C. Temes, &lt;em>Understanding Delta-Sigma Data Converters&lt;/em>. IEEE Press, 2005. (Noise shaping and oversampled converter architectures.)&lt;/p>
&lt;/li>
&lt;/ol>
&lt;h2 id="further-reading">Further reading
&lt;/h2>&lt;ul>
&lt;li>&lt;a class="link" href="https://corebaseit.com/posts/snr-qpsk/" >SNR: the number that decides whether a signal survives&lt;/a> — how noise shows up in receiver decisions&lt;/li>
&lt;li>&lt;a class="link" href="https://corebaseit.com/posts/why-your-internet-has-speed-limit/" >Why your internet has a speed limit&lt;/a> — thermal noise and the physical noise floor&lt;/li>
&lt;li>&lt;a class="link" href="https://corebaseit.com/posts/stochastic-entropy-ai/" >Stochastic, entropy &amp;amp; AI&lt;/a> — Shannon&amp;rsquo;s information-theoretic foundations in broader context&lt;/li>
&lt;/ul></description></item></channel></rss>