Videos/Digital Show and Tell

<<< Intro >>>>

Hi, I'm Monty Montgomery from Red Hat and Xiph.Org.

A few months ago, I wrote an article on digital audio and why 24bit/192kHz music downloads don't make sense. In the article, I mentioned--almost in passing--that a digital waveform is not a stairstep, and you certainly don't get a stairstep when you convert from digital back to analog.

Of everything in the entire article, *that* was the number one thing people wrote about. In fact, more than half the mail I got was questions and comments about basic digital signal behavior. Since there's interest, let's take a little time to play with some _simple_ digital signals.

<<<< veritas ex machina >>>

Pretend for a moment that we have no idea how digital signals really behave. In that case it doesn't make sense for us to use digital test equipment either. Fortunately for this exercise, there's still plenty of working analog lab equipment out there.

[[ close on 3325 ]

First up, we need a signal generator to provide us with analog input signals--in this case, an HP3325 from 1978. It's still a pretty good generator, so if you don't mind the size, the weight, the power consumption, and the noisy fan, you can find them on eBay... occasionally for only slightly more than you'll pay for shipping.

close on 2246

Next, we'll observe our analog waveforms on analog oscilloscopes, like this Tektronix 2246 from the mid-90s, one of the last and very best analog scopes ever made. Every home lab should have one.

close on 3585

...and finally inspect the frequency spectrum of our signals using an analog spectrum analyzer, this HP3585 from the same product line as the signal generator. Like the other equipment here it has a rudimentary and hilariously large microcontroller, but the signal path from input to what you see on the screen is completely analog.

All of this equipment is vintage, but aside from its raw tonnage, the specs are still quite good.

out

At the moment, we have our signal generator set to output a nice 1kHz sine wave at one volt RMS,

we see the sine wave on the oscilloscope, can verify that it is indeed 1kHz at one volt RMS, which is 2.8V peak-to-peak, and that matches the measurement on the spectrum analyzer as well.

The analyzer also shows some low-level white noise and just a bit of harmonic distortion, with the highest peak about 70dB or so below the fundamental. Now, this doesn't matter at all in our demos, but I wanted to point it out now just in case you didn't notice it until later.

cut to complete setup

Now, we drop digital sampling in the middle.

For the conversion, we'll use a boring, consumer-grade, eMagic USB1 audio device. It's also more than ten years old at this point, and it's getting obsolete.

A recent converter can easily have an order of magnitude better specs. Flatness, linearity, jitter, noise behavior, everything... you may not have noticed. Just because we can measure an improvement doesn't mean we can hear it, and even these old consumer boxes were already at the edge of ideal transparency.

out to see emagic initialize and digital waveform appear on TP

The eMagic connects to my ThinkPad, which displays a digital waveform and spectrum for comparison, then the ThinkPad sends the digital signal right back out to the eMagic for re-conversion to analog and observation on the output scopes.

Input to output, left to right.

<<<< stairsteps >>>>

OK, it's go time. We begin by converting an analog signal to digital and then right back to analog again with no other steps.

close to 3325 The signal generator is set to produce a 1kHz sine wave just like before.

close to input scope We can see our analog sine wave on our input-side oscilloscope.

close to TP: spectrum We digitize our signal to 16 bit PCM at 44.1kHz, same as on a CD. The spectrum of the digitized signal matches what we saw earlier

close to SA and what we see now on the analog spectrum analyzer, aside from its high-impedance input being just a smidge noisier.

close to TP ; overview/waveform For now, the waveform display shows our digitized sine wave as a stairstep pattern, one step for each sample.

out And when we look at the output signal that's been converted from digital back to analog, we see...

close to output scope: press CH1 button to show waveform It's exactly like the original sine wave. No stairsteps.

out OK, 1kHz is still a fairly low frequency, maybe the stairsteps are just hard to see or they're being smoothed away. Fair enough. Let's choose a higher frequency, something close to Nyquist, say 15kHz.

set 3325 to 15kHz Now the sine wave is represented by less than three samples per cycle, and...

close to TP the digital waveform looks pretty awful. Well, looks can be deceiving. The analog output...

close to output scope is still a perfect sine wave, exactly like the original.

Let's keep going up.

Let's see if I can do this without blocking any cameras.

16kHz.... 17kHz... 18kHz... 19kHz...

20kHz. Welcome to the upper limits of human hearing. The output waveform is still perfect. No jagged edges, no dropoff, no stairsteps.

So where'd the stairsteps go? Don't answer, it's a trick question. They were never there.

Drawing a digital waveform as a stairstep... was wrong to begin with.

Why? A stairstep is a continuous-time function. It's jagged, and it's piecewise, but it has a defined value at every point in time.

A sampled signal is entirely different. It's discrete-time; it's only got a value right at each instantaneous sample point and it's undefined, there is no value at all, everywhere between. A discrete-time signal is properly drawn as a lollipop graph.

The continuous, analog counterpart of a digital signal passes smoothly through each sample point, and that's just as true for high frequencies as it is for low.

Now, the interesting and not at all obvious bit is: there's only one bandlimited signal that passes exactly through each sample point. It's a unique solution. So if you sample a bandlimited signal and then convert it back, the original input is also the only possible output.

And before you say, "oh, I can draw a different signal that passes through those points", well, yes you can, but if it differs even minutely from the original, it includes frequency content at or beyond Nyquist, breaks the bandlimiting requirement and isn't a valid solution.

out So how did everyone get confused and start thinking of digital signals as stairsteps? I can think of two good reasons.

close to TP; freeze display; draw in zero-order First: it's easy enough to convert a sampled signal to a true stairstep. Just extend each sample value forward until the next sample period. This is called a zero-order hold, and it's an important part of how some digital-to-analog converters work, especially the simplest ones.

Wikipedia DAC lookup + scroll down to hold image So, anyone who looks up digital-to-analog converter or digital-to-analog conversion is probably going to see a diagram of a stairstep waveform somewere, but that's not a finished conversion, and it's not the signal that comes out.

out Second, and this is probably the more likely reason, engineers who supposedly know better, like me, draw stairsteps even though they're technically wrong. It's a sort of like a one-dimensional version of fat bits in an image editor.

gimp RMD animation] Pixels aren't squares either, they're samples of a 2-dimensional function space and so they're also, conceptually, infinitely small points. Practically, it's a real pain in the ass to see or manipulate infinitely small anything, so big squares it is. Digital stairstep drawings are exactly the same thing.

out It's just a convenient drawing. The stairsteps aren't really there.

<<< bit-depth >>>

When we convert a digital signal back to analog, the result is _also_ smooth regardless of the bit depth. 24 bits or 16 bits... or 8 bits... it doesn't matter.

So does that mean that the digital bit depth makes no difference at all? Of course not.

Channel 2 here is the same sine wave input, but we quantize with dither down to eight bits.

On the scope, we still see a nice smooth sine wave on channel 2. Look very close, and you'll also see a bit more noise. That's a clue.

If we look at the spectrum of the signal... aha! Our sine wave is still there unaffected, but the noise level of the eight-bit signal on the second channel is much higher!

And that's the difference the number of bits makes. That's it!

When we digitize a signal, first we sample it. The sampling step is perfect; it loses nothing. But then we quantize it, and quantization adds noise.

panel 2; demonstrate changing bit depth on tablet

The number of bits determines how much noise and so the level of the noise floor. demonstrate changing bit depth on tablet.

out

What does this dithered quantization noise sound like? Let's listen to our eight-bit sine wave.

That may have been hard to hear anything but the tone. Let's listen to just the noise after we notch out the sine wave and then bring the gain up a bit because the noise is quiet.

Those of you who have used analog recording equipment may have just thought to yourselves, "My goodness! That sounds like tape hiss!" Well, it doesn't just sound like tape hiss, it acts like it too, and if we use a gaussian dither then it's mathematically equivalent in every way. It _is_ tape hiss.

Intuitively, that means that we can measure tape hiss and thus the noise floor of magnetic audio tape in bits instead of decibels, in order to put things in a digital perspective. Compact cassettes...

reveal cassette

for those of you who are old enough to remember them, could reach as deep as nine bits in perfect conditions, though five to six bits was more typical, especially if it was a recording made on a tape deck. That's right... your mix tapes were only about six bits deep... if you were lucky!

The very best professional open reel tape used in studios could barely hit... any guesses? 13 bits _with_ advanced noise reduction. And that's why seeing 'D D D' on a Compact Disc used to be such a big, high-end deal.

<<< dither >>>

I keep saying that I'm quantizing with dither, so what is dither exactly and, more importantly, what does it do?

The simple way to quantize a signal is to choose the digital amplitude value closest to the original analog amplitude. Obvious, right? Unfortunately, the exact noise you get from this simple quantization scheme depends somewhat on the input signal,

so we may get noise that's inconsistent, or causes distortion, or is undesirable in some other way.

[show/attribute the dither paper] Dither is specially-constructed noise that substitutes for the noise produced by simple quantization. Dither doesn't drown out or mask quantization noise, it actually replaces it with noise characteristics of our choosing that aren't influenced by the input.

out

Let's _watch_ what dither does. The signal generator has too much noise for this test so

we'll produce a mathematically perfect sine wave with the ThinkPad press

and quantize it to eight bits press

with dithering. press

We see a nice sine wave on the waveform display

show outscope and output scope

show analyzer and, once the analog spectrum analyzer catches up...

time accel sweep a clean frequency peak with a uniform noise floor on both spectral displays

overview: spectrum just like before. Again, this is with dither.

Now I turn dithering off. deactivate dither

The quantization noise, that dither had spread out into a nice, flat noise floor, piles up into harmonic distortion peaks. The noise floor is lower, but the level of distortion becomes nonzero, and the distortion peaks sit higher than the dithering noise did.

At eight bits this effect is exaggerated. At sixteen bits, click 16

even without dither, harmonic distortion is going to be so low as to be completely inaudible.

draw line across -100

Still, we can use dither to eliminate it completely if we so choose.

Turning the dither off again for a moment, you'll notice that the absolute level of distortion from undithered quantization stays approximately constant regardless of the input amplitude.

But when the signal level drops below a half a bit, everything quantizes to zero.

In a sense, everything quantizing to zero is just 100% distortion! Dither eliminates this distortion too. We reenable dither and...

dither on

there's our signal back at 1/4 bit, with our nice flat noise floor.

out

The noise floor doesn't have to be flat. Dither is noise of our choosing, so let's choose a noise as inoffensive and difficult to notice as possible.

panel 5

Our hearing is most sensitive in the midrange from 2kHz to 4kHz, so that's where background noise is going to be the most obvious.

[[click shaped]

We can shape dithering noise away from sensitive frequencies to where hearing is less sensitive, usually the highest frequencies.

out 16-bit dithering noise is normally much too quiet to hear at all, but let's listen to our noise shaping example, again with the gain brought way up...

close unshaped white to shaped

out Lastly, dithered quantization noise _is_ higher power overall than undithered quantization noise even when it sounds quieter, and you can see that on a VU meter during passages of near-silence. But dither isn't only an on or off choice. We can reduce the dither's power to balance less noise against a bit of distortion to minimize the overall effect.

 panel 6 audio :: flat, unmodulated 

We'll also modulate the input signal like this:

 panel 6 audio :: flat, modulated 

...to show how a varying input affects the quantization noise. At full dithering power, the noise is uniform, constant, and featureless just like we expect:

 panel 6 audio :: flat, modulated, notch 

As we reduce the dither's power, the input increasingly affects the amplitude and the character of the quantization noise:

 panel 6 audio :: flat, modulated, notch 

Shaped dither behaves similarly, but noise shaping lends one more nice advantage. To make a long story short, it can use a somewhat lower dither power before the input has as much effect on the output.

 panel 6 audio :: shaped, modulated, notch 
 reset panel :: shaped, unmodulated, no notch 

out

Despite all the time I just spent on dither, we're talking about differences that start 100 decibels and more below full scale. Maybe if the CD had been 14 bits as originally designed, dither _might_ be more important. Maybe. At 16 bits, really, it's mostly a wash. You can think of dither as an insurance policy that gives several extra decibels of dynamic range just in case. The simple fact is, though, no one ever ruined a great recording by not dithering the final master.

<<<< bandlimitation and timing >>>>

We've been using sine waves. They're the obvious choice when what we want to see is a system's behavior at a given isolated frequency. Now let's look at something a bit more complex. What should we expect to happen when I change the input to a square wave...

close to sig analyzer-- press the button

close to input scope The input scope confirms our 1kHz square wave. The output scope shows..

close to output scope Exactly what it should.

...

What is a square wave really? illustrate

Well, we can say it's a waveform that's some positive value for half a cycle and then transitions instantaneously to a negative value for the other half. But that doesn't really tell us anything useful about how this input close/point becomes this output close/point.

animated diagram Then we remember that any waveform is also the sum of discrete frequencies, and a square wave is particularly simple sum: a fundamental and an infinite series of odd harmonics. Sum them all up, you get a squarewave.

out At first glance, that doesn't seem very useful either. You have to sum up an infinite number of harmonics to get the answer. Ah, but we don't have an infinite number of harmonics.

close to panel, annotate circling cutoff, and line at 20kHz on spectrum

We're using a quite sharp anti-aliasing filter that cuts off right above 20kHz, so our signal is bandlimited, which means we get this:

diagram

..and that's exactly what we see on the output scope. pan/fade to scope display showing they line up perfectly

The rippling you see around sharp edges in a bandlimited signal is called the Gibbs effect. It happens whenever you slice off part of the frequency domain in the middle of nonzero energy.

out The usual rule of thumb you'll hear is "the sharper the cutoff, the stronger the rippling", which is approximately true, but we have to be careful how we think about it.

For example... what would you expect our quite sharp anti-aliasing filter to do if I run our signal through it a second time?

plug plug go outscope

Aside from adding a few fractional cycles of delay, the answer is... nothing at all. The signal is already bandlimited. Bandlimiting it again doesn't do anything. A second pass can't remove frequencies that we already removed.

out And that's important. People tend to think of the ripples as a kind of artifact that's added by anti-aliasing and anti-imaging filters, implying that the ripples get worse each time the signal passes through. We can see that in this case that didn't happen. So was it really the filter that added the ripples the first time through? No, not really. It's a subtle distinction, but Gibbs effect ripples aren't added by filters, they're just part of what a bandlimited signal _is_.

Even if we synthetically construct what looks like a perfect digital square wave,

turn on digital 'squarewave'

it's still limited to the channel bandwidth. Remember, the stairstep representation is misleading.

go to lollipop

What we really have here are instantaneous sample points,

to diagram, trace original

and only one bandlimited signal fits those points. All we did when we drew our apparently perfect square wave was line up the sample points just right so it appeared that there were no ripples if we played connect-the-dots.

[[ diagram: shift samples forward and back; fade to waveform display showing same ]]

But the original bandlimited signal, complete with ripples, was still there.

show output scope out

And that leads us to one more important point. You've probably heard that the timing precision of a digital signal is limited by its sample rate; put another way,

diagram

that digital signals can't represent anything that falls between the samples.. implying that impulses or fast attacks have to align exactly with a sample, or the timing gets mangled... or they just disapper.

scribble it out

At this point, we can easily see why that's wrong.

Again, our input signals are bandlimited. And digital signals are samples, not stairsteps, not 'connect-the-dots'. We most certainly can, for example, put the rising edge of our bandlimited square wave anywhere we want between samples.

It's represented perfectly show on the waveform display, move slider and it's reconstructed perfectly show on output scope with moving slider.

<<< epilogue >>>

Just like in the previous episode, we've covered a broad range of topics, and yet barely scratched the surface of each one. If anything, my sins of omission are greater this time around... but this is a good stopping point.

Or maybe, a good starting point. Dig deeper. Experiment. I chose my demos very carefully to be simple and give clear results. You can reproduce every one of them on your own if you like. But let's face it, sometimes we learn the most about a spiffy toy by breaking it open and studying all the pieces that fall out. And that's OK, we're engineers. Play with the demo parameters, hack up the code, set up alternate experiments. The source code for everything, including the little pushbutton demo application, is up at xiph.org.

In the course of experimentation, you're likely to run into something that you didn't expect and can't explain. Don't worry! My earlier snark aside, Wikipedia is fantastic for exactly this kind of casual research. And, if you're really serious about understanding signals, several universities have advanced materials online, such as the 6.003 and 6.007 Signals and Systems modules at MIT OpenCourseWare. And of course, there's always the community here at Xiph.Org.

Digging deeper or not, I am out of coffee, so, until next time, happy hacking!