Sampling Theorem and reconstruction
$begingroup$
I do not understand a concept about the Nyquist - Shannon sampling theorem.
It says that it is possibile to perfectly get the original analog signal from the signal obtained by sampling if and only if the sampling frequency is higher than twice the maximum frequency of the initial signal.
I can understand it if I think at what happens in the frequency domain, in which the sampling produces replicas of the initial spectrum and therefore a low pass filter reconstructor can delete them and keep the original spectrum.
But in time domain sampling simply means to extract values of the original signal at instants separated by the sampling time T.
Once I have extracted these values, I have lost all the informations about the points between two consecutive instants of sampling. How can the reconstructor device perfectly obtain the original signal? It does not know how to connect the sampled points (they can be connected by infinite mathematical curves and all the information inside T time are lost). For example, it can connect them as in figure 1 (the correct original signal), or as in figure 2.
figure 1
figure 2
This makes me think that a very high sampling frequency is surely a good thing, since the points are very close together, but there is not a frequency that if overcome, allows a 100% perfect reconstruction, since sampling implies losing information.
analog signal signal-processing sampling signal-theory
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
$endgroup$
add a comment |
$begingroup$
I do not understand a concept about the Nyquist - Shannon sampling theorem.
It says that it is possibile to perfectly get the original analog signal from the signal obtained by sampling if and only if the sampling frequency is higher than twice the maximum frequency of the initial signal.
I can understand it if I think at what happens in the frequency domain, in which the sampling produces replicas of the initial spectrum and therefore a low pass filter reconstructor can delete them and keep the original spectrum.
But in time domain sampling simply means to extract values of the original signal at instants separated by the sampling time T.
Once I have extracted these values, I have lost all the informations about the points between two consecutive instants of sampling. How can the reconstructor device perfectly obtain the original signal? It does not know how to connect the sampled points (they can be connected by infinite mathematical curves and all the information inside T time are lost). For example, it can connect them as in figure 1 (the correct original signal), or as in figure 2.
figure 1
figure 2
This makes me think that a very high sampling frequency is surely a good thing, since the points are very close together, but there is not a frequency that if overcome, allows a 100% perfect reconstruction, since sampling implies losing information.
analog signal signal-processing sampling signal-theory
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
$endgroup$
7
$begingroup$
Your bottom signal has some much higher frequency components than the other ones here.
$endgroup$
– Hearth
Mar 24 at 21:14
5
$begingroup$
There is exactly ONE curve that passes thru all those points AND is band limited to strictly less then Fs/2.
$endgroup$
– Dan Mills
Mar 24 at 21:15
$begingroup$
it's important to note that unique reconstruction is only possible if the original signal is strictly bandlimited. Or to put it another way, given the samples, the assumption of strict bandlimiting allows a single signal to be reconstructed. To the extent that the bandlimited assumption is untrue, then the reconstructed signal will not match the original - this is called aliasing.
$endgroup$
– Neil_UK
Mar 24 at 22:13
$begingroup$
Also note that in practice it may require higher sampling frequency to provide acceptable reconstruction since perfect band-limiting are not practical. For example Audio CDs use 44.1kHz sampling to provide 0-20kHz output. Oscilloscopes generally use 5-10 times the required minimum sampling frequency to provide acceptable waveform integrity as a sharp cutoff filter would tend to create waveform artifacts such as ringing.
$endgroup$
– Kevin White
Mar 24 at 22:42
$begingroup$
It says that...if the sampling frequency is higher than twice the maximum frequency of the initial signalIt most certainly does not. Don't confuse the frequency and bandwidth.
$endgroup$
– AndrejaKo
Mar 25 at 10:53
add a comment |
$begingroup$
I do not understand a concept about the Nyquist - Shannon sampling theorem.
It says that it is possibile to perfectly get the original analog signal from the signal obtained by sampling if and only if the sampling frequency is higher than twice the maximum frequency of the initial signal.
I can understand it if I think at what happens in the frequency domain, in which the sampling produces replicas of the initial spectrum and therefore a low pass filter reconstructor can delete them and keep the original spectrum.
But in time domain sampling simply means to extract values of the original signal at instants separated by the sampling time T.
Once I have extracted these values, I have lost all the informations about the points between two consecutive instants of sampling. How can the reconstructor device perfectly obtain the original signal? It does not know how to connect the sampled points (they can be connected by infinite mathematical curves and all the information inside T time are lost). For example, it can connect them as in figure 1 (the correct original signal), or as in figure 2.
figure 1
figure 2
This makes me think that a very high sampling frequency is surely a good thing, since the points are very close together, but there is not a frequency that if overcome, allows a 100% perfect reconstruction, since sampling implies losing information.
analog signal signal-processing sampling signal-theory
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
$endgroup$
I do not understand a concept about the Nyquist - Shannon sampling theorem.
It says that it is possibile to perfectly get the original analog signal from the signal obtained by sampling if and only if the sampling frequency is higher than twice the maximum frequency of the initial signal.
I can understand it if I think at what happens in the frequency domain, in which the sampling produces replicas of the initial spectrum and therefore a low pass filter reconstructor can delete them and keep the original spectrum.
But in time domain sampling simply means to extract values of the original signal at instants separated by the sampling time T.
Once I have extracted these values, I have lost all the informations about the points between two consecutive instants of sampling. How can the reconstructor device perfectly obtain the original signal? It does not know how to connect the sampled points (they can be connected by infinite mathematical curves and all the information inside T time are lost). For example, it can connect them as in figure 1 (the correct original signal), or as in figure 2.
figure 1
figure 2
This makes me think that a very high sampling frequency is surely a good thing, since the points are very close together, but there is not a frequency that if overcome, allows a 100% perfect reconstruction, since sampling implies losing information.
analog signal signal-processing sampling signal-theory
analog signal signal-processing sampling signal-theory
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
asked Mar 24 at 21:11
Kinka-ByoKinka-Byo
612
612
7
$begingroup$
Your bottom signal has some much higher frequency components than the other ones here.
$endgroup$
– Hearth
Mar 24 at 21:14
5
$begingroup$
There is exactly ONE curve that passes thru all those points AND is band limited to strictly less then Fs/2.
$endgroup$
– Dan Mills
Mar 24 at 21:15
$begingroup$
it's important to note that unique reconstruction is only possible if the original signal is strictly bandlimited. Or to put it another way, given the samples, the assumption of strict bandlimiting allows a single signal to be reconstructed. To the extent that the bandlimited assumption is untrue, then the reconstructed signal will not match the original - this is called aliasing.
$endgroup$
– Neil_UK
Mar 24 at 22:13
$begingroup$
Also note that in practice it may require higher sampling frequency to provide acceptable reconstruction since perfect band-limiting are not practical. For example Audio CDs use 44.1kHz sampling to provide 0-20kHz output. Oscilloscopes generally use 5-10 times the required minimum sampling frequency to provide acceptable waveform integrity as a sharp cutoff filter would tend to create waveform artifacts such as ringing.
$endgroup$
– Kevin White
Mar 24 at 22:42
$begingroup$
It says that...if the sampling frequency is higher than twice the maximum frequency of the initial signalIt most certainly does not. Don't confuse the frequency and bandwidth.
$endgroup$
– AndrejaKo
Mar 25 at 10:53
add a comment |
7
$begingroup$
Your bottom signal has some much higher frequency components than the other ones here.
$endgroup$
– Hearth
Mar 24 at 21:14
5
$begingroup$
There is exactly ONE curve that passes thru all those points AND is band limited to strictly less then Fs/2.
$endgroup$
– Dan Mills
Mar 24 at 21:15
$begingroup$
it's important to note that unique reconstruction is only possible if the original signal is strictly bandlimited. Or to put it another way, given the samples, the assumption of strict bandlimiting allows a single signal to be reconstructed. To the extent that the bandlimited assumption is untrue, then the reconstructed signal will not match the original - this is called aliasing.
$endgroup$
– Neil_UK
Mar 24 at 22:13
$begingroup$
Also note that in practice it may require higher sampling frequency to provide acceptable reconstruction since perfect band-limiting are not practical. For example Audio CDs use 44.1kHz sampling to provide 0-20kHz output. Oscilloscopes generally use 5-10 times the required minimum sampling frequency to provide acceptable waveform integrity as a sharp cutoff filter would tend to create waveform artifacts such as ringing.
$endgroup$
– Kevin White
Mar 24 at 22:42
$begingroup$
It says that...if the sampling frequency is higher than twice the maximum frequency of the initial signalIt most certainly does not. Don't confuse the frequency and bandwidth.
$endgroup$
– AndrejaKo
Mar 25 at 10:53
7
7
$begingroup$
Your bottom signal has some much higher frequency components than the other ones here.
$endgroup$
– Hearth
Mar 24 at 21:14
$begingroup$
Your bottom signal has some much higher frequency components than the other ones here.
$endgroup$
– Hearth
Mar 24 at 21:14
5
5
$begingroup$
There is exactly ONE curve that passes thru all those points AND is band limited to strictly less then Fs/2.
$endgroup$
– Dan Mills
Mar 24 at 21:15
$begingroup$
There is exactly ONE curve that passes thru all those points AND is band limited to strictly less then Fs/2.
$endgroup$
– Dan Mills
Mar 24 at 21:15
$begingroup$
it's important to note that unique reconstruction is only possible if the original signal is strictly bandlimited. Or to put it another way, given the samples, the assumption of strict bandlimiting allows a single signal to be reconstructed. To the extent that the bandlimited assumption is untrue, then the reconstructed signal will not match the original - this is called aliasing.
$endgroup$
– Neil_UK
Mar 24 at 22:13
$begingroup$
it's important to note that unique reconstruction is only possible if the original signal is strictly bandlimited. Or to put it another way, given the samples, the assumption of strict bandlimiting allows a single signal to be reconstructed. To the extent that the bandlimited assumption is untrue, then the reconstructed signal will not match the original - this is called aliasing.
$endgroup$
– Neil_UK
Mar 24 at 22:13
$begingroup$
Also note that in practice it may require higher sampling frequency to provide acceptable reconstruction since perfect band-limiting are not practical. For example Audio CDs use 44.1kHz sampling to provide 0-20kHz output. Oscilloscopes generally use 5-10 times the required minimum sampling frequency to provide acceptable waveform integrity as a sharp cutoff filter would tend to create waveform artifacts such as ringing.
$endgroup$
– Kevin White
Mar 24 at 22:42
$begingroup$
Also note that in practice it may require higher sampling frequency to provide acceptable reconstruction since perfect band-limiting are not practical. For example Audio CDs use 44.1kHz sampling to provide 0-20kHz output. Oscilloscopes generally use 5-10 times the required minimum sampling frequency to provide acceptable waveform integrity as a sharp cutoff filter would tend to create waveform artifacts such as ringing.
$endgroup$
– Kevin White
Mar 24 at 22:42
$begingroup$
It says that...if the sampling frequency is higher than twice the maximum frequency of the initial signal It most certainly does not. Don't confuse the frequency and bandwidth.$endgroup$
– AndrejaKo
Mar 25 at 10:53
$begingroup$
It says that...if the sampling frequency is higher than twice the maximum frequency of the initial signal It most certainly does not. Don't confuse the frequency and bandwidth.$endgroup$
– AndrejaKo
Mar 25 at 10:53
add a comment |
4 Answers
4
active
oldest
votes
$begingroup$
You can think of any perfectly bandlimited signal as the superposition of a set of $frac{sin(t)}{t} = text{sinc}(t)$ curves, with their peaks positioned uniformly along the time axis. Their spacing is $frac{2}{BW}$.
sinc(x) also happens to be the time-domain response of a perfect low-pass filter, and it explains how the continuous-time reconstruction (interpolation) is accomplished from a series of discrete samples.
When we uniformly sample a signal, each sample is a direct measurement of the amplitude of one of those sinc() waves. This works because it is a property of the sinc() function that it is zero at every sampling point, except at its own peak. In other words, when you take a measurement, you're not getting any "interference" from any of the other sinc() functions. Therefore, the set of N discrete measurements contains all of the information in the continuous-time signal represented by that collection of sinc() waves.
Now, it gets even weirder than what TimWestcott was alluding to — the samples do not even have to be uniformly spaced in time! It turns out that ANY N unique samples taken within a window of time (with certain limitations) of a perfectly bandlimited signal can be used to reconstruct that signal. It takes a lot more math to do it, though!
With nonuniform sampling, you are no longer getting a clean measurement of just one of the sinc() amplitudes. Instead, you're getting a mix of many, if not all of them. However, since you know exactly where you are on each one (obviously, each sample must be time-stamped), it is possible to solve the large system of linear equations to find the actual amplitudes and therefore reconstruct the original signal. Of course, this process is very sensitive to small perturbations (noise and math errors, for example), and I'm hand-waving away some details about constraints on the set of samples, but the general principle holds.
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
$endgroup$
add a comment |
$begingroup$
If the signal is perfectly bandlimited, then there is no additional information to be gotten out of it by sampling faster than twice the bandwidth. So perfect reconstruction must be possible. It's as @DanMills said: there's one and only one curve that'll pass through the sampled points and be correct, and that's the curve that you'd get from a perfect reconstruction filter.
(Note that it gets weirder -- at least in theory, if the bandwidth is $B$, then you don't need to sample $x(t)$ at $2B$ -- you can sample $x(t)$ and $frac{d x(t)}{dt}$ simultaneously at $B$, or sample out to the third derivative (i.e., collect four samples) at $frac{B}{2}$, or commit various other crimes to the signal before sampling an $N$ wide vector at $frac{2B}{N}$. Most such schemes (definitely the derivatives that I mention) would be horribly impractical, but in theory they'll work, and you do occasionally stumble across schemes that are actually used in reality.)
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
$endgroup$
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
1
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
add a comment |
$begingroup$
One way to represent a signal is by its evolution in time (the time domain). Another equivalent way is by its frequency components (the frequency domain). The "steeper" or "sharper" the variation in a time domain signal, the higher that signal's frequency content.
The signal you show in Figure 1 may have a frequency spectrum like the one below:
There is a maximum frequency fmax1 beyond which the frequency content is zero, meaning the signal is bandlimited. To reconstruct the signal without error, sample at a minimum rate of fs1 = 2*fmax1 (the Nyquist rate).
The signal you show in Figure 2 has higher frequency content since you placed sharp variations between several samples. Its frequency spectrum may resemble this:
The highest frequency component in the Figure 2 signal (fmax2) is greater than the highest frequency component in the Figure 1 signal (fmax1). This means you must sample at a higher rate to reconstruct the signal, fs2 = 2*fmax2 > fs1.
In summary, you can add as many small variations to the signals as you want, but in doing so you introduce higher frequency content, and you must increase the sampling rate according to the Nyquist theorem.
You may argue that a non-bandlimited signal has frequency content extending to infinity, and for such a signal we can't define a minimum sampling rate for error-free reconstruction. In practical situations, we bandlimit signals with antialiasing filters to ensure the frequency content above a certain frequency is zero.
answered Mar 25 at 6:28
w_hilew_hile
1011
$endgroup$
add a comment |
$begingroup$
There are already good answers here. Maybe here a very short one which might be useful. I assume you now something about FFT, spectrum or at least Fourier rows.
Look at the second picture you posted. What frequencies appear in its Fourier decomposition? Obviously it has much higher frequencies in it than the curve in picture one. But with the distance between the sampling points (and therefor the sampling frequency) you are limited to something which highest frequency has to be lower than 1/2 the sampling frequency. Or the other way: $$f_{highest} < 2*f_s$$ to be able to reconstruct it.
The points will reconstruct something with the least amount of sinusoids needed to hit the points.
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["\$", "\$"]]);
});
});
}, "mathjax-editing");
StackExchange.ifUsing("editor", function () {
return StackExchange.using("schematics", function () {
StackExchange.schematics.init();
});
}, "cicuitlab");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "135"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2felectronics.stackexchange.com%2fquestions%2f428871%2fsampling-theorem-and-reconstruction%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
4 Answers
4
active
oldest
votes
4 Answers
4
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
You can think of any perfectly bandlimited signal as the superposition of a set of $frac{sin(t)}{t} = text{sinc}(t)$ curves, with their peaks positioned uniformly along the time axis. Their spacing is $frac{2}{BW}$.
sinc(x) also happens to be the time-domain response of a perfect low-pass filter, and it explains how the continuous-time reconstruction (interpolation) is accomplished from a series of discrete samples.
When we uniformly sample a signal, each sample is a direct measurement of the amplitude of one of those sinc() waves. This works because it is a property of the sinc() function that it is zero at every sampling point, except at its own peak. In other words, when you take a measurement, you're not getting any "interference" from any of the other sinc() functions. Therefore, the set of N discrete measurements contains all of the information in the continuous-time signal represented by that collection of sinc() waves.
Now, it gets even weirder than what TimWestcott was alluding to — the samples do not even have to be uniformly spaced in time! It turns out that ANY N unique samples taken within a window of time (with certain limitations) of a perfectly bandlimited signal can be used to reconstruct that signal. It takes a lot more math to do it, though!
With nonuniform sampling, you are no longer getting a clean measurement of just one of the sinc() amplitudes. Instead, you're getting a mix of many, if not all of them. However, since you know exactly where you are on each one (obviously, each sample must be time-stamped), it is possible to solve the large system of linear equations to find the actual amplitudes and therefore reconstruct the original signal. Of course, this process is very sensitive to small perturbations (noise and math errors, for example), and I'm hand-waving away some details about constraints on the set of samples, but the general principle holds.
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
$endgroup$
add a comment |
$begingroup$
You can think of any perfectly bandlimited signal as the superposition of a set of $frac{sin(t)}{t} = text{sinc}(t)$ curves, with their peaks positioned uniformly along the time axis. Their spacing is $frac{2}{BW}$.
sinc(x) also happens to be the time-domain response of a perfect low-pass filter, and it explains how the continuous-time reconstruction (interpolation) is accomplished from a series of discrete samples.
When we uniformly sample a signal, each sample is a direct measurement of the amplitude of one of those sinc() waves. This works because it is a property of the sinc() function that it is zero at every sampling point, except at its own peak. In other words, when you take a measurement, you're not getting any "interference" from any of the other sinc() functions. Therefore, the set of N discrete measurements contains all of the information in the continuous-time signal represented by that collection of sinc() waves.
Now, it gets even weirder than what TimWestcott was alluding to — the samples do not even have to be uniformly spaced in time! It turns out that ANY N unique samples taken within a window of time (with certain limitations) of a perfectly bandlimited signal can be used to reconstruct that signal. It takes a lot more math to do it, though!
With nonuniform sampling, you are no longer getting a clean measurement of just one of the sinc() amplitudes. Instead, you're getting a mix of many, if not all of them. However, since you know exactly where you are on each one (obviously, each sample must be time-stamped), it is possible to solve the large system of linear equations to find the actual amplitudes and therefore reconstruct the original signal. Of course, this process is very sensitive to small perturbations (noise and math errors, for example), and I'm hand-waving away some details about constraints on the set of samples, but the general principle holds.
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
$endgroup$
add a comment |
$begingroup$
You can think of any perfectly bandlimited signal as the superposition of a set of $frac{sin(t)}{t} = text{sinc}(t)$ curves, with their peaks positioned uniformly along the time axis. Their spacing is $frac{2}{BW}$.
sinc(x) also happens to be the time-domain response of a perfect low-pass filter, and it explains how the continuous-time reconstruction (interpolation) is accomplished from a series of discrete samples.
When we uniformly sample a signal, each sample is a direct measurement of the amplitude of one of those sinc() waves. This works because it is a property of the sinc() function that it is zero at every sampling point, except at its own peak. In other words, when you take a measurement, you're not getting any "interference" from any of the other sinc() functions. Therefore, the set of N discrete measurements contains all of the information in the continuous-time signal represented by that collection of sinc() waves.
Now, it gets even weirder than what TimWestcott was alluding to — the samples do not even have to be uniformly spaced in time! It turns out that ANY N unique samples taken within a window of time (with certain limitations) of a perfectly bandlimited signal can be used to reconstruct that signal. It takes a lot more math to do it, though!
With nonuniform sampling, you are no longer getting a clean measurement of just one of the sinc() amplitudes. Instead, you're getting a mix of many, if not all of them. However, since you know exactly where you are on each one (obviously, each sample must be time-stamped), it is possible to solve the large system of linear equations to find the actual amplitudes and therefore reconstruct the original signal. Of course, this process is very sensitive to small perturbations (noise and math errors, for example), and I'm hand-waving away some details about constraints on the set of samples, but the general principle holds.
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
$endgroup$
You can think of any perfectly bandlimited signal as the superposition of a set of $frac{sin(t)}{t} = text{sinc}(t)$ curves, with their peaks positioned uniformly along the time axis. Their spacing is $frac{2}{BW}$.
sinc(x) also happens to be the time-domain response of a perfect low-pass filter, and it explains how the continuous-time reconstruction (interpolation) is accomplished from a series of discrete samples.
When we uniformly sample a signal, each sample is a direct measurement of the amplitude of one of those sinc() waves. This works because it is a property of the sinc() function that it is zero at every sampling point, except at its own peak. In other words, when you take a measurement, you're not getting any "interference" from any of the other sinc() functions. Therefore, the set of N discrete measurements contains all of the information in the continuous-time signal represented by that collection of sinc() waves.
Now, it gets even weirder than what TimWestcott was alluding to — the samples do not even have to be uniformly spaced in time! It turns out that ANY N unique samples taken within a window of time (with certain limitations) of a perfectly bandlimited signal can be used to reconstruct that signal. It takes a lot more math to do it, though!
With nonuniform sampling, you are no longer getting a clean measurement of just one of the sinc() amplitudes. Instead, you're getting a mix of many, if not all of them. However, since you know exactly where you are on each one (obviously, each sample must be time-stamped), it is possible to solve the large system of linear equations to find the actual amplitudes and therefore reconstruct the original signal. Of course, this process is very sensitive to small perturbations (noise and math errors, for example), and I'm hand-waving away some details about constraints on the set of samples, but the general principle holds.
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
answered Mar 24 at 21:53
Dave Tweed♦Dave Tweed
123k9152265
123k9152265
add a comment |
add a comment |
$begingroup$
If the signal is perfectly bandlimited, then there is no additional information to be gotten out of it by sampling faster than twice the bandwidth. So perfect reconstruction must be possible. It's as @DanMills said: there's one and only one curve that'll pass through the sampled points and be correct, and that's the curve that you'd get from a perfect reconstruction filter.
(Note that it gets weirder -- at least in theory, if the bandwidth is $B$, then you don't need to sample $x(t)$ at $2B$ -- you can sample $x(t)$ and $frac{d x(t)}{dt}$ simultaneously at $B$, or sample out to the third derivative (i.e., collect four samples) at $frac{B}{2}$, or commit various other crimes to the signal before sampling an $N$ wide vector at $frac{2B}{N}$. Most such schemes (definitely the derivatives that I mention) would be horribly impractical, but in theory they'll work, and you do occasionally stumble across schemes that are actually used in reality.)
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
$endgroup$
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
1
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
add a comment |
$begingroup$
If the signal is perfectly bandlimited, then there is no additional information to be gotten out of it by sampling faster than twice the bandwidth. So perfect reconstruction must be possible. It's as @DanMills said: there's one and only one curve that'll pass through the sampled points and be correct, and that's the curve that you'd get from a perfect reconstruction filter.
(Note that it gets weirder -- at least in theory, if the bandwidth is $B$, then you don't need to sample $x(t)$ at $2B$ -- you can sample $x(t)$ and $frac{d x(t)}{dt}$ simultaneously at $B$, or sample out to the third derivative (i.e., collect four samples) at $frac{B}{2}$, or commit various other crimes to the signal before sampling an $N$ wide vector at $frac{2B}{N}$. Most such schemes (definitely the derivatives that I mention) would be horribly impractical, but in theory they'll work, and you do occasionally stumble across schemes that are actually used in reality.)
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
$endgroup$
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
1
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
add a comment |
$begingroup$
If the signal is perfectly bandlimited, then there is no additional information to be gotten out of it by sampling faster than twice the bandwidth. So perfect reconstruction must be possible. It's as @DanMills said: there's one and only one curve that'll pass through the sampled points and be correct, and that's the curve that you'd get from a perfect reconstruction filter.
(Note that it gets weirder -- at least in theory, if the bandwidth is $B$, then you don't need to sample $x(t)$ at $2B$ -- you can sample $x(t)$ and $frac{d x(t)}{dt}$ simultaneously at $B$, or sample out to the third derivative (i.e., collect four samples) at $frac{B}{2}$, or commit various other crimes to the signal before sampling an $N$ wide vector at $frac{2B}{N}$. Most such schemes (definitely the derivatives that I mention) would be horribly impractical, but in theory they'll work, and you do occasionally stumble across schemes that are actually used in reality.)
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
$endgroup$
If the signal is perfectly bandlimited, then there is no additional information to be gotten out of it by sampling faster than twice the bandwidth. So perfect reconstruction must be possible. It's as @DanMills said: there's one and only one curve that'll pass through the sampled points and be correct, and that's the curve that you'd get from a perfect reconstruction filter.
(Note that it gets weirder -- at least in theory, if the bandwidth is $B$, then you don't need to sample $x(t)$ at $2B$ -- you can sample $x(t)$ and $frac{d x(t)}{dt}$ simultaneously at $B$, or sample out to the third derivative (i.e., collect four samples) at $frac{B}{2}$, or commit various other crimes to the signal before sampling an $N$ wide vector at $frac{2B}{N}$. Most such schemes (definitely the derivatives that I mention) would be horribly impractical, but in theory they'll work, and you do occasionally stumble across schemes that are actually used in reality.)
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
answered Mar 24 at 21:22
TimWescottTimWescott
6,5281416
6,5281416
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
1
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
add a comment |
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
1
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
$begingroup$
Why band - limiting means there is one e only one curves that will pass through the sampled points?
$endgroup$
– Kinka-Byo
Mar 25 at 1:18
1
1
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
$begingroup$
One of the things that you just have to accept with linear systems theory is that there are some things that are much easier to describe using frequency domain analysis, and there are other things that are much easier to describe using time domain analysis, and they are equivalent. So it is true in the time domain because it is true in the frequency domain. There is probably some mostly-time-domain explanation, but it'll take pages and pages more mathematics to describe it -- and there's still going to be frequency domain arguments in the proof, because of the way it's stated.
$endgroup$
– TimWescott
Mar 25 at 4:37
add a comment |
$begingroup$
One way to represent a signal is by its evolution in time (the time domain). Another equivalent way is by its frequency components (the frequency domain). The "steeper" or "sharper" the variation in a time domain signal, the higher that signal's frequency content.
The signal you show in Figure 1 may have a frequency spectrum like the one below:
There is a maximum frequency fmax1 beyond which the frequency content is zero, meaning the signal is bandlimited. To reconstruct the signal without error, sample at a minimum rate of fs1 = 2*fmax1 (the Nyquist rate).
The signal you show in Figure 2 has higher frequency content since you placed sharp variations between several samples. Its frequency spectrum may resemble this:
The highest frequency component in the Figure 2 signal (fmax2) is greater than the highest frequency component in the Figure 1 signal (fmax1). This means you must sample at a higher rate to reconstruct the signal, fs2 = 2*fmax2 > fs1.
In summary, you can add as many small variations to the signals as you want, but in doing so you introduce higher frequency content, and you must increase the sampling rate according to the Nyquist theorem.
You may argue that a non-bandlimited signal has frequency content extending to infinity, and for such a signal we can't define a minimum sampling rate for error-free reconstruction. In practical situations, we bandlimit signals with antialiasing filters to ensure the frequency content above a certain frequency is zero.
answered Mar 25 at 6:28
w_hilew_hile
1011
$endgroup$
add a comment |
$begingroup$
One way to represent a signal is by its evolution in time (the time domain). Another equivalent way is by its frequency components (the frequency domain). The "steeper" or "sharper" the variation in a time domain signal, the higher that signal's frequency content.
The signal you show in Figure 1 may have a frequency spectrum like the one below:
There is a maximum frequency fmax1 beyond which the frequency content is zero, meaning the signal is bandlimited. To reconstruct the signal without error, sample at a minimum rate of fs1 = 2*fmax1 (the Nyquist rate).
The signal you show in Figure 2 has higher frequency content since you placed sharp variations between several samples. Its frequency spectrum may resemble this:
The highest frequency component in the Figure 2 signal (fmax2) is greater than the highest frequency component in the Figure 1 signal (fmax1). This means you must sample at a higher rate to reconstruct the signal, fs2 = 2*fmax2 > fs1.
In summary, you can add as many small variations to the signals as you want, but in doing so you introduce higher frequency content, and you must increase the sampling rate according to the Nyquist theorem.
You may argue that a non-bandlimited signal has frequency content extending to infinity, and for such a signal we can't define a minimum sampling rate for error-free reconstruction. In practical situations, we bandlimit signals with antialiasing filters to ensure the frequency content above a certain frequency is zero.
answered Mar 25 at 6:28
w_hilew_hile
1011
$endgroup$
add a comment |
$begingroup$
One way to represent a signal is by its evolution in time (the time domain). Another equivalent way is by its frequency components (the frequency domain). The "steeper" or "sharper" the variation in a time domain signal, the higher that signal's frequency content.
The signal you show in Figure 1 may have a frequency spectrum like the one below:
There is a maximum frequency fmax1 beyond which the frequency content is zero, meaning the signal is bandlimited. To reconstruct the signal without error, sample at a minimum rate of fs1 = 2*fmax1 (the Nyquist rate).
The signal you show in Figure 2 has higher frequency content since you placed sharp variations between several samples. Its frequency spectrum may resemble this:
The highest frequency component in the Figure 2 signal (fmax2) is greater than the highest frequency component in the Figure 1 signal (fmax1). This means you must sample at a higher rate to reconstruct the signal, fs2 = 2*fmax2 > fs1.
In summary, you can add as many small variations to the signals as you want, but in doing so you introduce higher frequency content, and you must increase the sampling rate according to the Nyquist theorem.
You may argue that a non-bandlimited signal has frequency content extending to infinity, and for such a signal we can't define a minimum sampling rate for error-free reconstruction. In practical situations, we bandlimit signals with antialiasing filters to ensure the frequency content above a certain frequency is zero.
answered Mar 25 at 6:28
w_hilew_hile
1011
$endgroup$
One way to represent a signal is by its evolution in time (the time domain). Another equivalent way is by its frequency components (the frequency domain). The "steeper" or "sharper" the variation in a time domain signal, the higher that signal's frequency content.
The signal you show in Figure 1 may have a frequency spectrum like the one below:
There is a maximum frequency fmax1 beyond which the frequency content is zero, meaning the signal is bandlimited. To reconstruct the signal without error, sample at a minimum rate of fs1 = 2*fmax1 (the Nyquist rate).
The signal you show in Figure 2 has higher frequency content since you placed sharp variations between several samples. Its frequency spectrum may resemble this:
The highest frequency component in the Figure 2 signal (fmax2) is greater than the highest frequency component in the Figure 1 signal (fmax1). This means you must sample at a higher rate to reconstruct the signal, fs2 = 2*fmax2 > fs1.
In summary, you can add as many small variations to the signals as you want, but in doing so you introduce higher frequency content, and you must increase the sampling rate according to the Nyquist theorem.
You may argue that a non-bandlimited signal has frequency content extending to infinity, and for such a signal we can't define a minimum sampling rate for error-free reconstruction. In practical situations, we bandlimit signals with antialiasing filters to ensure the frequency content above a certain frequency is zero.
answered Mar 25 at 6:28
w_hilew_hile
1011
answered Mar 25 at 6:28
w_hilew_hile
1011
answered Mar 25 at 6:28
w_hilew_hile
1011
answered Mar 25 at 6:28
w_hilew_hile
1011
1011
add a comment |
add a comment |
$begingroup$
There are already good answers here. Maybe here a very short one which might be useful. I assume you now something about FFT, spectrum or at least Fourier rows.
Look at the second picture you posted. What frequencies appear in its Fourier decomposition? Obviously it has much higher frequencies in it than the curve in picture one. But with the distance between the sampling points (and therefor the sampling frequency) you are limited to something which highest frequency has to be lower than 1/2 the sampling frequency. Or the other way: $$f_{highest} < 2*f_s$$ to be able to reconstruct it.
The points will reconstruct something with the least amount of sinusoids needed to hit the points.
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
$endgroup$
add a comment |
$begingroup$
There are already good answers here. Maybe here a very short one which might be useful. I assume you now something about FFT, spectrum or at least Fourier rows.
Look at the second picture you posted. What frequencies appear in its Fourier decomposition? Obviously it has much higher frequencies in it than the curve in picture one. But with the distance between the sampling points (and therefor the sampling frequency) you are limited to something which highest frequency has to be lower than 1/2 the sampling frequency. Or the other way: $$f_{highest} < 2*f_s$$ to be able to reconstruct it.
The points will reconstruct something with the least amount of sinusoids needed to hit the points.
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
$endgroup$
add a comment |
$begingroup$
There are already good answers here. Maybe here a very short one which might be useful. I assume you now something about FFT, spectrum or at least Fourier rows.
Look at the second picture you posted. What frequencies appear in its Fourier decomposition? Obviously it has much higher frequencies in it than the curve in picture one. But with the distance between the sampling points (and therefor the sampling frequency) you are limited to something which highest frequency has to be lower than 1/2 the sampling frequency. Or the other way: $$f_{highest} < 2*f_s$$ to be able to reconstruct it.
The points will reconstruct something with the least amount of sinusoids needed to hit the points.
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
$endgroup$
There are already good answers here. Maybe here a very short one which might be useful. I assume you now something about FFT, spectrum or at least Fourier rows.
Look at the second picture you posted. What frequencies appear in its Fourier decomposition? Obviously it has much higher frequencies in it than the curve in picture one. But with the distance between the sampling points (and therefor the sampling frequency) you are limited to something which highest frequency has to be lower than 1/2 the sampling frequency. Or the other way: $$f_{highest} < 2*f_s$$ to be able to reconstruct it.
The points will reconstruct something with the least amount of sinusoids needed to hit the points.
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
answered Mar 25 at 10:17
Mr.Sh4nnonMr.Sh4nnon
1339
1339
add a comment |
add a comment |
Thanks for contributing an answer to Electrical Engineering Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2felectronics.stackexchange.com%2fquestions%2f428871%2fsampling-theorem-and-reconstruction%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
7
$begingroup$
Your bottom signal has some much higher frequency components than the other ones here.
$endgroup$
– Hearth
Mar 24 at 21:14
5
$begingroup$
There is exactly ONE curve that passes thru all those points AND is band limited to strictly less then Fs/2.
$endgroup$
– Dan Mills
Mar 24 at 21:15
$begingroup$
it's important to note that unique reconstruction is only possible if the original signal is strictly bandlimited. Or to put it another way, given the samples, the assumption of strict bandlimiting allows a single signal to be reconstructed. To the extent that the bandlimited assumption is untrue, then the reconstructed signal will not match the original - this is called aliasing.
$endgroup$
– Neil_UK
Mar 24 at 22:13
$begingroup$
Also note that in practice it may require higher sampling frequency to provide acceptable reconstruction since perfect band-limiting are not practical. For example Audio CDs use 44.1kHz sampling to provide 0-20kHz output. Oscilloscopes generally use 5-10 times the required minimum sampling frequency to provide acceptable waveform integrity as a sharp cutoff filter would tend to create waveform artifacts such as ringing.
$endgroup$
– Kevin White
Mar 24 at 22:42
$begingroup$
It says that...if the sampling frequency is higher than twice the maximum frequency of the initial signalIt most certainly does not. Don't confuse the frequency and bandwidth.$endgroup$
– AndrejaKo
Mar 25 at 10:53