Fourier Transformation Tutorial Guide
Fourier Transformation Tutorial Guide
Ronald Starke
TU Bergakademie Freiberg
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 1 / 75
1 Fourier transformation on the real axis
Fundamentals
General properties
Kramers-Kronig relations
Effects on Fourier transforms
Connection to Laplace transform
Uncertainty relation
Connection to Fourier sine and cosine transform
2 Fourier transformation on an interval
Definition and properties
Connection to Fourier Sine and Cosine series
Connection to continuous Fourier transform
3 Discrete Fourier transformation
Definition and properties
Connection to Fourier series
Connection to continuous Fourier transformation
Shannon-Nyquist sampling theorem
4 Commemoratio
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 2 / 75
Fourier transformation on the real axis
Section 1
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 3 / 75
Fourier transformation on the real axis Fundamentals
Integral operators
An integral operator is a mapping of functions f (t) 7→ g(t) defined by its
integral kernel F (t, t 0 ) as
Z ∞
g(t) = dt 0 F (t, t 0 )f (t 0 ) . (1)
−∞
In other words, the image function g(t) is obtained by integrating out the
preimage f (t) against a function of two variables, F = F (t, t 0 ). This
operation is linear,
α1 f1 (t) + α2 f2 (t) 7→ α1 g1 (t) + α2 g2 (t) , (2)
with α1 , α2 ∈ C, as follows from the linearity of the integral.
The Dirac delta is the continuous analogue of the Kronecker delta in linear
algebra, X
fi = δij fj , (4)
j
with
1 , if i = j ,
δij = (5)
0 , if i 6= j .
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 5 / 75
Fourier transformation on the real axis Fundamentals
τ2
1
δη (τ ) = p exp − 2 , (9)
2πη 2 2η
2 the Cauchy-Lorentz distribution (also Breit-Wigner distribution),
1 η
δη (τ ) = , (10)
π η + τ2
2
Sokhotski-Plemelj identity
An extremely useful formula is given by the distributional identity
1 1
= P ∓ iπδ(τ ) , (13)
τ ± iη τ
i.e. for sufficiently well-behaved functions f (τ ) we have
Z Z Z
f (τ ) f (τ )
lim dτ = P dτ − iπ dτ f (τ )δ(τ ) . (14)
η→0 τ + iη τ
Here, P denotes the so-called principal value,
Z Z
f (τ ) def f (τ )
P dτ = lim dτ . (15)
τ η→0 R\[−η,η] τ
Essentially, this follows from the algebraic identity
1 τ η
= 2 −i 2 , (16)
τ + iη τ + η2 τ + η2
together with Eq. (10).
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 9 / 75
Fourier transformation on the real axis Fundamentals
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 10 / 75
Fourier transformation on the real axis Fundamentals
Linearity
The mapping of signals f (t) to their spectra f˜(ω) is linear, i.e. for
This simply follows from the fact the the integral constitutes a linear
functional of the integrand. Concretely, in our case we have
Z
dt
f˜(ω) = √ eiωt c1 f1 (t) + c2 f2 (t)
(30)
2π
Z Z
dt iωt dt
= c1 √ e f1 (t) + c2 √ eiωt f2 (t) (31)
2π 2π
= c1 f˜1 (ω) + c2 f˜2 (ω) . (32)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 14 / 75
Fourier transformation on the real axis General properties
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 15 / 75
Fourier transformation on the real axis General properties
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 22 / 75
Fourier transformation on the real axis General properties
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 23 / 75
Fourier transformation on the real axis Kramers-Kronig relations
Kramers-Kronig relations I
because for t > 0 the Heaviside function multiplies with unity. In the
frequency domain, this point-wise product translates into a convolution
(see Eq. (55)). Using Eq. (78), we get
dω 0 i f˜(ω 0 )
Z
f˜(ω) = √ √ (80)
2π 2π ω − ω 0 + iη
dω 0 f˜(ω 0 )
Z
=i . (81)
2π ω − ω 0 + iη
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 24 / 75
Fourier transformation on the real axis Kramers-Kronig relations
Kramers-Kronig relations II
We apply the Sokhotski-Plemelj identity, Eq. (13), in the form
1 1
0
=P − iπδ(ω − ω 0 ) . (82)
ω − ω + iη ω − ω0
Evaluating the Dirac delta, we then find
dω 0 f˜(ω 0 )
Z
˜
f (ω) = i P . (83)
π ω − ω0
Considering real and imaginary part separately yields
dω 0 Im f˜(ω 0 )
Z
Re f˜(ω) = −P , (84)
π ω − ω0
dω 0 Re f˜(ω 0 )
Z
˜
Im f (ω) = P (85)
π ω − ω0
These are the celebrated Kramer-Kronig relations.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 25 / 75
Fourier transformation on the real axis Effects on Fourier transforms
g(t) = f (t − t0 ) , (95)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 28 / 75
Fourier transformation on the real axis Effects on Fourier transforms
This is the inverse effect to the shift in the time signal. Note, however, the
difference in the presigns of the respective exponential.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 29 / 75
Fourier transformation on the real axis Effects on Fourier transforms
Consistency check
The modulation with an harmonic function as in Eq. (99) can be
interpreted as a pointwise product in the sense of Eq. (50).
Correspondingly, we now reproduce its effect on the Fourier transform,
Eq. (101), by using the result for the Fourier transform of pointwise
products, Eq. (55), and the Fourier transform of a harmonic funtion,
Eq. (66). With
√
f (t) = g(t)h(t) , g(t) = e−iω0 t , g̃(ω) = 2π δ(ω − ω0 ) , (102)
we find
dω 0
Z
f˜(ω) = √ g̃(ω − ω 0 )h̃(ω 0 ) (103)
Z 2π
= dω 0 δ(ω − ω 0 − ω0 )h̃(ω 0 ) (104)
= h̃(ω − ω0 ) . (105)
This coincides indeed exactly with our earlier result.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 30 / 75
Fourier transformation on the real axis Effects on Fourier transforms
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 31 / 75
Fourier transformation on the real axis Connection to Laplace transform
Concretely, we find
Z ∞
dω
f (t) = √ e−iωt+ηt f˜(ω + iη) (117)
−∞ 2π
Z ∞
dω −iωt+ηt ∞ dt 0 iωt 0 −ηt 0 0
Z
= √ e √ e f (t ) (118)
−∞ 2π 0 2π
Z ∞ Z ∞
0 dω −iω(t−t 0 ) 0
= dt e eη(t−t ) f (t 0 ) (119)
−∞ 2π
Z0 ∞
0
= dt 0 δ(t − t 0 )eη(t−t ) f (t 0 ) (120)
0
= Θ(t)f (t) , (121)
because for t < 0, the support of the Dirac delta lies outside the
integration domain.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 34 / 75
Fourier transformation on the real axis Connection to Laplace transform
Gaussian function I
Consider again a Gaussian function,
t2
1
f (t) = exp − 2 . (122)
(2πσt2 )1/4 4σt
ω2
˜ 1
f (ω) = exp − 2 , (123)
(2πσω2 )1/4 4σω
with
1
σω = . (124)
2σt
Observing, that f ∗ (t)f (t) is a normal distribution with variance σt2 and
similarly f ∗ (ω)f (ω) with σω2 , this implies that the deviations are inversely
proportional to each other, i.e. the more localized the one, the more
delocalized the other.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 36 / 75
Fourier transformation on the real axis Uncertainty relation
Gaussian function II
To convince ourselves, consider
t2
d 1 t
f (t) = − 2 exp − 2 . (125)
dt (2πσt2 )1/4 2σt 4σt
d t f (t)
f (t) + = 0, (126)
dt 2σt2
Taking the Fourier transform of the differential equation, Eq. (126), we get
with Eqs. (87) and (89)
1 1 d ˜
−iω f˜(ω) + f (ω) = 0 . (128)
2σt2 i dω
This is equivalent to
d ˜ 4σ 2
f (ω) + t ω f˜(ω) = 0 . (129)
dω 2
This is again of the form (126), but with the deviation given by Eq. (124).
Hence, f˜ is again given by a Gaussian. The prefactor is given such that the
Fourier transform is again normalized to one in the sense of kf˜k = 1 as it
has to be on account of the Plancherel theorem, Eq. (37).
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 38 / 75
Fourier transformation on the real axis Uncertainty relation
Gaussian function IV
and this coincides with Eq. (127). Here, we have used the fact that the
normal distribution is normalized.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 39 / 75
Fourier transformation on the real axis Uncertainty relation
Uncertainty relation I
We consider a normalized time signal,
Z Z
kf k2 = dt f ∗ (t)f (t) = dt |f (t)|2 = 1 . (135)
By the theorem of Plancherel, Eq. (37), the same will then hold for the
Fourier transform, Z
2
kf˜k2 = dω f˜(ω) = 1 . (136)
First, we assume that the expectation values of both the time signal and
its Fourier transformation vanish,
Z Z
2
dt t|f (t)| = 0 , dω ω|f˜(ω)|2 = 0 . (137)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 40 / 75
Fourier transformation on the real axis Uncertainty relation
Uncertainty relation II
Consider now the manifestly positive definite function
Z
d ˜ 2
I (λ) = dω ω f˜(ω) + λ f (ω) ≥ 0 , (139)
dω
with λ ∈ R. Multiplying out brings it to the form
with
Z
d ˜ 2
a= dω
f (ω) , (141)
dω
Z
∗ d d ∗
b = dω ω (f˜) (ω) f˜(ω) + f˜(ω) (f˜) (ω) , (142)
dω dω
Z
2
c = dω ω f˜(ω) . (143)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 41 / 75
Fourier transformation on the real axis Uncertainty relation
= −1 , (146)
where we have integrated by parts and used the fact that boundary terms
vanish because the spectral function has to decay sufficiently fast.
Furthermore, we obviously have
c = σω2 . (147)
Finally, by going back to the time domain and observing that Fourier
transforming translates multiplications into derivatives, we find
Z
2
a = dt t f (t) = σt2 . (148)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 42 / 75
Fourier transformation on the real axis Uncertainty relation
Uncertainty relation IV
b 2 − 4ca ≤ 0 . (149)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 43 / 75
Fourier transformation on the real axis Uncertainty relation
Uncertainty relation V
In the general case, where the expectation value of the time signal
f = f (t) is t0 , while the spectrum is concentrated at ω0 , we simply observe
that now the function g defined by
has its respective expectation values at the origin (see Eqs. (98) and
(101)), such that the uncertainty (150) relation applies. On the other
hand, the respective variances of f and g and their Fourier transforms also
coincide, because shifting the variable and multiplication with phase factors
has no bearing on these. This proves the general uncertainty relation.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 44 / 75
Fourier transformation on the real axis Connection to Fourier sine and cosine transform
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 45 / 75
Fourier transformation on the real axis Connection to Fourier sine and cosine transform
we get
Z ∞
dω
f (t) = √ a(ω) cos ωt + b(ω) sin ωt (167)
0 2π
Z ∞
dω
= √ A(ω) cos ϕ(ω) cos ωt − sin ϕ(ω) sin ωt (168)
2π
Z0 ∞
dω
= √ A(ω) cos ωt + ϕ(ω) . (169)
0 2π
In this representation, the time signal is written as a continuous
superposition of harmonic functions whose amplitude and phase angle
depend on the respective frequency.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 48 / 75
Fourier transformation on an interval
Section 2
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 49 / 75
Fourier transformation on an interval Definition and properties
Periodic functions I
A somewhat different notion of Fourier transformation is used in the case
of periodic functions,
f (t + T ) = f (t) . (170)
These have a Fourier series representation,
1 X −iωn t ˜
f (t) = √ e fn , (171)
T n
where the discrete frequencies are given by
2πn
, n ∈ Z,
ωn = (172)
T
i.e. the index n traverses all integers. The qualitatively new feature here
consists in the fact that the time signal is represented by a discrete
summation of harmonic functions while in the case of the Fourier
transformation on the real axis, the time signal is represented by a
continuous integration of such contributions.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 50 / 75
Fourier transformation on an interval Definition and properties
Periodic functions II
In Eq. (171), the contribution from n = 0 corresponds to a time
independent constant. ω1 = 2π/T is the so-called fundamental frequency
(Grundschwingung), while the ωn ; |n| > 1 are the higher harmonics
(Oberschwingungen). The frequencies are chosen in this way in order to
ensure the periodicity of the exponentials,
e−iωn (t+T ) = e−iωn t−iωn T (173)
= e−iωn t e−i2πn (174)
−iωn t
=e . (175)
Conversely, the Fourier amplitudes can be obtained from
Z T
˜ 1
fn = √ dt eiωn t f (t) , (176)
T 0
i.e. the Fourier expansion coefficents are already determined by the
behaviour of the function within a periodicity interval.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 51 / 75
Fourier transformation on an interval Definition and properties
Resolution of identity
One verifies directly the representation of the Kronecker delta,
1 T
Z
δnm = dt ei(ωn −ωm )t , (177)
T 0
Conversely, an integral kernel for the identity operator is given by
1 X −iωn (t−t 0 )
δT (t − t 0 ) = e . (178)
T
n∈Z
Its action is restricted to sufficiently well-behaved periodic functions,
Z T
f (t) = dt 0 δT (t − t 0 )f (t 0 ) . (179)
0
Analoga of the formulae for the continuous Fourier transform, as e.g.
Z T X
dt f ∗ (t)g(t) = f˜n∗ g̃n , (180)
0 n∈Z
can easily be found.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 52 / 75
Fourier transformation on an interval Connection to Fourier Sine and Cosine series
Real functions
In the case of a Fourier series, the reality condition reads
∗
f˜n = f˜−n . (181)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 53 / 75
Fourier transformation on an interval Connection to Fourier Sine and Cosine series
and for n = 0,
a0 = 2f˜0 , b0 = 0 . (194)
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 55 / 75
Fourier transformation on an interval Connection to Fourier Sine and Cosine series
The formulae for the Fourier sine and cosine coefficents can now also be
verified from
Z T
2
an = √ dt f (t) cos ωn t ,
T 0
∞
Z T !
2 1 1 X
=√ dt √ f0 + √ am cos ωm t + bn sin ωm t cos ωn t ,
T 0 T T m=1
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 57 / 75
Fourier transformation on an interval Connection to continuous Fourier transform
Section 3
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 60 / 75
Discrete Fourier transformation Definition and properties
f˜0
f0
f = ... , f˜ = ... , (209)
fN −1 f˜N −1
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 61 / 75
Discrete Fourier transformation Definition and properties
1 T
Z
δij = dt ei(ωi −ωj )t . (223)
T 0
This coincides with Eq. (177). Conversely, in the time domain we can write
N −1
δij 1 X
= ∆ω exp iω` (ti − tj ) , (224)
∆t 2π
`=0
and this converges to the Dirac delta for ti , tj ∈ [0, T ]. Hence, we recover
the Fourier transform on a finite interval from the discrete Fourier
transformation in an appropriate limit.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 65 / 75
Discrete Fourier transformation Connection to continuous Fourier transformation
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 67 / 75
Discrete Fourier transformation Connection to continuous Fourier transformation
https://www.researchgate.net/publication/303747580
https://www.researchgate.net/publication/275208133
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 68 / 75
Discrete Fourier transformation Shannon-Nyquist sampling theorem
Sampling theorem I
Assume we want to calculate numerically the Fourier transform of a
periodic function by sampling the time signal at discrete points
tj = j ∆t , j = 0, . . . , N − 1; T = N ∆t, i.e. the interval [0, T ] is sampled
with the frequency fsample = 1/∆t. We then get
Z T
1
f˜i ≡ √ dt eiωi t f (t) (228)
T 0
N −1
1 X
≈√ ∆t eiωi tj f (tj ) (229)
T j =0
1/2 N −1
T 1 X iωi tj
= √ e f (tj ) . (230)
N N j =0
Sampling theorem II
However, the exact expression for the periodic time signal is given by (see
Eq. (171))
1 X ˜ −iωn tj
f (tj ) = √ fn e . (231)
T n
For the discrete Fourier transform of this time signal, we then get
N −1 N −1
!
1 X iωi tj 1 X iωi tj 1 X ˜ −iωn tj
√ e f (tj ) = √ e √ fn e (232)
N j =0 N j =0 T n
N −1
1 X X
=√ f˜n ei(ωi −ωn )tj . (233)
NT n j =0
Sampling theorem IV
The reason for this is that a signal with frequency corresponding to an
integer mutliple of the sampling frequency,
2π
ω`N = `ωN = `N , (239)
T
will appear constant if only probed at the sampling points. In fact, due to
fsample = 1/∆t we get
eiω`N tj = e2πi`fsampl j ∆t = e2πi`j = 1 , ∀j ∈ Z . (240)
For the discrete approximation of the Fourier transform, Eq. (228) or
(233), this implies for our discrete approximation
X
fi ≈ fk +`N δik . (241)
`
This will only be true, if fk +`N ≈ 0 for ` 6= 0, i.e. the contributions from
the higher frequencies have to vanish.
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 72 / 75
Discrete Fourier transformation Shannon-Nyquist sampling theorem
Sampling theorem V
Consequently, we can only sample the periodic function reliably if the exact
time signal roughly involves only frequencies corresponding to one dual
lattice. E.g., for ` = 0 we get ωn = nω1 ; n = 0, . . . , N − 1; ω1 = 2π/T ,
which for large N samples the frequency interval [0, 2π/∆t] = [0, 2πN /T ].
We now ask the central question: which is the maximum frequency
detectable provided we know that the exact signal contains both positive
and negative frequencies (which it does for real valued functions)? To
answer this, we choose an alternative representation of the dual lattice
which is symmetric around the origin and hence corresponds to the
frequency interval [−π/∆t, π/∆t]. Strictly speaking, this is only possible
if N is odd, i.e. ωn = nω1 ; n = −(N − 1)/2, . . . , (N − 1)/2. The switch
in the frequency interval is possible, because the interval [−π/∆t, 0] is
equivalent to the interval [π/∆t, 2π/∆t] for discrete Fourier transforms:
the involved frequencies differ by 2π/∆t = 2πfsample .
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 73 / 75
Discrete Fourier transformation Shannon-Nyquist sampling theorem
Sampling theorem VI
The symmetric dual lattice samples the frequency interval
[−π/∆t, π/∆t] = [−πfsample , πfsample ] and hence stretches out between
We now read off that the modulus of the maximum frequency is just
or
1
|fmin | = fmax =
fsample , (244)
2
with the sampling frequency fsample = 1/∆t. This is the celebrated
Shannon-Nyquist theorem. We stress again that the validity of this
equation is based on the assumption that the time signal may involve
positive and negative frequencies. Otherwise one could detect with
fmax = fsample .
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 74 / 75
Commemoratio
Ronald Starke (Bergakademie Freiberg) Fourier transformation — A tutorial April 23, 2021 75 / 75