Finite Differences
Finite Differences
P. Sam Johnson
Finite Differences
1 / 45
Overview
Assume that we have a table of values
(xi , yi ),
i = 0, 1, 2, . . . , n
Finite Differences
2 / 45
Overview
The calculus of finite differences deals with the changes that take place
in the value of the function (dependent variable), due to finite changes in
the independent variable.
Through this, we also study the relations that exist between the values
assumed by the function, whenever the independent variable changes by
(equal or unequal) finite jumps.
On the other hand, in infinitesimal calculus, we study those changes of
the function which occur when the independent variable changes
continuously in a given interval.
We shall study the variations in the function when the independent
variable changes by equal intervals.
The calculus of differences is very useful for the finding the sum of a given
series.
P. Sam Johnson (NITK)
Finite Differences
3 / 45
Differences of y
Suppose a function (usually unknown) y = f (x) is given at discrete values
of x, x0 , x1 , . . . , xn so that we have a table of values
(xi , yi ),
i = 0, 1, 2, . . . n.
i = 0, 1, 2, . . . , n.
Finite Differences
4 / 45
Finite Differences
5 / 45
Higher Differences
The differences of the first forward differences are called second forward
differences and are denoted by 2 y0 , 2 y1 , . . . .
The symbol 2 does not represent the square of a quantity but denotes
the repetition of the operation .
Similarly, one can define third forward differences, fourth forward
differences, etc.
In general, the nth differences are defined as
n yi = n1 yi+1 n1 yi .
The forward difference operator can be operated on function-values,
generally denoted as
f (x) = f (x + h) f (x),
P. Sam Johnson (NITK)
x = x0 , x1 , . . . , xn1 .
Finite Differences
6 / 45
Exercises
1. Evaluate tan1 x, (e x log 2x), (x 2 / cos 2x).
2. Evaluate
5x + 12
,
x 2 + 5x + 16
(c) e x
(d) e a+bx
Finite Differences
7 / 45
The following result can be proved by the method of induction and it helps
in expressing, any powers of operated on y (x), in terms of yi s. The
proof is based on continuous substitution.
Theorem
Suppose that we have a table of values (xi , yi ), i = 0, 1, 2, . . . ., n of any
function y = f (x), the values of x being equally spaced with h as the
interval of differencing. Then for any non-negative integer k,
k
X
ki k
yr =
(1)
yr +i .
i
k
i=0
Finite Differences
8 / 45
Value
of
y = f (x)
y0
x0 + h
y1
First
Difference
f (x)
Second
Difference
2 f (x)
Third
Difference
3 f (x)
Fourth
Difference
4 f (x)
y0
2 y 0
3 y 0
y1
x0 + 2h
y2
x0 + 3h
y3
x0 + 4h
y4
4 y 0
y1
y2
y1
2 y 2
y3
y0 , the first entry is called the leading term. y0 , 2 y0 , 3 y0 etc. are called the
leading differences. It can be seen that the differences k yi with a fixed
subscript i lie along the diagonal sloping downwards and each difference is written
midway between the values substracted.
P. Sam Johnson (NITK)
Finite Differences
9 / 45
Shift Operator, E
An operator E defined as
Ef (x) = f (x + h)
is called a shift operator which results in increasing the argument by the
interval of differencing.
E n stands for the operation E being carried n times. Then
E n f (x) = f (x + nh).
The inverse operator E 1 is defined as
E 1 f (x) = f (x h).
Finite Differences
10 / 45
Finite Differences
11 / 45
With the help of the operators E and , we can prove the above result
which is restated below.
For any non-negative integer k,
k
X
ki k
yr =
(1)
yr +i .
i
k
i=0
Finite Differences
False
12 / 45
Exercise
9. An operator T is said to be linear if
T [af (x) + bg (x)] = aT [f (x)] + bT [g (x)],
where a, b are constants. Prove that the operators E and are linear.
The following theorem says that any value of the function f (x) can be
expressed in terms of leading term and the leading differences of an
ordinary difference table. It can be proved by the method of induction.
Theorem
For all integral values of k, yk =
Pk
k
r =0 r
k y0 .
Exercise
10. Prove the above result with the help of the operators E and .
Finite Differences
13 / 45
Finite Differences
14 / 45
Exercises
11. If f (x) = a0 x n + a1 x n1 + + an1 x + an (a0 6= 0), then find
n f (x). Obtain 25 {(x a)(x b) (x z)} where the operand
has only 25 factors and there is no factor of the type (x x).
12. Prove that
x
e =
2
E
ex .
Ee x
,
2 e x
n1
X
yx = yn y0 .
x=0
Finite Differences
15 / 45
Exercises
16. Prove that
n+1
n+1
n+1
y0 + y1 + + yn =
y0 +
y0 + +
n y0 .
1
2
n+1
17. Prove the following identity
X
x=0
y2x
1X
1
=
yx +
2
4
x=0
4
1 +
2
4
y0 .
Finite Differences
16 / 45
Finite Differences
17 / 45
Value
of
y = f (x)
y0
x0 + h
y1
First
Difference
f (x)
Second
Difference
2 f (x)
Third
Difference
3 f (x)
Fourth
Difference
4 f (x)
y1
2 y2
3 y3
y2
x0 + 2h
2 y3
y2
y3
x0 + 3h
4 y 4
3 y4
2 y4
y3
y4
x0 + 4h
y4
y4 , the last entry is called the last term. y4 , 2 y4 , 3 y4 etc. are called
the last differences.
P. Sam Johnson (NITK)
Finite Differences
18 / 45
Finite Differences
19 / 45
Value
of
y = f (x)
y0
x0 + h
y1
First
Difference
f (x)
Second
Difference
2 f (x)
Third
Difference
3 f (x)
Fourth
Difference
4 f (x)
y1/2
2 y1
3 y3/2
y3/2
x0 + 2h
2 y2
y2
y5/2
x0 + 3h
4 y2
3 y5/2
2 y3
y3
y7/2
x0 + 4h
y4
Finite Differences
20 / 45
(a) The central differences on the same horizontal line have the same
suffix.
(b) The differences of odd order are known only for half values of the
suffix.
(c) The differences of even order are known only for integral values of the
suffix.
Finite Differences
21 / 45
Averaging Operator,
It is often required to find the mean of adjacent values in the same column
of differences. We denote this mean by , the averaging
(mean)
1
operator defined by yr = 2 yr +1/2 + yr 1/2 .
Thus y1 = 21 [y1/2 + y3/2 ], 2 y3/2 = 21 [ 2 y1 + 2 y2 ], . . . .
An Important Observation : We can observe the following
y0 = y1 = y1/2 ,
3 y1 = 3 y4 = 3 y5/2 .
Finite Differences
22 / 45
Exercises
Deduce the following:
24. E 1/2 E 1/2
2
25. 1 + 2 2 = 1 + 2
19. 1 E 1
20. = 2
27.of
1+
22. 21 2 + 1 + 4 write delta in term
2 1+
23. (E 1/2 + E 1/2 )(1 + )1/2 2 +
2
4.
28. E E E 1/2 .
*
P. Sam Johnson (NITK)
Finite Differences
23 / 45
Exercises
29. If y = a(3)x + b(2)x and h = 1, prove that (2 + 6)y = 0.
30. Evaluate 10 [(1 ax)(1 bx 2 )(1 cx 3 )(1 dx 4 )]. abcd*fact(10) *h^10
h
i
problem with sign (positive sign )
f (x)
1
31. Show that f (x)
= f (x)f
(x+1) .
o
n
(x)
.
32. Prove that log f (x) = log 1 + f
f (x)
33. Find the missing yx values from the first differences provided.
yx
0 0 1- -3 -7 -14 -25
yx 0 1 2 4 7 11
Finite Differences
24 / 45
Differential Operator, D
The differential operator D is defined by
Df (x) =
d
[f (x)].
dx
Exercises
Prove the following identities.
34. E e hD (Hint: Taylors series)
35. hD
2
2
3
3
1
2
5
2
12
()
+ )yn0 .
Finite Differences
25 / 45
Exercises
38. Using the method of separation of symbols, prove the following
identities:
(a) yx n yxn = yx1 + yx2 + 2 yx3 + + n1 yxn . doubt
x
x2
x3
2
(b) y1 x + y2 x 2 + y3 x 3 + = 1x
y1 + (1x)
2 y1 + (1x)3 y1 + .
doubt
where a = y0 + y5 , b = y1 + y4 , c = y2 + y5 .
40. For any positive integer n, prove the following:
x
(a) r nn = nr
,
n x
(b) n = 1.
r <n
doubt
Finite Differences
26 / 45
Exercises
41. Using the method of separation of symbols, prove that
2
3
y0 + y1!1 x + y2!2 x 2 + y3!3 x 3 + = e x [y0 + xy0 + x2! 2 y0 + x3! 3 y0 + ].
Hence find the sum of the following series.
3
y0
xy0
x 2 2 y0
+
+
+ .
1x
(1 x)2 (1 x)3
false
44. Say true or false : [f (x).g (x)] and f (x)g (x) are identical.
45. Prove that yi zi = y1 zi + zi+1 yi .
P. Sam Johnson (NITK)
Finite Differences
27 / 45
x!
x
= n!
(x n)!
n
(x > n).
Exercise
46. Prove that for any positive integer n,
[x]n = (x (n 1)h)[x]n1 .
P. Sam Johnson (NITK)
Finite Differences
28 / 45
Finite Differences
29 / 45
Finite Differences
30 / 45
Finite Differences
31 / 45
Finite Differences
32 / 45
We now discuss the factorial function [x]n , when n is any negative integer.
For any positive integer n, define
[x]n =
1
1
=
.
(x + h) (x + nh)
[x + nh]n
Finite Differences
33 / 45
Finite Differences
34 / 45
Exercises
50. Express the function
x 4 12x 3 + 24x 2 30x + 9
in factorial notation, the interval of differencing being unity.
51. Using factorial notation, obtain the function whose first difference is
x 3 + 4x 2 + 9x + 12.
52. Express 2x 3 3x 2 + 3x 10 and its successive difference in factorial
notation.
53. A third degree polynomial passes through (0, 1), (1, 3), (2, 7) and
(3, 13). Find the polynomial.
54. Prove that [x]r [x rh]n = [x]r +n .
55. Find the relation between , and in order that + x + x 2 may
be expressible in one term in the factorial notation. doubt
P. Sam Johnson (NITK)
Finite Differences
35 / 45
(a) 1 [x]n =
(b) 1 [ax +
[x]n+1
n+1 .
n+1
b]n = [ax+b]
a(n+1) .
(c) 1 [x]n =
(d) 1 [ax +
Finite Differences
36 / 45
1
1
1
3.4.5 + 4.5.6 + 5.6.7 +
13 + 2 3 + + n 3 .
Finite Differences
37 / 45
y = f (x)
y0
x1 = x0 + h
y1
f (x)
2 f (x)
3 f (x)
y0
2 y 0
3 y 0 +
y1
x2 = x0 + 2h
y2
y1 +
3 y1 3
y2 +
x3 = x0 + 3h
y2 2
y3 +
3 y2 + 3
y3
x4 = x0 + 4h
y4
y3 +
3 y 3
y4
x5 = x0 + 5h
..
.
P. Sam Johnson (NITK)
y5
..
.
..
.
Finite Differences
y4
..
.
..
.
January 31, 2015
38 / 45
Finite Differences
39 / 45
Exercises
59. One entry in the following table is incorrect and y is a cubic
polynomial in x. Use the difference table to locate and correct the
error.
x 0
1
2
3
4
5
6
7
y 25 21 18 18 27 45 76 123
60. The following table gives the values of y which is a polynomial of
degree five. It is known that f (3) is in error. Correct the error.
x
y
0
1
1
2
2
33
3
254
4
1025
Finite Differences
5
3126
6
7777
40 / 45
Finite Differences
41 / 45
Exercises
61. Find the missing term in the table:
x 2
3
4
5
6
y 45 49.2 54.1 - 67.4
62. Find the missing terms in the following data.
x 45 50 55 60 65
y 3
2
- -2.4
63. Assuming that the following values of y belong to a polynomial of
degree 4, compute the next three values.
x 0 1 2 3 4 5 6 7
y 1 -1 1 -1 1 - - -
Finite Differences
42 / 45
Additional Exercises
Exercises
64. Match the following :
+
E
2
hD
log(1 )
65. Express any value of y in terms of yn and backward differences of yn .
1
(3x+1)(3x+4)(3x+7) ,
Finite Differences
43 / 45
Additional Exercises
Exercises
71. Prove that (n Cr +1 ) =
n+1 C
r +1
nC
r +1 .
Finite Differences
44 / 45
References
Richard L. Burden and J. Douglas Faires, Numerical Analysis Theory and Applications, Cengage Learning, Singapore.
Kendall E. Atkinson, An Introduction to Numerical Analysis, Wiley
India.
David Kincaid and Ward Cheney, Numerical Analysis Mathematics of Scientific Computing, American Mathematical
Society, Providence, Rhode Island.
S.S. Sastry, Introductory Methods of Numerical Analysis, Fourth
Edition, Prentice-Hall, India.
Har Swarup Sharma, A Textbook of Numerical Analysis, Ratan
Prakashan Mandir, Delhi.
B.S. Grewal, Numerical Methods in Engineering & Science, Khanna
Publishers, Delhi.
P. Sam Johnson (NITK)
Finite Differences
45 / 45