Fundamentals of Engineering Numerical Analysis Book

Preface to the Second Edition

Preface to the First Edition

1 Interpolation 1

1.1 Lagrange Polynomial Interpolation 1

1.2 Cubic Spline Interpolation 4

Exercises 8

Further Reading 12

2 Numerical Differentiation - Finite Differences 13

2.1 Construction of Difference Formulas Using Taylor Series 13

2.2 A General Technique for Construction of Finite Difference Schemes 15

2.3 An Alternative Measure for the Accuracy of Finite Differences 17

2.4 Pade Approximations 20

2.5 Non-Uniform Grids 23

Exercises 25

Further Reading 29

3 Numerical Integration 30

3.1 Trapezoidal and Simpson's Rules 30

3.2 Error Analysis 31

3.3 Trapezoidal Rule with End-Correction 34

3.4 Romberg Integration and Richardson Extrapolation 35

3.5 Adaptive Quadrature 37

3.6 Gauss Quadrature 40

Exercises 44

Further Reading 47

4 Numerical Solution of Ordinary Differential Equations 48

4.1 Initial Value Problems 48

4.2 Numerical Stability 50

4.3 Stability Analysis for the Euler Method 52

4.4 Implicit or Backward Euler 55

4.5 Numerical Accuracy Revisited 56

4.6 Trapezoidal Method 58

4.7 Linearization for Implicit Methods 62

4.8 Runge-Kutta Methods 64

4.9 Multi-Step Methods 70

4.10 System of First-Order Ordinary Differential Equations 74

4.11 Boundary Value Problems 78

4.11.1 Shooting Method 79

4.11.2 Direct Methods 82

Exercises 84

Further Reading 100

5 Numerical Solution of Partial Differential Equations 101

5.1 Semi-Discretization 102

5.2 von Neumann Stability Analysis 109

5.3 Modified Wavenumber Analysis 111

5.4 Implicit Time Advancement 116

5.5 Accuracy via Modified Equation 119

5.6 Du Fort-Frankel Method: An Inconsistent Scheme 121

5.7 Multi-Dimensions 124

5.8 Implicit Methods in Higher Dimensions 126

5.9 Approximate Factorization 128

5.9.1 Stability of the Factored Scheme 133

5.9.2 Alternating Direction Implicit Methods 134

5.9.3 Mixed and Fractional Step Methods 136

5.10 Elliptic Partial Differential Equations 137

5.10.1 Iterative Solution Methods 140

5.10.2 The Point Jacobi Method 141

5.10.3 Gauss-Seidel Method 143

5.10.4 Successive Over Relaxation Scheme 144

5.10.5 Multigrid Acceleration 147

Exercises 154

Further Reading 166

6 Discrete Transform Methods 167

6.1 Fourier Series 167

6.1.1 Discrete Fourier Series 168

6.1.2 Fast Fourier Transform 169

6.1.3 Fourier Transform of a Real Function 170

6.1.4 Discrete Fourier Series in Higher Dimensions 172

6.1.5 Discrete Fourier Transform of a Product of Two Functions 173

6.1.6 Discrete Sine and Cosine Transforms 175

6.2 Applications of Discrete Fourier Series 176

6.2.1 Direct Solution of Finite Differenced Elliptic Equations 176

6.2.2 Differentiation of a Periodic Function Using Fourier Spectral Method 180

6.2.3 Numerical Solution of Linear, Constant Coefficient Differential Equations with Periodic Boundary Conditions 182

6.3 Matrix Operator for Fourier Spectral Numerical Differentiation 185

6.4 Discrete Chebyshev Transform and Applications 188

6.4.1 Numerical Differentiation Using Chebyshev Polynomials 192

6.4.2 Quadrature Using Chebyshev Polynomials 195

6.4.3 Matrix Form of Chebyshev Collocation Derivative 196

6.5 Method of Weighted Residuals 200

6.6 The Finite Element Method 201

6.6.1 Application of the Finite Element Method to a Boundary Value Problem 202

6.6.2 Comparison with Finite Difference Method 207

6.6.3 Comparison with a Pade Scheme 209

6.6.4 A Time-Dependent Problem 210

6.7 Application to Complex Domains 213

6.7.1 Constructing the Basis Functions 215

Exercises 221

Further Reading 226

A A Review of Linear Algebra 227

A.1 Vectors, Matrices and Elementary Operations 227

A.2 System of Linear Algebraic Equations 230

A.2.1 Effects of Round-off Error 230

A.3 Operations Counts 231

A.4 Eigenvalues and Eigenvectors 232

Index 235