Preface
- Page ID
- 126436
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)This textbook is written for a course in numerical methods for engineering undergraduates.
In 2002, National Science Foundation funded a prototype proposal on Holistic Numerical Methods to develop various resources for typical numerical methods topics of interpolation and nonlinear equations. With the success of this proposal, NSF continued to fund the proposal for other topics of numerical methods via three more multi-university grants in 2004-07, 2008-12, 2009-11. This funding has so far resulted in complete resources for a comprehensive course in Numerical Methods. Revision of the resources continued with funding from more NSF grants in 2013-16, 2016-20, 2020-23. These resources include textbook chapters, PowerPoint presentations, worksheets in MATLAB, MATHEMATICA, Maple and MathCAD, multiple-choice tests, experiments, digital audiovisual lectures, and a blog.
Go to the main website http://nm.mathforcollege.com and click on the numerical method of your choice. You will have access to PowerPoint presentations, worksheets, simulations, additional examples, and multiple-choice tests. In addition, we have uploaded broadcast quality (https://nm.mathforcollege.com/audiovisual-digital-lectures/) instructional audiovisual content for most of the course content. A blog on numerical methods and MATLAB is also available at http://blog.autarkaw.com.
The textbook consists of eleven topics:
1. Introduction to Scientific Computing
2. Differentiation
3. Nonlinear Equations
4. Simultaneous Linear Equations
5. Interpolation
6. Regression
7. Integration
8. Ordinary Differential Equations
9. Optimization
- Partial Differential Equations
11. Fast Fourier Transforms
Each subtopic in these topics is covered in several separate chapters because we decided to keep the chapters concise and independent. This modular nature of chapters allows you to customize the book based on your needs. Supplemental material is always available from the website.
The chapters in the book are numbered as Chapter XX.YY. The XX stands for the main topic, while YY is the chapter number within that topic.
Chapter 01.YY introduces scientific computing by taking a real-life example to show that solving an engineering problem requires one to develop a mathematical model, solve the model, and then implement the corresponding solution. This content is followed by a discussion of sources of numerical error and their measurement, binary, and floating-point representation of numbers, propagation of errors, and Taylor series.
Chapters 02.YY starts with physical applications of numerical differentiation followed by a just-in-time primer on differential calculus, numerical differentiation of continuous functions and functions that are only given at discrete points.
Chapter 03.YY starts with physical applications of solution of nonlinear equations, a primer on quadratic and cubic equations, and numerical methods of solving nonlinear equations, including bisection, Newton Raphson, secant methods. Simultaneous nonlinear equations are covered as well.
Chapter 04.YY starts with physical applications of solution of simultaneous linear equations, a just-in-time primer for matrix algebra, and numerical methods such as Gaussian elimination, LU decomposition and Gauss-Seidel methods.
Chapter 05.YY starts with physical applications of interpolation. It starts with the background of interpolation, followed by numerical methods of the direct method, Newton divided difference interpolation, Lagrange interpolation, and spline interpolation. Also included are chapters on extrapolation being a bad idea and how to numerically calculate the length of a curve.
Chapter 06.YY starts with physical application of regression. Background content for regression, include simple statistics, minimum of functions, and partial derivatives. The content includes linear regression, nonlinear regression and adequacy of linear regression models.
Chapter 07.YY starts with physical applications of numerical integration. It starts with a primer of integral calculus followed by numerical methods of trapezoidal rule, Simpson’s 1/3rd rule, Simpson’s 3/8 rule, Gauss quadrature rule, and integrating functions that are given at discrete points.
Chapter 08.YY begins with physical applications of numerical solution of ordinary differential equation. It begins with a primer for ordinary differential equations followed by numerical methods of Euler’s, Runge-Kutta 2nd order, Runge-Kutta 4th order, shooting method, and finite difference methods.
Chapter 9 on optimization will be added soon.
Chapter 10 on the numerical solutions of partial differential equations will be added soon.
Chapter 11 on the fast Fourier transforms will be added soon.
Numerical methods used to solve the mathematical procedure are shown with complete treatment and examples. Most chapters are followed by a multiple-choice test and a problem set. Comprehensive solutions to individual multiple-choice tests are available via a link at the end of each multiple-choice question set. The final answers to the problem set are given at the end of each problem.
We would like to thank - Sri Harsha Garapati, Luke Snyder, Eric Marvella, Sue Britten, and Matthew Emmons for reformatting and typing the textbook. Sean Rodby’s meticulous proofreading has been critical in maintaining the accuracy of the contents of the book. We would like to thank Cuong Nguyen, Praveen Chalasani, Michael Keteltas, and Luke Snyder for contributions to the textbook. The conversion of the original files from Word to markdown was a considerable task, and Kaw would like to thank Jonas Fernandes, Bharath Pulaparthi, Jayendra Patel, and Gregory Sims for the detailed work involved. Kaw would like to thank his spouse, Sherrie, and children Candace and Angelie for their encouragement in writing this textbook.
We would like to thank Professors Melvin Corley of Louisiana Technical University, Tianxia Zhao of Indiana University-Purdue University, Fort Wayne and Xudong Jia of California State Polytechnic University for reviewing the contents of the textbook content of the first edition of the textbook.
We would appreciate feedback, questions, or comments that you may have on the book or the numerical methods project. You can contact the first author, Autar Kaw, via
Email: kaw@usf.edu
Telephone: 813.974.5626
Mailing Address: Department of Mechanical Engineering Department, University of South Florida, 4202 East Fowler Avenue ENG030, Tampa, FL 33620-5350.