- Key People:
- James H. Wilkinson
- William Kahan
numerical analysis
-
What is numerical analysis?
Numerical analysis is a branch of mathematics and computer science focused on creating, analyzing, and implementing algorithms to find numerical solutions for problems involving continuous variables. It is concerned with all aspects of numerical solutions, including theoretical development, practical implementation, and the analysis of errors involved.
This field is crucial for solving complex mathematical models that arise in various scientific and engineering disciplines. The growth of digital computers has significantly expanded the use and sophistication of numerical analysis. Key aspects include replacing difficult problems with nearby, solvable ones, using linear and functional analysis, and rigorously examining errors and stability in computations. Numerical analysis is essential for applications ranging from computer-aided engineering to atmospheric modeling and business optimization.
3 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
Why do mathematicians use numerical methods instead of exact solutions sometimes?
Mathematicians use numerical methods when exact solutions are impossible to find or are too complex to derive. Many real-world problems in science, engineering, and business involve intricate mathematical models that do not have simple, closed-form solutions.
Numerical analysis focuses on creating and analyzing algorithms to approximate solutions to these problems. This approach allows for the use of powerful digital computers to solve complex equations and models that would otherwise be intractable. The process involves understanding and managing potential errors in these approximations to ensure reliable results.
3 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
What is an example of a problem that numerical analysis helps to solve?
Numerical analysis is a branch of mathematics and computer science focused on creating and analyzing algorithms to find numerical solutions for problems with continuous variables. A common problem it helps solve is finding the roots of equations, such as calculating the square root of a number. For example, to find the square root of 5, one can solve the equation (x^2 - 5 = 0) using numerical methods like Newton's method. This iterative technique refines an initial guess to progressively closer approximations of the actual root, providing a practical solution when direct calculation is difficult or impossible. Numerical analysis is crucial for solving complex mathematical models across various scientific and engineering fields.
5 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
How does a computer help in numerical analysis?
Computers are indispensable in numerical analysis because they can perform complex calculations rapidly and efficiently. Numerical analysis involves creating and analyzing algorithms to find approximate solutions to mathematical problems that are too complex for direct analytical solutions.
Computers enable the use of sophisticated mathematical models in science and engineering by solving intricate equations, such as differential and integral equations, which often lack exact analytical solutions. They facilitate the implementation of methods like finite difference and finite element methods, which approximate solutions at discrete points or by simpler functions. The speed and data-handling capabilities of computers allow for detailed simulations in fields like weather forecasting and engineering, leading to more accurate predictions and designs. Furthermore, advancements in computer hardware and standardized arithmetic, like the IEEE floating-point standard, have improved the reliability and portability of numerical algorithms.
3 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
What are some common techniques or algorithms used in numerical analysis?
Numerical analysis is a field of mathematics and computer science focused on creating and analyzing algorithms for solving mathematical problems with continuous variables. Common techniques include interpolation, which approximates functions using simpler ones, and methods for solving systems of linear algebra equations, such as Gaussian elimination.
Numerical analysts are concerned with understanding and quantifying error in computations and assessing the stability of algorithms. They also consider the effects of finite-precision computer arithmetic and the efficiency of algorithms. Newton's methods are frequently used for solving nonlinear equations and systems of equations. Integration and differentiation are often approximated by first interpolating the function and then integrating or differentiating the interpolating function.
4 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
Why is understanding error and accuracy important in numerical analysis?
Understanding error and accuracy is crucial in numerical analysis because it involves finding quantitative approximations to mathematical problems. Error is defined as the difference between a true value and an estimated or measured value. In numerical analysis, errors can arise from various sources, such as round-off error (e.g., approximating π) or truncation error (e.g., stopping an infinite series prematurely). Accuracy refers to the quality of being very accurate. Numerical analysts must understand the nature and size of errors to ensure the computed solutions are reliable and efficient. This understanding allows for the creation of methods to improve convergence and manage the sensitivity of solutions to data changes.
3 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles.
numerical analysis, area of mathematics and computer science that creates, analyzes, and implements algorithms for obtaining numerical solutions to problems involving continuous variables. Such problems arise throughout the natural sciences, social sciences, engineering, medicine, and business. Since the mid 20th century, the growth in power and availability of digital computers has led to an increasing use of realistic mathematical models in science and engineering, and numerical analysis of increasing sophistication is needed to solve these more detailed models of the world. The formal academic area of numerical analysis ranges from quite theoretical mathematical studies to computer science issues.
With the increasing availability of computers, the new discipline of scientific computing, or computational science, emerged during the 1980s and 1990s. The discipline combines numerical analysis, symbolic mathematical computations, computer graphics, and other areas of computer science to make it easier to set up, solve, and interpret complicated mathematical models of the real world.
Common perspectives in numerical analysis
Numerical analysis is concerned with all aspects of the numerical solution of a problem, from the theoretical development and understanding of numerical methods to their practical implementation as reliable and efficient computer programs. Most numerical analysts specialize in small subfields, but they share some common concerns, perspectives, and mathematical methods of analysis. These include the following:
- When presented with a problem that cannot be solved directly, they try to replace it with a “nearby problem” that can be solved more easily. Examples are the use of interpolation in developing numerical integration methods and root-finding methods.
- There is widespread use of the language and results of linear algebra, real analysis, and functional analysis (with its simplifying notation of norms, vector spaces, and operators).
- There is a fundamental concern with error, its size, and its analytic form. When approximating a problem, it is prudent to understand the nature of the error in the computed solution. Moreover, understanding the form of the error allows creation of extrapolation processes to improve the convergence behaviour of the numerical method.
- Numerical analysts are concerned with stability, a concept referring to the sensitivity of the solution of a problem to small changes in the data or the parameters of the problem. Consider the following example. The polynomial p(x) = (x − 1)(x − 2)(x − 3)(x − 4)(x − 5)(x − 6)(x − 7),
or expanded, p(x) = x7 − 28x6 + 322x5 − 1,960x4 − 6,769x3 − 13,132x2 + 13,068x − 5,040has roots that are very sensitive to small changes in the coefficients. If the coefficient of x6 is changed to −28.002, then the original roots 5 and 6 are perturbed to the complex numbers 5.459 0.540i—a very significant change in values. Such a polynomial p(x) is called unstable or ill-conditioned with respect to the root-finding problem. Numerical methods for solving problems should be no more sensitive to changes in the data than the original problem to be solved. Moreover, the formulation of the original problem should be stable or well-conditioned. - Numerical analysts are very interested in the effects of using finite precision computer arithmetic. This is especially important in numerical linear algebra, as large problems contain many rounding errors.
- Numerical analysts are generally interested in measuring the efficiency (or “cost”) of an algorithm. For example, the use of Gaussian elimination to solve a linear system Ax = b containing n equations will require approximately 2n3/3 arithmetic operations. Numerical analysts would want to know how this method compares with other methods for solving the problem.
Modern applications and computer software
Numerical analysis and mathematical modeling are essential in many areas of modern life. Sophisticated numerical analysis software is commonly embedded in popular software packages (e.g., spreadsheet programs) and allows fairly detailed models to be evaluated, even when the user is unaware of the underlying mathematics. Attaining this level of user transparency requires reliable, efficient, and accurate numerical analysis software, and it requires problem-solving environments (PSE) in which it is relatively easy to model a given situation. PSEs are usually based on excellent theoretical mathematical models, made available to the user through a convenient graphical user interface.
Applications
Computer-aided engineering (CAE) is an important subject within engineering, and some quite sophisticated PSEs have been developed for this field. A wide variety of numerical analysis techniques is involved in solving such mathematical models. The models follow the basic Newtonian laws of mechanics, but there is a variety of possible specific models, and research continues on their design. One important CAE topic is that of modeling the dynamics of moving mechanical systems, a technique that involves both ordinary differential equations and algebraic equations (generally nonlinear). The numerical analysis of these mixed systems, called differential-algebraic systems, is quite difficult but necessary in order to model moving mechanical systems. Building simulators for cars, planes, and other vehicles requires solving differential-algebraic systems in real time.
Another important application is atmospheric modeling. In addition to improving weather forecasts, such models are crucial for understanding the possible effects of human activities on the Earth’s climate. In order to create a useful model, many variables must be introduced. Fundamental among these are the velocity V(x, y, z, t), pressure P(x, y, z, t), and temperature T(x, y, z, t), all given at position (x, y, z) and time t. In addition, various chemicals exist in the atmosphere, including ozone, certain chemical pollutants, carbon dioxide, and other gases and particulates, and their interactions have to be considered. The underlying equations for studying V(x, y, z, t), P(x, y, z, t), and T(x, y, z, t) are partial differential equations; and the interactions of the various chemicals are described using some quite difficult ordinary differential equations. Many types of numerical analysis procedures are used in atmospheric modeling, including computational fluid mechanics and the numerical solution of differential equations. Researchers strive to include ever finer detail in atmospheric models, primarily by incorporating data over smaller and smaller local regions in the atmosphere and implementing their models on highly parallel supercomputers.
Modern businesses rely on optimization methods to decide how to allocate resources most efficiently. For example, optimization methods are used for inventory control, scheduling, determining the best location for manufacturing and storage facilities, and investment strategies.
Computer software
Software to implement common numerical analysis procedures must be reliable, accurate, and efficient. Moreover, it must be written so as to be easily portable between different computer systems. Since about 1970, a number of government-sponsored research efforts have produced specialized, high-quality numerical analysis software.
The most popular programming language for implementing numerical analysis methods is Fortran, a language developed in the 1950s that continues to be updated to meet changing needs. Other languages, such as C, C++, and Java, are also used for numerical analysis. Another approach for basic problems involves creating higher level PSEs, which often contain quite sophisticated numerical analysis, programming, and graphical tools. Best known of these PSEs is MATLAB, a commercial package that is arguably the most popular way to do numerical computing. Two popular computer programs for handling algebraic-analytic mathematics (manipulating and displaying formulas) are Maple and Mathematica.

" height="20" alt="HEW Logo">