Practical Mathematical Optimization Basic Optimization Theory and Gradient-Based Algorithms

This textbook presents a wide range of tools for a course in mathematical optimization for upper undergraduate and graduate students in mathematics, engineering, computer science, and other applied sciences.  Basic optimization principles are presented with emphasis on gradient-based numerical optimization strategies and algorithms for solving both smooth and noisy discontinuous optimization problems. Attention is also paid to the difficulties of expense of function evaluations and the existence of multiple minima that often unnecessarily inhibit the use of gradient-based methods. This second edition addresses further advancements of gradient-only optimization strategies to handle discontinuities in objective functions. New chapters discuss the construction of surrogate models as well as new gradient-only solution strategies and numerical optimization using Python. A special Python module is electronically available (via springerlink) that makes the new algorithms featured in the text easily accessible and directly applicable. Numerical examples and exercises are included to encourage senior- to graduate-level students to plan, execute, and reflect on numerical investigations. By gaining a deep understanding of the conceptual material presented, students, scientists, and engineers will be  able to develop systematic and scientific numerical investigative skills.

1.Introduction.- 2.Line search descent methods for unconstrained minimization.-3. Standard methods for constrained optimization.-4. Basic Example Problems.- 5. Some Basic Optimization Theorems.-  6. New gradient-based trajectory and approximation methods.- 7. Surrogate Models.- 8. Gradient-only solution strategies.- 9. Practical computational optimization using Python.- Appendix.- Index.

Jan A. Snyman currently holds the position of emeritus professor in the Department of Mechanical and Aeronautical Engineering of the University of Pretoria, having retired as full professor in 2005. He has taught physics, mathematics and engineering mechanics to science and engineering students at undergraduate and postgraduate level, and has supervised the theses of 26 Masters and 8 PhD students. His research mainly concerns the development of gradient-based trajectory optimization algorithms for solving noisy and multi-modal problems, and their application in approximation methodologies for the optimal design of engineering systems. He has authored or co-authored 89 research articles in peer-reviewed journals as well as numerous papers in international conference proceedings.

Daniel N. Wilke is a senior lecturer in the Department of Mechanical and Aeronautical Engineering of the University of Pretoria.   He teaches computer programming, mathematicalprogramming and computational mechanics to science and engineering students at undergraduate and postgraduate level. His current research focuses on the development of interactive design optimization technologies, and enabling statistical learning (artificial intelligence) application layers, for industrial processes and engineering design. He has co-authored over 50 peer-reviewed journal articles and full length conference papers.