Fundamentals of Optimization Theory With Applications to Machine Learning Jean Gallier and Jocelyn Quaintance Department of Computer and Information Science University of Pennsylvania Philadelphia, PA 19104, USA e-mail: jean@cis.upenn.edu © Jean Gallier April 25, 2024