COVID-19 Updates: MIT Professional Education fully expects to resume on-campus courses during the Summer of 2022. In the event there is a change in MIT's COVID-19 policies and a course cannot be held on-campus, we will deliver courses via live virtual format. Find the latest information here.

Course is closed
Lead Instructor(s)
Date(s)
TBD Summer 2024
Location
On Campus
Course Length
5 Days
Course Fee
$4,700
CEUs
2.7 CEUs
Sign-up for Course Updates
Course is closed
Sign-up for Course Updates

Master the data and tools you need—from numerical linear algebra to convex programming—to make smarter decisions and drive enhanced results. With the guidance of MIT experts, you’ll gain a greater understanding of how to apply cutting-edge digital strategies to practical vision, learning, and graphics challenges. You’ll then apply your newfound skills by taking part in hands-on coding and mathematical exercises designed to strengthen your knowledge.

THIS COURSE MAY BE TAKEN INDIVIDUALLY OR AS part of THE PROFESSIONAL CERTIFICATE PROGRAM IN MACHINE LEARNING & ARTIFICIAL INTELLIGENCE.

Course Overview

Optimization algorithms lie at the heart of machine learning (ML) and artificial intelligence (AI). The distinctive feature of optimization within ML is the strong departure from textbook approaches: the focus is now on a different set of goals driven by big data, non-convex deep learning, and high-dimensions. This departure and the different focus make it challenging for newcomers and even experienced users to obtain a solid grasp of the fundamental ideas without getting lost in myriad tutorials, blogs, and papers. 

This course provides an accessible entry point to Modeling and Optimization for Machine Learning, key skills needed to use state-of-the-art software and algorithms from machine learning. It covers underlying theoretical motivations behind widely-used optimization algorithms (the “science”), while diving deep into aspects of mathematical modeling (the “art”) to provide students with an intuitive, foundational introduction to this modern and fast-moving research area.

Modeling reduces messy engineering or computational problems to mathematical forms that can be solved by using standard software and techniques. By recognizing mathematical patterns “in the wild,” participants will develop an intuition for which problems are solvable using standard numerical modeling techniques and gain the knowledge and skills to then solve them in practice.

After we develop an appropriate model for a machine learning problem, the next step is to choose an optimization technique. Participants in the course will learn to pair mathematical models with efficient optimization algorithms, from stochastic gradient descent to cone programming. Participants will delve into the details of how popular optimization methods work and will receive practical experience interfacing with optimization software through case studies and exercises.

By the end of the course, participants will learn how to boil real-world challenges down to their computational essence to make a reasonable estimate of how difficult it would be to design a numerical method to solve them. We will cover a breadth of tools, from numerical linear algebra to convex programming and stochastic/deterministic gradient descent, in the context of practical problems drawn from emerging applications in learning, computer vision, time series analysis, and imaging. Coding and mathematical exercises will reinforce these ideas and expose participants to standard software packages for optimization.

COVID-19 Updates

We fully expect to resume on-campus Short Programs courses during the Summer of 2022. However, the possibility remains of ongoing disruption and restrictions due to COVID-19 which may require that the course be delivered via live virtual format. Please read more here.

Learning Outcomes

Participants in the course will learn how to:

  • Recognize classes of optimization problems in machine learning and related disciplines.
  • Learn concepts that demystify the “why” and “how” of ubiquitous topics such as regression, deep learning, and large-scale optimization, with a focus on convex and non-convex models.
  • Interface with software for computing optimal solutions to a given machine learning problem.
  • Understand the mathematical underpinnings of optimization methods via examples drawn from machine learning, computer vision, engineering, and data analysis.
  • Understand foundational optimization ideas including gradient descent, stochastic gradient methods, higher-order methods, and more advanced optimization algorithms.
  • Classify optimization problems by their tractability, difficulty, and compatibility with existing software.
  • Learn to cut through the hype to make more informed choices for their own applications.

Program Outline

The course begins with the fundamentals of modeling and optimization, including case studies converting regression and classification problems to mathematical models as well as the basics of deterministic and stochastic gradient descent. We then broaden the capabilities of our modeling language by showing how to incorporate constraints and accelerate optimization with second-order information. After establishing the basics, we consider a variety of more advanced models in machine learning, including neural network training, sparsity and low-rank regularization, metric learning, time-series analysis, and adversarial training of robust models. We conclude with practical discussion drawn from research projects at MIT as well as from participants’ domain areas.

Our course will include daily practicum exercises in which students will experiment with optimization tools applied to modeling problems drawn from machine learning applications.  We will complete the exercises using Google Colab in Python.

Who Should Attend

This course is designed for people working in data science, finance, marketing, computer-aided design, operations, strategy, engineering, research, or computer vision. Typical roles include engineer, programmer, developer, data scientist, researcher, consultant, or marketing analyst.

Relevant roles include:

  • Computer engineers, programmers, and developers seeking to leverage leading-edge machine learning technologies and algorithms 
  • Data scientists who want to use advanced tools, such as numerical linear algebra and convex programming, to improve decision-making and results 
  • IT and business leaders looking to identify the machine learning strategies that will be most effective for meeting their unique organizational needs 
  • Academics and researchers who need a deeper understanding of the latest developments in machine learning modeling and optimization 
  • Financial professionals who use—or want to use—models to more accurately predict risk and shape decision making 

Requirements

Participants are required to have a background in linear algebra and multivariable calculus, as well as at least basic programming in Python.

Laptops (or tablets) with Python are required for this course. Participants should have administrative privileges for their computers in case Python packages need to be installed during the course.

Brochure
Download the Course Brochure
Image of Modeling and Optimization for Machine Learning Brochure

Content

The type of content you will learn in this course, whether it's a foundational understanding of the subject, the hottest trends and developments in the field, or suggested practical applications for industry.

Fundamentals: Core concepts, understandings, and tools - 30%|Latest Developments: Recent advances and future trends - 42%|Industry Applications: Linking theory and real-world - 28%
30|42|28
Delivery Methods

How the course is taught, from traditional classroom lectures and riveting discussions to group projects to engaging and interactive simulations and exercises with your peers.

Lecture: Delivery of material in a lecture format - 50%|Discussions or Group Work: Participatory learning - 30%|Labs: Demonstrations, experiments, simulations - 20%
50|30|20
Levels

What level of expertise and familiarity the material in this course assumes you have. The greater the amount of introductory material taught in the course, the less you will need to be familiar with when you attend.

Introductory: Appropriate for a general audience - 75%|Advanced: In-depth exploration at the graduate level - 25%
75|25