Applied Deep Learning Boot Camp

The use of machine learning models in industry continues to grow. The goal of this bootcamp is to teach participants how to use deep learning (DL) tools to process data in different modalities, ranging from text, images and graphs. In this course, you will learn how to formulate your problems in the machine learning terms and how to effectively utilize existing deep learning packages to solve them. We will discuss issues that impact classification performance, foresee likely hurdles and explore possible remedies for improving model accuracy. This is a hands-on course where lectures will be supplemented by the guided practical tutorials and in class-programming labs where participants will learn how to implement, train and improve supervised models using PyTorch package.

Enrollment for this course is limited to 30 participants to allow for more personalized instruction.

EARN A PROFESSIONAL CERTIFICATE IN MACHINE LEARNING AND ARTIFICIAL INTELLIGENCE

This course may be taken individually or as part of the Professional Certificate Program in Machine Learning and Artificial Intelligence.

This course is taught in collaboration with J-Clinic (Abdul Latif Jameel Clinic for Machine Learning in Health)

Lead Instructor(s): 

Regina Barzilay, Tommi Jaakkola

Dates: 

Nov 13, 2019 - Nov 14, 2019

Course Length: 

2 Days

Course Fee: 

$2,500

CEUs: 

1.3

Status: 

  • Wait List

It is highly recommended that you apply for a course at least 6-8 weeks before the start date to guarantee there will be space available. After that date you may be placed on a waitlist. Courses with low enrollment may be cancelled up to 4 weeks before start date if sufficient enrollments are not met. If you are able to access the online application form, then registration for that particular course is still open.

This program has reached capacity; additional registrations will be placed on a wait list and given priority for the next session of this program (date TBD 2020).

Participant Takeaways: 

  • Understand broad opportunities for automation with machine learning
  • Explore modern natural language processing and computer vision tools, formulations, and problems
  • Understand how to formulate new problems into machine learning terms
  • Learn alternative approaches for feature representation and modeling for graphs, text and images.
  • Outline key aspects of practical problems that are likely to impact performance
  • Obtain hands-on experience in implementing, debugging and tuning neural models in pytorch.
  • Learn to discuss scaling issues (amount of data, dimensionality, storage, and computation)
  • Identify limitations of existing tools
  • Understand current machine learning trends and opportunities that they bring

Who Should Attend: 

  • This course is designed for people with basic analytic skills and familiarity with supervised learning. The course assumes an undergraduate degree in computer science or another technical area such as statistics, physics, electrical engineering, etc., with exposure to vectors and matrices, basic concepts of probability. A high-level understanding of programming (thinking in terms of programs) is also beneficial.
  • For professionals whose work involves data hands-on, the course aims to provide a deeper understanding and sharper intuitions about translating their problems into the deep learning terms and writing programs to implement these formulations and which methods to consider in what contexts.

Requirements: 

Computer Requirements: Laptops with Google Chrome are required. Tablets will not be sufficient for the computing activities performed in this course.

Program Outline: 

Day 1:

[9:00-10:30 am]  Introduction to Machine Learning (Lecture)

[10:30am-noon] Training and Improving Classifiers with Sklearn (Practicum)

[Noon-1:00pm] Lunch

[1:00pm-2:30pm] Introduction to Neural Networks (Lecture)

[2:30pm-5:00pm] Building Neural Networks with PyTorch (Practicum)

Practicum Notes:

The SKLearn lab will have a tutorial for sentiment analysis and mnist (via a Google Colab Notebook) with emphasis on how to improve performance, then time for students to try their own classifiers on a separate sentiment analysis task. 

The PyTorch lab willhave a tutorial on PyTorch and how to build feed-forward nets for the same tasks as in the Sklearn lab (with emphasis on how to improve performance), and time for students to try to build their own network for the separate sentiment analysis task. 

Day 2:

[9:00-10:30 am]  Advanced Neural Networks for Sequential Data and Transfer Learning (Lecture)

[10:30am-noon] Building Advanced Networks for Text in PyTorch and Using PreTrained Models  (Practicum)

[Noon-1:00pm] Lunch

[1:00pm-2:30pm] Advanced Neural Networks for Images and Graphs (Lecture)

[2:30pm-4:00pm] Building Advanced Networks for Images in PyTorch and Using PreTrained Models (Practicum)

[4:00pm-5:00pm] Discussion of Participants' Problems

Practicum Notes:

The first lab will focus on sentiment analysis and walk them through how to build an RNN/Transformer, and how to extend a pretrained model. Then there will be time to try to tune your own model on a separate sentiment analysis task. 

The second lab will walk you through how to build a CNN to solve MNIST (or a simple vision task), and how to leverage an imagenet pre-trained CNN for a new task (as well as tricks like data augmentation). Then there will be time to try to tune your own model for a separate image classification task. There may be a subset of MiniPlaces or CIFAR-10. 

Course Schedule: 

Class runs from 9:00am until 5:00pm each day with one-hour lunch and two 15-minute breaks. 

Instructors: 

Location: 

This course takes place on MIT campus in Cambridge, Massachusetts. We can also offer this course for groups of employees at your location. Please complete the Custom Programs request form for further details.