This schedule should be considered tentative and subject to change, at least until it actually takes place! In addition to class notes, I have compiled some background notes that may be helpful.

Week Day Date Notes and readings HW
2 Mon, Jan 24

Introduction

[slides][NB (Julia)][NB (HTML)]

Wed, Jan 26

Matrix manipulations

[NB (Julia)][NB (HTML)]

Fri, Jan 28

Vector spaces, norms, singular values

3 Mon, Jan 31

Matrices, norms, sensitivity and conditioning

Wed, Feb 02

Matrices, norms, sensitivity and conditioning

Fri, Feb 04 Snow day (was to be floating point)
  • HW1 due
4 Mon, Feb 07

Floating point

[NB (Julia)][NB (HTML)]

Wed, Feb 09

Gaussian elimination and Cholesky

[NB (Julia)][NB (HTML)]

Fri, Feb 11

Pivoting and blocking

[NB (Julia)][NB (HTML)]

  • HW2 due
5 Mon, Feb 14

Conditioning, error estimation, and refinement of linear systems

[NB (Julia)][NB (HTML)]

Wed, Feb 16

Sparse, banded, and structured solves

Fri, Feb 18

Other structured systems

(Bindel away)

[NB (Julia)][NB (HTML)]

6 Mon, Feb 21

Intro to least squares

[NB (Julia)][NB (HTML)]

Wed, Feb 23

Least squares and QR

[NB (Julia)][NB (HTML)]

Fri, Feb 25

Ill-posedness and regularization

[NB (Julia)][NB (HTML)]

7 Mon, Feb 28 February break
Wed, Mar 02

Ill-posedness and regularization

Fri, Mar 04

Applications of eigenvalue problems

  • P1 due
8 Mon, Mar 07

Power iteration

[NB (Julia)][NB (HTML)]

  • HW3 due
  • Proj proposal (5223 only)
Wed, Mar 09

From power methods to QR iteration

[NB (Julia)][NB (HTML)]

Fri, Mar 11

Hessenberg, tridiagonal, and bidiagonal

9 Mon, Mar 14

Stationary iterations

[NB (Julia)][NB (HTML)]

  • MT due
Wed, Mar 16

Gauss-Seidel convergence, extrapolation

[NB (Julia)][NB (HTML)]

Fri, Mar 18

Krylov subspace iterations

10 Mon, Mar 21

Nonlinear equations in 1D

(Bindel away)

[NB (Julia)][NB (HTML)]

Wed, Mar 23

Nonlinear equations in 1D

(Bindel away)

[NB (Julia)][NB (HTML)]

Fri, Mar 25

Optimization in 1D

(Bindel away)

[NB (Julia)][NB (HTML)]

  • P2 due
11 Mon, Mar 28

Nonlinear equations and optimization

[NB (Julia)][NB (HTML)]

Wed, Mar 30

Newton in many dimensions

[NB (Julia)][NB (HTML)]

Fri, Apr 01

Gradient descent and Newton for optimization

[NB (Julia)][NB (HTML)]

  • HW4 due
12 Mon, Apr 04 Spring break
Wed, Apr 06 Spring break
Fri, Apr 08 Spring break
13 Mon, Apr 11

Gauss-Newton and nonlinear least squares

[NB (Julia)][NB (HTML)]

Wed, Apr 13

Modified Newton iterations

[NB (Julia)][NB (HTML)]

Fri, Apr 15

Quasi-Newton and other iterations

[NB (Julia)][NB (HTML)]

14 Mon, Apr 18

Line search and globalization

[NB (Julia)][NB (HTML)]

Wed, Apr 20

Trust regions

[NB (Julia)][NB (HTML)]

Fri, Apr 22

Homotopy and continuation

[NB (Julia)][NB (HTML)]

  • P3 due
15 Mon, Apr 25

Constraints and multipliers

[NB (Julia)][NB (HTML)]

Wed, Apr 27

Methods for equality constraints

[NB (Julia)][NB (HTML)]

Fri, Apr 29

Methods for inequality constraints

[NB (Julia)][NB (HTML)]

  • HW5 due
16 Mon, May 02

CANCELED (illness)

Wed, May 04

Derivative free methods

[NB (Julia)][NB (HTML)]

Fri, May 06

Review

17 Mon, May 09

Review

  • Project due (5223 only)