|
Times |
TuTh 11:00AM-12:15AM, Zoom synchronous meeting |
Office hours |
|
Instructor |
(The instructor reserves the right to make changes to the syllabus. Any changes will be announced as early as possible.)
Linear algebra is one of the fundamental techniques underlying multiple mathematical disciplines. Correspondingly, numerical linear algebra is the foundation of scientific computation. This course introduces the basic techniques, analysis methods, and implementation details of numerical linear algebra. The course emphasizes the strong link between theoretical concepts, algorithm formulation, and practical implementation that leads to the ubiquity of numerical linear algebra in applications. Recent progress in machine learning is based to a large degree on extending concepts from numerical linear algebra and will be discussed in the course.
Upon course completion students:
• will be proficient in the basic operations of numerical linear algebra;
• will understand the significance of the main matrix factorizations;
• will be proficient in construction of linear subspaces;
• will be able to determine the computational complexity of numerical linear algebra algorithms;
• understand the links between numerical linear algebra operations and other fields of numerical analysis, in particular, approximation theory;
• will be able to implement numerical linear algebra algorithms.
Unless explicitly stated otherwise, all work is individual. You may discuss various approaches to homework problems with students, instructors, but must draft your answers by yourself.
• Bi-weekly homework: 6 assignments x 8 points = 48 points.
• In-class tests: 3 tests x 12 points = 36 points.
• Comprehensive final examination: 16 points.
• Extra credit: 4 reading topics x 3 points = 12 points.
Grade |
Points |
Grade |
Points |
Grade |
Points |
Grade |
Points |
H+,A+ |
101-112 |
H-,B+ |
86-90 |
P-,C+ |
71-75 |
L-,D+ |
56-60 |
H+,A, |
96-100 |
P+,B |
81-85 |
L+,C |
66-70 |
L-,D- |
50-55 |
H,A- |
91-95 |
P,B– |
76-80 |
L,C- |
61-65 |
F |
0-49 |
• Class attendance is expected and highly beneficial to understanding of course topics.
• Homework is to be submitted electronically through Sakai.
• Late homework is not accepted.
• Students are offered the opportunity to make up for 12 course points (i.e., 3 homeworks, or 1 in-class test) through extra credits posted on this web page every 3 weeks. This should accomodate a reasonable number of excused absences.
• There is no need to inform instructor of planned absences.
For each of the topics below:
read the textbook presentation
look up and read original sources, use Web of Science
try a small sample computation
present influence of work in the field by following citations
Lecture 30, Jacobi
Lecture 30, Bisection
Lecture 30, Divide & conquer
Extra credit: 4 reading topics x 3 points = 12 points.
• Three tests are scheduled during class hours, approximately once every 4 weeks, covering the material presented during that time period.
• The final examination covers all course material, and concentrates on verification of understanding of basic concepts rather than extensive computation or detalied knowledge of analytical techniques.
• Test1 and Test2 are closed-book. Test3 and the Final Examination are open-book. Test 3 is an implementation problem.
• Final examination: May 7, 12:00PM, conceptual questions on the entirety of the material, similar to what is to be expected on the SciComp comprehensive examination.
Test |
Date |
Questions |
Solutions |
1 |
01/28 |
||
2 |
04/04 |
||
3 |
04/29 |
MAT. Matrix operations.
FAC. Matrix factorizations.
CND. Conditioning and stability
BAS. Change of basis, aka linear systems
EIG. Eigenvalues.
ITR. Iterative methods
DNN. Deep neural networks
Numerical Linear Algebra, by L.N. Trefethen and D. Bau.
Matrix Computations, by G.H. Golub and C.F. Van Loan
Applied Numerical Linear Algebra, by J.W. Demmel
Matrix Iterative Analysis, by R.S. Varga
Methods of Mathematical Physics, by R. Courant and D. Hilbert
Methods of Theoretical Physics, by P.M. Morse and H. Feshbach
Mathematics for the Physical Sciences, by L. Schwartz
Computational Functional Analysis, by R. Moore
Class notes will be provided to summarize class discussion, and are posted on this website.
Week |
Date |
Topic |
Tuesday |
Thursday |
01 |
01/19 |
MAT |
||
02 |
01/26 |
MAT |
||
03 |
02/02 |
FAC |
||
04 |
02/09 |
FAC |
||
05 |
02/16 |
FAC |
UNC Wellness Day |
Adverse Weather Cancellation |
06 |
02/23 |
FAC |
Midterm exam 1 |
|
07 |
03/02 |
CND |
||
08 |
03/09 |
CND |
Wellness Day |
|
09 |
03/16 |
BAS |
||
10 |
03/23 |
BAS |
||
11 |
03/30 |
EIG |
||
12 |
04/06 |
ITR |
Midterm exam 2 |
|
13 |
04/13 |
ITR |
||
14 |
04/20 |
ITR |
||
15 |
04/27 |
ITR |
Midterm exam 3 |
|
16 |
05/04 |
ITR |
|
Homework generally consists of exercises from the textbook.
Nr. |
Issue Date |
Due Date |
Topic |
Problems |
Solution |
01 |
02/02 |
02/16 |
MAT |
||
2&3 |
03/18 |
03/30 |
FAC |
||
04 |
03/30 |
04/06 |
EIG |
|
|
05 |
03/26 |
04/23 |
ITR |
|
|
06 |
04/17 |
04/27 |
ITR |
|
Modern software systems allow efficient, productive formulation and solution of mathematical models. A key goal of the course is to familiarize students with these capabilities, using the SciComp@UNC environment in which tools required for data analysis have been preconfigured for immediate use. Follow instructions at SciComp@UNC to install on a laptop with at least 48GB free disk space and that conforms to CCI minimal standards.
Software usage is introduced gradually in each class, so the first resource students should use is careful, active reading of the material posted in class. In particular, carry out small tasks until it becomes clear what the software commands accomplish. Some additional resources:
Mathematica
TeXmacs:
Julia:
Scheme:
Course materials are stored in a repository that is accessed through the subversion utility, available on all major operating systems. The URL of the material is http://mitran-lab.amath.unc.edu/courses/MATH662
In the SciComp@UNC virtual machine the initial checkout can be carried out through the terminal commands
cd ~/courses
make MATH662
Update the course materials before each lecture by:
cd ~/courses
svn update
Links to course materials will also be posted to this site, but the most up-to-date version is that from the subversion repository, so carry out the svn update procedure prior to each lecture.