Lecture |
Date |
What was
covered |
Notes |
1 |
Jan. 28 |
Introduction; Hilbert spaces |
get assignment 1 |
2 |
Jan.
30 |
Convex sets; Projections |
sect. 6.2, and Theorem 8 in sec. 5.2 in Lax[E] |
3 |
Feb. 4 |
Convex analysis (II): Variational Inequality, Lipschitz constant; Examples |
Theorem 8 in sec. 5.2 in Lax[E]; turn in assignment 1 |
4 |
Feb.
6 |
Banach space; completion |
sect 8.3 in BacNar[F] |
5 |
Feb. 11 |
Fourier analysis: Fourier Series |
|
6 |
Feb.
13 |
Fourier analysis: Fourier Transform |
university closed due to snow |
7 |
Feb.
18 |
Fourier analysis: Fourier Series (2): Smoothness - Decay Relations; |
turn in assignment 2 |
8 |
Feb. 20. |
Fourier analysis: Fourier Series (3): Pointwise and MSE approximation order |
- |
9 |
Feb. 25 |
Fourier analysis: Fourier transform |
|
10 |
Feb. 27 |
Sampling Theory: Shannon Formula; Oversampling |
turn in assignment 3 |
11 |
Mar.
4 |
Fourier Analysis: Smoothness Decay Duality; Sampling Theory:Approximations (2) |
|
12 |
Mar.
6 |
Fourier analysis: Windowed Fourier Transform (1) |
turn in assignment 4 |
13 |
Mar.
11 |
Windowed Fourier Transform (2); Continuous Wavelet Transform |
|
14 |
Mar.
13 |
Reproducing Kernel Hilbert Space; |
|
- |
Mar.18 |
SPRING BREAK |
|
- |
Mar. 20 |
SPRING BREAK |
|
15 |
Mar. 25 |
Statistical Descriptions: Moments, Cumulants, Characteristic Functions |
turn in assignment 5 |
16 |
Mar.
27 |
Stochastic Approximations: Karhunen-Loev Expansion , PCA; Independent Component Analysis: ICA(Identifiability) |
|
17 |
Apr. 1 |
ICA (Identifiability) |
|
18 |
Apr.
3 |
ICA (Algorithms): Cumulants, JADE |
|
19 |
Apr. 8 |
NO CLASS |
|
20 |
Apr. 10 |
ICA: Max Entropy approach; |
|
21 (*) |
Apr.
15 |
Frequentist Approach:MLE; Bayesian Approach: MAP, MMSE; Sparse Component Analysis; Blind Source Separation (BSS) |
DIFFERRENT TIMES: 11:00am-1:00pm and 5:00pm-7:00pm
Deadline for Project/Report decision |
22 |
Apr.
17 |
Mixing Matrix Learning |
turn in assignment 6 |
23 (*) |
Apr.
22 |
BSS (audio case);Inequalities: Deterninistic Uncertainty Inequality: Fourier-Heisenberg; uncertainty inequality in finite setting |
DIFFERRENT TIMES: 11:00am-1:00pm and 5:00pm-7:00pm |
24 |
Apr.
24 |
Inequalities: Stochastic Bounds: Cramer-Rao Lower Bound |
|
25(*) |
Apr.
29 |
Model Selection: AIC, BIC, MDL |
DIFFERRENT TIMES: 11:00am-1:00pm and 5:00pm-7:00pm |
26 |
May 1 |
Compressive Sampling: L0-L1 "trick" |
|
27 |
May. 6 |
NO CLASS |
|
28 |
May. 8 |
CS Part II |
|
29 |
May. 13 |
Projects/Reports Submission Deadline;
Final Exam |
FINAL EXAM |