Term: Spring 2012-2013
CSC 249/449 Machine Vision (Spring 2012)
Fundamentals of computer vision, including image formation, elements of human vision, low-level image processing, and pattern recognition techniques. Advanced topics include modern visual features, graphical models, model-based and data-driven approaches, and contextual inference, as well as illustrative examples of successes and challenges in applications. CSC 449, a graduate-level course, requires additional readings and assignments (including a course project).
Please check pre-requisites on the official course listing page. Some knowledge of linear algebra and basic statistics is helpful but we will review these subjects in the class (please discuss with me if you are not sure). For assignments and projects, the most common programming languages are Matlab, C or C++. Note that Matlab provides an image processing toolbox and is available on most CS department undergraduate and research networks.
Course schedule (tentative)
|week||dates||chapter||key topics||CSC 249||CSC 449||notes|
|1||1/19||1, 2||overview; image formation|
|2||1/24, 1/26||3, 4||color vision; low-level image processing|
|3||1/31, 2/2||4, notes||texture; Intro to (review of) probability|
|4||2/7, 2/9||Duda & Hart||pattern recognition concepts (incl. classifiers)|
|5||2/14, 2/16||5, 6||modern visual features|
|6||2/21, 2/23||9, 10||mid-level vision (incl. segmentation, Hough Transform)|
|7||2/28, 3/1||guest lectures by Dr. Andrew Gallagher||recognizing faces and people|
|8||3/6, 3/8||review/midterm exam|
|9||3/13, 3/15||spring break|
|10||3/20, 3/22||midterm solutions, 12||image registration||selecting course survey topics||selecting course project topics||1-page proposal|
|11||3/27, 3/29||11, 7, 8||tracking, stereo & 3D|
|12||4/3, 4/5||18, notes||recognizing objects, scenes, actions and events|
|13||4/10, 4/12||notes||data-driven computer vision|
|14||4/17, 4/19||21, notes, & guest lecture by Dr. Dhiraj Joshi||content-based image annotation & retrieval|
|15||4/24, 4/26||notes||contextual inference in computer vision|
|16||5/1, 5/3||final presentations & reports||impress us!||5/1||5/3|
|17||5/5, 5/10||final presentations & reports||impress us!||5/8, 5/10|
Instructor and grading
Instructor: Prof. Jiebo Luo, CSB Rm 611, x65784
Lectures: Tuesdays and Thursdays, 12:30-13:45, CSB 601
Office hours: after classes (15:00-16:00) or by appointment (use email).
Grading (total 100%)
- homework assignments 35% (including a small project 10%)
- midterm 30%
- final project & presentation (for CSC 449) 30% (presentation counts 10%)
- final survey & presentation (for CSC 249) 30% (presentation counts 10%)
- class participation 5%
Expectation for the final project - something "new"
- an existing algorithm applied to new data or new problems
- a new algorithm (or modified version of an existing algorithm) applied to the same data
- new findings from a comparative study of using different algorithms for the same problem
Textbooks and other resources
Computer Vision: A Modern Approach, 2/E
Publisher: Prentice Hall, 2012
Pattern Classification, 2/E
Richard O. Duda, Peter E. Hart and David G. Stork
Publisher: John Wiley & Sons, 2001
Recommended papers (use IEEE Xplore on the university network for free access to these and other papers):
Longuet-Higgins Prize recipients
(CVPR annual award for 'fundamental contributions in Computer Vision that Have Withstood the Test of Time')
- 2005 –
- David Mumford and Jayant Shah, "Boundary detection by minimizing functionals", CVPR 1985.
- Ted Adelson and John Wang, "Layered representation for motion analysis", CVPR 1993.
- 2006 –
- H. Rowley, S. Baluja and Takeo Kanade, "Neural Network-Based Face Detection", CVPR 1996.
- Cordelia Schmid and Roger Mohr, "Combining greyvalue invariants with local constraints for object recognition", CVPR 1996.
- 2007 –
- J. Shi and J. Malik, "Normalized Cuts and Image Segmentation", CVPR 1997.
- E. Osuna, R. Freund, and F. Girosi, "Training Support Vector Machines: An Application to Face Detection", CVPR 1997.
- 2008 –
- H. Schneiderman and Takeo Kanade, "Probabilistic modeling of local appearance and spatial relationships for object recognition", CVPR 1998.
- C. Bregler and J. Malik, "Tracking people with twists and exponential maps", CVPR 1998.
- 2009 –
- Jinggang Huang, David Mumford, "Statistics of Natural Images and Models", CVPR 1999.
- Chris Stauffer, W.E.L. Grimson, "Adaptive Background Mixture Models for Real-Time Tracking", CVPR 1999.
- 2010 –
- Pedro F. Felzenszwalb and Daniel P. Huttenlocher, "Efficient Matching of Pictorial Structures", CVPR 2000.
- Dorin Comaniciu, Visvanathan Ramesh, and Peter Meer, "Real-Time Tracking of Non-Rigid Objects Using Mean Shift", CVPR 2000.
- 2011 –
- Paul A. Viola and Michael J. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features", CVPR 2001.