Tentative Schedule
8/25 Wed. |
Assignment: Written assignment 0
|
8/27 Fri. |
Buzzwords: Affine transformation, transformation matrix, scaling, rotation, identity matrix, translation, matrix decomposition, singular value decomposition, unitary matrix, orthogonal vector
Assignment: Written assignment 1
|
9/1 Wed. |
Buzzwords: Inner product, projection, Fourier Series, Fourier Transform, Discrete Fourier Transform, spectrum, low-pass filter, high-pass filter
|
9/3 Fri. |
Buzzwords: Nyquist-Shannon sampling theorem, signal sampling, signal reconstruction, convolution, convolution theorem, compressive sensing
Assignment: Written assignment 2
|
9/8 Wed. |
Buzzwords: Eyes, retina, fovea, foveated rendering, photoreceptors, cones, rods, blind spot, light spectrum, spectral power distribution, photopic vision, scotopic vision, contrast sensitivity function, luminosity efficiency function, lumen, spectral reflectance, color blindness, invisible light, visual cortex, metamerism, metamer, color matching experiment, color matching function, trichromatic theory of color, color space
|
9/10 Fri. |
Buzzwords: Colorimetry, equal-energy white, color cube, gamut, quantization, chromaticity, chromaticity plot, chromaticity gamut, XYZ color space, reference white, Planckian locus, sRGB, additive color model, subtractive color model, perceptual color space, HSV, HSL, HSB, hue, saturation, value, lightness, brightness, CMYK, gamma
|
9/15 Wed. |
Buzzwords: Pinhole camera, motion blur, convex lens, concave lens, Snell's law, refraction index, gravitational lens, waveguide, thin lens approximation, paraxial approximation, gaussian lens equation, circle of confusion, depth of field, F-number, magnification factor, field-of-view, think lens, optical aberration, chromatic aberration, monochromatic aberration, spherical aberration, motion from blur, depth from blur
|
9/17 Fri. |
Buzzwords: IR filter, UV filter, microlens, photoelectric effect, photodiodes, quantum efficiency, light-matter interaction, energy-harvesting camera, pixel well, full-well capacity, saturation, dynamic range, high dynamic range, NIR photography, thermographic camera, IR camera, depth sensing, fill factor, charge-to-voltage conversion, voltage gain, CCD sensor, CMOS sensor, rolling shutter, global shutter, analog-to-digital conversion, ADC, resolution
|
9/22 Wed. |
Buzzwords: bayer filter, CYGM filter, aliasing, anti-aliasing filter, demosaic, noise, fixed pattern noise, photon shot noise, dark current noise, read noise, Poisson distribution, signal to noise ratio, signal gain, ISO, dynamic range
|
9/24 Fri. |
Buzzwords: demosaic, white balancing, image signal processing, ISP, camera serial interface, systems-on-a-chip, SoC, Denoising, spatial denoising, temporal denoising, filtering, convolution, mean filter, moving average filter, Gaussian filter, low-pass filter, bilateral filter, luminance denoising, chroma denoising
|
9/29 Wed. |
Buzzwords: HDR imaging, tone mapping, graduated neutral density filter, GND, multiple exposures, radiance map, linear tone mapping, global tone mapping, local tone mapping, contrast, local contrast, HDR look
|
10/1 Fri. |
Buzzwords: Feedback-driven optimization, color constancy, chromatic adaptation, neutral point, white point, illuminant, von Kries adaptation model, auto white balancing, AWB, active AF, passive AF, phase detection, contrast detection, PDAF, CDAF, cross-correlation, autofocus point, dual pixel AF, time-of-flight, depth from stereo, structured light, metering
|
10/6 Wed. |
Buzzwords: Encoder, decoder, codec, lossless, lossy, luma, chroma, chroma subsampling, Y'CbCr, JPEG, DCT, basis function, quantization matrix, entropy encoding, run-length encoding, RLE, Motion-JPEG, M-JPEG, MPEG, H.262, H.264, H.265, AVC, HEVC, container former, .mp4, intra-frame prediction, inter-frame prediction, motion estimation, motion compensated interpolation, three step search, residual, macroblock, motion vector, reference frame, I-frame, P-frame, B-frame, GoP, sub-pixel motion, transcoding
|
10/8 Fri. |
Buzzwords: Color rendering index, luminous efficacy, luminous flux, fluorescent light, phosphor, emissive display, light-filtering display, LED, LCD, liquid crystal, polarizer, pointillism, white LED, phosphor-converted LED, field sequential color, FSC, color wheel, DLP projector, digital micromirror device, DMD, color breakup, three-chip projector, brightness, DCI-P3
|
10/13 Wed. |
Astrophysical-Scale Imaging (Guest Lecture by Segev BenZvi)
|
10/15 Fri. |
Buzzwords: Panorama, field of view, FOV, telephoto lens, long-focus lens, perspective projection, ghosting, cylindrical projection, spherical projection, distortion, equirectangular projection, cubemap projection, optical flow, camera rig, omnidirection stereo, VR tax, semantic-aware streaming
|
10/20 Wed. |
Buzzwords: Light field, plenoptic function, extended depth of field
|
10/22 Fri. |
Buzzwords: Photo-realism, computer-generated imagery, parametric surface, parametric curve, polygon mesh, triangle mesh, point cloud, point set, normal, polygon triangulation, bezier curve, bezier surface, basis functions, Bernstein polynomials, LiDAR, point set triangulation, Delaunay triangulation
|
10/27 Wed. |
Buzzwords: rasterization, ray tracing, image-centric, object-centric, visibility, shading, local frame, world frame, camera space, raster space, perspective projection, orthographic projection, environmental camera, near-clipping plane, far-clipping plane, barycentric coordinates, depth-buffer, z-buffer
|
10/29 Fri. |
Buzzwords: recursive ray tracing, ray-triangle intersection, acceleration structures, space-partitioning trees, octree, kd-tree, bounding volume hierarchy, BVH
|
11/3 Wed. |
Buzzwords: reflection, refraction, glossy, diffusion, translucent, subsurface scattering, specular, fresnel equation, Phong shading, Lambert's cosine law, Lambertian diffusion surface, albedo, reflectance, directional-hemispherical reflectance, hemespherical-directional reflectance
|
11/5 Fri. |
Buzzwords: Rendering equation, bidirectional reflectance distribution function, BRDF, emitted radiance, path tracing, Monte-Carlo integration, variance, bias, Monte-Carlo path tracing, specular lobe, caustic, bidirectional path tracing, texture map, texture mapping, texel, UV unwrapping, UV map, UV island, texture sampling, texture filtering, normal map
|
11/10 Wed. |
|
11/12 Fri. |
Buzzwords: shader, vertex shader, fragment shader, alpha blending, shader core, ROP, SIMD, control-flow divergence, fine-grained multi-threading, GPGPU, kernel, RT cores, OptiX, CUDA, tensor core, DLSS
|
11/17 Wed. |
Learning, Leveraging, and Optimizing Human Perception in Metaverse (Guest Lecture by Qi Sun) (Video)
Abstract: The world is becoming unprecedentedly connected thanks to emerging media and cloud-based technologies. The holy grail of metaverse requires recreating a remotely shared world as a digital twin of the physical planet. In this world, the human is probably the most complex mechanical, physical, and biological system. Unlike computers, it is remarkably challenging to model and engineer how humans perceive and react in a virtual environment. By leveraging computational advancements such as machine learning and biometric sensors, this talk will share some recent research on altering and optimizing the human visual and behavioral perception toward creating the ultimate metaverse.
|
11/19 Fri. |
Buzzwords: Light-particle interaction, absorption, in/out scattering, emission, CT scan, volume rendering, surface reconstruction, splat, splatting, reconstruction kernel, ε z-buffering, level of details, LOD, qsplat, bounding sphere hierarchy
|
11/24 Wed. |
Thanksgiving Holiday
|
11/26 Fri. |
Thanksgiving Holiday
|
12/1 Wed. |
Buzzwords: Eye piece, eye relief, virtual display, motion to photon latency, motion tracking, DoF, IMU, gyroscope, accelerometer, inside-out/outside-in tracking, teleportation, stereopsis, vergence-accommodation conflict, multi/vari-focal display, lightfield display, gaze tracking, foveated rendering, ventral metarism, foveated ray tracing
|
12/3 Fri. |
Buzzwords: localization, mapping, control, path planning, feedback control, RANSAC, bundle adjustment
|
12/8 Wed. |
Buzzwords: Herculaneum Papyri, Archimedes Palimpsest, The Old Guitarist, The Martellus Map, The Hunt-Lenox Globe, multispectral imaging, micro CT, structure from motion
|