Data Compression and Modeling
(3-0-0-3)
CMPE Degree: This course is Not Applicable for the CMPE degree.
EE Degree: This course is Not Applicable for the EE degree.
Lab Hours: 0 supervised lab hours and 0 unsupervised lab hours.
Technical Interest Group(s) / Course Type(s): Digital Signal Processing
Course Coordinator:
Prerequisites: ECE 4270
Corequisites: None.
Catalog Description
Theory and algorithms of signal encoding and decoding for data compression. Applications in information systems, digital telephony, digital television, and multimedia Internet.Textbook(s)
Introduction to Data Compression, Vector Quantization and Signal Compression, Digital Compression for Multimedia, Principles and StandardsCourse Outcomes
Not Applicable
Student Outcomes
In the parentheses for each Student Outcome:"P" for primary indicates the outcome is a major focus of the entire course.
“M” for moderate indicates the outcome is the focus of at least one component of the course, but not majority of course material.
“LN” for “little to none” indicates that the course does not contribute significantly to this outcome.
1. ( Not Applicable ) An ability to identify, formulate, and solve complex engineering problems by applying principles of engineering, science, and mathematics
2. ( Not Applicable ) An ability to apply engineering design to produce solutions that meet specified needs with consideration of public health, safety, and welfare, as well as global, cultural, social, environmental, and economic factors
3. ( Not Applicable ) An ability to communicate effectively with a range of audiences
4. ( Not Applicable ) An ability to recognize ethical and professional responsibilities in engineering situations and make informed judgments, which must consider the impact of engineering solutions in global, economic, environmental, and societal contexts
5. ( Not Applicable ) An ability to function effectively on a team whose members together provide leadership, create a collaborative and inclusive environment, establish goals, plan tasks, and meet objectives
6. ( Not Applicable ) An ability to develop and conduct appropriate experimentation, analyze and interpret data, and use engineering judgment to draw conclusions
7. ( Not Applicable ) An ability to acquire and apply new knowledge as needed, using appropriate learning strategies.
Strategic Performance Indicators (SPIs)
Outcome 1 (Students will demonstrate expertise in a subfield of study chosen from the fields of electrical engineering or computer engineering):
1. Understand the theory and practice of data compression and modeling as well as its applications in digital media and communication systems in everyday use.
Outcome 2 (Students will demonstrate the ability to identify and formulate advanced problems and apply knowledge of mathematics and science to solve those problems):
1. Understand and implement methods and algorithms for data compression and modeling
Outcome 3 (Students will demonstrate the ability to utilize current knowledge, technology, or techniques within their chosen subfield):
1. Design algorithms to model a given signal, extract model parameters, and achieve effective data compression on the signal
Course Objectives
Topical Outline
Introduction
signal compression, lossless and lossy compression
communication systems and building blocks: sources, channels, and codes
issues - fixed rate and variable rate, robustness to channel errors, degradation and perceptual effects
Quantization theory
uniform quantization, distortion and bit rates
amplitude distribution and high-rate quantization theory
Bennett approximations and optimal performance, Lloyd's code optimality and algorithm
elementary distortion-rate theory
Architecture for data compression & introduction to data modeling
signal models & spectral analysis
quantization with memory
fixed-rate vs. variable-rate code
entropy, estimated entropy, complexity and typical sequence of an ergodic source
variable rate quantization: lossless codes, prefix code
Lossless Coding Techniques
Huffman coding, arithmetic coding
Universal lossless codes, adaptive and predictive lossless coding
Distortion & Similarity Measures
sample difference, sum of squared deviations and Euclidean distance
Lp-norm, city-block distance, Mahalanobis distance
transformation and transformation invariant similarity measures
spectral distortion measures
mutual-information, divergence, and Kullback-Liebler number
perceptual issues
Coding algorithms scalar quantization
clustering algorithms for quantizer design
the Lloyd algorithm and its generalization
entropy-constrained quantizers
Coding algorithms - vector quantization (VQ)
sphere packing and optimal uniform lattice quantizers
Lloyd algorithm - revisited
progressive vector quantization
variations of vector quantization
finite-state VQ and Markov models
tree and trellis encoding
Applications
speech and audio coding
image and video coding
Compression standards and formats
Historical and evolutional aspects behind development of standards
Application areas