CS631 Paper Response Form

Paper Title: Fast Software Processing of Motion JPEG Video

Author(s): B.C. Smith

Main Point(s):

The paper describes a compressed domain video processing technique for global linear operations, that is, operations that describe a pixel value as a linear combination of arbitrary pixels in the input image. Straightforward compressed domain processing is very expensive for such global operations, but near real-time performance can be achieved by setting all irrelevant coefficients to zero and using sparse representations and operations for the resulting matrices. Irrelevancy of coefficients is determined by means of the statistical distribution of coefficient values,the number of matrices involved in an operation and an error boundary.

Possible Use(s):

The paper is enlarging the pool of operations that can be performed in the compressed domain, making real-time video processing more tractable.

Extensions:

A very straightforward extension is to apply this technique to binary image operators, maybe for linear global operations on MPEG B-frames. Another idea: right now, errors can be distributed among the different Matrices of an operation. Maybe it also makes sense to distribute error among groups of coefficients that have similar perceptual effects.

CS631 home page