Date of Award


Document Type


Degree Name

Master of Science (MS)

Legacy Department

Computer Engineering


Birchfield, Stan

Committee Member

Schalkoff , Robert

Committee Member

Dean , Brian


This work presents an approach to visual tracking based on dividing a target into multiple regions, or fragments. The target is represented by a Gaussian mixture model in a joint feature-spatial space, with each ellipsoid corresponding to a different fragment. The fragment set and its cardinality are automatically adapted to the image data using an efficient region-growing procedure and updated according to a weighted average of the past and present image statistics. The fragment modeling is used to generate a strength map indicating the probability of each pixel belonging to the foreground. The strength map provides vital information about new fragments appearing in the scene, thereby assisting in addressing problematic cases like self-occlusion. The strength map is used by the region growing formulation, reminiscent of discrete level set implementation, to extract accurate boundaries of the target. Significant speedup is achieved using the region growing procedure over traditional level set based methods. The joint Lucas-Kanade feature tracking approach is also incorporated for handling large unpredictable motions even in untextured regions. Experimental results on a number of challenging sequences demonstrate the effectiveness of the technique.

Elmo_OurAlgo.mpg (4310 kB)