Joint estimation of motion and illumination change in a sequence of images

Ja-Keoung Koo; Hyo-Hun Kim; Byung-Woo Hong

doi:10.1117/1.JEI.24.5.053027

15 October 2015 Joint estimation of motion and illumination change in a sequence of images

Ja-Keoung Koo, Hyo-Hun Kim, Byung-Woo Hong

Author Affiliations +

Funded by: NRF

Journal of Electronic Imaging, Vol. 24, Issue 5, 053027 (October 2015). https://doi.org/10.1117/1.JEI.24.5.053027

Abstract

We present an algorithm that simultaneously computes optical flow and estimates illumination change from an image sequence in a unified framework. We propose an energy functional consisting of conventional optical flow energy based on Horn–Schunck method and an additional constraint that is designed to compensate for illumination changes. Any undesirable illumination change that occurs in the imaging procedure in a sequence while the optical flow is being computed is considered a nuisance factor. In contrast to the conventional optical flow algorithm based on Horn–Schunck functional, which assumes the brightness constancy constraint, our algorithm is shown to be robust with respect to temporal illumination changes in the computation of optical flows. An efficient conjugate gradient descent technique is used in the optimization procedure as a numerical scheme. The experimental results obtained from the Middlebury benchmark dataset demonstrate the robustness and the effectiveness of our algorithm. In addition, comparative analysis of our algorithm and Horn–Schunck algorithm is performed on the additional test dataset that is constructed by applying a variety of synthetic bias fields to the original image sequences in the Middlebury benchmark dataset in order to demonstrate that our algorithm outperforms the Horn–Schunck algorithm. The superior performance of the proposed method is observed in terms of both qualitative visualizations and quantitative accuracy errors when compared to Horn–Schunck optical flow algorithm that easily yields poor results in the presence of small illumination changes leading to violation of the brightness constancy constraint.

Citation Download Citation

Ja-Keoung Koo, Hyo-Hun Kim, and Byung-Woo Hong "Joint estimation of motion and illumination change in a sequence of images," Journal of Electronic Imaging 24(5), 053027 (15 October 2015). https://doi.org/10.1117/1.JEI.24.5.053027

Published: 15 October 2015

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE