Sage Journals: Discover world-class research

Abstract

Depth map estimation from a light-field camera is an interesting and challenging problem. Recent works have demonstrated many fascinating results based on different cues in light-field images. According to the characteristics of light-field spatial refocusing, we introduced a confidence -aware depth estimation method on the basis of multiple cues. In this paper, the focus/defocus cue of focal stack is estimated in Discrete Cosine Transform (DCT) domain. Based on photo-consistency metric and relevance analysis, the correspondence cue between different rays of a refocusing pixel is extracted. Then the edge confidence analysis is introduced as the depth and color discontinuity cues. In order to get refined depth map, an iterative graph cut optimization framework with label cost is used to integrate these aforementioned cues with their confidences. Experimental results showed that our method can achieve accurate depth maps, especially in the depth discontinuous areas.

Keywords

Light-field camera depth estimation multiple cues confidence-aware graph cut optimization

Get full access to this article

View all access options for this article.

References

Levoy

Br’edif

Duval

Horowitz

and Hanrahan

, Light field photography with a handheld plenoptic camera, Computer Science Technical Report CSTR 2(9) (2005), 4.

Georgiev

Lumsdaine

and Goma

, Lytro Camera Technology: Theory, Algorithms, Performance Analysis, in Proc. SPIE 8667, Multimedia Content and Mobile Devices, 2013.

Liang

and Ramamoorthi

, A Light Transport Framework for Lenslet Light Field Cameras, ACM Transactions on Graphics, 2015.

Tao

M.W.

Hadap

Malik

and Ramamoorthi

, Depth from Combining Defocus and Correspondence Using Light-Field Cameras, in International Conference on Computer Vision (ICCV), 2013.

Nava

Marichal-Hernndez

and Rodrguez-Ramos

, The discrete focal stack transform, in 16th European Signal Processing Conference (EUSIPCO 2008), 2008.

Georgiev

and Lumsdaine

, Depth of field in plenoptic cameras, in 30th Annual Conference of the European Association for Computer Graphics (EuroGraphics 2009), 2009.

Georgiev

and Lumsdaine

, Reducing plenoptic camera artifacts, Computer Graphics Forum 29(6) (2010), 1955–1968.

Bishop

T.E.

and Favaro

, The light field camera: Extended depth of field, aliasing, and superresolution, IEEE Trans. PatternAnal. Mach. Intell. (PAMI) 34(5) (2012), 972–986.

Perwass

and Wietzke

, Single lens 3d-camera with extended depth-of-field, in Imaging Proceedings Volume 8291, Human Vision and Electronic Imaging XVII; 829108, 2012.

10.

Guo

Ling

Lumsdaine

and Yu

, Line assisted light fleld triangulation and stereo matching, in Proceedings of International Conference on Computer Vision (ICCV), 2013.

11.

Jeon

H.-G.

Park

Choe

Park

Bok

Tai

Y.-W.

and Kweon

, Accurate depth map estimation from a lenslet light field camera, in Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR), 2015.

12.

Lin

Chen

Kang

S.B.

and Yu

, Depth recovery from light field using focal stack symmetry, in Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2015.

13.

Liu

and Zhang

, A new freeform depth of field controlling method based on focused plenoptic camera, Journal of Computational Methods in Science and Engineering 16(2) (2016), 87–195.

14.

and Fang

, Method for measuring target depth by using optical field focusing image, Journal of Computational Methods in Science and Engineering 16(2) (2016), 369–377.

15.

Haghighat

Aghagolzadeh

and Seyedarabi

, Multi-focus Image Fusion for Visual Sensor Networks in DCT Domain, Computers and Electrical Engineering 37(3) (2011), 789–797.

16.

Phamila

and Amutha

, Discrete cosine transform based fusion of multi-focus images for visual sensor networks, Signal Processing 95 (2014), 161–170.

17.

Meer

and Georgescu

, Edge detection with embedded confi-dence, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 23 (2001), 1351–1365.

18.

Comaniciu

and Meer

, Mean shift: a robust approach toward feature space analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (2002), 603–619.

19.

Delong

, Advances in Graph-Cut Optimization: Multi-Surface Models, Label Costs, and Hierarchical Costs, University of Western Ontario, Canada, 2011.

20.

Delong

Osokin

Isack

and Boykov

, Fast Approximate Energy Minimization with Label Costs, International Journal of Computer Vision 96(1) (2012), 1–27.

A confidence-aware depth estimation method for light-field cameras based on multiple cues

Abstract

Keywords

Get full access to this article

References