• Laser & Optoelectronics Progress
  • Vol. 59, Issue 14, 1415007 (2022)
Xingsheng Liu1,†, Anhu Li†,*, Zhaojun Deng, and Hao Chen
Author Affiliations
  • School of Mechanical Engineering, Tongji University, Shanghai 201804, China
  • show less
    DOI: 10.3788/LOP202259.1415007 Cite this Article Set citation alerts
    Xingsheng Liu, Anhu Li, Zhaojun Deng, Hao Chen. Advances in Three-Dimensional Imaging Technologies Based on Single-Camera Stereo Vision[J]. Laser & Optoelectronics Progress, 2022, 59(14): 1415007 Copy Citation Text show less
    References

    [1] Pérez L, Rodríguez Í, Rodríguez N et al. Robot guidance using machine vision techniques in industrial environments: a comparative review[J]. Sensors, 16, 335(2016).

    [2] Yin S B, Ren Y J, Liu T et al. Review on application of machine vision in modern automobile manufacturing[J]. Acta Optica Sinica, 38, 0815001(2018).

    [3] Lu R S, Shi Y Q, Hu H B. Review of three-dimensional imaging techniques for robotic vision[J]. Laser & Optoelectronics Progress, 57, 040001(2020).

    [4] Geng J. Structured-light 3D surface imaging: a tutorial[J]. Advances in Optics and Photonics, 3, 128-160(2011).

    [5] Guo W B, Zhang Q C, Wu Z J. Real-time three-dimensional imaging technique based on phase-shift fringe analysis: a review[J]. Laser & Optoelectronics Progress, 58, 0800001(2021).

    [6] Liu L, Xi D D, Chen Z J et al. Three-dimensional shape measurement based on hybrid dual-frequency fringe projection[J]. Laser & Optoelectronics Progress, 58, 1212001(2021).

    [7] Wang J H, Lu R S, Liu D M. Adaptive fringe projection measurement method for high dynamic range surface[J]. Acta Optica Sinica, 41, 1912001(2021).

    [8] Zhang H H, Li Y, Zhang Q C. Dynamic 3D shape measurement based on rotating grating projection[J]. Acta Optica Sinica, 41, 2312005(2021).

    [9] Salinas C, Montes H, Fernandez G et al. Catadioptric panoramic stereovision for humanoid robots[J]. Robotica, 30, 799-811(2012).

    [10] Liu Y, Ge Z D, Yuan Y T et al. Wing deformation measurement using the stereo-vision methods in the presence of camera movements[J]. Aerospace Science and Technology, 119, 107161(2021).

    [11] Shu A, Pei H D, Duan H X. Trinocular stereo visual measurement method for spatial non-cooperative target[J]. Acta Optica Sinica, 41, 0615001(2021).

    [12] Kaczmarek A L. 3D vision system for a robotic arm based on equal baseline camera array[J]. Journal of Intelligent & Robotic Systems, 99, 13-28(2020).

    [13] Yin Y K, Yu K, Yu C Z et al. 3D imaging using geometric light field: a review[J]. Chinese Journal of Lasers, 48, 1209001(2021).

    [14] Yu Q F, Shang Y[M]. Videometrics: principles and researches(2009).

    [15] Davies E R[M]. Computer vision: principles, algorithms, applications, learning(2017).

    [16] Zhang J X, Han M H, Dai Y. Three-dimensional porous structure reconstruction for low-resolution monocular endoscopic images[J]. Optics and Precision Engineering, 28, 2085-2095(2020).

    [17] Martínez-Corral M, Javidi B. Fundamentals of 3D imaging and displays: a tutorial on integral imaging, light-field, and plenoptic systems[J]. Advances in Optics and Photonics, 10, 512-566(2018).

    [18] Pan B, Yu L P, Zhang Q B. Review of single-camera stereo-digital image correlation techniques for full-field 3D shape and deformation measurement[J]. Science China Technological Sciences, 61, 2-20(2018).

    [19] Fu K, Peng J S, He Q W et al. Single image 3D object reconstruction based on deep learning: a review[J]. Multimedia Tools and Applications, 80, 463-498(2021).

    [20] Zhang R, Tsai P S, Cryer J E et al. Shape-from-shading: a survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 690-706(1999).

    [21] Wöhler C, d’Angelo P, Krüger L et al. Monocular 3D scene reconstruction at absolute scale[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 64, 529-540(2009).

    [22] Bao X M, Bai C. Overview of monocular 3D reconstruction techniques[J]. Intelligent Computer and Applications, 10, 49-52(2020).

    [23] Hartley R, Zisserman A[M]. Multiple view geometry in computer vision(2004).

    [24] Li Z L. A research of 3D reconstruction technology based on multiple view geometry[D](2020).

    [25] Wu Z Z, Kou Z. 3D reconstruction of scene based on monocular multi-view image[J]. Optics & Optoelectronic Technology, 18, 51-56(2020).

    [26] Wei G Q, Ma S D. Implicit and explicit camera calibration: theory and experiments[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16, 469-480(1994).

    [27] Zhou F Q, Cui Y, Peng B et al. A novel optimization method of camera parameters used for vision measurement[J]. Optics & Laser Technology, 44, 1840-1849(2012).

    [28] Li Y, Chen X W, Wang Y et al. Progress in deep learning based monocular image depth estimation[J]. Laser & Optoelectronics Progress, 56, 190001(2019).

    [29] Özyeşil O, Voroninski V, Basri R et al. A survey of structure from motion[J]. Acta Numerica, 26, 305-364(2017).

    [30] Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 60, 91-110(2004).

    [31] Snavely N, Seitz S M, Szeliski R. Photo tourism: exploring photo collections in 3D[J]. ACM Transactions on Graphics, 25, 835-846(2006).

    [32] Özyeşil O, Singer A. Robust camera location estimation by convex programming[C], 2674-2683(2015).

    [33] Zhu S Y, Zhang R Z, Zhou L et al. Very large-scale global SfM by distributed motion averaging[C], 4568-4577(2018).

    [34] Bay H, Ess A, Tuytelaars T et al. Speeded-up robust features (SURF)[J]. Computer Vision and Image Understanding, 110, 346-359(2008).

    [35] Fan B, Kong Q Q, Wang X C et al. A performance evaluation of local features for image-based 3D reconstruction[J]. IEEE Transactions on Image Processing, 28, 4774-4789(2019).

    [36] Hartley R, Trumpf J, Dai Y C et al. Rotation averaging[J]. International Journal of Computer Vision, 103, 267-305(2013).

    [37] Zach C, Klopschitz M, Pollefeys M. Disambiguating visual relations using loop constraints[C], 1426-1433(2010).

    [38] Tron R, Zhou X W, Daniilidis K. A survey on rotation optimization in structure from motion[C], 1032-1040(2016).

    [39] Hand P, Lee C, Voroninski V. ShapeFit: exact location recovery from corrupted pairwise directions[J]. Communications on Pure and Applied Mathematics, 71, 3-50(2018).

    [40] Govindu V M. Lie-algebraic averaging for globally consistent motion estimation[C], 684-691(2004).

    [41] Arrigoni F, Fusiello A, Rossi B. Camera motion from group synchronization[C], 546-555(2016).

    [42] Havlena M, Torii A, Pajdla T. Efficient structure from motion by graph optimization[M]. Daniilidis K, Maragos P, Paragios N. Computer Vision-ECCV 2010, 6312, 100-113(2010).

    [43] Ge K L, Hu H, Feng J J et al. Depth estimation using a sliding camera[J]. IEEE Transactions on Image Processing, 25, 726-739(2016).

    [44] Agarwal S, Snavely N, Simon I et al. Building Rome in a day[C], 72-79(2009).

    [45] Jiang S, Jiang C, Jiang W S. Efficient structure from motion for large-scale UAV images: a review and a comparison of SfM tools[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 167, 230-251(2020).

    [46] Goldstein T, Hand P, Lee C et al. ShapeFit and ShapeKick for robust, scalable structure from motion[M]. Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016, 9911, 289-304(2016).

    [47] Lippmann G. Épreuves réversibles donnant la sensation du relief[J]. Journal De Physique Théorique et Appliquée, 7, 821-825(1908).

    [48] Davies N, McCormick M, Yang L. Three-dimensional imaging systems: a new development[J]. Applied Optics, 27, 4520-4528(1988).

    [49] Arimoto H, Javidi B. Integral three-dimensional imaging with digital reconstruction[J]. Optics Letters, 26, 157-159(2001).

    [50] Xiao X, Javidi B, Martinez-Corral M et al. Advances in three-dimensional integral imaging: sensing, display, and applications[J]. Applied Optics, 52, 546-560(2013).

    [51] Yoo H. Axially moving a lenslet array for high-resolution 3D images in computational integral imaging[J]. Optics Express, 21, 8873-8878(2013).

    [52] Xing Y, Xiong Z L, Zhao M et al. Real-time integral imaging pickup system using camera array[J]. Proceedings of SPIE, 10556, 105560D(2018).

    [53] Schulein R, DaneshPanah M, Javidi B. 3D imaging with axially distributed sensing[J]. Optics Letters, 34, 2012-2014(2009).

    [54] Xiao X, Javidi B. Axially distributed sensing for three-dimensional imaging with unknown sensor positions[J]. Optics Letters, 36, 1086-1088(2011).

    [55] Cho M, Javidi B. Three-dimensional photon counting axially distributed image sensing[J]. Journal of Display Technology, 9, 56-62(2013).

    [56] Piao Y R, Zhang M, Shin D et al. Three-dimensional imaging and visualization using off-axially distributed image sensing[J]. Optics Letters, 38, 3162-3164(2013).

    [57] Zhang M, Piao Y R, Kim N W et al. Distortion-free wide-angle 3D imaging and visualization using off-axially distributed image sensing[J]. Optics Letters, 39, 4212-4214(2014).

    [58] Piao Y R, Qu H J, Zhang M et al. Three-dimensional integral imaging display system via off-axially distributed image sensing[J]. Optics and Lasers in Engineering, 85, 18-23(2016).

    [59] Shin D, Javidi B. Three-dimensional integral imaging with improved visualization using subpixel optical ray sensing[J]. Optics Letters, 37, 2130-2132(2012).

    [60] Zhang M, Zhong Z L, Piao Y R et al. Three-dimensional integral imaging with circular non-uniform distribution[J]. Optics and Lasers in Engineering, 126, 105912(2020).

    [61] Zhou F Q, Wang Y X, Chai X H et al. Review on precise measurement technology based on mirror binocular vision[J]. Acta Optica Sinica, 38, 0815003(2018).

    [62] Zhang Z Y, Tsui H T. 3D reconstruction from a single view of an object and its image in a plane mirror[C], 1174-1176(1998).

    [63] Feng X F, Pan D F. Research on the application of single camera stereo vision sensor in three-dimensional point measurement[J]. Journal of Modern Optics, 62, 1204-1210(2015).

    [64] Gluckman J, Nayar S K. Catadioptric stereo using planar mirrors[J]. International Journal of Computer Vision, 44, 65-79(2001).

    [65] Ying X H, Peng K, Hou Y B et al. Self-calibration of catadioptric camera with two planar mirrors from silhouettes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1206-1220(2013).

    [66] Gluckman J, Nayar S K. Rectified catadioptric stereo sensors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 224-236(2002).

    [67] Pachidis T P, Lygouras J N. Pseudostereo-vision system: a monocular stereo-vision system as a sensor for real-time robot applications[J]. IEEE Transactions on Instrumentation and Measurement, 56, 2547-2560(2007).

    [68] Inaba M, Hara T, Inoue H. A stereo viewer based on a single camera with view-control mechanisms[C], 1857-1865(1993).

    [69] Zhou F Q, Chai X H, Chen X et al. Omnidirectional stereo vision sensor based on single camera and catoptric system[J]. Applied Optics, 55, 6813-6820(2016).

    [70] Ng W B, Zhang Y. Stereoscopic imaging and reconstruction of the 3D geometry of flame surfaces[J]. Experiments in Fluids, 34, 484-493(2003).

    [71] Xue T, Qu L Q, Wu B. Matching and 3-D reconstruction of multibubbles based on virtual stereo vision[J]. IEEE Transactions on Instrumentation and Measurement, 63, 1639-1647(2014).

    [72] Pan B, Yu L P, Yang Y Q et al. Full-field transient 3D deformation measurement of 3D braided composite panels during ballistic impact using single-camera high-speed stereo-digital image correlation[J]. Composite Structures, 157, 25-32(2016).

    [73] Yu L P, Pan B. Single-camera high-speed stereo-digital image correlation for full-field vibration measurement[J]. Mechanical Systems and Signal Processing, 94, 374-383(2017).

    [74] Hu S P, Matsumoto Y, Takaki T et al. Monocular stereo measurement using high-speed catadioptric tracking[J]. Sensors, 17, 1839(2017).

    [75] Yagi Y, Yachida M. Real-time omnidirectional image sensors[J]. International Journal of Computer Vision, 58, 173-207(2004).

    [76] Southwell D, Basu A, Fiala M et al. Panoramic stereo[C], 378-382(1996).

    [77] Jang G, Kim S, Kweon I. Single-camera panoramic stereo system with single-viewpoint optics[J]. Optics Letters, 31, 41-43(2006).

    [78] Li W M, Li Y F. Single-camera panoramic stereo imaging system with a fisheye lens and a convex mirror[J]. Optics Express, 19, 5855-5867(2011).

    [79] Chen S Y, Xiang Z Y, Zou N et al. Multi-stereo 3D reconstruction with a single-camera multi-mirror catadioptric system[J]. Measurement Science and Technology, 31, 015102(2020).

    [80] Lee D, Kweon I. A novel stereo camera system by a biprism[J]. IEEE Transactions on Robotics and Automation, 16, 528-541(2000).

    [81] Lim K B, Xiao Y. Virtual stereovision system: new understanding on single-lens stereovision using a biprism[J]. Journal of Electronic Imaging, 14, 043020(2005).

    [82] Wu L F, Zhu J G, Xie H M. A modified virtual point model of the 3D DIC technique using a single camera and a bi-prism[J]. Measurement Science and Technology, 25, 115008(2014).

    [83] Cui X Y, Zhao Y, Lim K B et al. Perspective projection model for prism-based stereovision[J]. Optics Express, 23, 27542-27557(2015).

    [84] Lim K B, Qian B B. Biprism distortion modeling and calibration for a single-lens stereovision system[J]. Journal of the Optical Society of America A, 33, 2213-2224(2016).

    [85] Cui X Y, Fan H Y, Chen H S et al. Epipolar geometry for prism-based single-lens stereovision[J]. Machine Vision and Applications, 28, 313-326(2017).

    [86] Kuznetsov A O, Gorevoy A V, Machikhin A S. Image rectification for prism-based stereoscopic optical systems[J]. Computer Vision and Image Understanding, 182, 30-37(2019).

    [87] Chen C Y, Yang T T, Sun W S. Optics system design applying a micro-prism array of a single lens stereo image pair[J]. Optics Express, 16, 15495-15505(2008).

    [88] Deng Q L, Chen C Y, Cheng S W et al. Micro-prism type single-lens 3D aircraft telescope system[J]. Optics Communications, 285, 5001-5007(2012).

    [89] Yang S P, Kim J J, Jang K W et al. Compact stereo endoscopic camera using microprism arrays[J]. Optics Letters, 41, 1285-1288(2016).

    [90] Sun W S, Tien C L, Chu P Y et al. Optimization design of a stereo-photographic system based on achromatic double-prism arrays[J]. Applied Optics, 57, 8034-8043(2018).

    [91] Gao C Y, Ahuja N. Single camera stereo using planar parallel plate[C], 108-111(2004).

    [92] Gao C Y, Ahuja N. A refractive camera for acquiring stereo and super-resolution images[C], 2316-2323(2006).

    [93] Jang K W, Yang S P, Baek S H et al. Electrothermal MEMS parallel plate rotation for single-imager stereoscopic endoscopes[J]. Optics Express, 24, 9667-9672(2016).

    [94] Baek S H, Kim M H. Stereo fusion: combining refractive and binocular disparity[J]. Computer Vision and Image Understanding, 146, 52-66(2016).

    [95] Li A H, Liu X S, Zhao Z S. Compact three-dimensional computational imaging using a dynamic virtual camera[J]. Optics Letters, 45, 3801-3804(2020).

    [96] Li A H, Zhong S Z. Calibration method of Risley-prism imaging system[J]. Optics Communications, 459, 124975(2020).

    [97] Liu X S, Li A H. Multiview three-dimensional imaging using a Risley-prism-based spatially adaptive virtual camera field[J]. Applied Optics, 61, 3619-3629(2022).

    [98] Trivi M, Rabal H J. Stereoscopic uses of diffraction gratings[J]. Applied Optics, 27, 1007-1009(1988).

    [99] Henao R, Medina F, Rabal H J et al. Three-dimensional speckle measurements with a diffraction grating[J]. Applied Optics, 32, 726-729(1993).

    [100] Pan B, Ma L J, Xia Y. A novel technique for measuring 3D deformation of adhesively bonded single lap joint[J]. Science China Physics, Mechanics & Astronomy, 59, 614601(2015).

    [101] Xia S M, Pan Z P, Zhang J W. Optical microscope for three-dimensional surface displacement and shape measurements at the microscale[J]. Optics Letters, 39, 4267-4270(2014).

    [102] Nickerson E K, Berke R B. Ultraviolet diffraction assisted image correlation (UV-DAIC) for single-camera 3D strain measurement at extreme temperatures[J]. Experimental Mechanics, 58, 885-892(2018).

    [103] Ser J I, Jang J Y, Cha S et al. Applicability of diffraction grating to parallax image array generation in integral imaging[J]. Applied Optics, 49, 2429-2433(2010).

    [104] Jang J Y, Ser J I, Kim E S. Wave-optical analysis of parallax-image generation based on multiple diffraction gratings[J]. Optics Letters, 38, 1835-1837(2013).

    [105] Jang J Y, Yoo H. Computational reconstruction for three-dimensional imaging via a diffraction grating[J]. Optics Express, 27, 27820-27830(2019).

    [106] Jang J Y, Yoo H. Computational three-dimensional imaging system via diffraction grating imaging with multiple wavelengths[J]. Sensors, 21, 6928(2021).

    [107] Shi Y Q, Chang C X, Liu X H et al. Calibration methods and progress for internal and external parameters of area-array camera[J]. Laser & Optoelectronics Progress, 58, 2400001(2021).

    [108] Chen C, Yang F L, Pan B. Model-free method for intrinsic camera parameters calibration and lens distortion correction[J]. Optical Engineering, 60, 104102(2021).

    [109] Zhou F Q, Wang Y X, Peng B et al. A novel way of understanding for calibrating stereo vision sensor constructed by a single camera and mirrors[J]. Measurement, 46, 1147-1160(2013).

    [110] Li X, Li W, Ma X et al. Spatial light path analysis and calibration of four-mirror-based monocular stereo vision[J]. Optics Express, 29, 31249-31269(2021).

    [111] Marcato J,, Tommaselli A M G, Moraes M V A. Calibration of a catadioptric omnidirectional vision system with conic mirror[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 113, 97-105(2016).

    [112] Genovese K, Casaletto L, Rayas J A et al. Stereo-Digital Image Correlation (DIC) measurements with a single camera using a biprism[J]. Optics and Lasers in Engineering, 51, 278-285(2013).

    [113] Wu L F, Zhu J G, Xie H M et al. An accurate method for shape retrieval and displacement measurement using Bi-prism-based single lens 3D digital image correlation[J]. Experimental Mechanics, 56, 1611-1624(2016).

    [114] Cui X Y, Lim K B, Zhao Y et al. Single-lens stereovision system using a prism: position estimation of a multi-ocular prism[J]. Journal of the Optical Society of America A, 31, 1074-1082(2014).

    [115] Gorevoy A V, Machikhin A S, Khokhlov D D et al. Optimization of prism-based stereoscopic imaging systems at the optical design stage with respect to required 3D measurement accuracy[J]. Optics Express, 28, 24418-24430(2020).

    [116] Liu X S, Li A H. An integrated calibration technique for variable-boresight three-dimensional imaging system[J]. Optics and Lasers in Engineering, 153, 107005(2022).

    [117] Zuo C, Feng S J, Zhang X Y et al. Deep learning based computational imaging: status, challenges, and future[J]. Acta Optica Sinica, 40, 0111003(2020).

    Xingsheng Liu, Anhu Li, Zhaojun Deng, Hao Chen. Advances in Three-Dimensional Imaging Technologies Based on Single-Camera Stereo Vision[J]. Laser & Optoelectronics Progress, 2022, 59(14): 1415007
    Download Citation