볼류메트릭 비디오 저작 연구 보고

기술 세부 수학 선형 최적화 기법 (곡면 근사, 뎁스맵 업샘플링을 비롯한 이미지 프로세싱) 레벤버그-마큇 비선형 최적화 기법 (Levenberg-Marquart) 멀티 스레딩 아이코날 방정식 (Eikonal Equation) 솔버 볼류메트릭 비디오 디포메이션 그래프를 이용한 임의의 형태의 디폼 D2Tree와 D2Tree를 활용한 비강체 정합 절단된 부호 거리 함수 (Truncated Signed Distance Function)을 활용한 메시 재구축 AR 업샘플링과 SD 업샘플링을 활용한 뎁스맵 수퍼 샘플링 엔지니어링 Freenect2를 활용, 다수의 키넥트를 이용하는 뎁스 캡처 KINSOL을 활용, Kinect에서 제공하지 않는 뎁스-카메라-컬러 스페이스 간의 좌표 변환 윈도우 미디어 라이브러리를 활용한 H.264 동영상 인코딩 DirectX 메시 라이브러리를 활용한 메시 리덕션

Depth Image Hole Filling and Super Sampling LIU, Soulan; CHEN, Chen; KEHTARNAVAZ, Nasser. A computationally efficient denoising and holefilling method for depth image enhancement. In: Real-Time Image and Video Processing. 2016. p. 98970V. WANG, Shenlong. A Tutorial on Primal-Dual Algorithm. 2016. YANG, Jingyu, et al. Color-guided depth recovery from RGB-D data using an adaptive autoregressive model. IEEE transactions on image processing, 2014, 23.8: 3443-3458. SCHROEDER, Jonatan; GUEDES, A. L. P.; DUARTE JR, Elias P. Computing the minimum cut and maximum flow of undirected graphs. RelatórioTécnico RT-DINF 003/2004, 2004. GRIGORESCU, Cosmin; PETKOV, Nicolai; WESTENBERG, Michel A. Contour detection based on nonclassical receptive field inhibition. IEEE Transactions on Image Processing, 2003, 12.7: 729-739. GREIG, Dorothy M.; PORTEOUS, Bruce T.; SEHEULT, Allan H. Exact maximum a posteriori estimation for binary images. Journal of the Royal Statistical Society. Series B (Methodological), 1989, 271279. BOYKOV, Yuri; VEKSLER, Olga; ZABIH, Ramin. Fast approximate energy minimization via graph cuts. IEEE Transactions on pattern analysis and machine intelligence, 2001, 23.11: 1222-1239.

BARNES, Randal J. Matrix differentiation. Department of Civil Engineering, University of Minnesota, 2014. FORD, Lester R.; FULKERSON, Delbert R. Maximal flow through a network. Canadian journal of Mathematics, 1956, 8.3: 399-404. RUDIN, Leonid I.; OSHER, Stanley; FATEMI, Emad. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena, 1992, 60.1-4: 259-268. BOOKSTEIN, Fred L.. . Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions on pattern analysis and machine intelligence, 1989, 11.6: 567-585. MORDVINTSEV, Alexander. ROF and TV-L1 denoising with primal-dual algorithm. 2013 HAM, Bumsub; CHO, Minsu; PONCE, Jean. Robust image filtering using joint static and dynamic guidance. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015. p. 4823-4831. EBERLY, David. Thin plate splines. Geometric Tools Inc, 2002, 2002: 116. BREDIES, Kristian; KUNISCH, Karl; POCK, Thomas. Total generalized variation. SIAM Journal on Imaging Sciences, 2010, 3.3: 492-526.

Articulated Shape Reconstruction BARAN, Ilya; POPOVIĆ, Jovan. Automatic rigging and animation of 3d characters. In: ACM Transactions on Graphics (TOG). ACM, 2007. p. 72. HIRSHBERG, David A., et al. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In: European Conference on Computer Vision. Springer Berlin Heidelberg, 2012. p. 242-255. BOGO, Federica, et al. Detailed full-body reconstructions of moving people from monocular RGB-D sequences. In: Proceedings of the IEEE International Conference on Computer Vision. 2015. p. 2300-2308. ANGUELOV, Dragomir, et al. Recovering articulated object models from 3D range data. In: Proceedings of the 20th conference on Uncertainty in artificial intelligence. AUAI Press, 2004. p. 18-26. ANGUELOV, Dragomir, et al. SCAPE: shape completion and animation of people. In: ACM Transactions on Graphics (TOG). ACM, 2005. p. 408-416.

Non-Rigid Registration and Fusion LI, Hao, et al. 3D self-portraits. ACM Transactions on Graphics (TOG), 2013, 32.6: 187. NEWCOMBE, Richard A.; FOX, Dieter; SEITZ, Steven M. Dynamicfusion: Reconstruction and tracking of non-rigid scenes in real-time. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2015. p. 343-352. WEISE, Thibaut, et al. Face/off: Live facial puppetry. In: Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer animation. ACM, 2009. p. 7-16. LI, Hao; SUMNER, Robert W.; PAULY, Mark. Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans. In: Computer graphics forum. Blackwell Publishing Ltd, 2008. p. 1421-1430. NEWCOMBE, Richard A., et al. KinectFusion: Real-time dense surface mapping and tracking. In: Mixed and augmented reality (ISMAR), 2011 10th IEEE international symposium on. IEEE, 2011. p. 127-136. Nurit Schwabsky, and Vered Cohen; Project Report, 2013 TAM, Gary KL, et al. Registration of 3D point clouds and meshes: a survey from rigid to nonrigid. IEEE transactions on visualization and computer graphics, 2013, 19.7: 1199-1217. LI, Hao, et al. Robust single-view geometry and motion reconstruction. In: ACM Transactions on Graphics (TOG). ACM, 2009. p. 175. INNMANN, Matthias, et al. Volumedeform: Real-time volumetric non-rigid reconstruction. In: European Conference on Computer Vision. Springer International Publishing, 2016. p. 362-379.

Squared Distance VANCO, Marek. A direct approach for the segmentation of unorganized points and recognition of simple algebraic surfaces. 2002. GOLDMAN, Ron. Curvature formulas for implicit curves and surfaces. Computer Aided Geometric Design, 2005, 22.7: 632-658. EBERLY, David. Distance between point and triangle in 3D. Magic Software, http://www. magicsoftware.com/Documentation/pt3tri3. pdf, 1999. POTTMANN, Helmut; HOFER, Michael. Geometry of the squared distance function to curves and surfaces. In: Visualization and mathematics III. Springer Berlin Heidelberg, 2003. p. 221-242. CHE, Wujun; PAUL, Jean-Claude; ZHANG, Xiaopeng. Lines of curvature and umbilical points for implicit surfaces. Computer Aided Geometric Design, 2007, 24.7: 395-409. NURUNNABI, Abdul; WEST, Geoff; BELTON, David. Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data. Pattern Recognition, 2015, 48.4: 1404-1419. KLASING, Klaas, et al. Comparison of surface normal estimation methods for range sensing applications. In: Robotics and Automation, 2009. ICRA’09. IEEE International Conference on. IEEE, 2009. p. 3206-3211. MITRA, Niloy J., et al. Registration of point cloud data from a geometric optimization perspective. In: Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing. ACM, 2004. p. 2231. LEOPOLDSEDER, Stefan; POTTMANN, Helmut; ZHAO, H. The d2-tree: A hierarchical representation of the squared distance function. Technical Report 101, 2003.

Fitting & Optimization NEALEN, Andrew; DARMSTADT, T. An as-short-as-possible introduction to the least squares, weighted least squares and moving least squares methods for scattered data approximation and interpolation. URL: http://www. nealen. com/projects, 2004, 130.150: 25. LOURAKIS, Manolis IA. A brief description of the Levenberg-Marquardt algorithm implemented by levmar. Foundation of Research and Technology, 2005, 4.1. EBERLY, David. Least squares fitting of data. Chapel Hill, NC: Magic Software, 2000. MADSEN, Kaj; NIELSEN, Hans Bruun; TINGLEFF, Ole. Methods for non-linear least squares problems. 1999. Denmarks Tekniske Universitet; Overhead of ‘02610 Optimization and Data Fitting’ CROEZE, ALFONSO; PITTMAN, LINDSEY; REYNOLDS, WINNIE. Solving nonlinear leastsquares problems with the Gauss-Newton and Levenberg-Marquardt methods. 2012.