| 摘要: |
| 深度图像获取是当前三维视频领域重要的研究课题.微软Kinect传感器可以获取到实时的稠密深度图,但往往在深度图中存在大量的空洞并且获取的深度图不稳定.针对这些问题,提出一种应用高斯混合模型实时修复的算法,首先要把彩色图像和深度图像对齐裁剪,然后通过高斯混合模型(GMM)把深度图像的前景和背景分离,针对不同的区域做不同的处理,对背景空洞做基于背景的填充,前景空洞采用颜色匹配算法进行处理,最后对处理后的深度图像做中值滤波处理去除噪声.实验证明,该算法在复杂前景物体和大面积深度缺失的情况下都可以有效填充深度图像中的大、小空洞,保留了物体边缘,尤其在遮挡物体的深度重建上,可以取得较好的重建效果. |
| 关键词: 深度图像 高斯混合模型 空洞填充 滤波 |
| DOI： |
| 分类号: |
| 基金项目:上海市自然科学基金(15ZR1431500);上海市教委科研创新项目(14ZZ125);上海高校青年教师培养资助计划;新型显示技术及应用集成教育部重点实验室开放课题(P200803) |
|
| Kinect sensor′s depth image enhancement based on gaussian mixture model |
|
LI Shaomin, ZHANG Qian, WANG Pei, CHEN Jiajia, HUANG Jifeng
|
|
College of Information,Mechanical and Electrical Engineering,Shanghai Normal University
|
| Abstract: |
| Depth image acquisition is currently a significant research topic in the field of three-dimensional video processing.The Microsoft′s Kinect sensor can generate a real-time dense depth map.However,there are usually numerous hole artifacts in the depth map which is instable and seriously affects its applications.To solve this problem,in this paper,we present a real-time refinement algorithm for kinect depth map based on Gaussian mixture model.First,we take color image and depth image to be aligned and cropped,then make the foreground and background image separated by GMM,fill the background holes using the background image,apply color matching algorithm for foreground holes.Finally,median filter is used to remove noise.Experimental results show that this method is very effective,for both complex foreground objects and objects with large areas of missing values.Big 〖JP2〗and small holes of depth image are filled, edges are retained,especially good results are achieved in the shade object reconstruction. |
| Key words: depth image gaussian mixture model hole filling filter |
Editorial Board