People tracking in an environment with multiple depth cameras: A skeleton-based pairwise trajectory matching scheme

NCUIR > College of Electrical Engineering & Computer Science > Department of Communication Engineering > journal & Dissertation > Item 987654321/106045

Please use this identifier to cite or link to this item: https://ir.lib.ncu.edu.tw/handle/987654321/106045

Title:	People tracking in an environment with multiple depth cameras: A skeleton-based pairwise trajectory matching scheme
Authors:	張寶基;Sun, Shih-Wei;Kuo, Chien-Hao;Chang, Pao-Chi
Contributors:	資訊電機學院通訊工程學系
Keywords:	Calibration;Cameras;Construction;Eyes;Fusion;Hand gesture;Matching;Multiple depth cameras;Occlusion;Pairwise;People tracking;Skeleton;Tracking;Tracking (position);Trajectories;Trajectory matching
Date:	2016-02-01
Issue Date:	2026-04-23 13:05:48 (UTC+8)
Publisher:	Academic Press Inc.;Elsevier Inc
Abstract:	摘要： •The hand-gesture-triggered calibration can build the geometry in a region of interest.•The proposed interleaving-based skeleton obtaining can track more people.•The proposed pairwise trajectory matching scheme manages occlusion situations. This paper proposes a pairwise trajectory matching scheme from multiple cameras for people tracking, handling the mistracking situations caused by occlusion events occurred in one of the cameras. In a multiple cameras environment, a geometric calibration process is necessary for the co-plane of the overlapping field of views from different cameras as the initial step. Once the geometry is calibrated, according to the 2D positions of the analyzed foot joints from the depth cameras. Homography transformation is applied to project the detected foot points from different views into a synergistic virtual bird’s eye view for people tracking. At the virtual bird’s eye view, the people tracking results from each of the cameras based on Kalman filter are fused according to the proposed pairwise trajectory matching scheme. The contribution of this paper is trifold: (1) The proposed hand-gesture-triggered calibration process with temporally synchronization capability can effectively build and calibrate the geometry in a region of interest. (2) The proposed interleaving-based skeleton obtaining and moving average based valid skeleton determination can extend the skeleton tracking capability to track more people. (3) The proposed pairwise trajectory matching scheme effectively manages occlusion situations happened in one of the depth cameras. In addition, in the extensive experimental results, the proposed method can track up to six simultaneously freely moving persons in the field of view, with affordable complexity for real-time applications. Furthermore, the infrared-based depth cameras track people satisfactorily from bright to extremely dark environments. 出版者： Elsevier Inc 出版日期： 2016-02 出處： Journal of visual communication and image representation, 2016-02, Vol.35, p.36-54 資源來源： ScienceDirect 版權： 2015 Elsevier Inc. 識別號： ISSN: 1047-3203 識別號： EISSN: 1095-9076 識別號： DOI: 10.1016/j.jvcir.2015.11.012
Appears in Collections:	[Department of Communication Engineering] journal & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	21	View/Open

社群 sharing

Loading...