+1 Recommend
1 collections
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      Multi-video Supervisory Target Tracking Improved by Interactive On-line Learning


      , , , ,

      Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI)

      Human Computer Interaction Conference

      4 - 6 July 2018

      Interactive learning, eye-tracker, target tracking, TLD



            It is difficult for a human operator to monitor multiple video streams in real-time surveillance tasks. A variety of machine learning algorithms have been proposed for target tracking, but human intervention is still necessary because the algorithms have limitations to detect and recover from tracking failures. In this paper, we propose a supervisory target tracking method for multi-video surveillance tasks based on hTLD (human-in-the-loop Tracking-Learning-Detection). The human operator can monitor both the original video streams and the calculated confidence values of the tracking results. Human intervention allows to update the training data for TLD whenever a tracking failure is observed, by manually drawing a bounding box or using an eye-tracker to relocate the target. Meanwhile, an interactive on-line learning algorithm is used to learn the relations between the confidence values and the tracking results. In this way, the confidence values help avoid unnecessary intervention caused by false alarms of tracking failures. Experimental results have demonstrated that the proposed method can reduce the task completion time.


            Author and article information

            July 2018
            July 2018
            : 1-5
            [0001]College of Intelligent Systems, National University of Defense Technology

            De Ya Lu 109, Changsha, Hu’nan, China, 410073
            © Wang et al. Published by BCS Learning and Development Ltd. Proceedings of British HCI 2018. Belfast, UK.

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            Proceedings of the 32nd International BCS Human Computer Interaction Conference
            Belfast, UK
            4 - 6 July 2018
            Electronic Workshops in Computing (eWiC)
            Human Computer Interaction Conference
            Product Information: 1477-9358BCS Learning & Development
            Self URI (journal page): https://ewic.bcs.org/
            Electronic Workshops in Computing


            1. 2017 Study on the electrical devices detection in UAV images based on region based convolutional neural networks Journal of Geo-information Science 19 2 256 263

            2. 2017 Aerial Image Location of Unmanned Aerial Vehicle Based on YOLO v2 Laser&Optoelectronics Progress 11 95 104

            3. 2013 A coarse-to-fine approach for vehicles detection from aerial images International Conference on Computer Vision in Remote Sensing 21 221 225

            4. 2012 Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks IEEE Transactions on Image Processing 21 4 2152 2159

            5. 2000 A system for video surveillance and monitoring 59 5 329 337

            6. 2012 Adaptive multicue background subtraction for robust vehicle counting and classification IEEE Transactions on Intelligent Transportation Systems 13 2 527 540

            7. 2013 Video Object Tracking in the Compressed Domain Using Spatio-Temporal Markov Random Fields IEEE Press

            8. 2018 hTLD? A Human-in-the-loop Target Detection and Tracking Method for UAV IEEE/CSAA Guidance, Navigation and Control Conference To appear

            9. 2017 Human machine collaborative support scheduling system of intelligence information from multiple unmanned aerial vehicles based on eye tracker Journal of Shanghai Jiaotong University 22.3 322 328

            10. 1981 An iterative image registration technique with an application to stereo vision International Joint Conference on Artificial Intelligence 2 674 679

            11. 2012 Tracking-learning-detection IEEE transactions on pattern analysis and machine intelligence 34 7 1409 1422

            12. 2010 PN learning: Bootstrapping binary classifiers by structural constraints Computer Vision and Pattern Recognition 49 56 238 49 56

            13. 1979 A K-Means Clustering Algorithm Appl Stat 28 1 100 108


            Comment on this article