research-article

Object detection and matching in a mixed network of fixed and mobile cameras

Authors:

Alexandre Alahi,

Pierre Vandergheynst,

Michel Bierlaire,

Murat KuntAuthors Info & Claims

AREA '08: Proceedings of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams

Pages 9 - 16

https://doi.org/10.1145/1463542.1463545

Published: 31 October 2008 Publication History

Abstract

This work tackles the challenge of detecting and matching objects in scenes observed simultaneously by fixed and mobile cameras. No calibration between the cameras is needed, and no training data is used. A fully automated system is presented to detect if an object, observed by a fixed camera, is seen by a mobile camera and where it is localized in its image plane. Only the observations from the fixed camera are used.

An object descriptor based on grids of region descriptors is used in a cascade manner. Fixed and mobile cameras collaborate to confirm detection. Detected regions in the mobile camera are validated by analyzing the dual problem: analyzing their corresponding most similar regions in the fixed camera to check if they coincide with the object of interest.

Experiments show that objects are successfully detected even if the cameras have significant change in image quality, illumination, and viewpoint. Qualitative and quantitative results are presented in indoor and outdoor urban scenes.

References

[1]

A. Alahi, M. Bierlaire, and M. Kunt. Object matching with mobile cameras collaborating with fixed cameras. In Submitted to the Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications at ECCV, 2008.

[2]

A. Alahi, D. Marimon, M. Bierlaire, and M. Kunt. A master-slave approach for object detection and matching with fixed and mobile cameras. In Accepted IEEE Int. Conf. on Image Processing (ICIP), San Diego, CA, USA, 2008.

[3]

M. Bertozzi, A. Broggi, R. Chapuis, F. Chausse, A. Fascioli, and A. Tibaldi. Shape-based pedestrian detection and localization. In Procs. IEEE Intl. Conf. on Intelligent Transportation Systems 2003, pages 328--333, Shangai, China, Oct. 2003.

[4]

A. Broggi, M. Bertozzi, A. Fascioli, and M. Sechi. Shape-based pedestrian detection. Proc. IEEE Intelligent Vehicles Symp, pages 215--200, 2000.

[5]

Y. Caspi, D. Simakov, and M. Irani. Feature-based sequence-to-sequence matching. 68(1):53--64, June 2006.

Digital Library

[6]

N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. pages I: 886--893, 2005.

Digital Library

[7]

F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua. Multi-camera people tracking with a probabilistic occupancy map. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007.

Digital Library

[8]

W. Forstner and B. Moonen. A metric for covariance matrices. Qua vadis geodesia, pages 113--128, 1999.

[9]

D. Gavrila. Pedestrian detection from a moving vehicle. pages II: 37--49, 2000.

Digital Library

[10]

D. Gavrila and V. Philomin. Real-time object detection for 'smart' vehicles. pages 87--93.

[11]

S. Khan and M. Shah. A multiview approach to tracking people in crowded scenes using a planar homography constraint. pages IV: 133--146, 2006.

[12]

B. Leibe, N. Cornelis, K. Cornelis, L. Van Gool, and E. Zurich. Dynamic 3D Scene Analysis from a Moving Vehicle. CVPR'07, 2007.

[13]

K. Mueller, A. Smolic, M. Droese, P. Voigt, and T. Wienand. Multi-texture modeling of 3d traffic scenes. icme, 2:657--660, 2003.

Digital Library

[14]

M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, and T. Poggio. Pedestrian detection using wavelet templates. Proc. Computer Vision and Pattern Recognition, 97:193--199, 1997.

Digital Library

[15]

C. Papageorgiou and T. Poggio. Trainable pedestrian detection. Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on, 4, 1999.

[16]

F. Porikli, O. Tuzel, and P. Meer. Covariance Tracking using Model Update Based on Lie Algebra. IEEE Conf. on Computer Vision and Pattern Recognition, 2006.

Digital Library

[17]

A. Shashua, Y. Gdalyahu, and G. Hayun. Pedestrian detection for driving assistance systems: Single-frame classification and system level performance. pages 1--6, 2004.

[18]

F. Suard, A. Rakotomamonjy, A. Bensrhair, and A. Broggi. Pedestrian Detection using Infrared images and Histograms of Oriented Gradients. In Procs. IEEE Intelligent Vehicles Symposium 2006, pages 206--212, Tokyo, Japan, June 2006.

[19]

O. Tuzel, F. Porikli, and P. Meer. Region covariance: A fast descriptor for detection and classification. Proc. 9th European Conf. on Computer Vision, 2006.

Digital Library

[20]

O. Tuzel, F. Porikli, and P. Meer. Human Detection via Classification on Riemannian Manifolds. Proc. CVPR, pages 1--8, 2007.

Cited By

Coates ANg A(2010)Multi-camera object detection for robotics2010 IEEE International Conference on Robotics and Automation10.1109/ROBOT.2010.5509644(412-419)Online publication date: May-2010
https://doi.org/10.1109/ROBOT.2010.5509644
Alahi AVandergheynst PBierlaire MKunt M(2010)Cascade of descriptors to detect and track objects across any network of camerasComputer Vision and Image Understanding10.1016/j.cviu.2010.01.004114:6(624-640)Online publication date: 1-Jun-2010
https://dl.acm.org/doi/10.1016/j.cviu.2010.01.004

Index Terms

Object detection and matching in a mixed network of fixed and mobile cameras
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding

Recommendations

Cascade of descriptors to detect and track objects across any network of cameras

Most multi-camera systems assume a well structured environment to detect and track objects across cameras. Cameras need to be fixed and calibrated, or only objects within a training data can be detected (e.g. pedestrians only). In this work, a master-...
Object Matching Across Multiple Cameras Based on Combination of SIFT and the Rotation Invariant LBP
ICEICE '12: Proceedings of the 2012 Second International Conference on Electric Information and Control Engineering - Volume 01

SIFT (scale invariant feature transform) is one of the most robust and the widely used image matching algorithms based on local features. It has been used in the aspect of the cameras target matching. For its high complexity, this paper proposes a ...
Robust object tracking via multi-cue fusion

A long-term object tracking method based on calibrated binocular cameras by fusing information of the two channels and binocular geometry constraints is proposed.The stereo filter which is built based on the epipolar geometry of the binocular cameras is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AREA '08: Proceedings of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams

October 2008

132 pages

ISBN:9781605583181

DOI:10.1145/1463542

General Chairs:
Anastasios Doulamis
Technical University of Crete, Greece
,
Luc van Gool
Eidgenoessische Technische Hochschule Zuerich, Switzerland
,
Mark Nixon
University of Southampton, United Kingdom
,
Theodora Varvarigou
National Technical University of Athens, Greece
,
Nikolaos Doulamis
National Technical University of Athens, Greece
,
Program Chair:
Manolis Sardis
Aegean University, Greece

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 31, 2008

British Columbia, Vancouver, Canada

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
293
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Coates ANg A(2010)Multi-camera object detection for robotics2010 IEEE International Conference on Robotics and Automation10.1109/ROBOT.2010.5509644(412-419)Online publication date: May-2010
https://doi.org/10.1109/ROBOT.2010.5509644
Alahi AVandergheynst PBierlaire MKunt M(2010)Cascade of descriptors to detect and track objects across any network of camerasComputer Vision and Image Understanding10.1016/j.cviu.2010.01.004114:6(624-640)Online publication date: 1-Jun-2010
https://dl.acm.org/doi/10.1016/j.cviu.2010.01.004

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents