Video Surveillance
We may use the following categorization of topics in video surveillance, similar to this image. Some topics are of particular interest, such as camera calibration, synchronizing multiple cameras, tracking objects in video and event/action recognition. We will also review the competitions and methods in the celebrated Trecvid benchmark.
| perspective | categorization
|
| camera type | single image
|
| video from fixed camera
|
| video from moving camera
|
| video from multiple cameras
|
| level of processing | low-level processing: motion segmentation, region segmentation, edge features etc
|
| detection
|
| tracking
|
| activity recognition
|
Calibration
| Author/Date/Source | Title | Content | Project page
|
| F. Lv et. al. PAMI 2006 pdf | Camera Calibration from Video of a Walking Human | A self-calibration method to estimate a camera's intrinsic/extrinsic parameters from vertical line segments of the same height. Proposes an algorithm to obtain the needed line segments by detecting the head and feet positions of a walking human in his leg-crossing phases is described. Experimental results show robust results under various viewing angles and different subjects. | N.A
|
| Xu, R et. al. ICPR 2008 pdf | A Computer Vision Based Camera Pedestal's Vertical Motion Control | Proposes an automatic procedure mimicking the human camera operator. Experiments to control the vertical motion of a pedestal by leveling its position with a human head or a tracked hand-held object. | N.A
|
Single-camera tracking
Benchmarks
| Author/Date/Source | Title | Content | Project page
|
| R. Collins et. al. PETS'05 pdf | An Open Source Tracking Testbed and Evaluation Web Site | Implemented a GUI testbed (openCV based) for tracking objects (e.g., car) in video. The source code and data seem to be private. | html
|
Multi-camera tracking
News!. NIST recently posted a Multi-camera tracking challenge (see this). The challenge will be sponsored in the 6th Advanced Video and Signal Based Surveillance (AVSS) IEEE Conference.
| Author/Date/Source | Title | Content | Project page
|
| K. Kim and L. Davis, ECCV'06 pdf | Multi-camera (multi-view), multi-hypothesis, multy-target segmentation and tracking | An efficient automatic technique for tracking multiple targets from multiple cameras (or views) becomes valuable for law enforcement, military and commercial applications. A multi-view multi-hypothesis approach to segmenting and tracking multiple persons on a ground plane is proposed. The tracking state space is the set of ground points of the people being tracked. During tracking, several iterations of segmentation are performed using information from human appearance models and ground plane homography. | N.A.
|
| J. Berclaz et. al. ECCV'08 pdf | Multi-Camera Tracking and Atypical Motion Detection with Behavioral Maps | A framework dedicated to incident detection based on a multi-camera setup. Goal is two-fold: 1. Processing the output of several cameras in order to handle occlusions among people and their environment and provide us with more robust people detection and tracking strategies; 2. Capturing the motion of a person or a group of people in order to make the interpretation of abnormal behaviors much easier. | video demos
|
| F. Fleure et. al. PAMI'08 pdf | Multi-Camera People Tracking with a Probabilistic Occupancy Map
|
| C. Loy et. al. CVPR'09 pdf | Multi-Camera Activity Correlation Analysis | A novel Cross Canonical Correlation Analysis (xCCA) framework is formulated to detect and quantify temporal and causal relationships between regional activities within and across camera views. The approach accomplishes three tasks: (1) estimate the spatial and temporal topology of the camera network; (2) facilitate more robust and accurate person re-identification; (3) perform global activity modelling and video temporal segmentation by linking visual evidence collected across camera views.
| html
|
Recognition of Actions and Events
| Author/Date/Source | Title | Content | Project page
|
| Y. Ke et. al. ICCV'07 pdf | Event Detection in Cluttered Videos | Explores the use of volumetric features for event detection. Proposes a novel method to correlate spatio-temporal shapes to video clips that have been automatically segmented. The method works on over-segmented videos, and background subtraction is not needed for reliable object segmentation. The project webpage includes a series of work from 05 to 07. | html
|
Space-time manifold.
| Author/Date/Source | Title | Content | Project page
|
| Y. Wexler and D. Simakov, ICCV 2005 pdf | Space-Time Scene Manifolds | A method to cut the space-time volume without incurring visual artifacts or distortions. In the manifold, any small part of it can be seen in some image even though the manifold spans the whole video. Posed as a shortest path in a graph and thus the globally optimum can be found efficiently. It can handle both static and dynamic scenes, with or without parallax. | results and codes
|
Video Retrieval Benchmark
Trecvid is an important benchmark for video surveillance, video retrieval, high-level feature extraction etc. Previously there was also an "shot boundary detection" task that cuts long video into short clips. Trecvid is an annual competition, and a workshop is organized which summarizes submitted methods and results. The publications for Trecvid2008 is can be found here in which 77 teams participated.
Data. The database includes 400 hours of news video, documentary video etc.
General issues on the create datasets in vision domain
Comments on collecting, organizing and distributing LHI data.
Discussion on how to organize benchmarks and what subsets are interesting.
Discussion about the matlab toolbox for the LHI dataset.
We greatly appreciate feedbacks on problems or errors.
|
