Parked aircraft monitoring in ToulouseUnloading Front Operation
Bank agency monitoring in Paris for bank attack preventionDisturbing people in a train scenario
Jumping over barrierSubway monitoring Fighting
Subway monitoring
Blocking an exit
Exit zo
ne
Subway monitoring
Activity Monitoring Results
Video Understanding for Activity Monitoring
François Brémond – PULSAR – INRIA – Sophia [email protected]
Keywords: Scene understanding, event recognition, behaviour analysis, multi-sensor fusion, real-time systems, system evaluation, adaptable system
François Brémondhttp://www-sop.inria.fr/pulsar/personnel/Francois.Bremond
75 Papers in international conferences and journals on video understanding available at the web site
12 PhD thesis
KeeneoStart-up (intelligent video surveillance) created in 2005. http://www.keeneo.com
Objective: Real-time Interpretation of videos from pixels to events
Segmentation Classification Scenario RecognitionTracking
3D scene modelScenario models
(A priori Knowledge)
Global approach integrating all video understanding functionalities
Cognitive vision: 4D analysis (3D + temporal analysis) Artificial intelligence: explicit knowledge
Predefined scenario models Context of the 3D environment, camera calibration Model of expected moving objects
Software engineering: Easy generation of dedicated systems Reusable & adaptable platform
Video Understanding Approach
Metadata
* Alarms* Access toforbidden area
Dissemination
Opposite direction in a demonstrationCrowd behaviorSubway
monitoring
Extract and structure knowledge (invariants & models) for Perception for video understanding
People detection (posture and gesture recognition) using background subtraction and feature computation (e.g. Haar, HOG)
Maintenance of the 3D coherency throughout time Short/long term tracker, crowd tracker Sensor information fusion
Event recognition Predefined models based on an ontology Learnt primitive and composite events
Evaluation, control and learning Evaluation framework Adaptation to dynamic environment Offline clustering, data mining
Control access in Paris subway
Tailgating detection Elderly monitoring Eating in the living
room Elderly monitoring Fainting
25 projects in safety/security:• 7 European projects: Esprit, ITEA, FP6, FP7: PASSWORDS, ADVISOR, AVITRACK, SERKET, CARETAKER, CANTATA, COFRIEND• 1 DARPA: VSAM• 10 French projects: ANR, DGE, Prédit, TechnoVision, PACA, CG06• 7 industrial research contracts: Bull, Vigitec, SNCF, RATP, ALSTOM, STMicroElectronics, Thales
Vandalism against vending machine
