"The aim of SAMURAI is to develop and integrate an innovative intelligent surveillance system for robust monitoring of both inside and surrounding areas of a critical public infrastructure site. SAMURAI has three significant novelties that make it distinctive from other recent and ongoing relevant activities both in the EU and elsewhere: *SAMURAI is to employ networked heterogeneous sensors rather than CCTV cameras alone so that multiple complementary sources of information can be fused to create a visualisation of a more complete ‘big picture’ of a crowded public space. *Existing systems focus on analysing recorded video using pre-defined hard rules, suffering from unacceptable false alarms. SAMURAI is to develop a real-time adaptive behaviour profiling and abnormality detection system for alarm event alert and prediction with much reduced false alarm. *In addition to fix-positioned CCTV cameras, the SAMURAI system will also take command input from control room operators and mobile sensory input for patrolling security staff for a hybrid context-aware based abnormal behaviour recognition. This is in contrary to current video behaviour recognition system that relies purely on information extracted from the video data, often too ambiguous to be effective. SAMURAI has the following scientific objectives: 1. Develop innovative tools and systems for people, vehicle and luggage detection, tracking, type categorisation across a network of cameras under real world conditions. 2. Develop an abnormal behaviour detection system based on a heterogeneous sensor network consisting of both fix-positioned CCTV cameras and mobile wearable cameras with audio and positioning sensors. These networked heterogeneous sensors will function cooperatively to provide enhanced situation awarenes. 3. Develop innovative tools using multi-modal data fusion and visualisation of heterogeneous sensor input to enable more effective control room operator queries."