Author Archives: admin

Magenta SRL and MICC demo at ICIAP 2011

Magenta SRL and MICC participated at the 16th edition of the International Conference on Image Analysis and Processing (ICIAP 2011) with a live demo of both off-line and on-camera traffic monitoring applications developed within the ORUSSI European Project.

MICC and Magenta SRL demo at ICIAP 2011

MICC and Magenta SRL demo at ICIAP 2011

ICIAP is organized every two years by the Italian group of researchers in pattern recognition (GIRPR), which is the Italian IAPR Member Society, with the aim to bring together researchers in image processing and pattern recognition from around the world. The 16th edition of the conference was organized by the University of Bologna, Ravenna site.

The main target of ICIAP 2011 was to provide a place in which the most recent approaches and goals in image analysis could be presented and discussed.

Main topics included:

  • Image analysis and processing
  • Pattern recognition and Vision
  • Machine Learning and Multimedia
  • Cultural Heritage and Applications

The demo by Magenta SRL and MICC presented an embedded solution for vehicle counting and speed estimation and off-site video analysis tools to detect anomalous behaviors and to perform semantic compression of videos. An on-camera application for extraction of FAST feature points was also shown.

EVA 2012 Florence – Electronic Imaging the Visual Arts

Eva 2012 in Piazza Santa Maria Novella

Eva 2012 in Piazza Santa Maria Novella. Image by Sailko

Main Topics:

  • 2D – 3D Digital Image Acquisition
  • Leading Edge Applications: Galleries, Libraries, Education, Archaeological Sites, Museums & Historical Tours
  • Mediterranean Initiatives in Technology for Cultural Heritage: synergy with European & International Programmes
  • Integrated Digital Archives for Cultural Heritage and Contemporary Art
  • Management of Museums by using ICT Technology: Access, Guides, Documentation & Other Services
  • The Impact of New Mobile Communications on Cultural Heritage and Modern Arts Area
  • Semantic Webs
  • Human – Computer Interaction for Cultural Heritage Applications
  • Copyright Protection (Watermarking & Electronic Commerce)
  • Culture and e-government
  • Activities and Programmes for e-learning
  • Application of Digital Terrestrial Television
  • 3D Developments and Applications in the Cultural Heritage Area
  • Cultural Tourism & Travel Applications
  • Art and Medicine

Who should attend:

  • the cultural sector
  • the government sector
  • media & related sectors
  • the ICT Industry, especially multimedia SME’s
  • tourism & travel sector
  • technology & visual arts research organizations

Chairmans:

Offers of papers:

(6 pages draft or 1 page summary), Workshops & Demonstrations to the Chairman or Co-Chairman by 30 October 2011

Computer Recognition of Human Activities, Objects and their Interactions

Computer Vision has graduated from a research tool in early 1960s to a mature discipline today. The developments in cameras, computers and memory have contributed in part to this maturing of computer vision. Namely, there is an explosive growth in the number of cameras in public places, the speed of computers has increased significantly and the price of memory has spectacularly decreased. The word camera may be used in a very broad sense since the imaging modalities range from the usual cameras imaging a visual intensity image to thermal image and laser range image. In addition, several applications of computer vision technology are contributing to the solution of a diverse set of societal problems.

Human activities

Human activities

At The University of Texas at Austin, we are pursuing a number of projects on human activity understanding and face/emotion recognition. Professor Aggarwal will present his research on modeling and recognition of actions and interactions, and human and object interactions. The
object may be a piece of luggage, a car or an unmovable object like a fence. The applications considered include monitoring of: human activities in public places, identification of abandoned baggage and face and emotion recognition. The issues considered in these problems will illustrate the richness of ideas involved and the difficulties associated with understanding human activities. Application of the above research to monitoring and surveillance will be discussed together with actual examples and their solutions.

Reading of electronic health records through the electronic health card

Roberto Caldelli will present an application for digital terrestrial television, which allows a user, in possession of the electronic health card (CSE) of the Region of Tuscany, to consult with their Electronic Health Record (ESF) on TV at home. The identity of the user, owner of the CSE, is ensured through a process of client authentication, defined by the Tuscany Region, based on a protocol which provides for asymmetric encryption, HTTPS connection and X509 certificates.

Roberto Caldelli

Roberto Caldelli

The application allows to view personal health information in a simple and immediate manner, without the need to provide a smart-card reader and having to install special libraries.

This application is a sample implementation for the supply of value-added services through a strong authentication technique, which can be used in other application scenarios that need to provide, safely, personal information.

Analysis and development of a learning application for people with autism spectrum disorder (ASD) according to the Applied Behavioral Analysis (ABA) method

The thesis work presented is part of a larger project named Autistic Behavior & Computer-based Didactic & Software (ABCDSW).

The mission of the project is the definition of an educational methodology (according to the model Applied Behavior Analysis – ABA), and the development of open source software tools to enhance and improve, in terms of effectiveness and efficiency, the learning process for children with Autism Spectrum Disorder (ASD) also through sharing of knowledge.

Fabio Ceccarelli

Fabio Ceccarelli

The need for unconventional learning programs for children with these syndromes coupled to the attraction that most of them have in the technology (mobile phones, computers and other electronic devices) has led to consider the use of computers as means to enhance learning. Starting from this idea, and using a multidisciplinary team, have been defined the main objectives to be achieved:

  • definition (and development) of a specific educational methodology to be effective and efficient for children with ASD;
  • creation of ad hoc educational software modules for children affected by autism, in the range of 2-6 years;
  • development of tools to monitor the level of learning of children during therapy with educators / parents.

Daniele Pezzatini will have a poster session at CBMi 2011

Daniele Pezzatini will present “Interactive Video Search and Browsing Systems” at the 9th International Conference on Content based Multimedia Indexing in Madrid on  Monday 13 June 2011.

Interactive Video Search and Browsing Systems: MediaPick

Interactive Video Search and Browsing Systems: MediaPick

Daniele will present two interactive systems for video search and browsing;  a rich internet application designed to obtain the levels of responsiveness and interactivity typical of a desk- top application, and a system that exploits multi-touch devices to implement a multi-user collaborative application. Both systems use the same ontology-based video search engine, that is capable of expanding user queries through ontology reasoning and let users to search for specific video segments that contain a semantic concept or to browse the content of video collections, when it’s too difficult to express a specific query.

High dynamic images between devices and vision limits

High-dynamic or High Dynamic Range (HDR) images are a very attractive extension compared to conventional digital images. After a brief description of the problem of the dynamics acquisition, the seminar will present the characteristics of HDR images and video and it will treat the problems of the accuracy and limits of the acquisition, and of the use of these images, both with respect to the display and to the characteristics of our visual system.

The Jefferson National Expansion Memorial in St Louis, MO, USA. HDR built by Darxus from four exposures by Kevin McCoy, then simply contrast reduced to LDR without local tone mapping.

The Jefferson Memorial in St Louis, MO, USA. HDR built by Darxus from four exposures by Kevin McCoy, then simply contrast reduced to LDR without local tone mapping.

The seminar will present an overview of the pipeline for the processing of HDR images stressing how the above limits are the basis both of the computation space mechanisms of our visual system and of some effective algorithms for their view and how certain techniques are known, although not formalized, since the Renaissance.

Continuous Recovery for real time PTZ localization and mapping

We propose a method for real time recovering from tracking failure in monocular localization and mapping with a Pan Tilt Zoom camera (PTZ). The method automatically detects and seamlessly recovers from tracking failure while preserving map integrity.

By extending recent advances in the PTZ localization and mapping, the system can quickly and continuously resume tracking failures by determining the best way to task two different localization modalities.

Continuous Recovery for Real Time Pan Tilt Zoom Localization and Mapping demo

Continuous Recovery for Real Time Pan Tilt Zoom Localization and Mapping demo

The trade-off involved when choosing between the two modalities is captured by maximizing the information expected to be extracted from the scene map.

This is especially helpful in four main viewing condition: blurred frames, weak textured scene, not up to date map and occlusions due to sensor quantization or moving objects. Extensive tests show that the resulting system is able to recover from several different failures while zooming-in weak textured scene, all in real time.

Dataset: we provide four sequences (Festival, Exhibition, Lab, Backyard) used for testing the recovery module for our AVSS 2011 publication, including the map, nearest neighbour keyframe of the map, calibration results (focal length and image to world homography) and finally a total of 2,376 annotated frames. The annotations are ground-truth feet position and head location, used to decide if the calibration is correct or not. Annotations are in term of MATLAB workspace files. Data was recorded using a PTZ Axis Q6032-E and a Sony SNC-RZ30 with a resolution of 320 x 240 pixel and a frame-rate of about 10 FPS. Dataset download.

Details:

  • NN keyframe are described as a txt file where first number is the id of the frame and the next string is the id (filename of images in map dir) of the relative NN keyframe as #frame = keyframe id. Note that we store in the file only the frame number in which there is a keyframe switch.
  • Calibration is provided as a CSV file using the following notation [#frames, h11,h12,h13,…., h31,h32 ,h33, focal length], where hij are the i-th row and j-th colum of homography.
    • A MATLAB script is provided to superimpose ground-plane in the current image(plotGrid.m).
    • The homograhy h11..h33 is the world to image homography that maps pixel into meters.
  • Ground-Truth is under the name of “ground-truth.mat” and it consists of a cells where each item is the feet position and the head position.
  • In each sequence it is present a main script plotGrid.m MATLAB script that plots ground-truth annotations and superimposes the ground-plane on the image. ScaleView.m is the script that exploits calibration to predict head location.
  • Note that we have obfuscated most of the faces to keep anonymity.

ORUSSI. Optimal Road sUrveillance System based on Scalable video

The growing mobility of people and goods has a very high societal cost in terms of traffic congestion and of fatalities and injured people every year. The management of a road network needs efficient ways for assessment at minimal costs. Road monitoring is a relevant part of road management, especially for safety, optimal traffic flow and for investigating new sustainable transport patterns.

Road monitoring

Road monitoring

On the road side, there are several technologies used for collecting detection and surveillance information: sophisticated automated systems such as in-roadway or over-roadway sensors, closed circuit television (CCTV) system for viewing real-time video images of the roadway or road weather information systems for monitoring pavement and weather.

Current monitoring systems based on video lack of optimal usage of networks and are difficult to be extended efficiently.

Our project focuses on road monitoring through a network of roadside sensors (mainly cameras) that can be dynamically deployed and added to the surveillance systems in an efficient way. The main objective of the project is to develop an optimized platform offering innovative real-time media (video and data) applications for road monitoring in real scenarios. The project will develop a novel platform based on the synergetic bundling of current research results in the field of semantic transcoding, the recently approved standard Scalable Video Coding standard (SVC), wireless communication and roadside equipment.

Dataset: thanks to the involvement of Comune di Prato (a local municipality), we were able to collect a very wide dataset of video sequences that turned out to be key for the project activities. The dataset is made of more than 250 hours of recording taken on a well-travelled county road, with different lighting and weather conditions. From these video sequences we have extracted an image dataset of about 1250 vehicle images. This data set, available here, can be used to train a vehicle classifier.

euTV: adaptive media channels

The explosion of digital data in recent times, in its varied forms and formats (MPEG4 image, Flash video, WAV audio, etc.), has necessitated the creation of effective tools to organise, manage and link digital assets, in order to maximise accessibility and reduce cost issues for everyone concerned, from content managers to online content consumers.

euTV MICC interfaces

euTV video annotation and transcription web component

On a larger scale, isolated information repositories developed by content owners and technology providers can be connected, unleashing opportunities for innovative user services and creating new business models, in the vein of on-demand, online, or mobile TV ventures.

The euTV project stems from above conditions and potentialities, to connect publicly available multimedia information streams under a unifying framework, which additionally allows publishers of audio-visual content to monetise their products and services. The backbone of euTV is a scalable audio-visual analysis and indexing system that allows detection and tracking of vast amounts of multimedia content based on Topics of Interest (TOI) corresponding to a user’s profile and employed search terms. The front-end is a portal that displays syndicated content, allowing users to perform searches, refine queries, and produce faceted presentation of results.

euTV

euTV logo

The three main content domains will be (a) news, (b) sports, and (c) documentaries. In the existing market of media monitoring and clipping, euTV distinguishes itself by simultaneously analysing multiple information streams (text, speech, audio, image, video) instead of a single one and tracking TOI in real time. This provides the user with a more robust identification of their TOI and greater insights into how the information is spread.