LACE: Indoor Activity Benchmark Data Sets


Data Set Details

This site contains description of and links to the benchmark data sets in the forms of synchronized multi-camera videos and time-stamped RFID readings recorded and annotated by the Laboratory for Assisted Cognition Environments (LACE) at University of Rochester. 

The data sets are generated for the Department of Defense MURI project.  

Currently, five participants are involved in the data collection in two separate sessions, respectively.
In total,  10 data sets ( = 5 [subjects] x 2 [sessions] ) were collected in the forms of videos and RFID readings.

Data Set No. Subject Video File RFID File Video File size Video Compression 
D01 S01 mv_20080124_131218_Eur_sp.avi timeLabelMap_20080124_131218.csv 600 MB Xvid MPEG-4 Codec
D02 S02 mv_20080124_141551_Eur_sp.avi timeLabelMap_20080124_141551.csv 606 MB Xvid MPEG-4 Codec
D03 S03 mv_20080124_145358_Eur_sp.avi timeLabelMap_20080124_145358.csv 572 MB Xvid MPEG-4 Codec
D04 S04 mv_20080313_142428_Eur_sp.avi timeLabelMap_20080313_142428.csv 132 MB DivX 5.1.1 Codec
D05 S04 mv_20080313_144707_Eur_sp.avi timeLabelMap_20080313_144707.csv 133 MB DivX 5.1.1 Codec
D06 S02 mv_20080313_151829_Eur_sp.avi timeLabelMap_20080313_151829.csv 146 MB DivX 5.1.1 Codec
D07 S01 mv_20080313_160721_Eur_sp.avi timeLabelMap_20080313_160721.csv 116 MB DivX 5.1.1 Codec
D08 S03 mv_20080313_163733_Eur_sp.avi timeLabelMap_20080313_163733.csv 137 MB DivX 5.1.1 Codec
D09 S05 mv_20080314_143621_Eur_sp.avi timeLabelMap_20080314_143621.csv 113 MB DivX 5.1.1 Codec
D10 S05 mv_20080314_145536_Eur_sp.avi timeLabelMap_20080314_145536.csv 109 MB DivX 5.1.1 Codec

Each of the 10 data sets contains 5 trials of the  following 6 activities performed in a continuous manner as follows:

Trials trial-1 trial-2  ..................
Activities A01 A02 A03 A04 A05 A06 A01 A02 A03 A04 A05 A06 ............

The RFID labels-based annotation for the temporal segmentation of the activities is downloadable here.
The individual activities are described below:

Activity Descriptions

Activity Description
A01 Walking around the indoor space
A02 Sitting and watching TV
A03 Preparing utensil (at kitchen)
A04 Preparing cereal (with utensil and food)
A05 Drinking water (with a cup)
A06 Storing utensil (to cupboard)


Data Synchronization

The video file and RFID file in a give data set are synchronized as follows:
Each frame of a given AVI file contains four synchronized camera views (i.e., cam-1 in top left through cam-4 in bottom-right).
The RFID file contains  frame number, RFID label, and the associated objet label, which are commar-separatged according to the csv data format.
The list of the RFID tags attached on the various positions in the lab is downloadable here.
 
AVI File Viewing Tip

Most of commercial / free programs to view videos are time-based (i.e., the program indicates the lapse time of the currently viewing frame in terms of seconds or miliseconds.)
VirtualDub, a free software to view AVI files, is frame-based (i.e., the program indicates the lapse time of the currently viewing frame in terms of the frame number.)
I recommend the use of VirtualDub to control the view of individual frames.



Contact

Administrative: Craig Harman
Technical: Sangho Park

Last update: 6/30-2008