LACE: Indoor Activity Benchmark Data Sets


Overview

This site contains description of and links to the benchmark data sets in the forms of synchronized multi-camera videos and time-stamped RFID readings recorded and annotated by the Laboratory for Assisted Cognition Environments (LACE) at University of Rochester. 

The data sets are generated for the Department of Defense MURI project.  

Downloading the data sets requires registered login ID and password.  
Please e-mail Craig Harman  if you require assistance obtaining these datasets.

Aims and Scope

The datasets are multisensor (video + RFID) sequences, all of which are synchronized together, containing the following 6 senarios of activities in daily living (ADLs): 

    1. Walking around the indoor space

    2. Sitting and watching TV

    3. Preparing utensil (at kitchen)

    4. Preparing cereal (with utensil and food)

    5. Drinking water (with a cup)

    6. Storing utensil (to cupboard)

Currently, five participants are involved in the data collection in two separate sessions, respectively.
In total, videos and RFID readings from 5 [persons] x 2 [sessions] x 6 [activities] x 5 [trials] were collected.

The above scenarios of ADLs are characterized by their composition of sub-activities (See below.)
The operational definition of each of the above activities is made in terms of the sub-activities and described with example video frames as follows:

Walking around

Sitting and watching TV

Preparing utensil

Walking around
Sub-activities:
Enter the scene.
Walk
Sit_n_watch_TV
Sub-activities:
Bring remote control
Sit on couch
Turn on / watch TV
Prepare utensil
Sub-activities:
Open / close cupboard/drawer
Bring utensil  (dish, cup, bowl)
Bring flatware  (spoon, knife, and fork)

Preparing cereal

Drinking water

Storing utensil

Prepare cereal
Sub-activities:
Open cupboard
Bring a cereal box
Pour cereal in the bowl
Pour milk in the bowl
Eat cereal with spoon
Drink water
Sub-activities:
Open refrigerator
Bring water jar
Pour water in a cup
Drink water in the cup
Store utensil
Sub-activities:
Open / close cupboard
Return utensil
Return flatware
Open / close drawer


Calibration Data

Our experimental approach is based on calibration-free multi-view approaches to relax the combersome and sensitive camera calibration procedures for diverse practical deployment options. 

Therefore the external camera parameters (i.e., relative rotation and translation of the cameras) are not calibrated.
However, we provide the internal camera calibration parameters for removing the radial distortion of lens effect. 

Please click here to download the calibrationd aata.



Full dataset

This data set contains RFID readings in the csv file format and video recordings in the AVI file format.

The actual data can be downloaded here.



Contact

Administrative: Craig Harman
Technical: Sangho Park

Last update: 6/30-2008