TY - GEN
T1 - Segmenting and Recognizing Human Action using Low-level Video Features
AU - Buchsbaum, Daphna
AU - Canini, Kevin R.
AU - Griffiths, Thomas L.
N1 - Publisher Copyright:
© CogSci 2011.
PY - 2011
Y1 - 2011
N2 - Dividing observed human behavior into individual, meaningful actions is a critical task for both human learners and computer vision systems. An important question is how much action structure and segmentation information is available in the observed surface level motion and image changes, without any knowledge of human pose or behavior. Here we present a novel approach to jointly segmenting and recognizing videos of human action sequences, using a hierarchical topic model. Video sequences are represented as bags of video words, automatically discovered from local space-time interest points. Our model jointly infers both action identification and action segmentation. Our results are a good fit with human segmentation judgments as well as providing relatively accurate action recognition and localization within the videos.
AB - Dividing observed human behavior into individual, meaningful actions is a critical task for both human learners and computer vision systems. An important question is how much action structure and segmentation information is available in the observed surface level motion and image changes, without any knowledge of human pose or behavior. Here we present a novel approach to jointly segmenting and recognizing videos of human action sequences, using a hierarchical topic model. Video sequences are represented as bags of video words, automatically discovered from local space-time interest points. Our model jointly infers both action identification and action segmentation. Our results are a good fit with human segmentation judgments as well as providing relatively accurate action recognition and localization within the videos.
UR - http://www.scopus.com/inward/record.url?scp=84918826826&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84918826826&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84918826826
T3 - Expanding the Space of Cognitive Science - Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, CogSci 2011
SP - 3162
EP - 3167
BT - Expanding the Space of Cognitive Science - Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, CogSci 2011
A2 - Carlson, Laura
A2 - Hoelscher, Christoph
A2 - Shipley, Thomas F.
PB - The Cognitive Science Society
T2 - 33rd Annual Meeting of the Cognitive Science Society: Expanding the Space of Cognitive Science, CogSci 2011
Y2 - 20 July 2011 through 23 July 2011
ER -