Semantic Relation Detection between Construction Entities to Support Safe Human-Robot Collaboration in Construction

Daeho Kim, Ankit Goyal, Alejandro Newell, Sang Hyun Lee, Jia Deng, Vineet R. Kamat

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Construction robots have drawn increased attention as a potential means of improving construction safety and productivity. However, it is still challenging to ensure safe human-robot collaboration on dynamic and unstructured construction workspaces. On construction sites, multiple entities dynamically collaborate with each other and the situational context between them evolves continually. Construction robots must therefore be equipped to visually understand the scene's contexts (i.e., semantic relations to surrounding entities), thereby safely collaborating with humans, as a human vision system does. Toward this end, this study builds a unique deep neural network architecture and develops a construction-specialized model by experimenting multiple fine-tuning scenarios. Also, this study evaluates its performance on real construction operations data in order to examine its potential toward real-world applications. The results showed the promising performance of the tuned model: the recall@5 on training and validation dataset reached 92% and 67%, respectively. The proposed method, which supports construction co-robots with the holistic scene understanding, is expected to contribute to promoting safer human-robot collaboration in construction.

Original languageEnglish (US)
Title of host publicationComputing in Civil Engineering 2019
Subtitle of host publicationData, Sensing, and Analytics - Selected Papers from the ASCE International Conference on Computing in Civil Engineering 2019
EditorsYong K. Cho, Fernanda Leite, Amir Behzadan, Chao Wang
PublisherAmerican Society of Civil Engineers (ASCE)
Pages265-272
Number of pages8
ISBN (Electronic)9780784482438
StatePublished - 2019
EventASCE International Conference on Computing in Civil Engineering 2019: Data, Sensing, and Analytics, i3CE 2019 - Atlanta, United States
Duration: Jun 17 2019Jun 19 2019

Publication series

NameComputing in Civil Engineering 2019: Data, Sensing, and Analytics - Selected Papers from the ASCE International Conference on Computing in Civil Engineering 2019

Conference

ConferenceASCE International Conference on Computing in Civil Engineering 2019: Data, Sensing, and Analytics, i3CE 2019
CountryUnited States
CityAtlanta
Period6/17/196/19/19

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Civil and Structural Engineering

Fingerprint Dive into the research topics of 'Semantic Relation Detection between Construction Entities to Support Safe Human-Robot Collaboration in Construction'. Together they form a unique fingerprint.

Cite this