The goal of the Object Disambiguation using Locative Prepositions project is to improve human-robot interaction by developing models for how humans use prepositional phrases to identify objects in a cluttered space. When using only words to reference听one of many objects located together, it is hard to avoid misunderstanding,听even between human coworkers. To reduce听uncertainty, humans often use prepositional phrases that describe the target object in reference to the most easily distinguished nearby objects. This research makes human-robot interactions of this sort more effective by developing a new system for object disambiguation in cluttered environments based on probabilistic models of unique object features and spatial relationships. It builds on prior models of spatial relationship semantics by collecting and encoding empirical data from a series of crowdsourced studies to better understand how and when people use locative prepositions, how reference objects are chosen and how to model prepositional geometry in 3D space. The project also introduces new techniques for responding to compound locative phrases of arbitrary complexity and proposes a new metric for disambiguation confidence. Experiments demonstrate听that these methods can improve accuracy and performance over existing approaches.
听
Publications
- Daniel Prendergast and Daniel Szafir. 2018. Improving Object Disambiguation from Natural Language using Empirical Models. In Proceedings of the 2018 on International Conference on Multimodal Interaction (ICMI '18). ACM, New York, NY, USA, 477-485. DOI: (Boulder, baby直播app 鈥� Oct. 16 - 20, 2018).
听
Associated Researchers
