Distributed Consistent Multi-Robot Semantic Localization and Mapping

Vladimir Tchuiev, Vadim Indelman

Research output: Contribution to journalArticlepeer-review

Abstract

We present an approach for multi-robot consistent distributed localization and semantic mapping in an unknown environment, considering scenarios with classification ambiguity, where objects' visual appearance generally varies with viewpoint. Our approach addresses such a setting by maintaining a distributed posterior hybrid belief over continuous localization and discrete classification variables. In particular, we utilize a viewpoint-dependent classifier model to leverage the coupling between semantics and geometry. Moreover, our approach yields a consistent estimation of both continuous and discrete variables, with the latter being addressed for the first time, to the best of our knowledge. We evaluate the performance of our approach in a multi-robot semantic SLAM simulation and in a real-world experiment, demonstrating an increase in both classification and localization accuracy compared to maintaining a hybrid belief using local information only.
Original languageUndefined/Unknown
Article number9120171
Pages (from-to)4649-4656
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume5
Issue number3
DOIs
StatePublished - 6 Jul 2020

Keywords

  • I.2.9
  • Multi-robot systems
  • SLAM
  • cs.RO
  • semantic scene understanding

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Biomedical Engineering
  • Human-Computer Interaction
  • Mechanical Engineering
  • Computer Vision and Pattern Recognition
  • Computer Science Applications
  • Control and Optimization
  • Artificial Intelligence

Cite this