← ListarXivPDF

#9 DM^3-Nav: Decentralized Multi-Agent Multimodal Multi-Object Semantic Navigation

Score: 19.4 | Matched keywords: agent, multi-agent, multimodal

Categories: cs.MA, cs.RO

Abstract Snapshot

Compressed abstract

We present DM^3-Nav, a fully decentralized multi-agent semantic navigation system supporting multimodal open-vocabulary goal specification and multi-object missions. In our setting, decentralization implies operation without a central coordinator, global map aggregation, or shared global state at runtime.

Main idea

We present DM^3-Nav, a fully decentralized multi-agent semantic navigation system supporting multimodal open-vocabulary goal specification and multi-object missions.

Method signal

In our setting, decentralization implies operation without a central coordinator, global map aggregation, or shared global state at runtime. Robots operate autonomously and coordinate through ad-hoc pairwise communication, exchanging local maps, goal status, and navigation intent without synchronization.

Contribution signal

An implicit task allocation mechanism combining intent broadcasting and distance-weighted frontier selection reduces redundant exploration while preserving decentralized operation. Evaluations on HM3 DSem scenes using the HM3 Dv0.2 and GOAT-Bench datasets demonstrate that DM^3-Nav matches or exceeds centralized and shared-map baselines while eliminating single points of failure inherent in centralized architectures.

Original Abstract

We present DM^3-Nav, a fully decentralized multi-agent semantic navigation system supporting multimodal open-vocabulary goal specification and multi-object missions. In our setting, decentralization implies operation without a central coordinator, global map aggregation, or shared global state at runtime. Robots operate autonomously and coordinate through ad-hoc pairwise communication, exchanging local maps, goal status, and navigation intent without synchronization. An implicit task allocation mechanism combining intent broadcasting and distance-weighted frontier selection reduces redundant exploration while preserving decentralized operation. Evaluations on HM3 DSem scenes using the HM3 Dv0.2 and GOAT-Bench datasets demonstrate that DM^3-Nav matches or exceeds centralized and shared-map baselines while eliminating single points of failure inherent in centralized architectures. Finally, we validate our approach in a real-world office environment using two mobile robots, demonstrating successful deployment relying entirely on onboard sensing and computation. A video of our real-world experiments is available online: https://drive.google.com/file/d/1 QiUSCn5 rIvtuTUqtuXLPgmt6 S8 x9-MCZ/view?usp=drive_link