2024 · 23 citations · 34 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceMotion PlanningRoboticsReinforcement LearningRobot Motion PlanningAgent PlanningLarge Language ModelsMotion Planning Under Uncertainty
Designing robotic agents to perform open vocabulary tasks has been the long-standing goal in robotics and AI. Recently, Large Language Models (LLMs) have achieved impressive results in creating robotic agents for performing open vocabulary tasks. However, planning for these tasks in the presence of uncertainties is challenging as it requires "chain-of-thought" reasoning, aggregating information from the environment, updating state estimates, and generating actions based on the updated state estimates. In this paper, we present an interactive planning technique for partially observable tasks using LLMs. In the proposed method, an LLM is used to collect missing information from the environment using a robot, and infer the state of the underlying problem from collected observations while guiding the robot to perform the required actions. We also use a fine-tuned Llama 2 model via self-instruct and compare its performance against a pre-trained LLM like GPT-4. Results are demonstrated on several tasks in simulation as well as real-world environments.
34
LLaMA: Open and Efficient Foundation Language Models
Hugo Touvron, Thibaut Lavril, Gautier Izacard et al. · arXiv (Cornell University) · 2023 · 3.9K citations · Full text
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron, Louis Martin, Kevin H. Stone et al. · arXiv (Cornell University) · 2023 · 2.6K citations · Full text
AprilTag: A robust and flexible visual fiducial system
Edwin Olson · 2011 · 1.7K citations
Large Language Models are Zero-Shot Reasoners
Takeshi Kojima, Shixiang Gu, Machel Reid et al. · arXiv (Cornell University) · 2022 · 1.1K citations · Full text