PDDLEGO: Iterative Planning in Textual Environments

Li Zhang, Peter Jansen, Tianyi Zhang, Peter Clark, Chris Callison-Burch, Niket Tandon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Planning in textual environments have been shown to be a long-standing challenge even for current models. A recent, promising line of work uses LLMs to generate a formal representation of the environment that can be solved by a symbolic planner. However, existing methods rely on a fully-observed environment where all entity states are initially known, so a one-off representation can be constructed, leading to a complete plan. In contrast, we tackle partially-observed environments where there is initially no sufficient information to plan for the end-goal. We propose PDDLEGO that iteratively construct a planning representation that can lead to a partial plan for a given sub-goal. By accomplishing the sub-goal, more information is acquired to augment the representation, eventually achieving the end-goal. We show that plans produced by few-shot PDDLEGO are 43% more efficient than generating plans end-to-end on the Coin Collector simulation, with strong performance (98%) on the more complex Cooking World simulation where end-to-end LLMs fail to generate coherent plans (4%).

Original languageEnglish (US)
Title of host publicationStarSEM 2024 - 13th Joint Conference on Lexical and Computational Semantics, Proceedings of the Conference
EditorsDanushka Bollegala, Danushka Bollegala, Vered Shwartz
PublisherAssociation for Computational Linguistics (ACL)
Pages212-221
Number of pages10
ISBN (Electronic)9798891761063
DOIs
StatePublished - 2024
Event13th Joint Conference on Lexical and Computational Semantics, StarSEM 2024 - Mexico City, Mexico
Duration: Jun 20 2024Jun 21 2024

Publication series

NameProceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)0736-587X

Conference

Conference13th Joint Conference on Lexical and Computational Semantics, StarSEM 2024
Country/TerritoryMexico
CityMexico City
Period6/20/246/21/24

ASJC Scopus subject areas

  • Computer Science Applications
  • Linguistics and Language
  • Language and Linguistics

Fingerprint

Dive into the research topics of 'PDDLEGO: Iterative Planning in Textual Environments'. Together they form a unique fingerprint.

Cite this