TY - GEN
T1 - TEXTWORLDEXPRESS
T2 - 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023
AU - Jansen, Peter
AU - Côté, Marc Alexandre
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - Text-based games offer a challenging test bed to evaluate virtual agents at language understanding, multi-step problem-solving, and common-sense reasoning. However, speed is a major limitation of current text-based games, capping at 300 steps per second, mainly due to the use of legacy tooling. In this work we present TEXTWORLDEXPRESS, a high-performance simulator that includes implementations of three common text game benchmarks that increases simulation throughput by approximately three orders of magnitude, reaching over one million steps per second on common desktop hardware. This significantly reduces experiment runtime, enabling billion-step-scale experiments in about one day.1
AB - Text-based games offer a challenging test bed to evaluate virtual agents at language understanding, multi-step problem-solving, and common-sense reasoning. However, speed is a major limitation of current text-based games, capping at 300 steps per second, mainly due to the use of legacy tooling. In this work we present TEXTWORLDEXPRESS, a high-performance simulator that includes implementations of three common text game benchmarks that increases simulation throughput by approximately three orders of magnitude, reaching over one million steps per second on common desktop hardware. This significantly reduces experiment runtime, enabling billion-step-scale experiments in about one day.1
UR - http://www.scopus.com/inward/record.url?scp=85159853023&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85159853023&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85159853023
T3 - EACL 2023 - 17th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of System Demonstrations
SP - 169
EP - 177
BT - EACL 2023 - 17th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of System Demonstrations
PB - Association for Computational Linguistics (ACL)
Y2 - 2 May 2023 through 4 May 2023
ER -