TY - GEN
T1 - FROM WORDS TO WIRES
T2 - 2023 Findings of the Association for Computational Linguistics: EMNLP 2023
AU - Jansen, Peter
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - In this work, we show that contemporary language models have a previously unknown skill - the capacity for electronic circuit design from high-level textual descriptions, akin to code generation. We introduce two benchmarks: PINS100, assessing model knowledge of electrical components, and MICRO25, evaluating a model's capability to design common microcontroller circuits and code in the ARDUINO ecosystem that involve input, output, sensors, motors, protocols, and logic - with models such as GPT-4 and Claude-V1 achieving between 60% to 96% PASS@1 on generating full devices. We include six case studies of using language models as a design assistant for moderately complex devices, such as a radiation-powered random number generator, an emoji keyboard, a visible spectrometer, and several assistive devices, while offering a qualitative analysis performance, outlining evaluation challenges, and suggesting areas of development to improve complex circuit design and practical utility. With this work, we aim to spur research at the juncture of natural language processing and electronic design.
AB - In this work, we show that contemporary language models have a previously unknown skill - the capacity for electronic circuit design from high-level textual descriptions, akin to code generation. We introduce two benchmarks: PINS100, assessing model knowledge of electrical components, and MICRO25, evaluating a model's capability to design common microcontroller circuits and code in the ARDUINO ecosystem that involve input, output, sensors, motors, protocols, and logic - with models such as GPT-4 and Claude-V1 achieving between 60% to 96% PASS@1 on generating full devices. We include six case studies of using language models as a design assistant for moderately complex devices, such as a radiation-powered random number generator, an emoji keyboard, a visible spectrometer, and several assistive devices, while offering a qualitative analysis performance, outlining evaluation challenges, and suggesting areas of development to improve complex circuit design and practical utility. With this work, we aim to spur research at the juncture of natural language processing and electronic design.
UR - http://www.scopus.com/inward/record.url?scp=85183307087&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85183307087&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85183307087
T3 - Findings of the Association for Computational Linguistics: EMNLP 2023
SP - 12972
EP - 12990
BT - Findings of the Association for Computational Linguistics
PB - Association for Computational Linguistics (ACL)
Y2 - 6 December 2023 through 10 December 2023
ER -