Interaction analysis of the ALICE chatterbot: A two-study investigation of dialog and domain questioning

Robert P. Schumaker, Hsinchun Chen

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


This paper analyzes and compares the data gathered from two previously conducted Artificial Linguistic Internet Chat Entity (ALICE) chatterbot studies that were focused on response accuracy and user satisfaction measures for six chatterbots. These chatterbots were further loaded with varying degrees of conversational, telecommunications, and terrorism knowledge. From our prior experiments using 347 participants, we obtained 33 446 human/chatterbot interactions. It was found that asking the ALICE chatterbots "are" and "where" questions resulted in higher response satisfaction levels, as compared to other interrogative-style inputs because of their acceptability to vague,binary, or clichéd chatterbot responses. We also found a relationship between the length of a query and the users perceived satisfaction of the chatterbot response, where shorter queries led to more satisfying responses.

Original languageEnglish (US)
Article number5272316
Pages (from-to)40-51
Number of pages12
JournalIEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
Issue number1
StatePublished - Jan 2010


  • Artificial linguistic internet chat entity (ALICE)
  • Chatterbot
  • Dialog platform
  • Domain-specific knowledge
  • Evaluation
  • Knowledge delivery

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Human-Computer Interaction
  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Computer Science Applications


Dive into the research topics of 'Interaction analysis of the ALICE chatterbot: A two-study investigation of dialog and domain questioning'. Together they form a unique fingerprint.

Cite this