TY - JOUR
T1 - Embodied conversational agent-based kiosk for automated interviewing
AU - Nunamaker, Jay
AU - Derrick, Douglas
AU - Elkins, Aaron
AU - Burgoon, Judee
AU - Patton, Mark
N1 - Funding Information:
Acknowledgments: the u.S. Department of Homeland Security, National Center for Border Security and Immigration (grant no. 2008-St-061-BS0002), and the Defense academy for Credibility assessment (grant no. IIP-0701519) supported this research. However, any opinions, findings, and conclusions or recommendations herein are those of the authors and do not necessarily reflect views of the u.S. Department of Homeland Security. the views, opinions, and findings in this report are those of the authors and should not be construed as an official u.S. government position, policy, or decision.
PY - 2011/7/1
Y1 - 2011/7/1
N2 - We have created an automated kiosk that uses embodied intelligent agents to interview individuals and detect changes in arousal, behavior, and cognitive effort by using psychophysiological information systems. In this paper, we describe the system and propose a unique class of intelligent agents, which are described as Special Purpose Embodied Conversational Intelligence with Environmental Sensors (SPECIES). SPECIES agents use heterogeneous sensors to detect human physiology and behavior during interactions, and they affect their environment by influencing human behavior using various embodied states (i.e., gender and demeanor), messages, and recommendations. Based on the SPECIES paradigm, we present three studies that evaluate different portions of the model, and these studies are used as foundational research for the development of the automated kiosk. The first study evaluates human-computer interaction and how SPECIES agents can change perceptions of information systems by varying appearance and demeanor. Instantiations that had the agents embodied as males were perceived as more powerful, while female embodied agents were perceived as more likable. Similarly, smiling agents were perceived as more likable than neutral demeanor agents. The second study demonstrated that a single sensor measuring vocal pitch provides SPECIES with environmental awareness of human stress and deception. The final study ties the first two studies together and demonstrates an avatar-based kiosk that asks questions and measures the responses using vocalic measurements.
AB - We have created an automated kiosk that uses embodied intelligent agents to interview individuals and detect changes in arousal, behavior, and cognitive effort by using psychophysiological information systems. In this paper, we describe the system and propose a unique class of intelligent agents, which are described as Special Purpose Embodied Conversational Intelligence with Environmental Sensors (SPECIES). SPECIES agents use heterogeneous sensors to detect human physiology and behavior during interactions, and they affect their environment by influencing human behavior using various embodied states (i.e., gender and demeanor), messages, and recommendations. Based on the SPECIES paradigm, we present three studies that evaluate different portions of the model, and these studies are used as foundational research for the development of the automated kiosk. The first study evaluates human-computer interaction and how SPECIES agents can change perceptions of information systems by varying appearance and demeanor. Instantiations that had the agents embodied as males were perceived as more powerful, while female embodied agents were perceived as more likable. Similarly, smiling agents were perceived as more likable than neutral demeanor agents. The second study demonstrated that a single sensor measuring vocal pitch provides SPECIES with environmental awareness of human stress and deception. The final study ties the first two studies together and demonstrates an avatar-based kiosk that asks questions and measures the responses using vocalic measurements.
KW - Avatars
KW - NeuroIS
KW - deception detection
KW - embodied conversational agents
UR - http://www.scopus.com/inward/record.url?scp=80051709642&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80051709642&partnerID=8YFLogxK
U2 - 10.2753/MIS0742-1222280102
DO - 10.2753/MIS0742-1222280102
M3 - Article
AN - SCOPUS:80051709642
SN - 0742-1222
VL - 28
SP - 17
EP - 48
JO - Journal of Management Information Systems
JF - Journal of Management Information Systems
IS - 1
ER -