Eyetracked optical see-through head-mounted display as an AAC device

Hong Hua, Xinda Hu, Chunyu Gao, Xiao Qin

Research output: Chapter in Book/Report/Conference proceedingConference contribution


An eye-tracked head-mounted display (ET-HMD) system is able to display virtual images as a classical headmounted display (HMD) does, while additionally tracking the gaze direction of the user. An HMD with fullyintegrated eyetracking capability offers multi-fold benefits, not only to fundamental scientific research but also to emerging applications of such technology. A key limitation of the state-of-the-art ET-HMD technology is the lack of compactness and portability. In this paper, we present an innovative design of a high resolution optical see-through ET-HMD system based on freeform optical technology. A prototype system is demonstrated, which offers a goggle-like compact form factor, non-obstructive see-through field of view, true high-definition image resolution for the virtual display, and better than 0.5 arc minute of angular resolution for the see-through view. We will demonstrate the application of the technology as an assistive and augmentative communication (AAC) device.

Original languageEnglish (US)
Title of host publicationThree-Dimensional Imaging, Visualization, and Display 2014
ISBN (Print)9781628410549
StatePublished - 2014
EventThree-Dimensional Imaging, Visualization, and Display 2014 - Baltimore, MD, United States
Duration: May 5 2014May 7 2014

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


OtherThree-Dimensional Imaging, Visualization, and Display 2014
Country/TerritoryUnited States
CityBaltimore, MD


  • Optical see-through
  • eye tracking
  • eyetracked HMD
  • freeform optics
  • head-mounted display

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Eyetracked optical see-through head-mounted display as an AAC device'. Together they form a unique fingerprint.

Cite this