Beam tracking and image steering by Texas Instruments Phase Light Modulator based on camera input for lidar and AR applications

Xianyue Deng, Chin I. Tang, Yuzuru Takashima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Micro Electro Mechanical System (MEMS) spatial light modulators enables adaptive and fast beam and image steering. For lidar applications, Texas Instruments Phase Light Modulator (TI-PLM) is paired with real-time calculation and display of Computer Generated Holograms (CGH) by CUDA-OpenGL interoperability assisted by YOLOv4-tiny network model for object detection and recognition. The real-time object recognition, CGH calculation, and display framework replaces conventional raster scanning with camera-input based and foveated beam steering while having a beam scan rate beyond the frame rate of TI-PLM. For Augmented Reality (AR) application, the same framework is used for image steering based on gaze information of eye. With Texas Instruments Digital Micromirror Device (TI-DMD), image is steered into a part of field of view by following movement of eye. The diffractive image steering enabled by TI-DMD increases FOV while not sacrificing resolution of the image displayed.

Original languageEnglish (US)
Title of host publicationEmerging Digital Micromirror Device Based Systems and Applications XV
EditorsJohn Ehmke, Benjamin L. Lee
PublisherSPIE
ISBN (Electronic)9781510659759
DOIs
StatePublished - 2023
EventEmerging Digital Micromirror Device Based Systems and Applications XV 2023 - San Francisco, United States
Duration: Jan 30 2023Feb 1 2023

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12435
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceEmerging Digital Micromirror Device Based Systems and Applications XV 2023
Country/TerritoryUnited States
CitySan Francisco
Period1/30/232/1/23

Keywords

  • AR display
  • beam steering
  • image steering
  • lidar
  • MEMS
  • phase light modulator
  • spatial light modulator

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Beam tracking and image steering by Texas Instruments Phase Light Modulator based on camera input for lidar and AR applications'. Together they form a unique fingerprint.

Cite this