Joint segmentation and reconstruction of hyperspectral images from a single snapshot

Qiang Zhang, Robert J. Plemmons, David Kittle, David Brady, Sudhakar Prasad

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This work describes numerical methods for the joint reconstruction and segmentation of spectral images taken by compressive sensing coded aperture snapshot spectral imagers (CASSI). In a snapshot, a CASSI captures a two-dimensional (2D) array of measurements that is an encoded representation of both spectral information and 2D spatial information of a scene, resulting in significant savings in acquisition time and data storage. The double disperser coded aperture snapshot imager (DD-CASSI) is able to capture a hyperspectral image from which a highly underdetermined inverse problem is solved for the original hyperspectral cube with regularization terms such as total variation minimization. The reconstruction process decodes the 2D measurements to render a three-dimensional spatio-spectral estimate of the scene, and is therefore an indispensable component of the spectral imager. In this study, we seek a particular form of the compressed sensing solution that assumes spectrally homogeneous segments in the two spatial dimensions, and greatly reduces the number of unknowns. The proposed method generalizes popular active contour segmentation algorithms such as the Chan-Vese model and also enables one to jointly estimate both the segmentation membership functions and the spectral signatures of each segment. The results are illustrated on a simulated Hubble Space Satellite hyperspectral dataset, a real urban hyperspectral dataset, and a real DD-CASSI image in microscopy.

Original languageEnglish (US)
Title of host publicationAlgorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XVII
DOIs
StatePublished - 2011
Externally publishedYes
EventAlgorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XVII - Orlando, FL, United States
Duration: Apr 25 2011Apr 28 2011

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8048
ISSN (Print)0277-786X

Conference

ConferenceAlgorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XVII
Country/TerritoryUnited States
CityOrlando, FL
Period4/25/114/28/11

Keywords

  • Coded apertures
  • Compressive sensing
  • Hyperspectral data
  • Reconstruction
  • Segmentation

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Joint segmentation and reconstruction of hyperspectral images from a single snapshot'. Together they form a unique fingerprint.

Cite this