Multidimensional Optical Sensing and Imaging System (MOSIS): From Macroscales to Microscales

Bahram Javidi, Xin Shen, Adam S. Markman, Pedro Latorre-Carmona, Adolfo Martinez-Uso, Jose Martinez Sotoca, Filiberto Pla, Manuel Martinez-Corral, Genaro Saavedra, Yi Pai Huang, Adrian Stern

Research output: Contribution to journalArticlepeer-review


Multidimensional optical imaging systems for information processing and visualization technologies have numerous applications in fields such as manufacturing, medical sciences, entertainment, robotics, surveillance, and defense. Among different three-dimensional (3-D) imaging methods, integral imaging is a promising multiperspective sensing and display technique. Compared with other 3-D imaging techniques, integral imaging can capture a scene using an incoherent light source and generate real 3-D images for observation without any special viewing devices. This review paper describes passive multidimensional imaging systems combined with different integral imaging configurations. One example is the integral-imaging-based multidimensional optical sensing and imaging systems (MOSIS), which can be used for 3-D visualization, seeing through obscurations, material inspection, and object recognition from microscales to long range imaging. This system utilizes many degrees of freedom such as time and space multiplexing, depth information, polarimetric, temporal, photon flux and multispectral information based on integral imaging to record and reconstruct the multidimensionally integrated scene. Image fusion may be used to integrate the multidimensional images obtained by polarimetric sensors, multispectral cameras, and various multiplexing techniques. The multidimensional images contain substantially more information compared with two-dimensional (2-D) images or conventional 3-D images. In addition, we present recent progress and applications of 3-D integral imaging including human gesture recognition in the time domain, depth estimation, mid-wave-infrared photon counting, 3-D polarimetric imaging for object shape and material identification, dynamic integral imaging implemented with liquid-crystal devices, and 3-D endoscopy for healthcare applications.

Original languageEnglish
Article number7866839
Pages (from-to)850-875
Number of pages26
JournalProceedings of the IEEE
Issue number5
StatePublished - 1 May 2017


  • 3-D endoscopy
  • 3-D human activity recognition
  • 3-D imaging
  • dynamic integral imaging
  • long-range integral imaging
  • material analysis
  • multidimensional object recognition
  • multispectral imaging
  • photon counting
  • polarimetric imaging

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering


Dive into the research topics of 'Multidimensional Optical Sensing and Imaging System (MOSIS): From Macroscales to Microscales'. Together they form a unique fingerprint.

Cite this