Data Fusion of Spectral and Visible Images for Resolution Enhancement of Fraction Maps Through Neural Network and Spatial Statistical Features

Fadi Kizel, Jon Atli Benediktsson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

A new methodology is proposed for the enhancement of endmember (EMs) fractions' maps. The new method, termed DFNeFE (data fusion through neural-network for fraction estimation), is based on the fusion of a multispectral image, with low spatial resolution (LSR) and a visible RGB image, with high spatial restitution (HSR), through a back propagation neural network (BPNN). First, the fraction maps of a set of EMs are estimated for the spectral image using an accurate unmixing method. Then spatial statistical features (SSFs) are extracted from both images and a BPNN is trained to learn the relationship between the fractions, the visible bands of the HSR image and the SSFs based on invariant points (IPs) which are assumed to have the same land cover type in both the multispectral and visible images. Using an automatic method for IP extraction, we can also apply our method to images that are not co-registered. An evaluation of the proposed method, is carried out using a real data set with two spectral images acquired by Landsat -8 and Sentine1-2 satellites, and an RGB image available in Google Earth.

Original languageEnglish
Title of host publication2018 9th Workshop on Hyperspectral Image and Signal Processing
Subtitle of host publicationEvolution in Remote Sensing, WHISPERS 2018
ISBN (Electronic)9781728115818
DOIs
StatePublished - Sep 2018
Event9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing, WHISPERS 2018 - Amsterdam, Netherlands
Duration: 23 Sep 201826 Sep 2018

Publication series

NameWorkshop on Hyperspectral Image and Signal Processing, Evolution in Remote Sensing
Volume2018-September

Conference

Conference9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing, WHISPERS 2018
Country/TerritoryNetherlands
CityAmsterdam
Period23/09/1826/09/18

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'Data Fusion of Spectral and Visible Images for Resolution Enhancement of Fraction Maps Through Neural Network and Spatial Statistical Features'. Together they form a unique fingerprint.

Cite this