Evaluating supervised learning approaches for spatial-domain multi-focus image fusion

Abstract Image fusion is the generation of an image f that combines the most relevant information from a set of images of the same scene, acquired with different cameras or camera settings. Multi-Focus Image Fusion (MFIF) aims to generate an image fe with extended depth-of-field from a set of images taken at different focal distances or focal planes, and it proposes a solution to the typical limited depth-of-field problem in an optical system configuration. A broad variety of works presented in the literature address this problem. The primary approaches found there are domain transformations and block-of-pixels analysis. In this work, we evaluate different systems of supervised machine learning applied to MFIF, including k-nearest neighbors, linear discriminant analysis, neural networks, and support vector machines. We started from two images at different focal distances and divided them into rectangular regions. The main objective of the machine-learning-based classification system is to choose the parts of both images that must be in the fused image in order to obtain a completely focused image. For focus quantification, we used the most popular metrics proposed in the literature, such as: Laplacian energy, sum-modified Laplacian, and gradient energy, among others. The evaluation of the proposed method considered classifier testing and fusion quality metrics commonly used in research, such as visual information fidelity and mutual information feature. Our results strongly suggest that the automatic classification concept satisfactorily addresses the MFIF problem.

Saved in:
Bibliographic Details
Main Authors: Atencio-Ortiz,Pedro, Sanchez-Torres,German, Branch-Bedoya,John William
Format: Digital revista
Language:English
Published: Universidad Nacional de Colombia 2017
Online Access:http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0012-73532017000300137
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:scielo:S0012-73532017000300137
record_format ojs
spelling oai:scielo:S0012-735320170003001372017-12-18Evaluating supervised learning approaches for spatial-domain multi-focus image fusionAtencio-Ortiz,PedroSanchez-Torres,GermanBranch-Bedoya,John William Multi-focus image fusion image processing supervised learning machine learning. Abstract Image fusion is the generation of an image f that combines the most relevant information from a set of images of the same scene, acquired with different cameras or camera settings. Multi-Focus Image Fusion (MFIF) aims to generate an image fe with extended depth-of-field from a set of images taken at different focal distances or focal planes, and it proposes a solution to the typical limited depth-of-field problem in an optical system configuration. A broad variety of works presented in the literature address this problem. The primary approaches found there are domain transformations and block-of-pixels analysis. In this work, we evaluate different systems of supervised machine learning applied to MFIF, including k-nearest neighbors, linear discriminant analysis, neural networks, and support vector machines. We started from two images at different focal distances and divided them into rectangular regions. The main objective of the machine-learning-based classification system is to choose the parts of both images that must be in the fused image in order to obtain a completely focused image. For focus quantification, we used the most popular metrics proposed in the literature, such as: Laplacian energy, sum-modified Laplacian, and gradient energy, among others. The evaluation of the proposed method considered classifier testing and fusion quality metrics commonly used in research, such as visual information fidelity and mutual information feature. Our results strongly suggest that the automatic classification concept satisfactorily addresses the MFIF problem.info:eu-repo/semantics/openAccessUniversidad Nacional de ColombiaDYNA v.84 n.202 20172017-09-01info:eu-repo/semantics/articletext/htmlhttp://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0012-73532017000300137en10.15446/dyna.v84n202.63389
institution SCIELO
collection OJS
country Colombia
countrycode CO
component Revista
access En linea
databasecode rev-scielo-co
tag revista
region America del Sur
libraryname SciELO
language English
format Digital
author Atencio-Ortiz,Pedro
Sanchez-Torres,German
Branch-Bedoya,John William
spellingShingle Atencio-Ortiz,Pedro
Sanchez-Torres,German
Branch-Bedoya,John William
Evaluating supervised learning approaches for spatial-domain multi-focus image fusion
author_facet Atencio-Ortiz,Pedro
Sanchez-Torres,German
Branch-Bedoya,John William
author_sort Atencio-Ortiz,Pedro
title Evaluating supervised learning approaches for spatial-domain multi-focus image fusion
title_short Evaluating supervised learning approaches for spatial-domain multi-focus image fusion
title_full Evaluating supervised learning approaches for spatial-domain multi-focus image fusion
title_fullStr Evaluating supervised learning approaches for spatial-domain multi-focus image fusion
title_full_unstemmed Evaluating supervised learning approaches for spatial-domain multi-focus image fusion
title_sort evaluating supervised learning approaches for spatial-domain multi-focus image fusion
description Abstract Image fusion is the generation of an image f that combines the most relevant information from a set of images of the same scene, acquired with different cameras or camera settings. Multi-Focus Image Fusion (MFIF) aims to generate an image fe with extended depth-of-field from a set of images taken at different focal distances or focal planes, and it proposes a solution to the typical limited depth-of-field problem in an optical system configuration. A broad variety of works presented in the literature address this problem. The primary approaches found there are domain transformations and block-of-pixels analysis. In this work, we evaluate different systems of supervised machine learning applied to MFIF, including k-nearest neighbors, linear discriminant analysis, neural networks, and support vector machines. We started from two images at different focal distances and divided them into rectangular regions. The main objective of the machine-learning-based classification system is to choose the parts of both images that must be in the fused image in order to obtain a completely focused image. For focus quantification, we used the most popular metrics proposed in the literature, such as: Laplacian energy, sum-modified Laplacian, and gradient energy, among others. The evaluation of the proposed method considered classifier testing and fusion quality metrics commonly used in research, such as visual information fidelity and mutual information feature. Our results strongly suggest that the automatic classification concept satisfactorily addresses the MFIF problem.
publisher Universidad Nacional de Colombia
publishDate 2017
url http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0012-73532017000300137
work_keys_str_mv AT atencioortizpedro evaluatingsupervisedlearningapproachesforspatialdomainmultifocusimagefusion
AT sancheztorresgerman evaluatingsupervisedlearningapproachesforspatialdomainmultifocusimagefusion
AT branchbedoyajohnwilliam evaluatingsupervisedlearningapproachesforspatialdomainmultifocusimagefusion
_version_ 1755932689029922816