A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Nicolas Francos
  • Daniela Heller-Pearlshtien
  • Jose A.M. Dematte
  • Bas Van Wesemael
  • Robert Milewski
  • Sabine Chabrillat
  • Nikolaos Tziolas
  • Adrian Sanz Diaz
  • Maria Julia Yague Ballester
  • Asa Gholizadeh
  • Eyal Ben-Dor

Research Organisations

External Research Organisations

  • Tel Aviv University
  • Universidade de Sao Paulo
  • Université catholique de Louvain (UCL)
  • Helmholtz Centre Potsdam - German Research Centre for Geosciences (GFZ)
  • University of Florida
  • GMV Aerospace and Defence S.A.
  • Czech University of Life Sciences Prague
  • Aristotle University of Thessaloniki (A.U.Th.)
View graph of relations

Details

Original languageEnglish
Article number4155390
JournalApplied and Environmental Soil Science
Volume2023
Publication statusPublished - 20 Jan 2023

Abstract

Soil spectral libraries (SSLs) are important big-data archives (spectra associated with soil properties) that are analyzed via machine-learning algorithms to estimate soil attributes. Since different spectral measurement protocols are applied when constructing SSLs, it is necessary to examine harmonization techniques to merge the data. In recent years, several techniques for harmonization have been proposed, among which the internal soil standard (ISS) protocol is the most largely applied and has demonstrated its capacity to rectify systematic effects during spectral measurements. Here, we postulate that a spectral transfer function (TF) can be extracted between existing (old) SSLs if a subset of samples from two (or more) different SSLs are remeasured using the ISS protocol. A machine-learning TF strategy was developed, assembling random forest (RF) spectral-based models to predict the ISS spectral condition using soil samples from two existing SSLs. These SSLs had already been measured using different protocols without any ISS treatment the Brazilian (BSSL, generated in 2019) and the European (LUCAS, generated in 2009-2012) SSLs. To verify the TF's ability to improve the spectral assessment of soil attributes after harmonizing the different SSLs' protocols, RF spectral-based models for estimating organic carbon (OC) in soil were developed. The results showed high spectral similarities between the ISS and the ISS-TF spectral observations, indicating that post-ISS rectification is possible. Furthermore, after merging the SSLs with the TFs, the spectral-based assessment of OC was considerably improved, from R2 = 0.61, RMSE (g/kg) = 12.46 to R2 = 0.69, RMSE (g/kg) = 11.13. Given our results, this paper enhances the importance of soil spectroscopy by contributing to analyses in remote sensing, soil surveys, and digital soil mapping.

ASJC Scopus subject areas

Cite this

A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols. / Francos, Nicolas; Heller-Pearlshtien, Daniela; Dematte, Jose A.M. et al.
In: Applied and Environmental Soil Science, Vol. 2023, 4155390, 20.01.2023.

Research output: Contribution to journalArticleResearchpeer review

Francos, N, Heller-Pearlshtien, D, Dematte, JAM, Van Wesemael, B, Milewski, R, Chabrillat, S, Tziolas, N, Sanz Diaz, A, Yague Ballester, MJ, Gholizadeh, A & Ben-Dor, E 2023, 'A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols', Applied and Environmental Soil Science, vol. 2023, 4155390. https://doi.org/10.1155/2023/4155390
Francos, N., Heller-Pearlshtien, D., Dematte, J. A. M., Van Wesemael, B., Milewski, R., Chabrillat, S., Tziolas, N., Sanz Diaz, A., Yague Ballester, M. J., Gholizadeh, A., & Ben-Dor, E. (2023). A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols. Applied and Environmental Soil Science, 2023, Article 4155390. https://doi.org/10.1155/2023/4155390
Francos N, Heller-Pearlshtien D, Dematte JAM, Van Wesemael B, Milewski R, Chabrillat S et al. A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols. Applied and Environmental Soil Science. 2023 Jan 20;2023:4155390. doi: 10.1155/2023/4155390
Francos, Nicolas ; Heller-Pearlshtien, Daniela ; Dematte, Jose A.M. et al. / A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols. In: Applied and Environmental Soil Science. 2023 ; Vol. 2023.
Download
@article{f0ec34b2d2574f7680565a5ce0839aae,
title = "A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols",
abstract = "Soil spectral libraries (SSLs) are important big-data archives (spectra associated with soil properties) that are analyzed via machine-learning algorithms to estimate soil attributes. Since different spectral measurement protocols are applied when constructing SSLs, it is necessary to examine harmonization techniques to merge the data. In recent years, several techniques for harmonization have been proposed, among which the internal soil standard (ISS) protocol is the most largely applied and has demonstrated its capacity to rectify systematic effects during spectral measurements. Here, we postulate that a spectral transfer function (TF) can be extracted between existing (old) SSLs if a subset of samples from two (or more) different SSLs are remeasured using the ISS protocol. A machine-learning TF strategy was developed, assembling random forest (RF) spectral-based models to predict the ISS spectral condition using soil samples from two existing SSLs. These SSLs had already been measured using different protocols without any ISS treatment the Brazilian (BSSL, generated in 2019) and the European (LUCAS, generated in 2009-2012) SSLs. To verify the TF's ability to improve the spectral assessment of soil attributes after harmonizing the different SSLs' protocols, RF spectral-based models for estimating organic carbon (OC) in soil were developed. The results showed high spectral similarities between the ISS and the ISS-TF spectral observations, indicating that post-ISS rectification is possible. Furthermore, after merging the SSLs with the TFs, the spectral-based assessment of OC was considerably improved, from R2 = 0.61, RMSE (g/kg) = 12.46 to R2 = 0.69, RMSE (g/kg) = 11.13. Given our results, this paper enhances the importance of soil spectroscopy by contributing to analyses in remote sensing, soil surveys, and digital soil mapping.",
author = "Nicolas Francos and Daniela Heller-Pearlshtien and Dematte, {Jose A.M.} and {Van Wesemael}, Bas and Robert Milewski and Sabine Chabrillat and Nikolaos Tziolas and {Sanz Diaz}, Adrian and {Yague Ballester}, {Maria Julia} and Asa Gholizadeh and Eyal Ben-Dor",
note = "This work has been partially funded by the “WORLD SOILS” project supported by the European Space Agency developed within the EO Science for Society slice of the 5th Earth Observation Envelope and by the ProbeField project in the framework of the H2020 European Joint Programme for SOIL.",
year = "2023",
month = jan,
day = "20",
doi = "10.1155/2023/4155390",
language = "English",
volume = "2023",

}

Download

TY - JOUR

T1 - A Spectral Transfer Function to Harmonize Existing Soil Spectral Libraries Generated by Different Protocols

AU - Francos, Nicolas

AU - Heller-Pearlshtien, Daniela

AU - Dematte, Jose A.M.

AU - Van Wesemael, Bas

AU - Milewski, Robert

AU - Chabrillat, Sabine

AU - Tziolas, Nikolaos

AU - Sanz Diaz, Adrian

AU - Yague Ballester, Maria Julia

AU - Gholizadeh, Asa

AU - Ben-Dor, Eyal

N1 - This work has been partially funded by the “WORLD SOILS” project supported by the European Space Agency developed within the EO Science for Society slice of the 5th Earth Observation Envelope and by the ProbeField project in the framework of the H2020 European Joint Programme for SOIL.

PY - 2023/1/20

Y1 - 2023/1/20

N2 - Soil spectral libraries (SSLs) are important big-data archives (spectra associated with soil properties) that are analyzed via machine-learning algorithms to estimate soil attributes. Since different spectral measurement protocols are applied when constructing SSLs, it is necessary to examine harmonization techniques to merge the data. In recent years, several techniques for harmonization have been proposed, among which the internal soil standard (ISS) protocol is the most largely applied and has demonstrated its capacity to rectify systematic effects during spectral measurements. Here, we postulate that a spectral transfer function (TF) can be extracted between existing (old) SSLs if a subset of samples from two (or more) different SSLs are remeasured using the ISS protocol. A machine-learning TF strategy was developed, assembling random forest (RF) spectral-based models to predict the ISS spectral condition using soil samples from two existing SSLs. These SSLs had already been measured using different protocols without any ISS treatment the Brazilian (BSSL, generated in 2019) and the European (LUCAS, generated in 2009-2012) SSLs. To verify the TF's ability to improve the spectral assessment of soil attributes after harmonizing the different SSLs' protocols, RF spectral-based models for estimating organic carbon (OC) in soil were developed. The results showed high spectral similarities between the ISS and the ISS-TF spectral observations, indicating that post-ISS rectification is possible. Furthermore, after merging the SSLs with the TFs, the spectral-based assessment of OC was considerably improved, from R2 = 0.61, RMSE (g/kg) = 12.46 to R2 = 0.69, RMSE (g/kg) = 11.13. Given our results, this paper enhances the importance of soil spectroscopy by contributing to analyses in remote sensing, soil surveys, and digital soil mapping.

AB - Soil spectral libraries (SSLs) are important big-data archives (spectra associated with soil properties) that are analyzed via machine-learning algorithms to estimate soil attributes. Since different spectral measurement protocols are applied when constructing SSLs, it is necessary to examine harmonization techniques to merge the data. In recent years, several techniques for harmonization have been proposed, among which the internal soil standard (ISS) protocol is the most largely applied and has demonstrated its capacity to rectify systematic effects during spectral measurements. Here, we postulate that a spectral transfer function (TF) can be extracted between existing (old) SSLs if a subset of samples from two (or more) different SSLs are remeasured using the ISS protocol. A machine-learning TF strategy was developed, assembling random forest (RF) spectral-based models to predict the ISS spectral condition using soil samples from two existing SSLs. These SSLs had already been measured using different protocols without any ISS treatment the Brazilian (BSSL, generated in 2019) and the European (LUCAS, generated in 2009-2012) SSLs. To verify the TF's ability to improve the spectral assessment of soil attributes after harmonizing the different SSLs' protocols, RF spectral-based models for estimating organic carbon (OC) in soil were developed. The results showed high spectral similarities between the ISS and the ISS-TF spectral observations, indicating that post-ISS rectification is possible. Furthermore, after merging the SSLs with the TFs, the spectral-based assessment of OC was considerably improved, from R2 = 0.61, RMSE (g/kg) = 12.46 to R2 = 0.69, RMSE (g/kg) = 11.13. Given our results, this paper enhances the importance of soil spectroscopy by contributing to analyses in remote sensing, soil surveys, and digital soil mapping.

UR - http://www.scopus.com/inward/record.url?scp=85147098731&partnerID=8YFLogxK

U2 - 10.1155/2023/4155390

DO - 10.1155/2023/4155390

M3 - Article

AN - SCOPUS:85147098731

VL - 2023

JO - Applied and Environmental Soil Science

JF - Applied and Environmental Soil Science

SN - 1687-7667

M1 - 4155390

ER -