An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter

Research output: Contribution to journalArticleResearchpeer review

Authors

  • José L. Safanelli
  • Jonathan Sanderman
  • Dellena Bloom
  • Katherine Todd-Brown
  • Leandro L. Parente
  • Tomislav Hengl
  • Sean Adam
  • Franck Albinet
  • Eyal Ben-Dor
  • Claudia M. Boot
  • James H. Bridson
  • Sabine Chabrillat
  • Leonardo Deiss
  • José A.M. Demattê
  • M. Scott Demyan
  • Gerd Dercon
  • Sebastian Doetterl
  • Fenny van Egmond
  • Rich Ferguson
  • Loretta G. Garrett
  • Michelle L. Haddix
  • Stephan M. Haefele
  • Maria Heiling
  • Javier Hernandez-Allica
  • Jingyi Huang
  • Julie D. Jastrow
  • Konstantinos Karyotis
  • Megan B. Machmuller
  • Malefetsane Khesuoe
  • Andrew Margenot
  • Roser Matamala
  • Jessica R. Miesel
  • Abdul M. Mouazen
  • Penelope Nagel
  • Sunita Patel
  • Muhammad Qaswar
  • Selebalo Ramakhanna
  • Christian Resch
  • Jean Robertson
  • Pierre Roudier
  • Marmar Sabetizade
  • Itamar Shabtai
  • Faisal Sherif
  • Nishant Sinha
  • Johan Six
  • Laura Summerauer
  • Cathy L. Thomas
  • Arsenio Toloza
  • Beata Tomczyk-Wójtowicz
  • Nikolaos L. Tsakiridis
  • Bas van Wesemael
  • Finnleigh Woodings
  • George C. Zalidis
  • Wiktor R. Żelazny

Research Organisations

External Research Organisations

  • Woodwell Climate Research Center
  • University of Florida
  • OpenGeoHub Foundation
  • TU Bergakademie Freiberg - University of Resources
  • International Atomic Energy Agency (IAEA)
  • KU Leuven
  • Tel Aviv University
  • Colorado State University
  • New Zealand Forest Research Institute Limited
  • Helmholtz Centre Potsdam - German Research Centre for Geosciences
  • The Ohio State University
  • Universidade de Sao Paulo
  • ETH Zurich
  • Wageningen University and Research
  • USDA-NRCS Kellogg Soil Survey Laboratory (KSSL)
  • Rothamsted Research
  • University of Wisconsin
  • Argonne National Laboratory (ANL)
  • Aristotle University of Thessaloniki (A.U.Th.)
  • Ministry of Agriculture and Food Security Lesotho
  • University of Illinois at Urbana-Champaign
  • Michigan State University (MSU)
  • Ghent University
  • Persistence Data Mining Inc.
  • The James Hutton Institute
  • Landcare Research
  • Université catholique de Louvain (UCL)
  • Connecticut Agricultural Experiment Station
  • ICAR-Indian institute of soil science (ICAR-IISS)
  • Care4Agro B.V.
  • Research Institute of Crop Production
View graph of relations

Details

Original languageEnglish
Article number116724
Number of pages14
JournalGEODERMA
Volume440
Early online date1 Dec 2023
Publication statusPublished - Dec 2023

Abstract

Diffuse reflectance spectroscopy has been extensively employed to deliver timely and cost-effective predictions of a number of soil properties. However, although several soil spectral laboratories have been established worldwide, the distinct characteristics of instruments and operations still hamper further integration and interoperability across mid-infrared (MIR) soil spectral libraries. In this study, we conducted a large-scale ring trial experiment to understand the lab-to-lab variability of multiple MIR instruments. By developing a systematic evaluation of different mathematical treatments with modeling algorithms, including regular preprocessing and spectral standardization, we quantified and evaluated instruments' dissimilarity and how this impacts internal and shared model performance. We found that all instruments delivered good predictions when calibrated internally using the same instruments' characteristics and standard operating procedures by solely relying on regular spectral preprocessing that accounts for light scattering and multiplicative/additive effects, e.g., using standard normal variate (SNV). When performing model transfer from a large public library (the USDA NSSC-KSSL MIR library) to secondary instruments, good performance was also achieved by regular preprocessing (e.g., SNV) if both instruments shared the same manufacturer. However, significant differences between the KSSL MIR library and contrasting ring trial instruments responses were evident and confirmed by a semi-unsupervised spectral clustering. For heavily contrasting setups, spectral standardization was necessary before transferring prediction models. Non-linear model types like Cubist and memory-based learning delivered more precise estimates because they seemed to be less sensitive to spectral variations than global partial least square regression. In summary, the results from this study can assist new laboratories in building spectroscopy capacity utilizing existing MIR spectral libraries and support the recent global efforts to make soil spectroscopy universally accessible with centralized or shared operating procedures.

Keywords

    Calibration transfer, Chemometrics, Ring trial, Soil spectroscopy, Spectral standardization

ASJC Scopus subject areas

Cite this

An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter. / Safanelli, José L.; Sanderman, Jonathan; Bloom, Dellena et al.
In: GEODERMA, Vol. 440, 116724, 12.2023.

Research output: Contribution to journalArticleResearchpeer review

Safanelli, JL, Sanderman, J, Bloom, D, Todd-Brown, K, Parente, LL, Hengl, T, Adam, S, Albinet, F, Ben-Dor, E, Boot, CM, Bridson, JH, Chabrillat, S, Deiss, L, Demattê, JAM, Scott Demyan, M, Dercon, G, Doetterl, S, van Egmond, F, Ferguson, R, Garrett, LG, Haddix, ML, Haefele, SM, Heiling, M, Hernandez-Allica, J, Huang, J, Jastrow, JD, Karyotis, K, Machmuller, MB, Khesuoe, M, Margenot, A, Matamala, R, Miesel, JR, Mouazen, AM, Nagel, P, Patel, S, Qaswar, M, Ramakhanna, S, Resch, C, Robertson, J, Roudier, P, Sabetizade, M, Shabtai, I, Sherif, F, Sinha, N, Six, J, Summerauer, L, Thomas, CL, Toloza, A, Tomczyk-Wójtowicz, B, Tsakiridis, NL, van Wesemael, B, Woodings, F, Zalidis, GC & Żelazny, WR 2023, 'An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter', GEODERMA, vol. 440, 116724. https://doi.org/10.1016/j.geoderma.2023.116724
Safanelli, J. L., Sanderman, J., Bloom, D., Todd-Brown, K., Parente, L. L., Hengl, T., Adam, S., Albinet, F., Ben-Dor, E., Boot, C. M., Bridson, J. H., Chabrillat, S., Deiss, L., Demattê, J. A. M., Scott Demyan, M., Dercon, G., Doetterl, S., van Egmond, F., Ferguson, R., ... Żelazny, W. R. (2023). An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter. GEODERMA, 440, Article 116724. https://doi.org/10.1016/j.geoderma.2023.116724
Safanelli JL, Sanderman J, Bloom D, Todd-Brown K, Parente LL, Hengl T et al. An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter. GEODERMA. 2023 Dec;440:116724. Epub 2023 Dec 1. doi: 10.1016/j.geoderma.2023.116724
Safanelli, José L. ; Sanderman, Jonathan ; Bloom, Dellena et al. / An interlaboratory comparison of mid-infrared spectra acquisition : Instruments and procedures matter. In: GEODERMA. 2023 ; Vol. 440.
Download
@article{c28c9f53c15242bb8775610c53edd118,
title = "An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter",
abstract = "Diffuse reflectance spectroscopy has been extensively employed to deliver timely and cost-effective predictions of a number of soil properties. However, although several soil spectral laboratories have been established worldwide, the distinct characteristics of instruments and operations still hamper further integration and interoperability across mid-infrared (MIR) soil spectral libraries. In this study, we conducted a large-scale ring trial experiment to understand the lab-to-lab variability of multiple MIR instruments. By developing a systematic evaluation of different mathematical treatments with modeling algorithms, including regular preprocessing and spectral standardization, we quantified and evaluated instruments' dissimilarity and how this impacts internal and shared model performance. We found that all instruments delivered good predictions when calibrated internally using the same instruments' characteristics and standard operating procedures by solely relying on regular spectral preprocessing that accounts for light scattering and multiplicative/additive effects, e.g., using standard normal variate (SNV). When performing model transfer from a large public library (the USDA NSSC-KSSL MIR library) to secondary instruments, good performance was also achieved by regular preprocessing (e.g., SNV) if both instruments shared the same manufacturer. However, significant differences between the KSSL MIR library and contrasting ring trial instruments responses were evident and confirmed by a semi-unsupervised spectral clustering. For heavily contrasting setups, spectral standardization was necessary before transferring prediction models. Non-linear model types like Cubist and memory-based learning delivered more precise estimates because they seemed to be less sensitive to spectral variations than global partial least square regression. In summary, the results from this study can assist new laboratories in building spectroscopy capacity utilizing existing MIR spectral libraries and support the recent global efforts to make soil spectroscopy universally accessible with centralized or shared operating procedures.",
keywords = "Calibration transfer, Chemometrics, Ring trial, Soil spectroscopy, Spectral standardization",
author = "Safanelli, {Jos{\'e} L.} and Jonathan Sanderman and Dellena Bloom and Katherine Todd-Brown and Parente, {Leandro L.} and Tomislav Hengl and Sean Adam and Franck Albinet and Eyal Ben-Dor and Boot, {Claudia M.} and Bridson, {James H.} and Sabine Chabrillat and Leonardo Deiss and Dematt{\^e}, {Jos{\'e} A.M.} and {Scott Demyan}, M. and Gerd Dercon and Sebastian Doetterl and {van Egmond}, Fenny and Rich Ferguson and Garrett, {Loretta G.} and Haddix, {Michelle L.} and Haefele, {Stephan M.} and Maria Heiling and Javier Hernandez-Allica and Jingyi Huang and Jastrow, {Julie D.} and Konstantinos Karyotis and Machmuller, {Megan B.} and Malefetsane Khesuoe and Andrew Margenot and Roser Matamala and Miesel, {Jessica R.} and Mouazen, {Abdul M.} and Penelope Nagel and Sunita Patel and Muhammad Qaswar and Selebalo Ramakhanna and Christian Resch and Jean Robertson and Pierre Roudier and Marmar Sabetizade and Itamar Shabtai and Faisal Sherif and Nishant Sinha and Johan Six and Laura Summerauer and Thomas, {Cathy L.} and Arsenio Toloza and Beata Tomczyk-W{\'o}jtowicz and Tsakiridis, {Nikolaos L.} and {van Wesemael}, Bas and Finnleigh Woodings and Zalidis, {George C.} and {\.Z}elazny, {Wiktor R.}",
note = "Funding Information: Funding for this work came from USDA NIFA Award 2020-67021-32467 (Soil Spectroscopy for the Global Good). The authors would like to thank the staff at the NSSC-KSSL for facilitating this research and Matthew Jacques for preparing and shipping samples to all participants. We would like to thank Dr. Cathy Seybold and Dr. Jonathan Maynard for taking the time and effort necessary to review the manuscript as part of the USDA NRCS internal review, which helped us to improve the quality of the manuscript. In addition, C.M.B. received funding from the Grantham Foundation and support from the Analytical Resources Core RRID: SCR_021758, and thanks Olivia Hill for assistance with data collection; J.A.M.D. was supported by the Department of Soil Science, CNPq and FAPESP foundation 2014-22260-0, 2021-05129-8; L.G.G. J.H.B, and S.P. were supported by the Tree-Root-Microbiome program, which is funded by the New Zealand Ministry of Business, Innovation & Employment (MBIE) Endeavour Fund and in part by the New Zealand Forest Growers Levy Trust (C04X2002); M.H. was supported by USDA NRCS #NR193A750025C005; S.M.H. C.L.T. and J.H.A. were supported from the Growing Health Institute Strategic Programme [BB/X010953/1], funded by the Biotechnology and Biological Sciences Research Council of the United Kingdom (BBSRC); J.H. was supported by NSF Signals in the Soil Grant 2226568; J.D.J and R.M. were supported by the U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research, Environmental System Science Program, under contract DE-AC02-06CH11357; A.M. was funded by USDA NIFA #2020-67021-32799, project accession 1024178, and USDA NIFA #2021-68012-35896, project accession 1027512; A.H.J.R was funded by the Rural & Environment Science & Analytical Services Division of the Scottish Government; P.R. was supported by the Strategic Science Investment Funding for Crown Research Institutes from the New Zealand Ministry of Business, Innovation and Employment's Science and Innovation Group; J.S. S.D. and L.S. received core funding provided by ETH Zurich to purchase and maintain MIR instrumentation; V.R.{\.Z}. was supported by the Ministry of Agriculture of the Czech Republic, institutional support MZE-RO0423. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Trade names are solely used to provide information. Mention of trade names does not constitute a guarantee of the product nor does it imply endorsement over comparable products that are named or not named. ",
year = "2023",
month = dec,
doi = "10.1016/j.geoderma.2023.116724",
language = "English",
volume = "440",
journal = "GEODERMA",
issn = "0016-7061",
publisher = "Elsevier",

}

Download

TY - JOUR

T1 - An interlaboratory comparison of mid-infrared spectra acquisition

T2 - Instruments and procedures matter

AU - Safanelli, José L.

AU - Sanderman, Jonathan

AU - Bloom, Dellena

AU - Todd-Brown, Katherine

AU - Parente, Leandro L.

AU - Hengl, Tomislav

AU - Adam, Sean

AU - Albinet, Franck

AU - Ben-Dor, Eyal

AU - Boot, Claudia M.

AU - Bridson, James H.

AU - Chabrillat, Sabine

AU - Deiss, Leonardo

AU - Demattê, José A.M.

AU - Scott Demyan, M.

AU - Dercon, Gerd

AU - Doetterl, Sebastian

AU - van Egmond, Fenny

AU - Ferguson, Rich

AU - Garrett, Loretta G.

AU - Haddix, Michelle L.

AU - Haefele, Stephan M.

AU - Heiling, Maria

AU - Hernandez-Allica, Javier

AU - Huang, Jingyi

AU - Jastrow, Julie D.

AU - Karyotis, Konstantinos

AU - Machmuller, Megan B.

AU - Khesuoe, Malefetsane

AU - Margenot, Andrew

AU - Matamala, Roser

AU - Miesel, Jessica R.

AU - Mouazen, Abdul M.

AU - Nagel, Penelope

AU - Patel, Sunita

AU - Qaswar, Muhammad

AU - Ramakhanna, Selebalo

AU - Resch, Christian

AU - Robertson, Jean

AU - Roudier, Pierre

AU - Sabetizade, Marmar

AU - Shabtai, Itamar

AU - Sherif, Faisal

AU - Sinha, Nishant

AU - Six, Johan

AU - Summerauer, Laura

AU - Thomas, Cathy L.

AU - Toloza, Arsenio

AU - Tomczyk-Wójtowicz, Beata

AU - Tsakiridis, Nikolaos L.

AU - van Wesemael, Bas

AU - Woodings, Finnleigh

AU - Zalidis, George C.

AU - Żelazny, Wiktor R.

N1 - Funding Information: Funding for this work came from USDA NIFA Award 2020-67021-32467 (Soil Spectroscopy for the Global Good). The authors would like to thank the staff at the NSSC-KSSL for facilitating this research and Matthew Jacques for preparing and shipping samples to all participants. We would like to thank Dr. Cathy Seybold and Dr. Jonathan Maynard for taking the time and effort necessary to review the manuscript as part of the USDA NRCS internal review, which helped us to improve the quality of the manuscript. In addition, C.M.B. received funding from the Grantham Foundation and support from the Analytical Resources Core RRID: SCR_021758, and thanks Olivia Hill for assistance with data collection; J.A.M.D. was supported by the Department of Soil Science, CNPq and FAPESP foundation 2014-22260-0, 2021-05129-8; L.G.G. J.H.B, and S.P. were supported by the Tree-Root-Microbiome program, which is funded by the New Zealand Ministry of Business, Innovation & Employment (MBIE) Endeavour Fund and in part by the New Zealand Forest Growers Levy Trust (C04X2002); M.H. was supported by USDA NRCS #NR193A750025C005; S.M.H. C.L.T. and J.H.A. were supported from the Growing Health Institute Strategic Programme [BB/X010953/1], funded by the Biotechnology and Biological Sciences Research Council of the United Kingdom (BBSRC); J.H. was supported by NSF Signals in the Soil Grant 2226568; J.D.J and R.M. were supported by the U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research, Environmental System Science Program, under contract DE-AC02-06CH11357; A.M. was funded by USDA NIFA #2020-67021-32799, project accession 1024178, and USDA NIFA #2021-68012-35896, project accession 1027512; A.H.J.R was funded by the Rural & Environment Science & Analytical Services Division of the Scottish Government; P.R. was supported by the Strategic Science Investment Funding for Crown Research Institutes from the New Zealand Ministry of Business, Innovation and Employment's Science and Innovation Group; J.S. S.D. and L.S. received core funding provided by ETH Zurich to purchase and maintain MIR instrumentation; V.R.Ż. was supported by the Ministry of Agriculture of the Czech Republic, institutional support MZE-RO0423. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Trade names are solely used to provide information. Mention of trade names does not constitute a guarantee of the product nor does it imply endorsement over comparable products that are named or not named.

PY - 2023/12

Y1 - 2023/12

N2 - Diffuse reflectance spectroscopy has been extensively employed to deliver timely and cost-effective predictions of a number of soil properties. However, although several soil spectral laboratories have been established worldwide, the distinct characteristics of instruments and operations still hamper further integration and interoperability across mid-infrared (MIR) soil spectral libraries. In this study, we conducted a large-scale ring trial experiment to understand the lab-to-lab variability of multiple MIR instruments. By developing a systematic evaluation of different mathematical treatments with modeling algorithms, including regular preprocessing and spectral standardization, we quantified and evaluated instruments' dissimilarity and how this impacts internal and shared model performance. We found that all instruments delivered good predictions when calibrated internally using the same instruments' characteristics and standard operating procedures by solely relying on regular spectral preprocessing that accounts for light scattering and multiplicative/additive effects, e.g., using standard normal variate (SNV). When performing model transfer from a large public library (the USDA NSSC-KSSL MIR library) to secondary instruments, good performance was also achieved by regular preprocessing (e.g., SNV) if both instruments shared the same manufacturer. However, significant differences between the KSSL MIR library and contrasting ring trial instruments responses were evident and confirmed by a semi-unsupervised spectral clustering. For heavily contrasting setups, spectral standardization was necessary before transferring prediction models. Non-linear model types like Cubist and memory-based learning delivered more precise estimates because they seemed to be less sensitive to spectral variations than global partial least square regression. In summary, the results from this study can assist new laboratories in building spectroscopy capacity utilizing existing MIR spectral libraries and support the recent global efforts to make soil spectroscopy universally accessible with centralized or shared operating procedures.

AB - Diffuse reflectance spectroscopy has been extensively employed to deliver timely and cost-effective predictions of a number of soil properties. However, although several soil spectral laboratories have been established worldwide, the distinct characteristics of instruments and operations still hamper further integration and interoperability across mid-infrared (MIR) soil spectral libraries. In this study, we conducted a large-scale ring trial experiment to understand the lab-to-lab variability of multiple MIR instruments. By developing a systematic evaluation of different mathematical treatments with modeling algorithms, including regular preprocessing and spectral standardization, we quantified and evaluated instruments' dissimilarity and how this impacts internal and shared model performance. We found that all instruments delivered good predictions when calibrated internally using the same instruments' characteristics and standard operating procedures by solely relying on regular spectral preprocessing that accounts for light scattering and multiplicative/additive effects, e.g., using standard normal variate (SNV). When performing model transfer from a large public library (the USDA NSSC-KSSL MIR library) to secondary instruments, good performance was also achieved by regular preprocessing (e.g., SNV) if both instruments shared the same manufacturer. However, significant differences between the KSSL MIR library and contrasting ring trial instruments responses were evident and confirmed by a semi-unsupervised spectral clustering. For heavily contrasting setups, spectral standardization was necessary before transferring prediction models. Non-linear model types like Cubist and memory-based learning delivered more precise estimates because they seemed to be less sensitive to spectral variations than global partial least square regression. In summary, the results from this study can assist new laboratories in building spectroscopy capacity utilizing existing MIR spectral libraries and support the recent global efforts to make soil spectroscopy universally accessible with centralized or shared operating procedures.

KW - Calibration transfer

KW - Chemometrics

KW - Ring trial

KW - Soil spectroscopy

KW - Spectral standardization

UR - http://www.scopus.com/inward/record.url?scp=85178668878&partnerID=8YFLogxK

U2 - 10.1016/j.geoderma.2023.116724

DO - 10.1016/j.geoderma.2023.116724

M3 - Article

AN - SCOPUS:85178668878

VL - 440

JO - GEODERMA

JF - GEODERMA

SN - 0016-7061

M1 - 116724

ER -