Why LASSO, EN, and CLOT: Invariance-Based Explanation

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandBeitrag in Buch/SammelwerkForschungPeer-Review

Autoren

Organisationseinheiten

Externe Organisationen

  • University of Texas at El Paso
  • Vietnam National University Ho Chi Minh City
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksData Science for Financial Econometrics
ErscheinungsortCham
Herausgeber (Verlag)Springer Science and Business Media Deutschland GmbH
Seiten37-50
Seitenumfang14
ISBN (elektronisch)978-3-030-48853-6
ISBN (Print)978-3-030-48852-9
PublikationsstatusVeröffentlicht - 14 Nov. 2020

Publikationsreihe

NameStudies in Computational Intelligence
Band898
ISSN (Print)1860-949X
ISSN (elektronisch)1860-9503

Abstract

In many practical situations, observations and measurement results are consistent with many different models—i.e., the corresponding problem is ill-posed. In such situations, a reasonable idea is to take into account that the values of the corresponding parameters should not be too large; this idea is known as regularization. Several different regularization techniques have been proposed; empirically the most successful are LASSO method, when we bound the sum of absolute values of the parameters, and EN and CLOT methods in which this sum is combined with the sum of the squares. In this paper, we explain the empirical success of these methods by showing that they are the only ones which are invariant with respect to natural transformations—like scaling which corresponds to selecting a different measuring unit.

ASJC Scopus Sachgebiete

Zitieren

Why LASSO, EN, and CLOT: Invariance-Based Explanation. / Alkhatib, Hamza; Neumann, Ingo; Kreinovich, Vladik et al.
Data Science for Financial Econometrics. Cham: Springer Science and Business Media Deutschland GmbH, 2020. S. 37-50 (Studies in Computational Intelligence; Band 898).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandBeitrag in Buch/SammelwerkForschungPeer-Review

Alkhatib, H, Neumann, I, Kreinovich, V & Van Le, C 2020, Why LASSO, EN, and CLOT: Invariance-Based Explanation. in Data Science for Financial Econometrics. Studies in Computational Intelligence, Bd. 898, Springer Science and Business Media Deutschland GmbH, Cham, S. 37-50. https://doi.org/10.1007/978-3-030-48853-6_2
Alkhatib, H., Neumann, I., Kreinovich, V., & Van Le, C. (2020). Why LASSO, EN, and CLOT: Invariance-Based Explanation. In Data Science for Financial Econometrics (S. 37-50). (Studies in Computational Intelligence; Band 898). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-48853-6_2
Alkhatib H, Neumann I, Kreinovich V, Van Le C. Why LASSO, EN, and CLOT: Invariance-Based Explanation. in Data Science for Financial Econometrics. Cham: Springer Science and Business Media Deutschland GmbH. 2020. S. 37-50. (Studies in Computational Intelligence). doi: 10.1007/978-3-030-48853-6_2
Alkhatib, Hamza ; Neumann, Ingo ; Kreinovich, Vladik et al. / Why LASSO, EN, and CLOT : Invariance-Based Explanation. Data Science for Financial Econometrics. Cham : Springer Science and Business Media Deutschland GmbH, 2020. S. 37-50 (Studies in Computational Intelligence).
Download
@inbook{52873ba9fc634310be2f378f757f15a8,
title = "Why LASSO, EN, and CLOT: Invariance-Based Explanation",
abstract = "In many practical situations, observations and measurement results are consistent with many different models—i.e., the corresponding problem is ill-posed. In such situations, a reasonable idea is to take into account that the values of the corresponding parameters should not be too large; this idea is known as regularization. Several different regularization techniques have been proposed; empirically the most successful are LASSO method, when we bound the sum of absolute values of the parameters, and EN and CLOT methods in which this sum is combined with the sum of the squares. In this paper, we explain the empirical success of these methods by showing that they are the only ones which are invariant with respect to natural transformations—like scaling which corresponds to selecting a different measuring unit.",
author = "Hamza Alkhatib and Ingo Neumann and Vladik Kreinovich and {Van Le}, Chon",
note = "Funding Information: Acknowledgements This work was supported by the Institute of Geodesy, Leibniz University of Hannover. It was also supported in part by the US National Science Foundation grants 1623190 (A Model of Change for Preparing a New Generation for Professional Practice in Computer Science) and HRD-1242122 (Cyber-ShARE Center of Excellence). This paper was written when V. Kreinovich was visiting Leibniz University of Hannover.",
year = "2020",
month = nov,
day = "14",
doi = "10.1007/978-3-030-48853-6_2",
language = "English",
isbn = "978-3-030-48852-9",
series = "Studies in Computational Intelligence",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "37--50",
booktitle = "Data Science for Financial Econometrics",
address = "Germany",

}

Download

TY - CHAP

T1 - Why LASSO, EN, and CLOT

T2 - Invariance-Based Explanation

AU - Alkhatib, Hamza

AU - Neumann, Ingo

AU - Kreinovich, Vladik

AU - Van Le, Chon

N1 - Funding Information: Acknowledgements This work was supported by the Institute of Geodesy, Leibniz University of Hannover. It was also supported in part by the US National Science Foundation grants 1623190 (A Model of Change for Preparing a New Generation for Professional Practice in Computer Science) and HRD-1242122 (Cyber-ShARE Center of Excellence). This paper was written when V. Kreinovich was visiting Leibniz University of Hannover.

PY - 2020/11/14

Y1 - 2020/11/14

N2 - In many practical situations, observations and measurement results are consistent with many different models—i.e., the corresponding problem is ill-posed. In such situations, a reasonable idea is to take into account that the values of the corresponding parameters should not be too large; this idea is known as regularization. Several different regularization techniques have been proposed; empirically the most successful are LASSO method, when we bound the sum of absolute values of the parameters, and EN and CLOT methods in which this sum is combined with the sum of the squares. In this paper, we explain the empirical success of these methods by showing that they are the only ones which are invariant with respect to natural transformations—like scaling which corresponds to selecting a different measuring unit.

AB - In many practical situations, observations and measurement results are consistent with many different models—i.e., the corresponding problem is ill-posed. In such situations, a reasonable idea is to take into account that the values of the corresponding parameters should not be too large; this idea is known as regularization. Several different regularization techniques have been proposed; empirically the most successful are LASSO method, when we bound the sum of absolute values of the parameters, and EN and CLOT methods in which this sum is combined with the sum of the squares. In this paper, we explain the empirical success of these methods by showing that they are the only ones which are invariant with respect to natural transformations—like scaling which corresponds to selecting a different measuring unit.

UR - http://www.scopus.com/inward/record.url?scp=85096207492&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-48853-6_2

DO - 10.1007/978-3-030-48853-6_2

M3 - Contribution to book/anthology

AN - SCOPUS:85096207492

SN - 978-3-030-48852-9

T3 - Studies in Computational Intelligence

SP - 37

EP - 50

BT - Data Science for Financial Econometrics

PB - Springer Science and Business Media Deutschland GmbH

CY - Cham

ER -

Von denselben Autoren