TVCalib: Camera Calibration for Sports Field Registration in Soccer

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Jonas Theiner
  • Ralph Ewerth

Research Organisations

External Research Organisations

  • German National Library of Science and Technology (TIB)
View graph of relations

Details

Original languageEnglish
Title of host publication2023 IEEE Winter Conference on Applications of Computer Vision
Subtitle of host publicationWACV 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1166-1175
Number of pages10
ISBN (electronic)9781665493468
ISBN (print)978-1-6654-9347-5
Publication statusPublished - 2023
Event23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023 - Waikoloa, United States
Duration: 3 Jan 20237 Jan 2023

Publication series

NameIEEE Winter Conference on Applications of Computer Vision
ISSN (Print)2472-6737
ISSN (electronic)2642-9381

Abstract

Sports field registration in broadcast videos is typically interpreted as the task of homography estimation, which provides a mapping between a planar field and the corresponding visible area of the image. In contrast to previous approaches, we consider the task as a camera calibration problem. First, we introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences (e.g., lines, point clouds), based on pixel-level annotations for segments of a known calibration object. The calibration module iteratively minimizes the segment reprojection error induced by the estimated camera parameters. Second, we propose a novel approach for 3D sports field registration from broadcast soccer images. Compared to the typical solution, which subsequently refines an initial estimation, our solution does it in one step. The proposed method is evaluated for sports field registration on two datasets and achieves superior results compared to two state-of-the-art approaches.

Keywords

    Algorithms: 3D computer vision, Arts/games/social media, Image recognition and understanding (object detection, categorization, segmentation, scene modeling, visual reasoning)

ASJC Scopus subject areas

Cite this

TVCalib: Camera Calibration for Sports Field Registration in Soccer. / Theiner, Jonas; Ewerth, Ralph.
2023 IEEE Winter Conference on Applications of Computer Vision: WACV 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 1166-1175 (IEEE Winter Conference on Applications of Computer Vision).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Theiner, J & Ewerth, R 2023, TVCalib: Camera Calibration for Sports Field Registration in Soccer. in 2023 IEEE Winter Conference on Applications of Computer Vision: WACV 2023. IEEE Winter Conference on Applications of Computer Vision, Institute of Electrical and Electronics Engineers Inc., pp. 1166-1175, 23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023, Waikoloa, United States, 3 Jan 2023. https://doi.org/10.48550/arXiv.2207.11709, https://doi.org/10.1109/WACV56688.2023.00122
Theiner, J., & Ewerth, R. (2023). TVCalib: Camera Calibration for Sports Field Registration in Soccer. In 2023 IEEE Winter Conference on Applications of Computer Vision: WACV 2023 (pp. 1166-1175). (IEEE Winter Conference on Applications of Computer Vision). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.48550/arXiv.2207.11709, https://doi.org/10.1109/WACV56688.2023.00122
Theiner J, Ewerth R. TVCalib: Camera Calibration for Sports Field Registration in Soccer. In 2023 IEEE Winter Conference on Applications of Computer Vision: WACV 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 1166-1175. (IEEE Winter Conference on Applications of Computer Vision). doi: 10.48550/arXiv.2207.11709, 10.1109/WACV56688.2023.00122
Theiner, Jonas ; Ewerth, Ralph. / TVCalib : Camera Calibration for Sports Field Registration in Soccer. 2023 IEEE Winter Conference on Applications of Computer Vision: WACV 2023. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 1166-1175 (IEEE Winter Conference on Applications of Computer Vision).
Download
@inproceedings{5ed70d43622f48b38c03c04b19a9514a,
title = "TVCalib: Camera Calibration for Sports Field Registration in Soccer",
abstract = "Sports field registration in broadcast videos is typically interpreted as the task of homography estimation, which provides a mapping between a planar field and the corresponding visible area of the image. In contrast to previous approaches, we consider the task as a camera calibration problem. First, we introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences (e.g., lines, point clouds), based on pixel-level annotations for segments of a known calibration object. The calibration module iteratively minimizes the segment reprojection error induced by the estimated camera parameters. Second, we propose a novel approach for 3D sports field registration from broadcast soccer images. Compared to the typical solution, which subsequently refines an initial estimation, our solution does it in one step. The proposed method is evaluated for sports field registration on two datasets and achieves superior results compared to two state-of-the-art approaches.",
keywords = "Algorithms: 3D computer vision, Arts/games/social media, Image recognition and understanding (object detection, categorization, segmentation, scene modeling, visual reasoning)",
author = "Jonas Theiner and Ralph Ewerth",
note = "Funding Information: Thanks to Wolfgang Gritz and Eric M{\"u}ller-Budack for reviewing this paper, Jim Rhotert for the segmentation module and Markos Stamatakis for enriching the WC14 dataset. This project has received funding from the German Federal Ministry of Education and Research (BMBF – Bundesmin-isterium f{\"u}r Bildung und Forschung) under 01IS20021B.; 23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023 ; Conference date: 03-01-2023 Through 07-01-2023",
year = "2023",
doi = "10.48550/arXiv.2207.11709",
language = "English",
isbn = "978-1-6654-9347-5",
series = "IEEE Winter Conference on Applications of Computer Vision",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1166--1175",
booktitle = "2023 IEEE Winter Conference on Applications of Computer Vision",
address = "United States",

}

Download

TY - GEN

T1 - TVCalib

T2 - 23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023

AU - Theiner, Jonas

AU - Ewerth, Ralph

N1 - Funding Information: Thanks to Wolfgang Gritz and Eric Müller-Budack for reviewing this paper, Jim Rhotert for the segmentation module and Markos Stamatakis for enriching the WC14 dataset. This project has received funding from the German Federal Ministry of Education and Research (BMBF – Bundesmin-isterium für Bildung und Forschung) under 01IS20021B.

PY - 2023

Y1 - 2023

N2 - Sports field registration in broadcast videos is typically interpreted as the task of homography estimation, which provides a mapping between a planar field and the corresponding visible area of the image. In contrast to previous approaches, we consider the task as a camera calibration problem. First, we introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences (e.g., lines, point clouds), based on pixel-level annotations for segments of a known calibration object. The calibration module iteratively minimizes the segment reprojection error induced by the estimated camera parameters. Second, we propose a novel approach for 3D sports field registration from broadcast soccer images. Compared to the typical solution, which subsequently refines an initial estimation, our solution does it in one step. The proposed method is evaluated for sports field registration on two datasets and achieves superior results compared to two state-of-the-art approaches.

AB - Sports field registration in broadcast videos is typically interpreted as the task of homography estimation, which provides a mapping between a planar field and the corresponding visible area of the image. In contrast to previous approaches, we consider the task as a camera calibration problem. First, we introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences (e.g., lines, point clouds), based on pixel-level annotations for segments of a known calibration object. The calibration module iteratively minimizes the segment reprojection error induced by the estimated camera parameters. Second, we propose a novel approach for 3D sports field registration from broadcast soccer images. Compared to the typical solution, which subsequently refines an initial estimation, our solution does it in one step. The proposed method is evaluated for sports field registration on two datasets and achieves superior results compared to two state-of-the-art approaches.

KW - Algorithms: 3D computer vision

KW - Arts/games/social media

KW - Image recognition and understanding (object detection, categorization, segmentation, scene modeling, visual reasoning)

UR - http://www.scopus.com/inward/record.url?scp=85149032173&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2207.11709

DO - 10.48550/arXiv.2207.11709

M3 - Conference contribution

SN - 978-1-6654-9347-5

T3 - IEEE Winter Conference on Applications of Computer Vision

SP - 1166

EP - 1175

BT - 2023 IEEE Winter Conference on Applications of Computer Vision

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 3 January 2023 through 7 January 2023

ER -