Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

  • Torben Peters
  • Claus Brenner
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)257-269
Seitenumfang13
FachzeitschriftPFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science
Jahrgang88
Ausgabenummer3-4
Frühes Online-Datum7 Juli 2020
PublikationsstatusVeröffentlicht - Aug. 2020

Abstract

We investigate whether conditional generative adversarial networks (C-GANs) are suitable for point cloud rendering. For this purpose, we created a dataset containing approximately 150,000 renderings of point cloud–image pairs. The dataset was recorded using our mobile mapping system, with capture dates that spread across 1 year. Our model learns how to predict realistically looking images from just point cloud data. We show that we can use this approach to colourize point clouds without the usage of any camera images. Additionally, we show that by parameterizing the recording date, we are even able to predict realistically looking views for different seasons, from identical input point clouds.

ASJC Scopus Sachgebiete

Zitieren

Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering. / Peters, Torben; Brenner, Claus.
in: PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science, Jahrgang 88, Nr. 3-4, 08.2020, S. 257-269.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Peters, T & Brenner, C 2020, 'Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering', PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science, Jg. 88, Nr. 3-4, S. 257-269. https://doi.org/10.1007/s41064-020-00114-z
Peters, T., & Brenner, C. (2020). Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering. PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 88(3-4), 257-269. https://doi.org/10.1007/s41064-020-00114-z
Peters T, Brenner C. Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering. PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science. 2020 Aug;88(3-4):257-269. Epub 2020 Jul 7. doi: 10.1007/s41064-020-00114-z
Peters, Torben ; Brenner, Claus. / Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering. in: PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science. 2020 ; Jahrgang 88, Nr. 3-4. S. 257-269.
Download
@article{38f8b045059941d4be175e4aeaf47632,
title = "Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering",
abstract = "We investigate whether conditional generative adversarial networks (C-GANs) are suitable for point cloud rendering. For this purpose, we created a dataset containing approximately 150,000 renderings of point cloud–image pairs. The dataset was recorded using our mobile mapping system, with capture dates that spread across 1 year. Our model learns how to predict realistically looking images from just point cloud data. We show that we can use this approach to colourize point clouds without the usage of any camera images. Additionally, we show that by parameterizing the recording date, we are even able to predict realistically looking views for different seasons, from identical input point clouds.",
keywords = "Deep learning, GAN, Point cloud",
author = "Torben Peters and Claus Brenner",
note = "Funding information: Open Access funding provided by Projekt DEAL. This work was funded by the German Research Foundation (DFG) as a part of the Research Training Group GRK2159, {\textquoteleft}Integrity and collaboration in dynamic sensor networks{\textquoteright} (i.c.sens).",
year = "2020",
month = aug,
doi = "10.1007/s41064-020-00114-z",
language = "English",
volume = "88",
pages = "257--269",
number = "3-4",

}

Download

TY - JOUR

T1 - Conditional Adversarial Networks for Multimodal Photo-Realistic Point Cloud Rendering

AU - Peters, Torben

AU - Brenner, Claus

N1 - Funding information: Open Access funding provided by Projekt DEAL. This work was funded by the German Research Foundation (DFG) as a part of the Research Training Group GRK2159, ‘Integrity and collaboration in dynamic sensor networks’ (i.c.sens).

PY - 2020/8

Y1 - 2020/8

N2 - We investigate whether conditional generative adversarial networks (C-GANs) are suitable for point cloud rendering. For this purpose, we created a dataset containing approximately 150,000 renderings of point cloud–image pairs. The dataset was recorded using our mobile mapping system, with capture dates that spread across 1 year. Our model learns how to predict realistically looking images from just point cloud data. We show that we can use this approach to colourize point clouds without the usage of any camera images. Additionally, we show that by parameterizing the recording date, we are even able to predict realistically looking views for different seasons, from identical input point clouds.

AB - We investigate whether conditional generative adversarial networks (C-GANs) are suitable for point cloud rendering. For this purpose, we created a dataset containing approximately 150,000 renderings of point cloud–image pairs. The dataset was recorded using our mobile mapping system, with capture dates that spread across 1 year. Our model learns how to predict realistically looking images from just point cloud data. We show that we can use this approach to colourize point clouds without the usage of any camera images. Additionally, we show that by parameterizing the recording date, we are even able to predict realistically looking views for different seasons, from identical input point clouds.

KW - Deep learning

KW - GAN

KW - Point cloud

UR - http://www.scopus.com/inward/record.url?scp=85087646238&partnerID=8YFLogxK

U2 - 10.1007/s41064-020-00114-z

DO - 10.1007/s41064-020-00114-z

M3 - Article

AN - SCOPUS:85087646238

VL - 88

SP - 257

EP - 269

JO - PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science

JF - PFG - Journal of Photogrammetry, Remote Sensing and Geoinformation Science

SN - 2512-2789

IS - 3-4

ER -