The choice of code review process: A survey on the state of the practice

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationProduct-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings
EditorsBurak Turhan, Dietmar Winkler, Federica Sarro, Marcos Kalinowski, Daniel Mendez Fernandez, Michael Felderer
PublisherSpringer Verlag
Pages111-127
Number of pages17
ISBN (print)9783319699257
Publication statusPublished - 28 Oct 2017
Event18th International Conference on Product-Focused Software Process Improvement, PROFES 2017 - Innsbruck, Austria
Duration: 29 Nov 20171 Dec 2017

Publication series

NameLecture Notes in Computer Science
Volume10611 LNCS
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Code review has been known to be an effective quality assurance technique for decades. In the last years, industrial code review practices were observed to converge towards “change-based/modern code review”, but with a lot of variation in the details of the processes. Recent research also proposed hypotheses on factors that influence the choice of process. However, all current research in this area is based on small and largely non-random samples of cases. Therefore, we set out to assess the current state of the practice and to test some of these hypotheses with a survey among commercial software development teams. We received responses from 240 teams. They support many of the stated hypotheses, e.g., that change-based code review is the dominating style of code review in the industry, and that teams doing change-based code review have a lower risk that review use fades away. However, other hypotheses could not be confirmed, mainly that the balance of effects a team tries to reach with code reviews acts as a mediator in determining the details of the review process. Apart from these findings, we contribute the survey data set as a foundation for future research.

Keywords

    Change-based code review, Code inspections and walkthroughs, Code reviews, Empirical software engineering, Modern code review

ASJC Scopus subject areas

Cite this

The choice of code review process: A survey on the state of the practice. / Baum, Tobias; Leßmann, Hendrik; Schneider, Kurt.
Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings. ed. / Burak Turhan; Dietmar Winkler; Federica Sarro; Marcos Kalinowski; Daniel Mendez Fernandez; Michael Felderer. Springer Verlag, 2017. p. 111-127 (Lecture Notes in Computer Science; Vol. 10611 LNCS).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Baum, T, Leßmann, H & Schneider, K 2017, The choice of code review process: A survey on the state of the practice. in B Turhan, D Winkler, F Sarro, M Kalinowski, D Mendez Fernandez & M Felderer (eds), Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings. Lecture Notes in Computer Science, vol. 10611 LNCS, Springer Verlag, pp. 111-127, 18th International Conference on Product-Focused Software Process Improvement, PROFES 2017, Innsbruck, Austria, 29 Nov 2017. https://doi.org/10.1007/978-3-319-69926-4_9
Baum, T., Leßmann, H., & Schneider, K. (2017). The choice of code review process: A survey on the state of the practice. In B. Turhan, D. Winkler, F. Sarro, M. Kalinowski, D. Mendez Fernandez, & M. Felderer (Eds.), Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings (pp. 111-127). (Lecture Notes in Computer Science; Vol. 10611 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-69926-4_9
Baum T, Leßmann H, Schneider K. The choice of code review process: A survey on the state of the practice. In Turhan B, Winkler D, Sarro F, Kalinowski M, Mendez Fernandez D, Felderer M, editors, Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings. Springer Verlag. 2017. p. 111-127. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-69926-4_9
Baum, Tobias ; Leßmann, Hendrik ; Schneider, Kurt. / The choice of code review process : A survey on the state of the practice. Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings. editor / Burak Turhan ; Dietmar Winkler ; Federica Sarro ; Marcos Kalinowski ; Daniel Mendez Fernandez ; Michael Felderer. Springer Verlag, 2017. pp. 111-127 (Lecture Notes in Computer Science).
Download
@inproceedings{2701dfdac360497da4b17bf673fb0c9e,
title = "The choice of code review process: A survey on the state of the practice",
abstract = "Code review has been known to be an effective quality assurance technique for decades. In the last years, industrial code review practices were observed to converge towards “change-based/modern code review”, but with a lot of variation in the details of the processes. Recent research also proposed hypotheses on factors that influence the choice of process. However, all current research in this area is based on small and largely non-random samples of cases. Therefore, we set out to assess the current state of the practice and to test some of these hypotheses with a survey among commercial software development teams. We received responses from 240 teams. They support many of the stated hypotheses, e.g., that change-based code review is the dominating style of code review in the industry, and that teams doing change-based code review have a lower risk that review use fades away. However, other hypotheses could not be confirmed, mainly that the balance of effects a team tries to reach with code reviews acts as a mediator in determining the details of the review process. Apart from these findings, we contribute the survey data set as a foundation for future research.",
keywords = "Change-based code review, Code inspections and walkthroughs, Code reviews, Empirical software engineering, Modern code review",
author = "Tobias Baum and Hendrik Le{\ss}mann and Kurt Schneider",
note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.; 18th International Conference on Product-Focused Software Process Improvement, PROFES 2017 ; Conference date: 29-11-2017 Through 01-12-2017",
year = "2017",
month = oct,
day = "28",
doi = "10.1007/978-3-319-69926-4_9",
language = "English",
isbn = "9783319699257",
series = "Lecture Notes in Computer Science",
publisher = "Springer Verlag",
pages = "111--127",
editor = "Burak Turhan and Dietmar Winkler and Federica Sarro and Marcos Kalinowski and {Mendez Fernandez}, Daniel and Michael Felderer",
booktitle = "Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings",
address = "Germany",

}

Download

TY - GEN

T1 - The choice of code review process

T2 - 18th International Conference on Product-Focused Software Process Improvement, PROFES 2017

AU - Baum, Tobias

AU - Leßmann, Hendrik

AU - Schneider, Kurt

N1 - Publisher Copyright: © Springer International Publishing AG 2017. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.

PY - 2017/10/28

Y1 - 2017/10/28

N2 - Code review has been known to be an effective quality assurance technique for decades. In the last years, industrial code review practices were observed to converge towards “change-based/modern code review”, but with a lot of variation in the details of the processes. Recent research also proposed hypotheses on factors that influence the choice of process. However, all current research in this area is based on small and largely non-random samples of cases. Therefore, we set out to assess the current state of the practice and to test some of these hypotheses with a survey among commercial software development teams. We received responses from 240 teams. They support many of the stated hypotheses, e.g., that change-based code review is the dominating style of code review in the industry, and that teams doing change-based code review have a lower risk that review use fades away. However, other hypotheses could not be confirmed, mainly that the balance of effects a team tries to reach with code reviews acts as a mediator in determining the details of the review process. Apart from these findings, we contribute the survey data set as a foundation for future research.

AB - Code review has been known to be an effective quality assurance technique for decades. In the last years, industrial code review practices were observed to converge towards “change-based/modern code review”, but with a lot of variation in the details of the processes. Recent research also proposed hypotheses on factors that influence the choice of process. However, all current research in this area is based on small and largely non-random samples of cases. Therefore, we set out to assess the current state of the practice and to test some of these hypotheses with a survey among commercial software development teams. We received responses from 240 teams. They support many of the stated hypotheses, e.g., that change-based code review is the dominating style of code review in the industry, and that teams doing change-based code review have a lower risk that review use fades away. However, other hypotheses could not be confirmed, mainly that the balance of effects a team tries to reach with code reviews acts as a mediator in determining the details of the review process. Apart from these findings, we contribute the survey data set as a foundation for future research.

KW - Change-based code review

KW - Code inspections and walkthroughs

KW - Code reviews

KW - Empirical software engineering

KW - Modern code review

UR - http://www.scopus.com/inward/record.url?scp=85034615766&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-69926-4_9

DO - 10.1007/978-3-319-69926-4_9

M3 - Conference contribution

AN - SCOPUS:85034615766

SN - 9783319699257

T3 - Lecture Notes in Computer Science

SP - 111

EP - 127

BT - Product-Focused Software Process Improvement -18th International Conference, PROFES 2017, Proceedings

A2 - Turhan, Burak

A2 - Winkler, Dietmar

A2 - Sarro, Federica

A2 - Kalinowski, Marcos

A2 - Mendez Fernandez, Daniel

A2 - Felderer, Michael

PB - Springer Verlag

Y2 - 29 November 2017 through 1 December 2017

ER -

By the same author(s)