Comparing pre commit reviews and post commit reviews using process simulation

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • SET GmbH
  • T-Systems on site services GmbH
View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings - International Conference on Software and System Process, ICSSP 2016
Pages26-35
Number of pages10
ISBN (electronic)9781450341882
Publication statusPublished - 14 May 2016
EventInternational Conference on Software and System Process, ICSSP 2016 - Austin, United States
Duration: 14 May 201615 May 2016

Publication series

NameProceedings - International Conference on Software and System Process, ICSSP 2016

Abstract

Code review in practice is often performed change-based, i.e. using the code changes belonging to a task to determine which code to review. In previous studies, it was found that two variations of this process are used in industry: Pre commit review (review-then-commit) and post commit review (commit-then-review). The choice for one of these variants has implications not only for practitioners deciding on a code review process to use, but also for the development of review tools and for experimentation with review processes. In some situations, a specific variant is clearly preferable due to the nature of the development process or team. In other situations, there are conflicting opinions, and both variants have proponents arguing for their method of choice. So we asked: Are there practically relevant performance differences between pre commit and post commit reviews, and how are these differences influenced by contextual factors? To assess this question, we designed a parametric discrete event simulation model of certain agile development processes. We validated this model with practitioner's feedback and in part also with empirical data from industry. Our analysis of the simulation results indicates that the best choice does depend on the context, but also that there are many situations with no practically relevant difference between both choices. We identified the main influencing factors and underlying effects and condensed our findings into heuristic rules.

Keywords

    Agile software development, Code review, Discrete event simulation, Post commit review, Pre commit review

ASJC Scopus subject areas

Cite this

Comparing pre commit reviews and post commit reviews using process simulation. / Baum, Tobias; Kortum, Fabian; Schneider, Kurt et al.
Proceedings - International Conference on Software and System Process, ICSSP 2016. 2016. p. 26-35 2904362 (Proceedings - International Conference on Software and System Process, ICSSP 2016).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Baum, T, Kortum, F, Schneider, K, Brack, A & Schauder, J 2016, Comparing pre commit reviews and post commit reviews using process simulation. in Proceedings - International Conference on Software and System Process, ICSSP 2016., 2904362, Proceedings - International Conference on Software and System Process, ICSSP 2016, pp. 26-35, International Conference on Software and System Process, ICSSP 2016, Austin, United States, 14 May 2016. https://doi.org/10.1145/2904354.2904362
Baum, T., Kortum, F., Schneider, K., Brack, A., & Schauder, J. (2016). Comparing pre commit reviews and post commit reviews using process simulation. In Proceedings - International Conference on Software and System Process, ICSSP 2016 (pp. 26-35). Article 2904362 (Proceedings - International Conference on Software and System Process, ICSSP 2016). https://doi.org/10.1145/2904354.2904362
Baum T, Kortum F, Schneider K, Brack A, Schauder J. Comparing pre commit reviews and post commit reviews using process simulation. In Proceedings - International Conference on Software and System Process, ICSSP 2016. 2016. p. 26-35. 2904362. (Proceedings - International Conference on Software and System Process, ICSSP 2016). doi: 10.1145/2904354.2904362
Baum, Tobias ; Kortum, Fabian ; Schneider, Kurt et al. / Comparing pre commit reviews and post commit reviews using process simulation. Proceedings - International Conference on Software and System Process, ICSSP 2016. 2016. pp. 26-35 (Proceedings - International Conference on Software and System Process, ICSSP 2016).
Download
@inproceedings{ab506e37634b47828a5e0c444cd545b1,
title = "Comparing pre commit reviews and post commit reviews using process simulation",
abstract = "Code review in practice is often performed change-based, i.e. using the code changes belonging to a task to determine which code to review. In previous studies, it was found that two variations of this process are used in industry: Pre commit review (review-then-commit) and post commit review (commit-then-review). The choice for one of these variants has implications not only for practitioners deciding on a code review process to use, but also for the development of review tools and for experimentation with review processes. In some situations, a specific variant is clearly preferable due to the nature of the development process or team. In other situations, there are conflicting opinions, and both variants have proponents arguing for their method of choice. So we asked: Are there practically relevant performance differences between pre commit and post commit reviews, and how are these differences influenced by contextual factors? To assess this question, we designed a parametric discrete event simulation model of certain agile development processes. We validated this model with practitioner's feedback and in part also with empirical data from industry. Our analysis of the simulation results indicates that the best choice does depend on the context, but also that there are many situations with no practically relevant difference between both choices. We identified the main influencing factors and underlying effects and condensed our findings into heuristic rules.",
keywords = "Agile software development, Code review, Discrete event simulation, Post commit review, Pre commit review",
author = "Tobias Baum and Fabian Kortum and Kurt Schneider and Arthur Brack and Jens Schauder",
year = "2016",
month = may,
day = "14",
doi = "10.1145/2904354.2904362",
language = "English",
series = "Proceedings - International Conference on Software and System Process, ICSSP 2016",
pages = "26--35",
booktitle = "Proceedings - International Conference on Software and System Process, ICSSP 2016",
note = "International Conference on Software and System Process, ICSSP 2016 ; Conference date: 14-05-2016 Through 15-05-2016",

}

Download

TY - GEN

T1 - Comparing pre commit reviews and post commit reviews using process simulation

AU - Baum, Tobias

AU - Kortum, Fabian

AU - Schneider, Kurt

AU - Brack, Arthur

AU - Schauder, Jens

PY - 2016/5/14

Y1 - 2016/5/14

N2 - Code review in practice is often performed change-based, i.e. using the code changes belonging to a task to determine which code to review. In previous studies, it was found that two variations of this process are used in industry: Pre commit review (review-then-commit) and post commit review (commit-then-review). The choice for one of these variants has implications not only for practitioners deciding on a code review process to use, but also for the development of review tools and for experimentation with review processes. In some situations, a specific variant is clearly preferable due to the nature of the development process or team. In other situations, there are conflicting opinions, and both variants have proponents arguing for their method of choice. So we asked: Are there practically relevant performance differences between pre commit and post commit reviews, and how are these differences influenced by contextual factors? To assess this question, we designed a parametric discrete event simulation model of certain agile development processes. We validated this model with practitioner's feedback and in part also with empirical data from industry. Our analysis of the simulation results indicates that the best choice does depend on the context, but also that there are many situations with no practically relevant difference between both choices. We identified the main influencing factors and underlying effects and condensed our findings into heuristic rules.

AB - Code review in practice is often performed change-based, i.e. using the code changes belonging to a task to determine which code to review. In previous studies, it was found that two variations of this process are used in industry: Pre commit review (review-then-commit) and post commit review (commit-then-review). The choice for one of these variants has implications not only for practitioners deciding on a code review process to use, but also for the development of review tools and for experimentation with review processes. In some situations, a specific variant is clearly preferable due to the nature of the development process or team. In other situations, there are conflicting opinions, and both variants have proponents arguing for their method of choice. So we asked: Are there practically relevant performance differences between pre commit and post commit reviews, and how are these differences influenced by contextual factors? To assess this question, we designed a parametric discrete event simulation model of certain agile development processes. We validated this model with practitioner's feedback and in part also with empirical data from industry. Our analysis of the simulation results indicates that the best choice does depend on the context, but also that there are many situations with no practically relevant difference between both choices. We identified the main influencing factors and underlying effects and condensed our findings into heuristic rules.

KW - Agile software development

KW - Code review

KW - Discrete event simulation

KW - Post commit review

KW - Pre commit review

UR - http://www.scopus.com/inward/record.url?scp=84974625393&partnerID=8YFLogxK

U2 - 10.1145/2904354.2904362

DO - 10.1145/2904354.2904362

M3 - Conference contribution

AN - SCOPUS:84974625393

T3 - Proceedings - International Conference on Software and System Process, ICSSP 2016

SP - 26

EP - 35

BT - Proceedings - International Conference on Software and System Process, ICSSP 2016

T2 - International Conference on Software and System Process, ICSSP 2016

Y2 - 14 May 2016 through 15 May 2016

ER -

By the same author(s)