Knowledge Transfer in Modern Code Review

Knowledge transfer is one of the main goals of modern code review, as shown by several studies that surveyed and interviewed developers. While knowledge transfer is a clear expectation of the code review process, there are no analytical studies using data mined from software repositories to assess t...

Full description

Saved in:
Bibliographic Details
Published in:2020 IEEE/ACM 28th International Conference on Program Comprehension (ICPC) pp. 230 - 240
Main Authors: Caulo, Maria, Lin, Bin, Bavota, Gabriele, Scanniello, Giuseppe, Lanza, Michele
Format: Conference Proceeding
Language:English
Published: ACM 01.10.2020
Subjects:
Birds
code review
Codes
Knowledge transfer
mining software repositories
Software
Software development management
Stress
Training
ISSN:2643-7171
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Knowledge transfer is one of the main goals of modern code review, as shown by several studies that surveyed and interviewed developers. While knowledge transfer is a clear expectation of the code review process, there are no analytical studies using data mined from software repositories to assess the effectiveness of code review in "training" developers and improve their skills over time. We present a mining-based study investigating how and whether the code review process helps developers to improve their contributions to open source projects over time. We analyze 32,062 peer-reviewed pull requests (PRs) made across 4,981 GitHub repositories by 728 developers who created their GitHub account in 2015. We assume that PRs performed in the past by a developer D that have been subject to a code review process have "transferred knowledge" to D. Then, we verify if over time (i.e., when more and more reviewed PRs are made by D), the quality of the contributions made by D to open source projects increases (as assessed by proxies we defined, such as the acceptance of PRs, or the polarity of the sentiment in the review comments left for the submitted PRs). With the above measures, we were unable to capture the positive impact played by the code review process on the quality of developers' contributions. This might be due to several factors, including the choices we made in our experimental design.Additional investigations are needed to confirm or contradict such a negative result.
ISSN:2643-7171
DOI:10.1145/3387904.3389270