Automated Refactoring of Non-Idiomatic Python Code: A Differentiated Replication with LLMS

In the Python ecosystem, the adoption of idiomatic constructs has been fostered because of their expressiveness, increasing productivity and even efficiency, despite controversial arguments concerning familiarity or understandability issues. Recent research contributions have proposed approaches-bas...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings (IEEE International Conference on Program Comprehension. Online) pp. 01 - 11
Main Authors: Midolo, Alessandro, Di Penta, Massimiliano
Format: Conference Proceeding
Language:English
Published: IEEE 27.04.2025
Subjects:
Automated Refactoring
Benchmark testing
Codes
Ecosystems
Large language models
Manuals
Productivity
Python
Pythonic constructs
ISSN:2643-7171
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In the Python ecosystem, the adoption of idiomatic constructs has been fostered because of their expressiveness, increasing productivity and even efficiency, despite controversial arguments concerning familiarity or understandability issues. Recent research contributions have proposed approaches-based on static code analysis and transformation-to automatically identify and enact refactoring opportunities of non-idiomatic code into idiomatic ones. Given the potential recently offered by Large Language Models (LLMs) for code-related tasks, in this paper, we present the results of a replication study in which we investigate GPT-4 effectiveness in recommending and suggesting idiomatic refactoring actions. Our results reveal that GPT-4 not only identifies idiomatic constructs effectively but frequently exceeds the benchmark in proposing refactoring actions where the existing baseline failed. A manual analysis of a random sample shows the correctness of the obtained recommendations. Our findings underscore the potential of LLMs to achieve tasks where, in the past, implementing recommenders based on complex code analyses was required.
ISSN:2643-7171
DOI:10.1109/ICPC66645.2025.00020