View in EDS

Leveraging deep learning for Python version identification

Saved in:
Bibliographic Details
Title: Leveraging deep learning for Python version identification
Authors: Gerhold, Marcus, Solovyeva, Lola, Zaytsev, Vadim
Source: CEUR workshop proceedings. 3567:33-40
Publisher Information: Rheinisch Westfälische Technische Hochschule, 2023.
Publication Year: 2023
Subject Terms: Deep Learning, CodeBERT, version identification, Python
Description: Python, recognized for its dynamic and adaptable nature, has found widespread application in a myriad of projects. As the language evolves, determining the Python version employed in a project becomes pivotal to ensure compatibility and facilitate maintenance. Deep learning (DL) has emerged as a promising tool to automate this process. In this research, we assess various DL techniques in determining the minimum Python version for a code snippet. We explore the complexities of handling Python data and the DL techniques to achieve high classification accuracy. Our experimental results show, that LSTM with CodeBERT embedding achives an accuracy of 92%. This success can be attributed to the LSTM's proficiency in capturing structural details of the hierarchical nature of a source code, complemented by CodeBERT's ability to discern contextual differences between keywords and variable names. This research provides insights into the challenges associated with utilizing programming languages for deep learning models and suggests potential solutions for addressing these issues. The envisioned applications extend to predicting the minimum required version for individual files or an entire code base.
Document Type: Article
Language: English
ISSN: 1613-0073
Access URL: https://research.utwente.nl/en/publications/f0f8b2f7-dc79-4515-a968-d55e36f0bbae
Accession Number: edsair.dris...02403..749cdc11b2fc3a4b2562daf39d0839b2
Database: OpenAIRE
Description
Abstract:Python, recognized for its dynamic and adaptable nature, has found widespread application in a myriad of projects. As the language evolves, determining the Python version employed in a project becomes pivotal to ensure compatibility and facilitate maintenance. Deep learning (DL) has emerged as a promising tool to automate this process. In this research, we assess various DL techniques in determining the minimum Python version for a code snippet. We explore the complexities of handling Python data and the DL techniques to achieve high classification accuracy. Our experimental results show, that LSTM with CodeBERT embedding achives an accuracy of 92%. This success can be attributed to the LSTM's proficiency in capturing structural details of the hierarchical nature of a source code, complemented by CodeBERT's ability to discern contextual differences between keywords and variable names. This research provides insights into the challenges associated with utilizing programming languages for deep learning models and suggests potential solutions for addressing these issues. The envisioned applications extend to predicting the minimum required version for individual files or an entire code base.
ISSN:16130073