Automatic Analysis of Available Source Code of Top Artificial Intelligence Conference Papers.
Uložené v:
| Názov: | Automatic Analysis of Available Source Code of Top Artificial Intelligence Conference Papers. |
|---|---|
| Autori: | Lin, Jialiang, Wang, Yingmin, Yu, Yao, Zhou, Yu, Chen, Yidong, Shi, Xiaodong |
| Zdroj: | International Journal of Software Engineering & Knowledge Engineering; Jul2022, Vol. 32 Issue 7, p947-970, 24p |
| Predmety: | SOURCE code, ARTIFICIAL intelligence, CONFERENCE papers, UNIFORM Resource Locators, COMMUNITIES, STATISTICS |
| Abstrakt: | Source code is essential for researchers to reproduce the methods and replicate the results of artificial intelligence (AI) papers. Some organizations and researchers manually collect AI papers with available source code to contribute to the AI community. However, manual collection is a labor-intensive and time-consuming task. To address this issue, we propose a method to automatically identify papers with available source code and extract their source code repository URLs. With this method, we find that 20.5% of regular papers of 10 top AI conferences published from 2010 to 2019 are identified as papers with available source code and that 8.1% of these source code repositories are no longer accessible. We also create the XMU NLP Lab README Dataset, the largest dataset of labeled README files for source code document research. Through this dataset, we have discovered that quite a few README files have no installation instructions or usage tutorials provided. Further, a large-scale comprehensive statistical analysis is made for a general picture of the source code of AI conference papers. The proposed solution can also go beyond AI conference papers to analyze other scientific papers from both journals and conferences to shed light on more domains. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Software Engineering & Knowledge Engineering is the property of World Scientific Publishing Company and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Databáza: | Complementary Index |
Nájsť tento článok vo Web of Science Buďte prvý, kto okomentuje tento záznam!