A Natural Language Processing Framework for Document Similarity in Java Environments
Uloženo v:
| Název: | A Natural Language Processing Framework for Document Similarity in Java Environments |
|---|---|
| Autoři: | Ayan Hussain, Moh Zaid Khan, Rayyan Arif Hussain, Abdul Ahad, Ambreen Anees |
| Zdroj: | International Journal of Innovative Science and Research Technology. :4410-4415 |
| Informace o vydavateli: | International Journal of Innovative Science and Research Technology, 2025. |
| Rok vydání: | 2025 |
| Popis: | Document similarity plays a pivotal role in the field of Natural Language Processing (NLP), especially in tasks that require identifying the degree of relatedness between textual content. This paper presents a comprehensive study and implementation of document similarity techniques using the Java programming language, with a focus on practical NLP approaches. The motivation behind this work stems from real-world applications such as plagiarism detection, content recommendation systems, semantic search engines, and automated document classification. The system developed in this research employs a multi-step NLP pipeline beginning with data preprocessing. This includes default procedures such as text normalizing, tokenizing, stop word removal, and optional stemming or lemmatization. Following post-preprocessing, documents are converted into numerical vectors using the Term Frequency–Inverse Document Frequency (TF-IDF) weighting scheme, which determines how important terms are in each document in relation to the collection as a whole.Since cosine similarity is effective at comparing text-based vectors in a high-dimensional space, it is used to evaluate similarity among document vectors. |
| Druh dokumentu: | Article |
| Jazyk: | English |
| DOI: | 10.38124/ijisrt/25apr1961 |
| Přístupové číslo: | edsair.doi...........5bb91d0faf6f181f882ea78fa2ed2296 |
| Databáze: | OpenAIRE |
Nájsť tento článok vo Web of Science Buďte první, kdo okomentuje tento záznam!