ADVANCED METHODS FOR CLASSIFICATION QUALITY ASSESSMENT LEVERAGING ROC ANALYSIS AND MULTIDIMENSIONAL CONFUSION MATRIX
The object of the study is the process of classifying objects in scientific problems. The subject of the study is methods aimed at assessing the effectiveness of multiclass classification. The goal of the study is to study the classification process and develop a classifier evaluation module to incr...
Saved in:
| Published in: | Сучасні інформаційні системи Vol. 9; no. 1; pp. 24 - 34 |
|---|---|
| Main Authors: | , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
National Technical University "Kharkiv Polytechnic Institute"
24.02.2025
|
| Subjects: | |
| ISSN: | 2522-9052 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | The object of the study is the process of classifying objects in scientific problems. The subject of the study is methods aimed at assessing the effectiveness of multiclass classification. The goal of the study is to study the classification process and develop a classifier evaluation module to increase the speed of such evaluation and reduce the time to build complex machine learning classifiers. Methods used: methods for evaluating machine learning classifiers, methods for constructing ROC curves, principles of parallel and distributed computing. Results obtained: an analytical review of the scope of application of the classification quality assessment module in the field of humanities, technical and economic sciences was conducted. Existing classification quality assessment metrics were considered and mathematical descriptions of metrics were formed for the multi-class case. Software was developed that implements the proposed mathematical descriptions using parallel calculations and optimization of identical operations. The developed module was tested for reliability. Conclusions. According to the results of the study, methods for effective classification quality assessment is proposed, which allows reducing the time for assessing the quality of multi-class classifiers by 40% compared to the classical methods. The development of this module opens up broad prospects for further research in the direction of improving the quality of classification, which will contribute to the development of various spheres of human activity and increase the efficiency of solving tasks related to data analysis. |
|---|---|
| AbstractList | The object of the study is the process of classifying objects in scientific problems. The subject of the study is methods aimed at assessing the effectiveness of multiclass classification. The goal of the study is to study the classification process and develop a classifier evaluation module to increase the speed of such evaluation and reduce the time to build complex machine learning classifiers. Methods used: methods for evaluating machine learning classifiers, methods for constructing ROC curves, principles of parallel and distributed computing. Results obtained: an analytical review of the scope of application of the classification quality assessment module in the field of humanities, technical and economic sciences was conducted. Existing classification quality assessment metrics were considered and mathematical descriptions of metrics were formed for the multi-class case. Software was developed that implements the proposed mathematical descriptions using parallel calculations and optimization of identical operations. The developed module was tested for reliability. Conclusions. According to the results of the study, methods for effective classification quality assessment is proposed, which allows reducing the time for assessing the quality of multi-class classifiers by 40% compared to the classical methods. The development of this module opens up broad prospects for further research in the direction of improving the quality of classification, which will contribute to the development of various spheres of human activity and increase the efficiency of solving tasks related to data analysis. |
| Author | Hornostal, Oleksii Chelak, Viktor Gavrylenko, Svitlana Chelak, Yehor |
| Author_xml | – sequence: 1 givenname: Viktor surname: Chelak fullname: Chelak, Viktor – sequence: 2 givenname: Oleksii surname: Hornostal fullname: Hornostal, Oleksii – sequence: 3 givenname: Yehor surname: Chelak fullname: Chelak, Yehor – sequence: 4 givenname: Svitlana surname: Gavrylenko fullname: Gavrylenko, Svitlana |
| BookMark | eNo9kM1uwjAQhH2gUinlDXrwC0D9lx8frRDAUkhUkqBysuzErkCUVAmXvn0NVJx2drT7jTQvYHTuzhaAN4zmBHEev5OAkBlHAfE7CeZ4jugIjB_uM5gOwxEhRDgmOORjcBGLnciTdAE3abUuFiVcFluYZKIs5VImopJFDj9qkclqD72ZluUmzSuYpbt0K1YyX8FtkUCRi2xfytILT6qzSi6kvyv9t8hgUuTL-qrhRlRb-fkKnpw-DXb6PyegXqZVsp5lxcpnZrOGEE5npMVRaIl1Jua0NQZhFrHQYdLGjBBtYmsbRA0xUWgs1tY13CHG47bhTYtoSCdA3rltp4_qpz986_5XdfqgbkbXfyndXw7NySrDkHMxNVrHIWNBoB11mLY-ocWchZFnsTur6bth6K178DBSt_LVtWZ1rVldy1dYIUr_AKCsclk |
| ContentType | Journal Article |
| DBID | AAYXX CITATION DOA |
| DOI | 10.20998/2522-9052.2025.1.03 |
| DatabaseName | CrossRef DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | CrossRef |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website |
| DeliveryMethod | fulltext_linktorsrc |
| EndPage | 34 |
| ExternalDocumentID | oai_doaj_org_article_b40ff83baa864455af3f13deecd19467 10_20998_2522_9052_2025_1_03 |
| GroupedDBID | AAYXX ALMA_UNASSIGNED_HOLDINGS CITATION GROUPED_DOAJ |
| ID | FETCH-LOGICAL-c2293-2d176e2efb893dbb014746f12d8422ab8eec03b2b76be1aefc9f0498dc9cd0363 |
| IEDL.DBID | DOA |
| ISSN | 2522-9052 |
| IngestDate | Fri Oct 03 12:48:46 EDT 2025 Sat Nov 29 08:19:00 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c2293-2d176e2efb893dbb014746f12d8422ab8eec03b2b76be1aefc9f0498dc9cd0363 |
| OpenAccessLink | https://doaj.org/article/b40ff83baa864455af3f13deecd19467 |
| PageCount | 11 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_b40ff83baa864455af3f13deecd19467 crossref_primary_10_20998_2522_9052_2025_1_03 |
| PublicationCentury | 2000 |
| PublicationDate | 2025-02-24 |
| PublicationDateYYYYMMDD | 2025-02-24 |
| PublicationDate_xml | – month: 02 year: 2025 text: 2025-02-24 day: 24 |
| PublicationDecade | 2020 |
| PublicationTitle | Сучасні інформаційні системи |
| PublicationYear | 2025 |
| Publisher | National Technical University "Kharkiv Polytechnic Institute" |
| Publisher_xml | – name: National Technical University "Kharkiv Polytechnic Institute" |
| SSID | ssj0002912169 |
| Score | 2.290959 |
| Snippet | The object of the study is the process of classifying objects in scientific problems. The subject of the study is methods aimed at assessing the effectiveness... |
| SourceID | doaj crossref |
| SourceType | Open Website Index Database |
| StartPage | 24 |
| SubjectTerms | confusion matrix decision rule ensemble classifiers machine learning quality assessment ROC-analysis |
| Title | ADVANCED METHODS FOR CLASSIFICATION QUALITY ASSESSMENT LEVERAGING ROC ANALYSIS AND MULTIDIMENSIONAL CONFUSION MATRIX |
| URI | https://doaj.org/article/b40ff83baa864455af3f13deecd19467 |
| Volume | 9 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals issn: 2522-9052 databaseCode: DOA dateStart: 20170101 customDbUrl: isFulltext: true dateEnd: 99991231 titleUrlDefault: https://www.doaj.org/ omitProxy: false ssIdentifier: ssj0002912169 providerName: Directory of Open Access Journals |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV07T8MwELYQYmBBIEC85YE1UNtpao-hDxopTVGbojJZtmNLLAWVwu_nLgmoGwubY1mW9V18DyX3fYTchkSFRBoscpRDUm0RKeWTKHgfOyk8pACmFpvoFYVcLtXTltQX_hPW0AM3wN3buBOCFNYYCaG72zVBBCYq713FUB4evS9kPVvFFPpgrhhntZ4dhwQjUp0ub_rmsFNU3v9OwjPv3rG7H82sNi5t0ffXcWZ0SA7aBJGmzcGOyI5fHZMNRA9UkRnQybAcTwdzCsUb7ecp-MJR2wtMITnNs_KFwiSgiiT9NB8-D2fpY1Y80tm0T9MizV_m2RwGsNMiL7NBBuvmNR8u7U-L0QLHdJKWs2x5QhajYdkfR61eQuQ4RO2IV6yXeO6DhSSkshaqn16cBMYrGXNurATQOsJy20usZ8YHpwIUCLJyylX4QfeU7K7eVv6MUAV32YEvhCDm4sQKC_eaq9hUVhgLOcY5iX7Q0u8NLYaGcqJGVyO6GtHViK5muiPOyQNC-rsWSa3rCTC1bk2t_zL1xX9sckn28VR1V3p8RXY3609_Tfbc1-b1Y31Tv0Xf4B6_iA |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=ADVANCED+METHODS+FOR+CLASSIFICATION+QUALITY+ASSESSMENT+LEVERAGING+ROC+ANALYSIS+AND+MULTIDIMENSIONAL+CONFUSION+MATRIX&rft.jtitle=%D0%A1%D1%83%D1%87%D0%B0%D1%81%D0%BD%D1%96+%D1%96%D0%BD%D1%84%D0%BE%D1%80%D0%BC%D0%B0%D1%86%D1%96%D0%B9%D0%BD%D1%96+%D1%81%D0%B8%D1%81%D1%82%D0%B5%D0%BC%D0%B8&rft.au=Viktor+Chelak&rft.au=Oleksii+Hornostal&rft.au=Yehor+Chelak&rft.au=Svitlana+Gavrylenko&rft.date=2025-02-24&rft.pub=National+Technical+University+%22Kharkiv+Polytechnic+Institute%22&rft.issn=2522-9052&rft.volume=9&rft.issue=1&rft_id=info:doi/10.20998%2F2522-9052.2025.1.03&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_b40ff83baa864455af3f13deecd19467 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2522-9052&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2522-9052&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2522-9052&client=summon |