A Parallel Neuromorphic Text Recognition System and Its Implementation on a Heterogeneous High-Performance Computing Cluster

Given the recent progress in the evolution of high-performance computing (HPC) technologies, the research in computational intelligence has entered a new era. In this paper, we present an HPC-based context-aware intelligent text recognition system (ITRS) that serves as the physical layer of machine...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on computers Jg. 62; H. 5; S. 886 - 899
Hauptverfasser:	Qinru Qiu, Qing Wu, Bishop, M., Pino, R. E., Linderman, R. W.
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	IEEE 01.05.2013
Schlagworte:	Biological neural networks Brain models Computational modeling Computer architecture distributed architecture Heterogeneous (hybrid) systems machine learning natural language interfaces Neurons Optical character recognition software
ISSN:	0018-9340
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	Given the recent progress in the evolution of high-performance computing (HPC) technologies, the research in computational intelligence has entered a new era. In this paper, we present an HPC-based context-aware intelligent text recognition system (ITRS) that serves as the physical layer of machine reading. A parallel computing architecture is adopted that incorporates the HPC technologies with advances in neuromorphic computing models. The algorithm learns from what has been read and, based on the obtained knowledge, it forms anticipations of the word and sentence level context. The information processing flow of the ITRS imitates the function of the neocortex system. It incorporates large number of simple pattern detection modules with advanced information association layer to achieve perception and recognition. Such architecture provides robust performance to images with large noise. The implemented ITRS software is able to process about 16 to 20 scanned pages per second on the 500 trillion floating point operations per second (TFLOPS) Air Force Research Laboratory (AFRL)/Information Directorate (RI) Condor HPC after performance optimization.
AbstractList	Given the recent progress in the evolution of high-performance computing (HPC) technologies, the research in computational intelligence has entered a new era. In this paper, we present an HPC-based context-aware intelligent text recognition system (ITRS) that serves as the physical layer of machine reading. A parallel computing architecture is adopted that incorporates the HPC technologies with advances in neuromorphic computing models. The algorithm learns from what has been read and, based on the obtained knowledge, it forms anticipations of the word and sentence level context. The information processing flow of the ITRS imitates the function of the neocortex system. It incorporates large number of simple pattern detection modules with advanced information association layer to achieve perception and recognition. Such architecture provides robust performance to images with large noise. The implemented ITRS software is able to process about 16 to 20 scanned pages per second on the 500 trillion floating point operations per second (TFLOPS) Air Force Research Laboratory (AFRL)/Information Directorate (RI) Condor HPC after performance optimization.
Author	Pino, R. E. Bishop, M. Linderman, R. W. Qinru Qiu Qing Wu
Author_xml	– sequence: 1 surname: Qinru Qiu fullname: Qinru Qiu email: qiqiu@syr.edu organization: Syracuse Univ., Syracuse, NY, USA – sequence: 2 surname: Qing Wu fullname: Qing Wu email: Qing.Wu@rl.af.mil organization: Air Force Res. Lab., Rome, NY, USA – sequence: 3 givenname: M. surname: Bishop fullname: Bishop, M. email: Morgan.Bishop@rl.af.mil organization: Air Force Res. Lab., Rome, NY, USA – sequence: 4 givenname: R. E. surname: Pino fullname: Pino, R. E. email: Robinson.Pino@rl.af.mil organization: Air Force Res. Lab., Rome, NY, USA – sequence: 5 givenname: R. W. surname: Linderman fullname: Linderman, R. W. email: Richard.Linderman@rl.af.mil organization: Air Force Res. Lab., Rome, NY, USA
BookMark	eNptkM1Lw0AQxfdQwbZ68eplz0LqbD626bEEtYWiReM5bDeTdCXZDbsbsOAf39SKBxEGBmbe-zHzJmSkjUZCbhjMGIPFfZ7NQmDhLIERGQOwNFhEMVySiXMfAMBDWIzJ15JuhRVNgw19xt6a1thuryTN8dPTV5Sm1soro-nbwXlsqdAlXXtH123XYIvai-_tUIKu0KM1NWo0vaMrVe-DLdrK2FZoiTQzbdd7pWuaNf0As1fkohKNw-ufPiXvjw95tgo2L0_rbLkJZJgwH3AuBLKSR7ziyEUleQxSAmNM7NJkmEW8xN0cU5nuoJonVckhhhTLMpbpPBbRlNydudIa5yxWRWdVK-yhYFCcsiryrDhlVSQwiOGPWKrzk94K1fxvuT1bFCL-sjlL0uHm6Aj8K3vX
CODEN	ITCOB4
CitedBy_id	crossref_primary_10_1016_j_entcom_2024_100730 crossref_primary_10_1145_2629510 crossref_primary_10_1007_s11265_015_1067_4 crossref_primary_10_1016_j_comcom_2022_12_023 crossref_primary_10_1016_j_neunet_2021_01_018 crossref_primary_10_1109_TNNLS_2017_2676110 crossref_primary_10_1109_TNNLS_2013_2296777
Cites_doi	10.1109/5.156468 10.1109/5.156470 10.1109/CCMB.2011.5952109 10.1109/PDP.2010.43 10.1007/978-1-4612-0711-5 10.1016/0031-3203(95)00118-2 10.1109/ICVES.2009.5400240 10.1109/INMIC.2009.5383078 10.1109/34.406659 10.1016/0031-3203(91)90140-Z 10.1109/ICDAR.2011.281 10.1016/0031-3203(86)90040-3 10.1145/1390749.1390766 10.1117/12.783598 10.1109/34.55109 10.1016/S0169-7161(82)02032-X 10.1109/ICDAR.2009.58 10.7551/mitpress/3905.001.0001 10.1109/ISCAS.1994.409591 10.1109/ICPR.2008.4761930 10.1007/3-540-58473-0_146 10.1109/72.238313
ContentType	Journal Article
DBID	97E RIA RIE AAYXX CITATION
DOI	10.1109/TC.2012.50
DatabaseName	IEEE All-Society Periodicals Package (ASPP) 2005-present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef
DatabaseTitle	CrossRef
DatabaseTitleList
Database_xml	– sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering Computer Science
EndPage	899
ExternalDocumentID	10_1109_TC_2012_50 6158636
Genre	orig-research
GroupedDBID	--Z -DZ -~X .55 .DC 0R~ 29I 3EH 3O- 4.4 5GY 5VS 6IK 85S 97E AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABQJQ ABVLG ACGFO ACIWK ACNCT AENEX AETEA AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD HZ~ H~9 IAAWW IBMZZ ICLAB IEDLZ IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ MVM O9- OCL P2P PQQKQ RIA RIE RNI RNS RXW RZB TAE TN5 TWZ UHB UKR UPT VH1 X7M XJT XOL XZL YXB YYQ YZZ ZCG AAYXX ABUFD CITATION
ID	FETCH-LOGICAL-c251t-66aae1d636f6e6afc640cc0111ab85f6e36deb7e8c8b0f75fd60408edd4c874a3
IEDL.DBID	RIE
ISICitedReferencesCount	24
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000317010700004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0018-9340
IngestDate	Sat Nov 29 03:57:27 EST 2025 Tue Nov 18 22:41:41 EST 2025 Wed Aug 27 02:49:02 EDT 2025
IsPeerReviewed	true
IsScholarly	true
Issue	5
Language	English
License	https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c251t-66aae1d636f6e6afc640cc0111ab85f6e36deb7e8c8b0f75fd60408edd4c874a3
PageCount	14
ParticipantIDs	ieee_primary_6158636 crossref_citationtrail_10_1109_TC_2012_50 crossref_primary_10_1109_TC_2012_50
PublicationCentury	2000
PublicationDate	2013-05-01
PublicationDateYYYYMMDD	2013-05-01
PublicationDate_xml	– month: 05 year: 2013 text: 2013-05-01 day: 01
PublicationDecade	2010
PublicationTitle	IEEE transactions on computers
PublicationTitleAbbrev	TC
PublicationYear	2013
Publisher	IEEE
Publisher_xml	– name: IEEE
References	ref35 wu (ref10) 2008 ref13 smith (ref16) 2007 ref37 ref14 ref30 ref33 ref32 (ref3) 2012 ref17 devroye (ref27) 1996 ref19 ref18 budiwati (ref31) 2011 hassoun (ref8) 1993 fedorovici (ref22) 2010 ref24 ref26 ref25 ref20 ref21 (ref15) 2012 ref28 pratt (ref23) 1991 harding (ref38) 1997 ref29 jin (ref36) 2002 anderson (ref7) 1989 wray (ref1) 0 ref9 ref4 anderson (ref6) 1995 ref5 hecht-nielsen (ref11) 2007 (ref12) 2012 brodic (ref34) 2011 swenson (ref2) 2006
References_xml	– year: 0 ident: ref1 article-title: Towards a Complete, Multi-Level Cognitive Architecture publication-title: Proc Int'l Conf for Cognitive Modeling 2007 – year: 2012 ident: ref15 article-title: Tesseract-OCR publication-title: Google – ident: ref20 doi: 10.1109/5.156468 – year: 1991 ident: ref23 article-title: Digital Image Processing – ident: ref24 doi: 10.1109/5.156470 – year: 1997 ident: ref38 article-title: Probabilistic Retrieval of OCR Degraded Text Using N-Grams publication-title: Proc European Conf Digital Libraries – ident: ref17 doi: 10.1109/CCMB.2011.5952109 – ident: ref18 doi: 10.1109/PDP.2010.43 – year: 1996 ident: ref27 publication-title: A Probabilistic Theory of Pattern Recognition doi: 10.1007/978-1-4612-0711-5 – year: 1993 ident: ref8 article-title: Associative Neural Memories: Theory and Implementation – ident: ref21 doi: 10.1016/0031-3203(95)00118-2 – ident: ref30 doi: 10.1109/ICVES.2009.5400240 – ident: ref5 doi: 10.1109/INMIC.2009.5383078 – ident: ref19 doi: 10.1109/34.406659 – ident: ref26 doi: 10.1016/0031-3203(91)90140-Z – ident: ref33 doi: 10.1109/ICDAR.2011.281 – year: 2011 ident: ref34 article-title: Preprocessing of Binary Document Images by Morphological Operators publication-title: Proceedings of the International Convention MIPRO – ident: ref13 doi: 10.1016/0031-3203(86)90040-3 – ident: ref35 doi: 10.1145/1390749.1390766 – year: 2012 ident: ref12 article-title: IBM Cell Broadband Engine Resource Center publication-title: IBM – year: 2002 ident: ref36 article-title: A Content-based Probabilistic Correction Model for OCR Document Retrieval publication-title: Proc Int'l ACJI SIGIR Conf Research and Development in Information Retrieval Workshop Program – year: 2012 ident: ref3 article-title: The OCRopus Open Source Document Analysis and OCR System – year: 1989 ident: ref7 article-title: Distinctive Features, Categorical Perception, Probability Learning: Some Applications of a Neural Model – ident: ref4 doi: 10.1117/12.783598 – ident: ref25 doi: 10.1109/34.55109 – ident: ref14 doi: 10.1016/S0169-7161(82)02032-X – ident: ref32 doi: 10.1109/ICDAR.2009.58 – year: 1995 ident: ref6 article-title: An Introduction to Neural Networks doi: 10.7551/mitpress/3905.001.0001 – ident: ref29 doi: 10.1109/ISCAS.1994.409591 – ident: ref37 doi: 10.1109/ICPR.2008.4761930 – ident: ref28 doi: 10.1007/3-540-58473-0_146 – year: 2011 ident: ref31 article-title: Japanese Character (Kana) Pattern Recognition Application Using Neural Network publication-title: Int Conf on Electrical Engineering and Informatics (ICEEI) – year: 2006 ident: ref2 article-title: Review of Clinical and Functional Neuroscience publication-title: Educational Rev Manual in Neurology Castle Connolly Graduate Medical Publishing – year: 2008 ident: ref10 article-title: Performance Optimization for Pattern Recognition using Associative Neural Memory publication-title: Proc IEEE Int'l Conf Multimedia and Expo – year: 2007 ident: ref11 article-title: Confabulation Theory: The Mechanism of Thought – year: 2007 ident: ref16 article-title: An Overview of the Tesseract OCR Engine publication-title: Proc Int'l Conf Document Analysis and Recognition – year: 2010 ident: ref22 article-title: Improved Neural Network OCR based on Preprocessed Blob Cases publication-title: Proc Int'l Joint Conf Computational Cybernetics and Technical Informatics – ident: ref9 doi: 10.1109/72.238313
SSID	ssj0006209
Score	2.2152705
Snippet	Given the recent progress in the evolution of high-performance computing (HPC) technologies, the research in computational intelligence has entered a new era....
SourceID	crossref ieee
SourceType	Enrichment Source Index Database Publisher
StartPage	886
SubjectTerms	Biological neural networks Brain models Computational modeling Computer architecture distributed architecture Heterogeneous (hybrid) systems machine learning natural language interfaces Neurons Optical character recognition software
Title	A Parallel Neuromorphic Text Recognition System and Its Implementation on a Heterogeneous High-Performance Computing Cluster
URI	https://ieeexplore.ieee.org/document/6158636
Volume	62
WOSCitedRecordID	wos000317010700004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) issn: 0018-9340 databaseCode: RIE dateStart: 19680101 customDbUrl: isFulltext: true dateEnd: 99991231 titleUrlDefault: https://ieeexplore.ieee.org/ omitProxy: false ssIdentifier: ssj0006209 providerName: IEEE
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH9sw4MenDrF-UVAL4LVdm2T9DiGY4KMIVN2K2k-YLC1sg9P_vG-pN3cwYvQQ0lfadqX5CXp7_1-AHeKdrRUifQYDn9exELpJZILLzYmCiXGw9ChfD9e2XDIJ5NkVIOHbS6M1tqBz_SjPXX_8lUh13ar7AmjL6chrUOdMVbmam1HXbqBcwTYgcPIr6hIAz95GvcshKvzaHPrd4LPjpqKCyb95v-qcQSH1aSRdEsvH0NN5yfQ3AgykKp_nsDBDrtgC767ZCQWVitlRhwHx7zAjzqVZIwDMnnbIIeKnJS05UTkiryslsQxBs-rpKSc4CHIwMJmCmxtulgviUWHeKPfnANS1gUfS3qzteVeOIX3_vO4N_AqsQVP4hRn5VEqhA4UvpehmgojaeRLaZXoRcZjLAup0hnTXPLMNyw2imL_51qpSHIWifAMGnmR63MguGTMfG6ygGd4AZsIz0RiqI-3Cxob3ob7jRdSWTGRW0GMWepWJH6Sjnup9Vga-2243dp-lvwbf1q1rJu2FpWHLv4uvoT9jhO1sLDFK2isFmt9DXvyazVdLm5cs_oBhjPPdQ
linkProvider	IEEE
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1bS8MwFD7MC6gP3sV5DeiLYLd2bdP0cQxlwzmGVPGtpLnAYLayi0_-eE_Sbu7BF6EPJU1p2pOck6Tf-T6AW0lbSshYOBG6PyeIfOHEgnEn1DrwBcZD36J83_rRYMDe3-NhDe6XuTBKKQs-Uw1zav_ly0LMzVZZE6Mvoz5dg40wCFpema219Lt0AejwcAj7gVuRkXpu3Ew6BsTVapjs-pXws6KnYsPJ497_GrIPu9W0kbRLOx9ATeWHsLeQZCDVCD2EnRV-wSP4bpMhnxi1lDGxLBwfBX7WkSAJumTyssAOFTkpicsJzyXpzabEcgZ_VGlJOcGDk64BzhTY31QxnxKDD3GGv1kHpGwLPpZ0xnPDvnAMr48PSafrVHILjsBJzsyhlHPlSXwvTRXlWtDAFcJo0fOMhVjmU6mySDHBMldHoZYUPQBTUgaCRQH3T2A9L3J1CgQXjZnLdOaxDC9gJ2EZjzV18XZOQ83qcLewQioqLnIjiTFO7ZrEjdOkkxqLpaFbh5tl3c-SgePPWkfGTMsalYXO_i6-hq1u8txP-73B0zlst6zEhQExXsD6bDJXl7Apvmaj6eTKdrEfc__SvA
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Parallel+Neuromorphic+Text+Recognition+System+and+Its+Implementation+on+a+Heterogeneous+High-Performance+Computing+Cluster&rft.jtitle=IEEE+transactions+on+computers&rft.au=Qiu%2C+Qinru&rft.au=Wu%2C+Qing&rft.au=Bishop%2C+Morgan&rft.au=Pino%2C+Robinson+E.&rft.date=2013-05-01&rft.issn=0018-9340&rft.volume=62&rft.issue=5&rft.spage=886&rft.epage=899&rft_id=info:doi/10.1109%2FTC.2012.50&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TC_2012_50
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9340&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9340&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9340&client=summon