An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units
Uloženo v:
| Název: | An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units |
|---|---|
| Autoři: | Akula, Satya Sai Siva Rama Krishna |
| Přispěvatelé: | Rahman, Mostafizur |
| Rok vydání: | 2024 |
| Sbírka: | University of Missouri: MOspace |
| Témata: | Big data, Artificial intelligence -- Data processing, Heterogeneous distributed computing systems, Thesis -- University of Missouri--Kansas City -- Electrical Engineering |
| Popis: | Title from PDF of title page, viewed February 14, 2025 ; Thesis advisor: Rahman Mostafizur ; Vita ; Includes bibliographical references (pages 56-59) ; Thesis (M.S.)--Department of Computer Science and Electrical Engineering. University of Missouri--Kansas City, 2024 ; The ever-increasing demands of artificial intelligence (AI) and big data processing have spurred the rapid development of novel hardware architectures specifically designed for computationally intensive tasks. Alongside these advancements, software solutions are emerging to exploit this specialized hardware by offloading tasks. However, proprietary software often necessitates a substantial learning curve for users, hindering widespread adoption and flexibility. This paper proposes OFFLOAD, an open-source, hardware-agnostic software-hardware framework. OFFLOAD facilitates the distribution of tasks across diverse hardware units, encompassing both cutting-edge accelerators and existing system-on-chip (SoC) architectures. Our framework seamlessly integrates with popular databases and application development tools. Through the utilization of multi-level abstractions implemented at the compiler, operating system, and driver levels, OFFLOAD translates high-level code and data into hardware-optimized binary instructions. To the best of our knowledge, OFFLOAD represents a ground-breaking approach within this domain. The feasibility of OFFLOAD is demonstrably validated by its integration with prevalent tools such as MySQL, Apache Spark, and Apache Arrow within a user-friendly Python environment. Subsequently, tasks are offloaded for execution on hardware leveraging memory mapped I/O. This is exemplified by integrating OFFLOAD with Raspberry Pi devices, showcasing the entire workflow from software-based data query to hardware execution. ; Introduction -- Flow of information -- Software stack -- Hardware setup -- Hardware network and task distribution -- Software & firmware implementation -- Results -- Conclusion |
| Druh dokumentu: | thesis |
| Popis souboru: | x, 60 pages |
| Jazyk: | English |
| Relation: | https://hdl.handle.net/10355/107249 |
| Dostupnost: | https://hdl.handle.net/10355/107249 |
| Přístupové číslo: | edsbas.41C1C1B8 |
| Databáze: | BASE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://hdl.handle.net/10355/107249# Name: EDS - BASE (s4221598) Category: fullText Text: View record from BASE – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Akula%20SSSRK Name: ISI Category: fullText Text: Nájsť tento článok vo Web of Science Icon: https://imagesrvr.epnet.com/ls/20docs.gif MouseOverText: Nájsť tento článok vo Web of Science |
|---|---|
| Header | DbId: edsbas DbLabel: BASE An: edsbas.41C1C1B8 RelevancyScore: 814 AccessLevel: 3 PubType: Dissertation/ Thesis PubTypeId: dissertation PreciseRelevancyScore: 814.306396484375 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Akula%2C+Satya+Sai+Siva+Rama+Krishna%22">Akula, Satya Sai Siva Rama Krishna</searchLink> – Name: Author Label: Contributors Group: Au Data: Rahman, Mostafizur – Name: DatePubCY Label: Publication Year Group: Date Data: 2024 – Name: Subset Label: Collection Group: HoldingsInfo Data: University of Missouri: MOspace – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Big+data%22">Big data</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence+--+Data+processing%22">Artificial intelligence -- Data processing</searchLink><br /><searchLink fieldCode="DE" term="%22Heterogeneous+distributed+computing+systems%22">Heterogeneous distributed computing systems</searchLink><br /><searchLink fieldCode="DE" term="%22Thesis+--+University+of+Missouri--Kansas+City+--+Electrical+Engineering%22">Thesis -- University of Missouri--Kansas City -- Electrical Engineering</searchLink> – Name: Abstract Label: Description Group: Ab Data: Title from PDF of title page, viewed February 14, 2025 ; Thesis advisor: Rahman Mostafizur ; Vita ; Includes bibliographical references (pages 56-59) ; Thesis (M.S.)--Department of Computer Science and Electrical Engineering. University of Missouri--Kansas City, 2024 ; The ever-increasing demands of artificial intelligence (AI) and big data processing have spurred the rapid development of novel hardware architectures specifically designed for computationally intensive tasks. Alongside these advancements, software solutions are emerging to exploit this specialized hardware by offloading tasks. However, proprietary software often necessitates a substantial learning curve for users, hindering widespread adoption and flexibility. This paper proposes OFFLOAD, an open-source, hardware-agnostic software-hardware framework. OFFLOAD facilitates the distribution of tasks across diverse hardware units, encompassing both cutting-edge accelerators and existing system-on-chip (SoC) architectures. Our framework seamlessly integrates with popular databases and application development tools. Through the utilization of multi-level abstractions implemented at the compiler, operating system, and driver levels, OFFLOAD translates high-level code and data into hardware-optimized binary instructions. To the best of our knowledge, OFFLOAD represents a ground-breaking approach within this domain. The feasibility of OFFLOAD is demonstrably validated by its integration with prevalent tools such as MySQL, Apache Spark, and Apache Arrow within a user-friendly Python environment. Subsequently, tasks are offloaded for execution on hardware leveraging memory mapped I/O. This is exemplified by integrating OFFLOAD with Raspberry Pi devices, showcasing the entire workflow from software-based data query to hardware execution. ; Introduction -- Flow of information -- Software stack -- Hardware setup -- Hardware network and task distribution -- Software & firmware implementation -- Results -- Conclusion – Name: TypeDocument Label: Document Type Group: TypDoc Data: thesis – Name: Format Label: File Description Group: SrcInfo Data: x, 60 pages – Name: Language Label: Language Group: Lang Data: English – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: https://hdl.handle.net/10355/107249 – Name: URL Label: Availability Group: URL Data: https://hdl.handle.net/10355/107249 – Name: AN Label: Accession Number Group: ID Data: edsbas.41C1C1B8 |
| PLink | https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.41C1C1B8 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English Subjects: – SubjectFull: Big data Type: general – SubjectFull: Artificial intelligence -- Data processing Type: general – SubjectFull: Heterogeneous distributed computing systems Type: general – SubjectFull: Thesis -- University of Missouri--Kansas City -- Electrical Engineering Type: general Titles: – TitleFull: An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Akula, Satya Sai Siva Rama Krishna – PersonEntity: Name: NameFull: Rahman, Mostafizur IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2024 Identifiers: – Type: issn-locals Value: edsbas |
| ResultId | 1 |
Nájsť tento článok vo Web of Science