An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units

Uloženo v:
Podrobná bibliografie
Název: An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units
Autoři: Akula, Satya Sai Siva Rama Krishna
Přispěvatelé: Rahman, Mostafizur
Rok vydání: 2024
Sbírka: University of Missouri: MOspace
Témata: Big data, Artificial intelligence -- Data processing, Heterogeneous distributed computing systems, Thesis -- University of Missouri--Kansas City -- Electrical Engineering
Popis: Title from PDF of title page, viewed February 14, 2025 ; Thesis advisor: Rahman Mostafizur ; Vita ; Includes bibliographical references (pages 56-59) ; Thesis (M.S.)--Department of Computer Science and Electrical Engineering. University of Missouri--Kansas City, 2024 ; The ever-increasing demands of artificial intelligence (AI) and big data processing have spurred the rapid development of novel hardware architectures specifically designed for computationally intensive tasks. Alongside these advancements, software solutions are emerging to exploit this specialized hardware by offloading tasks. However, proprietary software often necessitates a substantial learning curve for users, hindering widespread adoption and flexibility. This paper proposes OFFLOAD, an open-source, hardware-agnostic software-hardware framework. OFFLOAD facilitates the distribution of tasks across diverse hardware units, encompassing both cutting-edge accelerators and existing system-on-chip (SoC) architectures. Our framework seamlessly integrates with popular databases and application development tools. Through the utilization of multi-level abstractions implemented at the compiler, operating system, and driver levels, OFFLOAD translates high-level code and data into hardware-optimized binary instructions. To the best of our knowledge, OFFLOAD represents a ground-breaking approach within this domain. The feasibility of OFFLOAD is demonstrably validated by its integration with prevalent tools such as MySQL, Apache Spark, and Apache Arrow within a user-friendly Python environment. Subsequently, tasks are offloaded for execution on hardware leveraging memory mapped I/O. This is exemplified by integrating OFFLOAD with Raspberry Pi devices, showcasing the entire workflow from software-based data query to hardware execution. ; Introduction -- Flow of information -- Software stack -- Hardware setup -- Hardware network and task distribution -- Software & firmware implementation -- Results -- Conclusion
Druh dokumentu: thesis
Popis souboru: x, 60 pages
Jazyk: English
Relation: https://hdl.handle.net/10355/107249
Dostupnost: https://hdl.handle.net/10355/107249
Přístupové číslo: edsbas.41C1C1B8
Databáze: BASE
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://hdl.handle.net/10355/107249#
    Name: EDS - BASE (s4221598)
    Category: fullText
    Text: View record from BASE
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Akula%20SSSRK
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsbas
DbLabel: BASE
An: edsbas.41C1C1B8
RelevancyScore: 814
AccessLevel: 3
PubType: Dissertation/ Thesis
PubTypeId: dissertation
PreciseRelevancyScore: 814.306396484375
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Akula%2C+Satya+Sai+Siva+Rama+Krishna%22">Akula, Satya Sai Siva Rama Krishna</searchLink>
– Name: Author
  Label: Contributors
  Group: Au
  Data: Rahman, Mostafizur
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2024
– Name: Subset
  Label: Collection
  Group: HoldingsInfo
  Data: University of Missouri: MOspace
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Big+data%22">Big data</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence+--+Data+processing%22">Artificial intelligence -- Data processing</searchLink><br /><searchLink fieldCode="DE" term="%22Heterogeneous+distributed+computing+systems%22">Heterogeneous distributed computing systems</searchLink><br /><searchLink fieldCode="DE" term="%22Thesis+--+University+of+Missouri--Kansas+City+--+Electrical+Engineering%22">Thesis -- University of Missouri--Kansas City -- Electrical Engineering</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Title from PDF of title page, viewed February 14, 2025 ; Thesis advisor: Rahman Mostafizur ; Vita ; Includes bibliographical references (pages 56-59) ; Thesis (M.S.)--Department of Computer Science and Electrical Engineering. University of Missouri--Kansas City, 2024 ; The ever-increasing demands of artificial intelligence (AI) and big data processing have spurred the rapid development of novel hardware architectures specifically designed for computationally intensive tasks. Alongside these advancements, software solutions are emerging to exploit this specialized hardware by offloading tasks. However, proprietary software often necessitates a substantial learning curve for users, hindering widespread adoption and flexibility. This paper proposes OFFLOAD, an open-source, hardware-agnostic software-hardware framework. OFFLOAD facilitates the distribution of tasks across diverse hardware units, encompassing both cutting-edge accelerators and existing system-on-chip (SoC) architectures. Our framework seamlessly integrates with popular databases and application development tools. Through the utilization of multi-level abstractions implemented at the compiler, operating system, and driver levels, OFFLOAD translates high-level code and data into hardware-optimized binary instructions. To the best of our knowledge, OFFLOAD represents a ground-breaking approach within this domain. The feasibility of OFFLOAD is demonstrably validated by its integration with prevalent tools such as MySQL, Apache Spark, and Apache Arrow within a user-friendly Python environment. Subsequently, tasks are offloaded for execution on hardware leveraging memory mapped I/O. This is exemplified by integrating OFFLOAD with Raspberry Pi devices, showcasing the entire workflow from software-based data query to hardware execution. ; Introduction -- Flow of information -- Software stack -- Hardware setup -- Hardware network and task distribution -- Software & firmware implementation -- Results -- Conclusion
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: thesis
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: x, 60 pages
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: NoteTitleSource
  Label: Relation
  Group: SrcInfo
  Data: https://hdl.handle.net/10355/107249
– Name: URL
  Label: Availability
  Group: URL
  Data: https://hdl.handle.net/10355/107249
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsbas.41C1C1B8
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.41C1C1B8
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: Big data
        Type: general
      – SubjectFull: Artificial intelligence -- Data processing
        Type: general
      – SubjectFull: Heterogeneous distributed computing systems
        Type: general
      – SubjectFull: Thesis -- University of Missouri--Kansas City -- Electrical Engineering
        Type: general
    Titles:
      – TitleFull: An open-source framework for offloading big data and AI tasks (Offload) to heterogeneous compute units
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Akula, Satya Sai Siva Rama Krishna
      – PersonEntity:
          Name:
            NameFull: Rahman, Mostafizur
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-locals
              Value: edsbas
ResultId 1