Neural Acceleration for General-Purpose Approximate Programs

This paper describes a learning-based approach to the acceleration of approximate programs. We describe the \emph{Parrot transformation}, a program transformation that selects and trains a neural network to mimic a region of imperative code. After the learning phase, the compiler replaces the origin...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2012 45th Annual IEEE/ACM International Symposium on Microarchitecture s. 449 - 460
Hlavní autoři: Esmaeilzadeh, H., Sampson, A., Ceze, L., Burger, D.
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.12.2012
Témata:
Accelerator
Approximate Computing
Neural Networks
Neural Processing Unit
NPU
ISSN:1072-4451
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract This paper describes a learning-based approach to the acceleration of approximate programs. We describe the \emph{Parrot transformation}, a program transformation that selects and trains a neural network to mimic a region of imperative code. After the learning phase, the compiler replaces the original code with an invocation of a low-power accelerator called a \emph{neural processing unit} (NPU). The NPU is tightly coupled to the processor pipeline to accelerate small code regions. Since neural networks produce inherently approximate results, we define a programming model that allows programmers to identify approximable code regions -- code that can produce imprecise but acceptable results. Offloading approximable code regions to NPUs is faster and more energy efficient than executing the original code. For a set of diverse applications, NPU acceleration provides whole-application speedup of 2.3× and energy savings of 3.0× on average with quality loss of at most 9.6%.
AbstractList This paper describes a learning-based approach to the acceleration of approximate programs. We describe the \emph{Parrot transformation}, a program transformation that selects and trains a neural network to mimic a region of imperative code. After the learning phase, the compiler replaces the original code with an invocation of a low-power accelerator called a \emph{neural processing unit} (NPU). The NPU is tightly coupled to the processor pipeline to accelerate small code regions. Since neural networks produce inherently approximate results, we define a programming model that allows programmers to identify approximable code regions -- code that can produce imprecise but acceptable results. Offloading approximable code regions to NPUs is faster and more energy efficient than executing the original code. For a set of diverse applications, NPU acceleration provides whole-application speedup of 2.3× and energy savings of 3.0× on average with quality loss of at most 9.6%.
Author Burger, D.
Sampson, A.
Ceze, L.
Esmaeilzadeh, H.
Author_xml – sequence: 1
  givenname: H.
  surname: Esmaeilzadeh
  fullname: Esmaeilzadeh, H.
  email: hadianeh@cs.washington.edu
– sequence: 2
  givenname: A.
  surname: Sampson
  fullname: Sampson, A.
  email: asampson@cs.washington.edu
– sequence: 3
  givenname: L.
  surname: Ceze
  fullname: Ceze, L.
  email: luisceze@cs.washington.edu
– sequence: 4
  givenname: D.
  surname: Burger
  fullname: Burger, D.
  email: dburger@microsoft.com
BookMark eNotjs1Kw0AURkeoYK1ZunKTF0icO_8X3ISgtVBtEV2XaXJHAmkSJino2xuoq4-zOIfvli26viPG7oHnABwf3zblxy4XHESu3BVL0DpuDWqFQrkFWwK3IlNKww1LxrE5cqm15tKqJXt6p3P0bVpUFbUU_dT0XRr6mK6pm7HN9uc49COlxTDE_qc5-YnSfey_oz-Nd-w6-Hak5H9X7Ovl-bN8zba79aYstpmXHKcs2EoFALAGKofKgwHrfRA1EdbeBdBoFOqjlVzp2gIKU3PPEX2lXG2NXLGHS7chosMQ5xfx9zA70iiQf2b8SY8
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/MICRO.2012.48
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
Accès Toulouse INP et ENVT - IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9780769549248
9781467348195
0769549241
1467348198
EndPage 460
ExternalDocumentID 6493641
Genre orig-research
GroupedDBID -~X
123
29O
6IE
6IF
6IK
6IL
6IN
AAJGR
AAWTH
ADZIZ
AFFNX
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IPLJI
M43
OCL
RIE
RIL
RNS
ID FETCH-LOGICAL-a309t-f7c4f111761c894a1617aaf2dee9da8f1596495b73045d71926d0a099ac48d763
IEDL.DBID RIE
ISICitedReferencesCount 320
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000319333900039&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1072-4451
IngestDate Wed Aug 27 02:44:23 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a309t-f7c4f111761c894a1617aaf2dee9da8f1596495b73045d71926d0a099ac48d763
PageCount 12
ParticipantIDs ieee_primary_6493641
PublicationCentury 2000
PublicationDate 2012-12
PublicationDateYYYYMMDD 2012-12-01
PublicationDate_xml – month: 12
  year: 2012
  text: 2012-12
PublicationDecade 2010
PublicationTitle 2012 45th Annual IEEE/ACM International Symposium on Microarchitecture
PublicationTitleAbbrev micro
PublicationYear 2012
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib035550374
ssj0001035055
ssj0008695
Score 2.434999
Snippet This paper describes a learning-based approach to the acceleration of approximate programs. We describe the \emph{Parrot transformation}, a program...
SourceID ieee
SourceType Publisher
StartPage 449
SubjectTerms Accelerator
Approximate Computing
Neural Networks
Neural Processing Unit
NPU
Title Neural Acceleration for General-Purpose Approximate Programs
URI https://ieeexplore.ieee.org/document/6493641
WOSCitedRecordID wos000319333900039&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELZKxcBUoEW8lYERt3k4tiOxVIiKqVQIpG6VY5-lSqhFfSB-PndO2jCwsCUZIufs-L7z3X0fY3caUXKJMJmXEHsucut4aTO8ldYB-nebZD6ITajxWE-nxaTF7ve9MAAQis-gT5chl--WdktHZQMpikxSl_qBUrLq1dqtHXSbOVGpNOcrlDLLGyisZVBgwWgn5UTK1fBtDvB7X1-oyivtkwzQL5WV4GRGnf8N75j1mm69aLL3QyesBYtT1tnJNUT139tlD0TEYT6iobXoa6qZjxCzRjX1NJ-g0ZdriIbEM_49RywbXkz1W-seex89vT0-81o8gZssLjbcKys8bmRKJlYXwlAcY4xPHUDhjPYIY3C8eakoVeoUAj3pYoN40VihHe46Z6y9WC7gnEU6FmAznQIR_yhRlonRUvhY-QSjpxIuWJeMMfus-DFmtR0u_358xY7I1FVJyDVrb1ZbuGGH9mszX69uw6T-ABH8neE
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEB6KCnqq2opvc_DotnlsNhvwUsRSsdYiFXorm31AQVrpQ_z5ziRp48GLtySHsJnd7HyzM_N9ALcSUXKGMJll1neMx9qwTEd4K7Sx6N91ELlcbCIZDOR4nA5rcLfthbHW5sVntkWXeS7fzPWajsragqeRoC713Zjz0C-6tTarBx1nTGQq1QkLJc3iCgxLkWuwYLwTMqLlqhg32_jFb69U5xW2SAjol85K7ma69f8N8BCaVb-eN9x6oiOo2dkx1DeCDV75_zbgnqg41IfX0Rq9TTH3HqJWrySfZkM0-3xpvQ4xjX9PEc3mL6YKrmUT3ruPo4ceK-UTmIr8dMVcornDrSwRgZYpVxTJKOVCY21qlHQIZHC8cZZQstQkCPWE8RUiRqW5NLjvnMDObD6zp-BJn1sdydAS9U_CsyxQUnDnJy7A-CmzZ9AgY0w-C4aMSWmH878f38B-b_TSn_SfBs8XcEBmLwpELmFntVjbK9jTX6vpcnGdT_APfnmhKA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2012+45th+Annual+IEEE%2FACM+International+Symposium+on+Microarchitecture&rft.atitle=Neural+Acceleration+for+General-Purpose+Approximate+Programs&rft.au=Esmaeilzadeh%2C+H.&rft.au=Sampson%2C+A.&rft.au=Ceze%2C+L.&rft.au=Burger%2C+D.&rft.date=2012-12-01&rft.pub=IEEE&rft.issn=1072-4451&rft.spage=449&rft.epage=460&rft_id=info:doi/10.1109%2FMICRO.2012.48&rft.externalDocID=6493641
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1072-4451&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1072-4451&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1072-4451&client=summon