KnightShift: Scaling the Energy Proportionality Wall through Server-Level Heterogeneity

Server energy proportionality has been improving over the past several years. Many components in a system, such as CPU, memory and disk, have been achieving good energy proportionality behavior. Using a wide range of server power data from the published SPEC power data we show that the overall syste...

Full description

Saved in:
Bibliographic Details
Published in:2012 45th Annual IEEE/ACM International Symposium on Microarchitecture pp. 119 - 130
Main Authors: Wong, Daniel, Annavaram, Murali
Format: Conference Proceeding
Language:English
Published: IEEE 01.12.2012
Subjects:
Costs
Dynamic range
Energy consumption
Energy efficiency
Energy measurement
Linearity
Measurement
Power demand
Servers
ISSN:1072-4451
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Server energy proportionality has been improving over the past several years. Many components in a system, such as CPU, memory and disk, have been achieving good energy proportionality behavior. Using a wide range of server power data from the published SPEC power data we show that the overall system energy proportionality has reached 80%. We present two novel metrics, linear deviation and proportionality gap, that provide insights into accurately quantifying energy proportionality. Using these metrics we show that energy proportionality improvements are not uniform across various server utilization levels. In particular, the energy proportionality of even a highly proportional server suffers significantly at non-zero but low utilizations. We propose to tackle the lack of energy proportionality at low utilization using server-level heterogeneity. We present Knight Shift, a server-level heterogenous server architecture that introduces an active low power mode, through the addition of a tightly-coupled compute node called the Knight, enabling two energy-efficient operating regions. We evaluated Knight Shift against a variety of real-world data center workloads using a combination of prototyping and simulation, showing up to 75% energy savings with tail latency bounded by the latency of the Knight and up to 14% improvement to Performance per TCO dollar spent.
AbstractList Server energy proportionality has been improving over the past several years. Many components in a system, such as CPU, memory and disk, have been achieving good energy proportionality behavior. Using a wide range of server power data from the published SPEC power data we show that the overall system energy proportionality has reached 80%. We present two novel metrics, linear deviation and proportionality gap, that provide insights into accurately quantifying energy proportionality. Using these metrics we show that energy proportionality improvements are not uniform across various server utilization levels. In particular, the energy proportionality of even a highly proportional server suffers significantly at non-zero but low utilizations. We propose to tackle the lack of energy proportionality at low utilization using server-level heterogeneity. We present Knight Shift, a server-level heterogenous server architecture that introduces an active low power mode, through the addition of a tightly-coupled compute node called the Knight, enabling two energy-efficient operating regions. We evaluated Knight Shift against a variety of real-world data center workloads using a combination of prototyping and simulation, showing up to 75% energy savings with tail latency bounded by the latency of the Knight and up to 14% improvement to Performance per TCO dollar spent.
Author Annavaram, Murali
Wong, Daniel
Author_xml – sequence: 1
  givenname: Daniel
  surname: Wong
  fullname: Wong, Daniel
  email: wongdani@usc.edu
  organization: Ming Hsieh Dept. of Electr. Eng., Univ. of Southern California, Los Angeles, CA, USA
– sequence: 2
  givenname: Murali
  surname: Annavaram
  fullname: Annavaram, Murali
  email: annavara@usc.edu
  organization: Ming Hsieh Dept. of Electr. Eng., Univ. of Southern California, Los Angeles, CA, USA
BookMark eNotjM1KAzEURiNUsGqXrtzkBaYmufmZuJNSbbFSsUqXJdO5mQmMmZLGQt_eAd2cb3E-zjUZxT4iIXecTTln9uFtOftYTwXjYsAFmVhTMqOtklbIckTGnBlRSKn4FZkcj6FioJRiYOSYbF9jaNq8aYPPj3Szd12IDc0t0nnE1Jzpe-oPfcqhj4PKZ7p1XTf41P80Ld1gOmEqVnjCji4wY-objDj8bsmld90RJ_97Q76e55-zRbFavyxnT6vCAbO5qCrJVK1LWWINla0Vq6zWWoHzKAEqw2uUAgCsN0I7L7zTey9RCXSIpYEbcv_XDYi4O6Tw7dJ5p6UFzQF-AWo2VLY
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/MICRO.2012.20
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9780769549248
9781467348195
0769549241
1467348198
EndPage 130
ExternalDocumentID 6493613
Genre orig-research
GroupedDBID -~X
123
29O
6IE
6IF
6IK
6IL
6IN
AAJGR
AAWTH
ADZIZ
AFFNX
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IPLJI
M43
OCL
RIE
RIL
RNS
ID FETCH-LOGICAL-a309t-bb405d6848ed3b9d50b966653afe433b71de423339f726af2fa6cf4e52eaee873
IEDL.DBID RIE
ISICitedReferencesCount 54
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000319333900011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1072-4451
IngestDate Wed Sep 03 07:09:23 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a309t-bb405d6848ed3b9d50b966653afe433b71de423339f726af2fa6cf4e52eaee873
PageCount 12
ParticipantIDs ieee_primary_6493613
PublicationCentury 2000
PublicationDate 2012-12
PublicationDateYYYYMMDD 2012-12-01
PublicationDate_xml – month: 12
  year: 2012
  text: 2012-12
PublicationDecade 2010
PublicationTitle 2012 45th Annual IEEE/ACM International Symposium on Microarchitecture
PublicationTitleAbbrev micro
PublicationYear 2012
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib035550374
ssj0001035055
ssj0008695
Score 2.174346
Snippet Server energy proportionality has been improving over the past several years. Many components in a system, such as CPU, memory and disk, have been achieving...
SourceID ieee
SourceType Publisher
StartPage 119
SubjectTerms Costs
Dynamic range
Energy consumption
Energy efficiency
Energy measurement
Linearity
Measurement
Power demand
Servers
Title KnightShift: Scaling the Energy Proportionality Wall through Server-Level Heterogeneity
URI https://ieeexplore.ieee.org/document/6493613
WOSCitedRecordID wos000319333900011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09b8IwELUo6tCJtlD1Wx461gVix7G7ViAGRFE_VDbkxGeVBSoI_f29SwJRpS7dIiuyEp-Te3e-946xO4kYQWminynvhMpUJpwySoA1NlV951JfiLiOk8nEzGZ22mD3ey4MABTFZ_BAl8VZvl9lW0qVdbWyUlOL2oMk0SVXa7d30G3GJKVS51foyCyuobDRRQcWjHYiQaJctd5mF9_35ZmqvIiY9avLSuFkhq3_Pd4x69RsPT7d-6ET1oDlKWvt2jXw6utts49SNeT1cxHyRxx2xETnCAD5oCAA0iSExhcVOOeUZOdVIx9OPxVYizEVGfERFdGscO8B3tdh78PB29NIVH0VhJM9m4s0RZTmtVEGvEytj3spBj06li6AkjJN-h4QZUlpQxJpF6LgdBYUxBE4AJPIM9ZcrpZwzrjug3YIInAeDDQN2ICmxxApQ1yHrjG5YG1ap_lXKZ0xr5bo8u_hK3ZEViirRa5ZM19v4YYdZt_5YrO-Lez9AwV3p_g
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fT8IwEG4ImugTKhh_2wcfrcDada2vBoJxIlGMvJFuuwVewODw7_duGywmvvi2NEuz9brdd9f77mPsRiJGUJroZypxQsUqFk4ZJcAaG6muc1GSN3ENg-HQTCZ2VGO3Wy4MAOTFZ3BHl_lZfrKM15Qqa2tlpSaJ2h1SzvILttZm96Dj9KmZSpVhoUMzvwLDRucaLBjveILaclUdN9v4xq8vVOdF1KxfOiu5m-k3_veAB6xV8fX4aOuJDlkNFkessRFs4OX322QfRd-Qt9k8ze5x2BEXnSME5L2cAkiTEB6fl_CcU5qdl1I-nH4rsBIhlRnxAZXRLHH3Ad7XYu_93vhhIEplBeFkx2YiihCnJdooA4mMbOJ3Igx7tC9dCkrKKOgmgDhLSpsGnnaplzodpwp8DxyACeQxqy-WCzhhXHdBO4QROA-GmgZsisbHIClGZIfOMThlTVqn6WfRPGNaLtHZ38PXbG8wfg6n4ePw6Zztk0WK2pELVs9Wa7hku_F3Nv9aXeW2_wH75KtD
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2012+45th+Annual+IEEE%2FACM+International+Symposium+on+Microarchitecture&rft.atitle=KnightShift%3A+Scaling+the+Energy+Proportionality+Wall+through+Server-Level+Heterogeneity&rft.au=Wong%2C+Daniel&rft.au=Annavaram%2C+Murali&rft.date=2012-12-01&rft.pub=IEEE&rft.issn=1072-4451&rft.spage=119&rft.epage=130&rft_id=info:doi/10.1109%2FMICRO.2012.20&rft.externalDocID=6493613
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1072-4451&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1072-4451&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1072-4451&client=summon