On the Problem of Evaluating the Performance of Multiprogrammed Workloads
Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines when the measurements for a given workload execution are taken. A metric combines those measurements to obtain a final eval...
Uloženo v:
| Vydáno v: | IEEE transactions on computers Ročník 59; číslo 12; s. 1722 - 1728 |
|---|---|
| Hlavní autoři: | , , , , |
| Médium: | Journal Article Publikace |
| Jazyk: | angličtina |
| Vydáno: |
New York
IEEE
01.12.2010
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Témata: | |
| ISSN: | 0018-9340, 1557-9956 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines when the measurements for a given workload execution are taken. A metric combines those measurements to obtain a final evaluation result. However, since current evaluation methodologies do not provide representative measurements for these metrics, the analysis and evaluation of novel ideas could be either unfair or misleading. Given the potential impact of multithreaded architectures on current and future processor designs, it is crucial to develop an accurate evaluation methodology for them. This paper presents FAME, a new evaluation methodology aimed to fairly measure the performance of multithreaded processors executing multiprogrammed workloads. FAME reexecutes all programs in the workload until all of them are fairly represented in the final measurements taken. We compare FAME with previously used methodologies showing that it provides more accurate measurements, becoming an ideal evaluation methodology to analyze proposals for multithreaded architectures. |
|---|---|
| AbstractList | Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines when the measurements for a given workload execution are taken. A metric combines those measurements to obtain a final evaluation result. However, since current evaluation methodologies do not provide representative measurements for these metrics, the analysis and evaluation of novel ideas could be either unfair or misleading. Given the potential impact of multithreaded architectures on current and future processor designs, it is crucial to develop an accurate evaluation methodology for them. This paper presents FAME, a new evaluation methodology aimed to fairly measure the performance of multithreaded processors executing multiprogrammed workloads. FAME reexecutes all programs in the workload until all of them are fairly represented in the final measurements taken. We compare FAME with previously used methodologies showing that it provides more accurate measurements, becoming an ideal evaluation methodology to analyze proposals for multithreaded architectures. Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines when the measurements for a given workload execution are taken. A metric combines those measurements to obtain a final evaluation result. However, since current evaluation methodologies do not provide representative measurements for these metrics, the analysis and evaluation of novel ideas could be either unfair or misleading. Given the potential impact of multithreaded architectures on current and future processor designs, it is crucial to develop an accurate evaluation methodology for them. This paper presents FAME, a new evaluation methodology aimed to fairly measure the performance of multithreaded processors executing multiprogrammed workloads. FAME reexecutes all programs in the workload until all of them are fairly represented in the final measurements taken. We compare FAME with previously used methodologies showing that it provides more accurate measurements, becoming an ideal evaluation methodology to analyze proposals for multithreaded architectures. Peer Reviewed |
| Author | Cazorla, F J Valero, M Pajuelo, A Fernandez, E Santana, O J |
| Author_xml | – sequence: 1 givenname: F J surname: Cazorla fullname: Cazorla, F J email: francisco.cazorla@bsc.es organization: IIIA, CSIC (Spanish Nat. Res. Council), Spain – sequence: 2 givenname: A surname: Pajuelo fullname: Pajuelo, A email: mpajuelo@ac.upc.edu organization: Dept. d'Arquitectura de Computadors, Univ. Politec. de Catalunya, Barcelona, Spain – sequence: 3 givenname: O J surname: Santana fullname: Santana, O J email: ojsantana@dis.ulpgc.es organization: Dept. de Inf. y Sist., Univ. de Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain – sequence: 4 givenname: E surname: Fernandez fullname: Fernandez, E email: efernandez@dis.ulpgc.es organization: Dept. de Inf. y Sist., Univ. de Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain – sequence: 5 givenname: M surname: Valero fullname: Valero, M email: mateo@ac.upc.edu organization: Dept. d'Arquitectura de Computadors, Univ. Politec. de Catalunya, Barcelona, Spain |
| BookMark | eNp9kcFLHTEQxkOx4NN68drLQg8twuokm2STY3m8VsFiD088hnnZWV3d3dhkt9D_3jyeKEjxEJKP7_cNk5kDtjeGkRg75nDKOdiz9fJUQBZafGALrlRdWqv0HlsAcFPaSsI-O0jpHgC0ALtgF1djMd1R8TuGTU9DEdpi9Rf7GaduvN05FNsQBxw9bd1fcz91jzHcRhwGaoqbEB_6gE36xD622Cc6er4P2fWP1Xp5Xl5e_bxYfr8svRRiKmtusKkrkkK1EpqNBuS-tU3b1CjrDVpjpfHeck3YqJo0gEdbCZ7lBvPrkPFdXZ9m7yJ5ih4nF7B7FdsjoBZOGGOkyZmvu0xu_M9MaXJDlzz1PY4U5uRMxbkxOZHJb--SXNdcGKk4ZPTLG_Q-zHHMf3fZBS6V0DpT8NxuDClFap3vpjzdME4Ruz6jbrs5t1667eacFjly8ibyGLsB47__w593cEdEL6CSeWLKVk-kWqJi |
| CODEN | ITCOB4 |
| CitedBy_id | crossref_primary_10_1109_MM_2012_13 |
| Cites_doi | 10.1109/MICRO.2004.8 10.1145/232973.232993 10.1109/MICRO.2004.17 10.1109/PACT.2007.4336221 10.1147/rd.494.0505 10.1109/MICRO.2003.1253185 10.1109/ISPASS.2004.1291355 10.1109/ispass.2001.990695 10.1145/511334.511343 10.1109/IPDPS.2001.924929 10.1109/MM.2008.44 |
| ContentType | Journal Article Publication |
| Contributor | Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors |
| Contributor_xml | – sequence: 1 fullname: Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors – sequence: 2 fullname: Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Dec 2010 info:eu-repo/semantics/openAccess |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Dec 2010 – notice: info:eu-repo/semantics/openAccess |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3 XX2 |
| DOI | 10.1109/TC.2010.62 |
| DatabaseName | IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ANTE: Abstracts in New Technology & Engineering Engineering Research Database Recercat |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional Engineering Research Database ANTE: Abstracts in New Technology & Engineering |
| DatabaseTitleList | Technology Research Database Technology Research Database Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Computer Science |
| EISSN | 1557-9956 |
| EndPage | 1728 |
| ExternalDocumentID | oai_recercat_cat_2072_288848 2724097171 10_1109_TC_2010_62 5432159 |
| Genre | orig-research |
| GroupedDBID | --Z -DZ -~X .55 .DC 0R~ 29I 3EH 3O- 4.4 5GY 5VS 6IK 85S 97E AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABQJQ ABVLG ACGFO ACIWK ACNCT AENEX AETEA AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD HZ~ H~9 IAAWW IBMZZ ICLAB IEDLZ IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ MVM O9- OCL P2P PQQKQ RIA RIE RNI RNS RXW RZB TAE TN5 TWZ UHB UKR UPT VH1 X7M XJT XOL XZL YXB YYQ YZZ ZCG AAYXX ABUFD CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3 XX2 |
| ID | FETCH-LOGICAL-c422t-718ad73e425f40db60a1cf9dfd7a47ba98948cc916ead57e600ca9321eadbaa93 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 2 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000283718100013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0018-9340 |
| IngestDate | Fri Nov 07 13:38:38 EST 2025 Sun Nov 09 14:28:51 EST 2025 Sun Nov 09 10:17:00 EST 2025 Sun Nov 09 06:49:05 EST 2025 Sat Nov 29 08:07:56 EST 2025 Tue Nov 18 21:31:46 EST 2025 Wed Aug 27 02:49:03 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 12 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c422t-718ad73e425f40db60a1cf9dfd7a47ba98948cc916ead57e600ca9321eadbaa93 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 ObjectType-Article-2 ObjectType-Feature-1 |
| OpenAccessLink | https://recercat.cat/handle/2072/288848 |
| PQID | 1030145266 |
| PQPubID | 23500 |
| PageCount | 7 |
| ParticipantIDs | proquest_miscellaneous_831188207 proquest_journals_1030145266 crossref_citationtrail_10_1109_TC_2010_62 csuc_recercat_oai_recercat_cat_2072_288848 proquest_miscellaneous_1671284510 ieee_primary_5432159 crossref_primary_10_1109_TC_2010_62 |
| PublicationCentury | 2000 |
| PublicationDate | 2010-12-01 |
| PublicationDateYYYYMMDD | 2010-12-01 |
| PublicationDate_xml | – month: 12 year: 2010 text: 2010-12-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York |
| PublicationTitle | IEEE transactions on computers |
| PublicationTitleAbbrev | TC |
| PublicationYear | 2010 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref12 Marr (ref3) 2002; 6 ref15 ref14 ref11 ref10 ref2 Serrano (ref1) 1993 ref8 ref7 ref9 ref6 ref5 |
| References_xml | – ident: ref9 doi: 10.1109/MICRO.2004.8 – ident: ref2 doi: 10.1145/232973.232993 – ident: ref8 doi: 10.1109/MICRO.2004.17 – ident: ref5 doi: 10.1109/PACT.2007.4336221 – ident: ref12 doi: 10.1147/rd.494.0505 – ident: ref11 doi: 10.1109/MICRO.2003.1253185 – volume: 6 start-page: 4 issue: 1 year: 2002 ident: ref3 article-title: Hyper-Threading Technology Architecture and Microarchitecture publication-title: Intel Technology J – ident: ref15 doi: 10.1109/ISPASS.2004.1291355 – ident: ref7 doi: 10.1109/ispass.2001.990695 – volume-title: Technical Report #93-05, Univ. of California year: 1993 ident: ref1 article-title: A Study of Multistreamed Superscalar Processors – ident: ref6 doi: 10.1145/511334.511343 – ident: ref10 doi: 10.1109/IPDPS.2001.924929 – ident: ref14 doi: 10.1109/MM.2008.44 |
| SSID | ssj0006209 |
| Score | 1.9563377 |
| Snippet | Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A... |
| SourceID | csuc proquest crossref ieee |
| SourceType | Open Access Repository Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 1722 |
| SubjectTerms | Arquitectura de computadors Benchmark testing Design and construction Design engineering Disseny i construcció Evaluation methodologies Informàtica Microprocessadors Microprocessors Multicore processing Multiprogrammed workloads Multithreaded processors Multithreading Performance evaluation Proposals Simultaneous multithreading processors Studies Workload Workloads Àrees temàtiques de la UPC |
| Title | On the Problem of Evaluating the Performance of Multiprogrammed Workloads |
| URI | https://ieeexplore.ieee.org/document/5432159 https://www.proquest.com/docview/1030145266 https://www.proquest.com/docview/1671284510 https://www.proquest.com/docview/831188207 https://recercat.cat/handle/2072/288848 |
| Volume | 59 |
| WOSCitedRecordID | wos000283718100013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1557-9956 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0006209 issn: 0018-9340 databaseCode: RIE dateStart: 19680101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT9wwEB7BigM98K5IecioXECkOI4TJ0e0AsGFclgkbpYzdlAllKB98Ps7TryhFfTQQyRbHsVRxuP5xp4HwCmS2nOFUXGG3MbSWRtXKGScYy2q2iWl4XVXbELd3xdPT-XDClwMsTDOuc75zP3wze4u37a48Edll5lMSUOVq7CqlOpjtYZdN1-6cyQkwKnkIRVpwsvLybh34crFX8pnhLMFhqIqH3biTr3cbP7fh23BRoCR7Krn-zasuGYHNpclGliQ2B348ke-wV24-9kwAnzsoa8iw9qaXYds381zP_IeR-BHu_Dc4MJFapP5o_WX1tjZHjzeXE_Gt3GopRCjFGIekwoyVqWORLSW3FY5NwnWpa2tMlJVxudhLxAJLNLSypQjHISGsF1C3cpQ6yuMmrZx-8BQlSpVsuKlUWReVYYwFk8xd67IMkyKCM6WP1ljSDTu61286M7g4KWejLVniM5FBN8H2tc-vcanVOeeV5p0gJuimWufE3vo-EdwJbQga17S9LueQcPrAm8iOFxyWAcxnemksygzAikRnAzDJGD-1sQ0rl0QTa68Dqe9KwL2D5oiJTuNsJT69vnkB7AuBjeYQxjNpwt3BGv4Nv81mx53C_k314jyRA |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT9wwEB7RpVLpAVooIkCpq_bSqgHHceLkWK1AoNIth63EzXLGDkJCCdoHv7_jxBtalR56iGTLozjKeDzf2PMA-Iik9lxhVJwht7F01sYVChnnWIuqdklpeN0Vm1CTSXF9XV6twZchFsY51zmfuWPf7O7ybYtLf1R2ksmUNFT5DNYzKUXSR2sN-26-cuhISIRTyUMy0oSXJ9Nx78SViz_UzwjnSwxlVf7aizsFc7b1f5_2CjYDkGRfe86_hjXXbMPWqkgDCzK7DS9_yzi4Axc_GkaQj131dWRYW7PTkO-7uelHHiMJ_GgXoBucuEhxMn-4ftcaO38DP89Op-PzOFRTiFEKsYhJCRmrUkdCWktuq5ybBOvS1lYZqSrjM7EXiAQXaXFlyhESQkPoLqFuZai1C6OmbdweMFSlSpWseGkUGViVIZTFU8ydK7IMkyKCT6ufrDGkGvcVL-50Z3LwUk_H2jNE5yKCDwPtfZ9g40mqz55XmrSAm6FZaJ8Ve-j4R3AltCB7XtL0O55Bw-sCbyI4XHFYB0Gd66SzKTOCKRG8H4ZJxPy9iWlcuySaXHktTrtXBOwfNEVKlhqhKbX_9OTv4MX59PulvryYfDuADTE4xRzCaDFburfwHB8Wt_PZUbeofwGS0PWL |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=On+the+Problem+of+Evaluating+the+Performance+of+Multiprogrammed+Workloads&rft.jtitle=IEEE+transactions+on+computers&rft.au=Cazorla%2C+Francisco+J&rft.au=Pajuelo%2C+Alex&rft.au=Santana%2C+Oliverio+J&rft.au=Fernandez%2C+Enrique&rft.date=2010-12-01&rft.issn=0018-9340&rft.volume=59&rft.issue=12&rft.spage=1722&rft.epage=1728&rft_id=info:doi/10.1109%2FTC.2010.62&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9340&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9340&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9340&client=summon |