Strategic Evaluation: Subjects, Evaluators, and Society
A broad current application of algorithms is in formal and quantitative measures of murky concepts -- like merit -- to make decisions. When people strategically respond to these sorts of evaluations in order to gain favorable decision outcomes, their behavior can be subjected to moral judgments. The...
Uloženo v:
| Vydáno v: | arXiv.org |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Paper |
| Jazyk: | angličtina |
| Vydáno: |
Ithaca
Cornell University Library, arXiv.org
05.10.2023
|
| Témata: | |
| ISSN: | 2331-8422 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | A broad current application of algorithms is in formal and quantitative measures of murky concepts -- like merit -- to make decisions. When people strategically respond to these sorts of evaluations in order to gain favorable decision outcomes, their behavior can be subjected to moral judgments. They may be described as 'gaming the system' or 'cheating,' or (in other cases) investing 'honest effort' or 'improving.' Machine learning literature on strategic behavior has tried to describe these dynamics by emphasizing the efforts expended by decision subjects hoping to obtain a more favorable assessment -- some works offer ways to preempt or prevent such manipulations, some differentiate 'gaming' from 'improvement' behavior, while others aim to measure the effort burden or disparate effects of classification systems. We begin from a different starting point: that the design of an evaluation itself can be understood as furthering goals held by the evaluator which may be misaligned with broader societal goals. To develop the idea that evaluation represents a strategic interaction in which both the evaluator and the subject of their evaluation are operating out of self-interest, we put forward a model that represents the process of evaluation using three interacting agents: a decision subject, an evaluator, and society, representing a bundle of values and oversight mechanisms. We highlight our model's applicability to a number of social systems where one or two players strategically undermine the others' interests to advance their own. Treating evaluators as themselves strategic allows us to re-cast the scrutiny directed at decision subjects, towards the incentives that underpin institutional designs of evaluations. The moral standing of strategic behaviors often depend on the moral standing of the evaluations and incentives that provoke such behaviors. |
|---|---|
| AbstractList | A broad current application of algorithms is in formal and quantitative measures of murky concepts -- like merit -- to make decisions. When people strategically respond to these sorts of evaluations in order to gain favorable decision outcomes, their behavior can be subjected to moral judgments. They may be described as 'gaming the system' or 'cheating,' or (in other cases) investing 'honest effort' or 'improving.' Machine learning literature on strategic behavior has tried to describe these dynamics by emphasizing the efforts expended by decision subjects hoping to obtain a more favorable assessment -- some works offer ways to preempt or prevent such manipulations, some differentiate 'gaming' from 'improvement' behavior, while others aim to measure the effort burden or disparate effects of classification systems. We begin from a different starting point: that the design of an evaluation itself can be understood as furthering goals held by the evaluator which may be misaligned with broader societal goals. To develop the idea that evaluation represents a strategic interaction in which both the evaluator and the subject of their evaluation are operating out of self-interest, we put forward a model that represents the process of evaluation using three interacting agents: a decision subject, an evaluator, and society, representing a bundle of values and oversight mechanisms. We highlight our model's applicability to a number of social systems where one or two players strategically undermine the others' interests to advance their own. Treating evaluators as themselves strategic allows us to re-cast the scrutiny directed at decision subjects, towards the incentives that underpin institutional designs of evaluations. The moral standing of strategic behaviors often depend on the moral standing of the evaluations and incentives that provoke such behaviors. |
| Author | Nissenbaum, Helen Levy, Karen Kleinberg, Jon Laufer, Benjamin |
| Author_xml | – sequence: 1 givenname: Benjamin surname: Laufer fullname: Laufer, Benjamin – sequence: 2 givenname: Jon surname: Kleinberg fullname: Kleinberg, Jon – sequence: 3 givenname: Karen surname: Levy fullname: Levy, Karen – sequence: 4 givenname: Helen surname: Nissenbaum fullname: Nissenbaum, Helen |
| BookMark | eNo1jUtLxDAURoMoOI7zA9wV3NoxvenNw50M4wMGXHT2Q5LeSMvQaJMO-u8tqKvzcRbfuWLnQxyIsZuKr2uNyO_t-NWd1iBmwYVEPGMLEKIqdQ1wyVYp9ZxzkAoQxYKpJo8203vni-3JHiebuzg8FM3kevI53f3bOM7bDm3RRN9R_r5mF8EeE63-uGT7p-1-81Lu3p5fN4-70iLo0rS-CtJhUEBGthCCBiPJuprQoa29U2R8pby0zlekPSmkUJNywcigjFiy29_bjzF-TpTyoY_TOMzFA2glpAAwWvwAX05KbQ |
| ContentType | Paper |
| Copyright | 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS |
| DOI | 10.48550/arxiv.2310.03655 |
| DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection ProQuest Materials Science & Engineering ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials ProQuest Central Technology collection ProQuest One Community College ProQuest Central ProQuest SciTech Premium Collection ProQuest Engineering Collection Engineering Database ProQuest Central Premium ProQuest One Academic Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering collection |
| DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest Central (New) ProQuest One Academic ProQuest One Academic (New) Engineering Collection |
| DatabaseTitleList | Publicly Available Content Database |
| Database_xml | – sequence: 1 dbid: PIMPY name: Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Physics |
| EISSN | 2331-8422 |
| Genre | Working Paper/Pre-Print |
| GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS |
| ID | FETCH-LOGICAL-a528-9dc1f6b5f72e96d2ff8296eab4e5b5a4cb7e9c17c6abc1e8ce75ef4e7bf96f793 |
| IEDL.DBID | M7S |
| IngestDate | Mon Jun 30 09:17:09 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a528-9dc1f6b5f72e96d2ff8296eab4e5b5a4cb7e9c17c6abc1e8ce75ef4e7bf96f793 |
| Notes | SourceType-Working Papers-1 ObjectType-Working Paper/Pre-Print-1 content type line 50 |
| OpenAccessLink | https://www.proquest.com/docview/2873632298?pq-origsite=%requestingapplication% |
| PQID | 2873632298 |
| PQPubID | 2050157 |
| ParticipantIDs | proquest_journals_2873632298 |
| PublicationCentury | 2000 |
| PublicationDate | 20231005 |
| PublicationDateYYYYMMDD | 2023-10-05 |
| PublicationDate_xml | – month: 10 year: 2023 text: 20231005 day: 05 |
| PublicationDecade | 2020 |
| PublicationPlace | Ithaca |
| PublicationPlace_xml | – name: Ithaca |
| PublicationTitle | arXiv.org |
| PublicationYear | 2023 |
| Publisher | Cornell University Library, arXiv.org |
| Publisher_xml | – name: Cornell University Library, arXiv.org |
| SSID | ssj0002672553 |
| Score | 1.84721 |
| SecondaryResourceType | preprint |
| Snippet | A broad current application of algorithms is in formal and quantitative measures of murky concepts -- like merit -- to make decisions. When people... |
| SourceID | proquest |
| SourceType | Aggregation Database |
| SubjectTerms | Algorithms Behavior Evaluation Incentives Machine learning |
| Title | Strategic Evaluation: Subjects, Evaluators, and Society |
| URI | https://www.proquest.com/docview/2873632298 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV07T8MwED5BAxITb_EoVQZG0jaJHzELEqgVSFBFUKEyVbZzlrqkJSkVPx_HJGVAYmHzY7HO5-_Od5_uAC65QiX6OgkkSURASGQCgX0dMElUmImEoSPIvj7y0SiZTERaB9zKmlbZYKID6myuqxh5z3r2MbPaJ5KbxXtQdY2qsqt1C41N8KoqCZGj7r2sYywR49Zjjr-Tma50V08Wn7NVt3Jquha7Kf0Fwc6uDHf_e6I98FK5wGIfNjA_gG3H59TlIfCm6qz2B-t63te-hYkq7lJeNavzwo5lnvk1e_MIxsPB-O4-qHskBJJGFqoyHRqmqOERCpZFxiSRYCgVQaqoJFpxFDrkmkmlQ0w0coqGIFdGMGPf5jG08nmOJ-BTY10vIwQxTBBlf22x6mMslDDa2vGMnEK7EcO01vNy-iODs7-3z2GnatTuaHC0Da1l8YEXsKVXy1lZdMC7HYzS5467PjtLH57Sty-bd6Y6 |
| linkProvider | ProQuest |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1LTwIxEG4IaPTkOz5Q96A3F9jdPrYmxoNCICAhkRhum7Y7TbgsuIuoP8r_aLuweDDxxsFb016a6fTr1-nXGYSumATJGyp0BQ65i7GvXQ4N5VKBpRfzkEIukH3psX4_HI34oIS-ir8wVlZZYGIO1PFE2Rh53TD7gBrv4-H99NW1VaPs62pRQmPhFl34fDdXtuyu82jW99r3W83hQ9tdVhVwBfHN5o6Vp6kkmvnAaexrHfqcgpAYiCQCK8mAK48pKqTyIFTACGgMTGpONbO5lwziV7AF_1wp-LwK6fiUGYIeLN5O80xhdZF-jOc1y6Fq5qgg5Bfi58dYa-efGWAXVQZiCukeKkGyjzZztarKDhArcuoqp7nKVn7rGBC0UaXspuidpKYtkthZalMP0XAdUz1C5WSSwDFyiDbEUnOONeVYmjtpIBsQcMm1MiwlxieoWlg9Wu7iLPox-enfw5doqz186kW9Tr97hrZtSfpc8EeqqDxL3-Acbaj5bJylF7nHOCha8wJ9A18RA0I |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Strategic+Evaluation%3A+Subjects%2C+Evaluators%2C+and+Society&rft.jtitle=arXiv.org&rft.au=Laufer%2C+Benjamin&rft.au=Kleinberg%2C+Jon&rft.au=Levy%2C+Karen&rft.au=Nissenbaum%2C+Helen&rft.date=2023-10-05&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.2310.03655 |