Zobraziť v EDS

Cheaper (and More Effective) by the Dozen: Evidence from 12 Randomized A/B Tests Optimizing Tutoring for Scale. EdWorkingPaper No. 25-1333

Uložené v:
Podrobná bibliografia
Názov: Cheaper (and More Effective) by the Dozen: Evidence from 12 Randomized A/B Tests Optimizing Tutoring for Scale. EdWorkingPaper No. 25-1333
Jazyk: English
Autori: Noam Angrist, Claire Cullen, Janica Magat, Annenberg Institute for School Reform at Brown University
Zdroj: Annenberg Institute for School Reform at Brown University. 2025.
Dostupnosť: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Peer Reviewed: N
Počet strán: 43
Dátum vydania: 2025
Sponsoring Agency: Jacobs Foundation
Druh dokumentu: Reports - Research
Education Level: Elementary Education
Descriptors: Tutoring, Tutorial Programs, Cost Effectiveness, Instructional Improvement, Efficiency, Instructional Effectiveness, Educational Experiments, Numeracy, Computer Uses in Education, Handheld Devices, Telecommunications, Foreign Countries, Elementary Education
Geografický termín: Botswana
Abstrakt: Over the course of 12 rapid randomized experiments, we optimize an educational tutoring program. Tutoring is one of the most effective educational approaches yet has remained difficult to scale due to high costs. We adaptively test and improve a technology-enabled tutoring program to enhance cost-effectiveness and scalability. Results show that seven of twelve tests led to efficiency improvements, a "rate of discovery" of 58%. This compares favorably to the tech sector where 10-40 percent of tests generate improvements, demonstrating the potential for A/B testing to yield large efficiency gains in the education sector. The largest efficiency gains were driven by cost-reducing modifications that streamlined labor-intensive implementation processes and effectiveness-enhancing innovations that actively involved caregivers in their child's education, more than doubling impact at minimal additional cost. We explicitly measure practitioner prior and posterior beliefs, and find that rigorous testing facilitates more accurate identification of 'what works.' Our findings both reveal the returns to iterative testing in social programs and contribute new evidence on simple, cost-effective strategies to improve learning outcomes. [This report was funded by the UBS Optimus Foundation, the Mulago Foundation, the Douglas B. Marshall Foundation, and the Agency Fund.]
Abstractor: As Provided
Entry Date: 2026
Prístupové číslo: ED678304
Databáza: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED678304
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED678304
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Cheaper (and More Effective) by the Dozen: Evidence from 12 Randomized A/B Tests Optimizing Tutoring for Scale. EdWorkingPaper No. 25-1333
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Noam+Angrist%22">Noam Angrist</searchLink><br /><searchLink fieldCode="AR" term="%22Claire+Cullen%22">Claire Cullen</searchLink><br /><searchLink fieldCode="AR" term="%22Janica+Magat%22">Janica Magat</searchLink><br /><searchLink fieldCode="AR" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22">Annenberg Institute for School Reform at Brown University</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22"><i>Annenberg Institute for School Reform at Brown University</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 43
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Jacobs Foundation
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Tutoring%22">Tutoring</searchLink><br /><searchLink fieldCode="DE" term="%22Tutorial+Programs%22">Tutorial Programs</searchLink><br /><searchLink fieldCode="DE" term="%22Cost+Effectiveness%22">Cost Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Improvement%22">Instructional Improvement</searchLink><br /><searchLink fieldCode="DE" term="%22Efficiency%22">Efficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Experiments%22">Educational Experiments</searchLink><br /><searchLink fieldCode="DE" term="%22Numeracy%22">Numeracy</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Uses+in+Education%22">Computer Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Handheld+Devices%22">Handheld Devices</searchLink><br /><searchLink fieldCode="DE" term="%22Telecommunications%22">Telecommunications</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+Education%22">Elementary Education</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Botswana%22">Botswana</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Over the course of 12 rapid randomized experiments, we optimize an educational tutoring program. Tutoring is one of the most effective educational approaches yet has remained difficult to scale due to high costs. We adaptively test and improve a technology-enabled tutoring program to enhance cost-effectiveness and scalability. Results show that seven of twelve tests led to efficiency improvements, a "rate of discovery" of 58%. This compares favorably to the tech sector where 10-40 percent of tests generate improvements, demonstrating the potential for A/B testing to yield large efficiency gains in the education sector. The largest efficiency gains were driven by cost-reducing modifications that streamlined labor-intensive implementation processes and effectiveness-enhancing innovations that actively involved caregivers in their child's education, more than doubling impact at minimal additional cost. We explicitly measure practitioner prior and posterior beliefs, and find that rigorous testing facilitates more accurate identification of 'what works.' Our findings both reveal the returns to iterative testing in social programs and contribute new evidence on simple, cost-effective strategies to improve learning outcomes. [This report was funded by the UBS Optimus Foundation, the Mulago Foundation, the Douglas B. Marshall Foundation, and the Agency Fund.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED678304
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED678304
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 43
    Subjects:
      – SubjectFull: Tutoring
        Type: general
      – SubjectFull: Tutorial Programs
        Type: general
      – SubjectFull: Cost Effectiveness
        Type: general
      – SubjectFull: Instructional Improvement
        Type: general
      – SubjectFull: Efficiency
        Type: general
      – SubjectFull: Instructional Effectiveness
        Type: general
      – SubjectFull: Educational Experiments
        Type: general
      – SubjectFull: Numeracy
        Type: general
      – SubjectFull: Computer Uses in Education
        Type: general
      – SubjectFull: Handheld Devices
        Type: general
      – SubjectFull: Telecommunications
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Elementary Education
        Type: general
      – SubjectFull: Botswana
        Type: general
    Titles:
      – TitleFull: Cheaper (and More Effective) by the Dozen: Evidence from 12 Randomized A/B Tests Optimizing Tutoring for Scale. EdWorkingPaper No. 25-1333
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Annenberg Institute for School Reform at Brown University
      – PersonEntity:
          Name:
            NameFull: Noam Angrist
      – PersonEntity:
          Name:
            NameFull: Claire Cullen
      – PersonEntity:
          Name:
            NameFull: Janica Magat
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Type: published
              Y: 2025
          Titles:
            – TitleFull: Annenberg Institute for School Reform at Brown University
              Type: main
ResultId 1