Measuring and Assessing Skills 2017 Conference

March 3–4, 2017

The Conference on Measuring and Assessing Skills was a follow up to the conference of the same name hosted by the R24 Network in 2015 at the University of Chicago. The conference focused on the growing recognition that multiple skills, beyond IQ and cognition, are important predictors and likely determinants of success in many aspects of life.

Although a variety of methods are used to measure these skills, there is no consensus on which approaches are most suitable for which purposes. This conference assembled leading economists, psychologists, neuroscientists, and measurement specialists to examine and evaluate alternative approaches to the measurement of skills, including modifications to self-reports, behavioral measures, games, and methods based on neuroscience. The conference addressed five guiding questions:

  1. How predictive are elicited measurements of skill of both short-run and long-run outcomes?
  2. How important are incentives and contexts in the measurement of skills?
  3. Do differences in environments change the predictive accuracy of elicited measures of skill?
  4. How can separate components of skill be identified?
  5. Are measurements of skills comparable across elicitation strategies?

This conference was co-organized with the The Human Capital and Economic Opportunity Global Working Group, and the Research Network on the Determinants of Life Course Capabilities and Outcomes, a Center initiative funded by the National Institute on Aging.

 

Organizers

Caterina Calsamiglia, CEMFI
Tim Kautz, Mathematica Policy Research

Program

March 3

9:45–10:00AM

9:45–10:00AM
Tim Kautz, Mathematica
Caterina Calsamiglia, CEMFI

Resources

Download Slides


10:00–11:00AM

Know When to Fold ‘Em: The Grit Factor
Larbi Alaoui, Universitat Pompeu Fabra
Discussant: Magne Mogstad, The University of Chicago

Resources

Download Slides


11:00–12:00PM

Secular Rise in Economically Valuable Personality Traits
Marko Tervio, Aalto University School of Business
Discussant: Caterina Calsamiglia, CEMFI


12:00–1:00PM

Lunch and Open Discussion

1:00–2:00PM

Gamification: a Key New Way to Assess Skills
Parag Mankeekar, Neeti Solutions
Discussant: Jorge Luis García, The University of Chicago

2:00–3:00PM

Assessing Skill Performance through Games and Automated Conversations
Tanner Jackson, Educational Testing Service
Discussant: Jorge Luis García, The University of Chicago

Resources

Download Discussion Slides


3:00–3:20PM

Break

3:20–4:20PM

Towards the Development of a Formative Assessment System for Social and Emotional Learning Skills: Science, Policy, and Practice
Richard Roberts, Professional Examination Service
Discussant: Chase Corbin, Former Research Professional at the Center for the Economics of Human Development

4:20–5:20PM

The role of Incentives in Measuring Cognitive and Non-cognitive Skills: Experimental Evidence from Primary Schools in Shanghai
Tim Kautz, Mathematica Policy Research
Discussant: Carmit Segal, University of Cyprus

Resources

Download Slides

Saturday, March 4


9:30–10:30AM

Using Neural Tools for Assessing Behaviors to Predict and Assess Personality Traits
Moran Cerf, Kellogg School of Management, Northwestern University
Discussant: Turhan Canli, Stony Brook University

10:30–11:30AM

Measuring and Assessing Executive Function Skills
Adele Diamond, University of British Columbia
Discussant: Sheena McConnell, Mathematica Policy Research

Resources

Download Slides


11:30–11:40AM

Break

11:40–12:40PM

Measuring Social-Emotional Learing at Scale: Early Evidence from California’s CORE Districts
Martin West, Harvard Graduate School of Education
Discussant: Pat Kyllonen, Educational Testing Service

Resources

Download Slides


12:40–1:40PM

Lunch and Open Discussion

1:40–2:40PM

Becoming Effective Learners
Camille Farrington, The University of Chicago
Discussant: Brian Gill, Mathematica Policy Research

Resources

Download Discussion Slides


2:40–3:40PM

The Potential for Survey-Effort Measures to Proxy for Relevant Character Skills
Gema Zamarro, University of Arkansas
Discussant: Christian Fons Rosen, Universitat Pompeu Fabra

Resources

Download Slides

Download Discussion Slides


3:40–4:20PM

What Do Test Scores Miss? The Importance of Teacher Effects on Non-Test-Score Outcomes
Kirabo Jackson, Northwestern University
Discussant: John Easton, The Spencer Foundation

Resources

Download Slides


4:40–5:00PM

Closing Remarks