A newer version of this project is available. See below for other available versions.

Class exercise: Predicting income mobility in PSID

Name: Class exercise: Predicting income mobility in PSID
Published: 2023-03-07
License: This work is licensed under an Other license created by the PSID, namely that you agree not to redistribute data or other materials without the written agreement of ICPSR, unless: 1. You serve as the OFFICIAL or DESIGNATED REPRESENTATIVE at an ICPSR MEMBER INSTITUTION and are assisting AUTHORIZED USERS with obtaining data, or 2. You are collaborating with other AUTHORIZED USERS to analyze the data for research or instructional purposes.

Principal Investigator(s): View help for Principal Investigator(s) Ian Lundberg, Cornell University

Version: View help for Version V1

Name	File Type	Size	Last Modified
for_instructors.zip	application/zip	141 KB	03/07/2023 10:02:AM
for_replication.zip	application/zip	48.4 MB	03/07/2023 10:03:AM
for_students.zip	application/zip	88.3 KB	03/07/2023 10:03:AM

Project Citation:

Lundberg, Ian. Class exercise: Predicting income mobility in PSID. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2023-03-07. https://doi.org/10.3886/E185941V1

Project Description

Summary: This repository contains data for a data science class exercise.

Students: This exercise is about income mobility over three generations: grandparents (g1), parents (g2), and children (g3). Your task is to predict log income in generation 3 using data on log incomes in generations 1 and 2.

The data you will use are in for_students.zip.

learning.csv contains 2,260 observations for which the outcome is recorded
holdout_public.csv contains 2,260 observations for which the outcome is NA

Your task is to build a predictive model using learning.csv. Then, make predictions for the cases in holdout_public.csv.

Here are some details about the variables in the data: In each generation, we took each respondent's annual income over several surveys from age 30 to 45, adjusted to 2022 dollars, and took the average. We truncated the data to the range from $5,000 to $448,501.10, where the bottom code is arbitrary and the top code is what we believe to be the lowest PSID top code over the series (in 1978), converted to 2022 dollars. We merged the data together across generations using the PSID Family Identification Mapping System 3-generation prospective linkage file.

We are trusting the students to not open the instructor data, which contains the outcomes you are trying to predict. You could peek of course, but that would be no fun! We are trusting you not to peek.

Instructors: For you, the file for_instructors.zip contains the true holdout outcomes in holdout_private.csv. You can use these to evaluate students' predictive performance (as long as you trust that they have not peeked).

For those replicating: For you, the file for_replication.zip contains the directory structure and code that produced this exercise from raw files downloaded from the PSID.

Scope of Project

Subject Terms: mobility; income; multigenerational; data science

Related Publications

Download this project

Published Versions

V2 [2023-03-14]

V1 [2023-03-07]

Export Metadata

Dublin Core

DDI 2.5

Report a Problem

Found a serious problem with the data, such as disclosure risk or copyrighted content? Let us know.

This material is distributed exactly as received from the data depositor. As of April 2026, depositors are required to submit study materials in accessible formats. ICPSR has not reviewed, checked, or processed this material. For additional information about the study, please contact the investigator(s) directly. If you have questions about the accessibility of materials distributed by ICPSR or require further assistance, please visit ICPSR's Accessibility Center.