Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
About: AEA Data Editor
AEA Data Editor
Page not in menu
This is a page not in th emain menu
Resources - AEA Data Editor
The AEA Data Editor provides a variety of textual and technical resources to further the goals of transparency, reproducibility and future replicability of A...
Office of the Data Editor of the American Economic Association
The AEA Data Editor defines and monitors the AEA journals’ approach to data and reproducibility.
Posts
On the use of Excel for reproducible tables
I sometimes see researchers doing much copy-pasting between output from Stata/R/MATLAB and Excel, to create tables. This is a lot of work, the source of many...
How to respond to data provider requests for data removal (take-down requests)
The AEA Data and Code Availability Policy asks that authors provide access to all data used in a published paper. But it also acknowledges that there are cas...
On the use and reuse of within-project code
We often see researchers handle variants of their analysis by copying and pasting code, or by copying code files into separate directories, and making only m...
On the use and redistribution of data
Many researchers are confused by the difference between “use” and “(re-)distribution” of data. In a nutshell, just because you are able to freely use the dat...
Random notes from the AMAs
In the AMAs (see past and future AMAs), we talked about many things. No transcript, but here’s a raw dump of the various websites that were used.
AEJ Best Papers 2024 and replication packages
The annual American Economic Journal (AEJ) Best Paper Awards highlight the best paper published in each of the American Economic Journals: Applied Economics,...
Examples of replication packages for research conducted in FSRDCs
I have been asked a few times about guidance for replication packages that use confidential data in research data centers, e.g., the Federal Statistical Res...
NDAs, NDAs, and NDAs: How to describe access to data that cannot be published
I was recently forwarded a question from a data librarian discussion list, and invited to respond to the question of “example language” for a data access des...
NDAs, DUAs in the verification process
Toni Whited (EIC of Journal of Financial Economics) had the following question on the ex-bird site: Econ and finance journals are getting their acts toge...
RESOLVED - Access to replication packages retrieval and deposit interrupted
THIS HAS BEEN RESOLVED. Please deposit as usual! The AEA uses the openICPSR repository for the deposit and dissemination of replication packages. On Sun...
Details on how to update a replication package post-publication
I have previously posted about how to update a replication package, after initial publication. We do get more than a dozen such updates a year (see my annual...
Some remarks on challenges and solutions when conducting reproducibility checking for two recent AEJ:Applied articles
I wanted to briefly discuss the challenges when conducting data provenance and reproducibility checks, for complex and highly interesting articles, with the ...
The oldest replication package, overall?
After our recent discussion about the oldest AEA replication package, I navigated over to the really old archive at the Journal of Applied Econometrics. Surp...
The oldest AEA replication package
We were recently discussing among data editors what the oldest replication package (in Econ and Political Science) might be.
DCAS v1.0 Compliance Self-Assessment
On 2022-12-15, various data editors, including myself, launched the Data and Code Availability Standard (DCAS). In this post, I will do a self-assessment o...
Launching DCAS
The data editors of the journals of the American Economic Association1, of the Royal Economic Society2, the Review of Economic Studies, the Canadian Journa...
What is this LICENSE thing
The template README required by various econ journals asks for a statement about the rights to RE-distribute data. Many economists are confused by this: “But...
A short example of how to update a replication package
The AEA Data and Code Availability does not just require that authors publish a replication package - it also encourages authors to improve upon the replicat...
Some remarks on coding when data are confidential
Back in the fall, I made a few notes regarding how to prepare replication packages when data are confidential (here). What I did not address, and what comes ...
Use of Docker for Reproducibility in Economics
In reproducibility verification, a common scenario is the author response “but-it-works-on-my-machine”. Finding common environments is important in such situ...
How to prepare replication packages for papers that used confidential data
On a tangent: we get this question regularly - how to prepare replication packages for papers that used confidential data (here: by statistical agencies). A ...
When a reproducibility check turns into a replication exercise
I wanted to highlight a particular interesting article in the latest AEJ: Microeconomics from the perspective of replicability and reproducibility.
Software, code, and repositories
A short thread on software, code, versioning, citation, and repositories. Only very few AEA articles reference Github/Gitlab/Bitbucket repositories. More sho...
File paths in statistical software
A short thread (PSA) on a FOC (frequently occurring problem) that shouldn’t be one: file paths in statistical software.
What data to provide
What do we mean by “data”?
Reproducible GIS
A note on reproducible GIS by economists: it’s mostly absent. Here are some tips.
A Day in the Life of a Data Editor
I wanted to illustrate the range of the various topics that a Data Editor might face, by taking a fairly random day (2021-01-29) and listing all the various ...
Follow-up to Fireside Chat
In this post, I’ll pick up questions that have been asked over Twitter or during the 2021-01-19 Fireside chat, in long form (Twitter is not always the best m...
A discussion about various things
Moved to later post.
Release of a template README
We have released the first version of a template README for social sciences at https://social-science-data-editors.github.io/template_README/.
An example of reproducibility checking when data is restricted-access
I wanted to highlight a recently (2020-04-30) published article in the AEJ:Economic Policy as an example of reproducibility checking when data is restricted-...
guidance
Licensing Guidance
This site does not provide legal guidance. The information below is provided for discussion and as a suggestion only. Authors should consult with a qualif...
License template
save “LICENSE.txt” as part of your deposit modify the COPYRIGHT line. Modified BSD License (https://opensource.org/licenses/BSD-3-Clause) - applies t...
Creating separate linked data archives
Every time we see that a lot of effort went into creating a data resource, we don’t want to have that sit hidden in a replication package. We want to give da...
Creating a Restricted Data Deposit for AEA Publications
THIS GUIDE IS OUTDATED, AND SHOULD NOT BE FOLLOWED. IT IS KEPT FOR HISTORICAL REASONS. This guide describes how to create a restricted-access data depos...
Creating a Restricted Data Deposit for AEA Publications
The original guide on how to deposit restricted-access data on openICPSR is available here. DO NOT USE THOSE INSTRUCTIONS, AS THEY ARE NO LONGER ACCURATE....
Step-by-Step tutorial on how to deposit data at DataLumos
DataLumos is an ICPSR archive for crowd-sourced deposits of government data resources. This tutorial shows how to create a deposit at DataLumos. You should r...
Guidance on how to deposit data at the AEA Data and Code Repository
Tutorial For a video tutorial on this process, see this Youtube video. If you are depositing at a different trusted repository, please be sure that your...
Frequently Asked Questions
… although some are not frequently asked, but might nevertheless be useful. Below questions and answers in random order. Please be sure to check out the offi...
Guidance on testing replicability of code
The code and data that have been archived should be reproducible and replicable. How do we test that? Generic guidance Generic guidance is provided at the ...
Privately sharing restricted-access data with the AEA Data Editor
In certain cases, you may be able to share data you obtained from somebody (“data provider”) with the AEA Data Editor for the purpose of conducting reproduci...
Guidance on how to prepare a comment based on a replication
You may have found an issue in a published article related to some of the computations therein, and are preparing a comment. This note describes how you shou...
Sharing of Pre-Publication openICPSR deposits
In certain situations, authors might want to provide access to others (co-authors, persons interested in the replication package) prior to publication of the...
Display Guidelines for Trusted Repositories (other than AEA Data and Code Repository)
The AEA accepts replication packages from any trusted repository (see list), as long as they meet certain display criteria, and otherwise satisfy the reprodu...
Step by step guidance
The following steps outline what you should expect after conditional a...
Step by step guidance
What to expect next The next steps happen behin...
Preparing your files for verification
This document describes how to best prepare a replication package for an AEA journal. Much of the guidance here is not specific to our journals - the documen...
Preparing your replication package for Papers and Proceedings
Much of the preparation for the replication packages for papers published in Papers and Proceedings is the same as for the AEA journals, see Step 1 and Step ...
projects
Migration of legacy replication packages (pending last packages)
Since July 16, 2019, the American Economic Association has used the AEA Data and Code Repository as the default archive for its supplements. The AEA also an...
Improving metadata of migrated replication packages
Improvement of metadata on migrated packages, those deposited before July 2019. see additional info if you received a request to contribute migration i...
Development of standardized README for social science journals
Together with other economics data editors, we developed a standardized README https://doi.org/10.5281/zenodo.4319999. The README was updated with a newe...
Identifying Stata packages used in replication packages
Initiated by one of our student replicators (Lydia Reiner), this project aims to run a static code analysis on replication packages, identifying Stata packag...
Internship with the AEA Data Editor Summer 2024
Project completed. The AEA Data Editor is happy to announce a pilot project for an internship with the AEA Data Editor. The collaborating institutions a...
Internship with the AEA Data Editor Summer 2025
The AEA Data Editor is happy to announce an internship with the AEA Data Editor. The collaborating institutions are Cornell University (AEA Data Editor), We...
publications
surveys
Improving Metadata
Emails sent Authors of articles may have received the following email:
Sharing And Reusing Research Data
Emails sent Members of the Association who are willing to receive occasional surveys about economics and economists received the following email from the AE...
talks
Implementing Increased Transparency and Reproducibility in Economics
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics
(together with cascad) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of rep...
Implementing Increased Transparency and Reproducibility in Economics
(together with cascad) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of rep...
Implementing Increased Transparency and Reproducibility in Economics
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics
(with BITSS) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability...
Implementing Increased Transparency and Reproducibility in Economics
(together with BITSS) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of repl...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Reproducibility Potpourri - or why we need a standard README
Abstract Short talk on failures of reproducibility, proposing a standardized README. The standard template README, proposed by the Social Science Data Edito...
Demystifying Replication Requirements and Processes: Best Practices Viewed by AEA-Data Editor
Abstract The AEA Data editor, Lars Vilhuber, was interviewed by Leah Boustan of Princeton University. Video recording Video available on the CSWEP resourc...
Improving reproducibility in the social sciences: Challenges
Abstract Presented as part of RDA17 in the session on “Experiments in Preparing Data for Interchange and Openness”, organized by the IG RDARI. Short talk o...
Implementing Increased Transparency and Reproducibility in Economics - Some Lessons
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics: Lessons for Register based Research
Abstract Presentation at the Virtual Workshop on “Research with German and Norwegian Register Data on Family Economics” on lessons learned while implementin...
Tutorial: Data Sharing and Archiving for Reproducibility
Abstract Tutorial at “Research Transparency and Reproducibility Training (RT2)” organized by BITSS on how to share data in a persistent, reproducible way, w...
Firm-Academic Research Collaborations in Economics - Journals’ Perspective
Abstract Short talk on the reproducibility, transparency in economic research involving firm (private) data. PDF/PPTX Google Presentation
Data Science Tools Workshop: Working with confidential data
Abstract Tutorial on reproducible practices, in particular when data are confidential. Can be interactive, with R. Handles acquiring and posting data via an...
Improving Transparency and Reproducibility: Lessons from 1,000 economics papers
Abstract Presentation at the University of Wisconsin - Madison’s Center for Demography of Health and Aging in the context of the Demography Training Seminar...
Panel: Challenges and Opportunities of Reproducibility when Data are Proprietary
Abstract Presentation at the NBER conference on “Challenges and Opportunities of Reproducibility when Data are Proprietary” The meeting will be livestreame...
Enhancing accessibility and reproducibility in scientific publications: Improvements on both ends of the pipeline
Abstract Presentation in the Statistics Department (Research Colloquium)
Overview of reproducibility and replicability in economics, with a side trip to provenance
Abstract Presentation at the Banco de Portugal Workshop on Reproducibility of Scientific Results.
Reproducibility and Transparency versus Privacy and Confidentiality: Reflections from a Data Editor
Abstract Presentation by Lars Vilhuber at ASSA 2022 in the Journal of Econometrics Session: “Econometrics and Data in the 21st Century: Reproducibility and ...
Teaching for Large-scale Reproducibility Verification
Abstract Presentation by Lars Vilhuber on how the RAs in the LDI Replication Lab are trained.
Challenges in Reproducibility and Replicability in Labor Economics
Abstract Presentation by Lars Vilhuber at SOLE 2022, joint session with Thibaut Lamadon and Felipe Gonçalves. Video recording Video available on the Corne...
Teaching for Large-scale Reproducibility Verification
Abstract Presentation by Lars Vilhuber on how the RAs in the LDI Replication Lab are trained, at the AEA’s annual CTREE conference.
Rethinking Reproducibility: Bridging the Gaps Between Research Cultures, Publishing Workflows and Scholarly Infrastructures
Abstract Participation by Lars Vilhuber on a panel at the Society for Scholarly Publishing, an annual meeting of publishers and editors of academic journals.
Lessons Learned from Implementing AEA Reproducibility
Abstract Some lessons learned for an academic audience.
Transparency and Reproducibility in Economics: Lessons learned from 1,000 papers
Abstract Presentation by Lars Vilhuber at WEAI 2022, followed by Panel discussion with Tim Salmon, Editor for “Economic Inquiry”, and Kyrani Reneau, openICP...
Reproducibility in the Social Sciences: Lessons learned for students, researchers, and institutions from 1,000 articles
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility in the Social Sciences: Lessons learned for students, researchers, and institutions from 1,000 articles
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Replication and Research Transparency
Abstract Research has to be transparent in order to be considered as credible and valid. Reproduction and replication are practices that seek to establish t...
Transparency and Reproducibility in Economics: Lessons learned from 1,000 papers when data are confidential
Abstract Presentation by Lars Vilhuber on how best to prepare reproducible and transparent packages when data are confidential. Live slides are available a...
Reproducible Research Fundamentals: Why does reproducibility matter for economics research
Abstract Variation of the “Lessons learned” talk, given to new World Bank interns.
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility when data are confidential or big
Abstract Presentation at the Banco de Portugal Workshop on Reproducibility of Scientific Results. URL for live slides is https://larsvilhuber.github.io/repr...
Coffee with Data Editors
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,663 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Replication and Research Transparency in Empirical Economics
Abstract Several top journals (including those of the RES) have recently initiated efforts to insure that published empirical results can be replicated. Not...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Kontinuierliche Transparenz und Reproduzierbarkeit bei akademischen Publikationen: Ansätze und Techniken
Abstract Part of a Symposium on open science in ecoomics (in German).
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,663 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility and Preservation: Lessons learned from 1,663 papers in Economics
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Ten Simple Rules for creating a replication package
Abstract We present a detailed and actionable guide on creating a replication package, relying on our expertise as data editors of leading journals. Thi...
Reproducible Research from Day 1
Abstract Miklós Koren and Lars Vilhuber, data editors of the Review of Economic Studies and the American Economic Association Journals require that you shar...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,800 empirical articles since July 2019, and worked with authors to improve...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,800 empirical articles since July 2019, and worked with authors to improve...
(Full day) Reproducibility Workshop Nihon
Abstract 9:00 Overview of reproducibility and replicability in economics, including replication packages (presentation) 10:00-10:50 … Let’...
(Full day) Reproducibility Workshop Nihon
Abstract 9:00 Overview of reproducibility and replicability in economics, including replication packages (presentation) 10:00-10:50 … Let’...
Reproducible Research from Day 1
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
Advanced methods for self-verification of reproducibility
Abstract In this second session, data editors describe a few possible steps to self-check replication packages before submitting them to a journal. It is no...
Data Editor AMA
Abstract Questions and Coffee with AEA Data Editor Lars Vilhuber Are you a researcher in the midst of preparing a replication package and are unsure about ...
Ask a Data Editor Anything
Abstract The growing focus on archiving and curating research data, along with promoting reproducible research, is highly relevant to our faculty and gradua...
Data Editor AMA
Abstract Questions and Coffee with AEA Data Editor Lars Vilhuber Are you a researcher in the midst of preparing a replication package and are unsure about ...
Don’t Worry, Be (Reproducibly) Happy! Reproducibility from Day 1 and Day X
Joint with Marie Connolly (UQAM and CEA Data Editor) and Sofia Encarnación (Cornell University, Assistant Data Editor, AEA) Abstract A brief overview of re...
Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor
Time 2:00pm - 3:30pm Room Wheelock 423 Abstract Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor Are you...
Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor
Time 4:00pm - 5:30pm Room E51-432 Abstract Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor Are you a re...
A chat with Data Librarians and the AEA Data Editor
Abstract The NEEDLS group is co-led by Charissa Jefferson, Labor Economics Librarian, Princeton University Library and Whitney Kramer, ILR Research and Data...
École d’été du CIQSS en reproductibilité de la recherche (in French)
Abstract Cette formation fournira une vue d’ensemble des enjeux en matière de reproductibilité de la recherche et proposera la marche à suivre pour réaliser...
QICSS Summer School on Research Reproducibility
Abstract This training will provide an overview of issues related to research reproducibility and will propose the steps to follow to carry out a replicable...
Training on reproducible methods in empirical economics
Preliminary! The session still needs to be confirmed. Details to follow. Abstract Session 1: “Reproducibility from Day 1” [May 31] Link to session Journ...
Reproducibility from Day 1 to Day T
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
Training on reproducible methods in empirical economics
Abstract Session 1: “Reproducibility from Day 1” Journals require that you share your code and data in a replication package upon acceptance. However, effi...
Training on reproducible methods in empirical economics when data are confidential
Abstract Session 1: “Reproducibility from Day 1” Journals require that you share your code and data in a replication package upon acceptance. However, effi...
TBD
Abstract Several top journals have recently initiated efforts to insure that published empirical results can be replicated. The panel will discuss fundamen...
ZBW Coffee Lecture on Open Science Education: A reproducibility internship?
Abstract The LDI Replication Lab verifies computational reproducibility of papers appearing in AEA journals with undergraduate students, who experience hand...
Open Q&A with Data Editors of the AEA, ECTA, and WEAI
Time 5:30pm - 6:30pm Room 310 Abstract Meet w/ Lars Vilhuber (AEA), Joan Llull (Econometrica) & Farasat Bokhari (Economic Inquiry, WEAI) to learn &a...
Open Q&A with the American Economic Association’s Data Editor
Time 1:00pm - 2:30pm Room “National Harbor 1” Abstract Open Q&A with the American Economic Association’s Data Editor Are you a researcher in the mi...
AEA/ES Data Editors’ Tutorial 1
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
AEA/ES Data Editors’ Tutorial 2
Abstract Data editors describe possible steps to self-check replication packages before submitting them to a journal. It is not meant to be exhaustive, and ...
La crédibilité de la recherche : comment améliorer la reproductibilité en sciences économiques
A discussion on the credibility of research with two data editors (The discussion will be in French) Join us in beautiful Orford, Quebec, just north of Ver...
QICSS Summer School on Research Reproducibility
Abstract This intensive (1.5 day) training explores the fundamental principles of reproducibility, a pillar of open science that ensures the transparency an...
CEA Panel on Reproducibility
Location 8:30am-10am, UQAM, Pavillon DS, 320, rue Ste-Catherine est, room DS-R510 Abstract Recent AI developments, particularly large language models (LLM...
Reproducibility from the data editor’s perspective
Time 9:00-10:30 AM (Mexico City time) Note I may also be available for individual meetings June 16 and 19.
Reproducibility from Day 1 to Day T
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
Conversation on Replication Packages with SOLE Mentees
Time 11:00am - 12:30pm Abstract General Q&A about replication packages, loosely based on topics available at https://larsvilhuber.github.io/tutorial-r...
Practical Guidance for Open Science in Your Research
Abstract Open Science is a key ingredient for credible research. Many also think that it is hard. We provide an accessible introduction into the topic and t...
Open Science - Increasing Research Transparency in Economics
Abstract Over the past years, several international associations in economics have introduced systematic reproducibility checks of submissions and a number ...