Licensing Guidance
This site does not provide legal guidance. The information below is provided for discussion and as a suggestion only. Authors should consult with a qualif...
Posts by Collection
guidance
License template
save “LICENSE.txt” as part of your deposit modify the COPYRIGHT line. Modified BSD License (https://opensource.org/licenses/BSD-3-Clause) - applies t...
Creating separate linked data archives
Every time we see that a lot of effort went into creating a data resource, we don’t want to have that sit hidden in a replication package. We want to give da...
Creating a Restricted Data Deposit for AEA Publications
THIS GUIDE IS OUTDATED, AND SHOULD NOT BE FOLLOWED. IT IS KEPT FOR HISTORICAL REASONS. This guide describes how to create a restricted-access data depos...
Creating a Restricted Data Deposit for AEA Publications
The original guide on how to deposit restricted-access data on openICPSR is available here. DO NOT USE THOSE INSTRUCTIONS, AS THEY ARE NO LONGER ACCURATE....
Guidance on how to deposit data at the AEA Data and Code Repository
Tutorial For a video tutorial on this process, see this Youtube video. If you are depositing at a different trusted repository, please be sure that your...
Frequently Asked Questions
… although some are not frequently asked, but might nevertheless be useful. Below questions and answers in random order. Please be sure to check out the offi...
Guidance on testing replicability of code
The code and data that have been archived should be reproducible and replicable. How do we test that? Generic guidance Generic guidance is provided at the ...
Privately sharing restricted-access data with the AEA Data Editor
In certain cases, you may be able to share data you obtained from somebody (“data provider”) with the AEA Data Editor for the purpose of conducting reproduci...
Guidance on how to prepare a comment based on a replication
You may have found an issue in a published article related to some of the computations therein, and are preparing a comment. This note describes how you shou...
Sharing of Pre-Publication openICPSR deposits
In certain situations, authors might want to provide access to others (co-authors, persons interested in the replication package) prior to publication of the...
Display Guidelines for Trusted Repositories (other than AEA Data and Code Repository)
The AEA accepts replication packages from any trusted repository (see list), as long as they meet certain display criteria, and otherwise satisfy the reprodu...
Step by step guidance
The following steps outline what you should expect after conditional a...
Step by step guidance
What to expect next The next steps happen behin...
Preparing your files for verification
This document describes how to best prepare a replication package for an AEA journal. Much of the guidance here is not specific to our journals - the documen...
projects
Migration of legacy replication packages (pending last packages)
Since July 16, 2019, the American Economic Association has used the AEA Data and Code Repository as the default archive for its supplements. The AEA also an...
Improving metadata of migrated replication packages
Improvement of metadata on migrated packages, those deposited before July 2019. see additional info if you received a request to contribute migration i...
Development of standardized README for social science journals
Together with other economics data editors, we developed a standardized README https://doi.org/10.5281/zenodo.4319999. The README was updated with a newe...
Identifying Stata packages used in replication packages
Initiated by one of our student replicators (Lydia Reiner), this project aims to run a static code analysis on replication packages, identifying Stata packag...
Internship with the AEA Data Editor Summer 2024
The AEA Data Editor is happy to announce a pilot project for an internship with the AEA Data Editor. The collaborating institutions are Cornell University (A...
publications
surveys
Improving Metadata
Emails sent Authors of articles may have received the following email:
Sharing And Reusing Research Data
Emails sent Members of the Association who are willing to receive occasional surveys about economics and economists received the following email from the AE...
talks
Implementing Increased Transparency and Reproducibility in Economics
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics
(together with cascad) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of rep...
Implementing Increased Transparency and Reproducibility in Economics
(together with cascad) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of rep...
Implementing Increased Transparency and Reproducibility in Economics
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics
(with BITSS) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability...
Implementing Increased Transparency and Reproducibility in Economics
(together with BITSS) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of repl...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Reproducibility Potpourri - or why we need a standard README
Abstract Short talk on failures of reproducibility, proposing a standardized README. The standard template README, proposed by the Social Science Data Edito...
Demystifying Replication Requirements and Processes: Best Practices Viewed by AEA-Data Editor
Abstract The AEA Data editor, Lars Vilhuber, was interviewed by Leah Boustan of Princeton University. Video recording Video available on the CSWEP resourc...
Improving reproducibility in the social sciences: Challenges
Abstract Presented as part of RDA17 in the session on “Experiments in Preparing Data for Interchange and Openness”, organized by the IG RDARI. Short talk o...
Implementing Increased Transparency and Reproducibility in Economics - Some Lessons
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics: Lessons for Register based Research
Abstract Presentation at the Virtual Workshop on “Research with German and Norwegian Register Data on Family Economics” on lessons learned while implementin...
Tutorial: Data Sharing and Archiving for Reproducibility
Abstract Tutorial at “Research Transparency and Reproducibility Training (RT2)” organized by BITSS on how to share data in a persistent, reproducible way, w...
Firm-Academic Research Collaborations in Economics - Journals’ Perspective
Abstract Short talk on the reproducibility, transparency in economic research involving firm (private) data. PDF/PPTX Google Presentation
Data Science Tools Workshop: Working with confidential data
Abstract Tutorial on reproducible practices, in particular when data are confidential. Can be interactive, with R. Handles acquiring and posting data via an...
Improving Transparency and Reproducibility: Lessons from 1,000 economics papers
Abstract Presentation at the University of Wisconsin - Madison’s Center for Demography of Health and Aging in the context of the Demography Training Seminar...
Panel: Challenges and Opportunities of Reproducibility when Data are Proprietary
Abstract Presentation at the NBER conference on “Challenges and Opportunities of Reproducibility when Data are Proprietary” The meeting will be livestreame...
Enhancing accessibility and reproducibility in scientific publications: Improvements on both ends of the pipeline
Abstract Presentation in the Statistics Department (Research Colloquium)
Overview of reproducibility and replicability in economics, with a side trip to provenance
Abstract Presentation at the Banco de Portugal Workshop on Reproducibility of Scientific Results.
Reproducibility and Transparency versus Privacy and Confidentiality: Reflections from a Data Editor
Abstract Presentation by Lars Vilhuber at ASSA 2022 in the Journal of Econometrics Session: “Econometrics and Data in the 21st Century: Reproducibility and ...
Teaching for Large-scale Reproducibility Verification
Abstract Presentation by Lars Vilhuber on how the RAs in the LDI Replication Lab are trained.
Challenges in Reproducibility and Replicability in Labor Economics
Abstract Presentation by Lars Vilhuber at SOLE 2022, joint session with Thibaut Lamadon and Felipe Gonçalves. Video recording Video available on the Corne...
Teaching for Large-scale Reproducibility Verification
Abstract Presentation by Lars Vilhuber on how the RAs in the LDI Replication Lab are trained, at the AEA’s annual CTREE conference.
Rethinking Reproducibility: Bridging the Gaps Between Research Cultures, Publishing Workflows and Scholarly Infrastructures
Abstract Participation by Lars Vilhuber on a panel at the Society for Scholarly Publishing, an annual meeting of publishers and editors of academic journals.
Lessons Learned from Implementing AEA Reproducibility
Abstract Some lessons learned for an academic audience.
Transparency and Reproducibility in Economics: Lessons learned from 1,000 papers
Abstract Presentation by Lars Vilhuber at WEAI 2022, followed by Panel discussion with Tim Salmon, Editor for “Economic Inquiry”, and Kyrani Reneau, openICP...
Reproducibility in the Social Sciences: Lessons learned for students, researchers, and institutions from 1,000 articles
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility in the Social Sciences: Lessons learned for students, researchers, and institutions from 1,000 articles
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Replication and Research Transparency
Abstract Research has to be transparent in order to be considered as credible and valid. Reproduction and replication are practices that seek to establish t...
Transparency and Reproducibility in Economics: Lessons learned from 1,000 papers when data are confidential
Abstract Presentation by Lars Vilhuber on how best to prepare reproducible and transparent packages when data are confidential. Live slides are available a...
Reproducible Research Fundamentals: Why does reproducibility matter for economics research
Abstract Variation of the “Lessons learned” talk, given to new World Bank interns.
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility when data are confidential or big
Abstract Presentation at the Banco de Portugal Workshop on Reproducibility of Scientific Results. URL for live slides is https://larsvilhuber.github.io/repr...
Coffee with Data Editors
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,663 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Replication and Research Transparency in Empirical Economics
Abstract Several top journals (including those of the RES) have recently initiated efforts to insure that published empirical results can be replicated. Not...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Kontinuierliche Transparenz und Reproduzierbarkeit bei akademischen Publikationen: Ansätze und Techniken
Abstract Part of a Symposium on open science in ecoomics (in German).
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,663 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility and Preservation: Lessons learned from 1,663 papers in Economics
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Ten Simple Rules for creating a replication package
Abstract We present a detailed and actionable guide on creating a replication package, relying on our expertise as data editors of leading journals. Thi...
Reproducible Research from Day 1
Abstract Miklós Koren and Lars Vilhuber, data editors of the Review of Economic Studies and the American Economic Association Journals require that you shar...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,800 empirical articles since July 2019, and worked with authors to improve...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,800 empirical articles since July 2019, and worked with authors to improve...
(Full day) Reproducibility Workshop Nihon
Abstract 9:00 Overview of reproducibility and replicability in economics, including replication packages (presentation) 10:00-10:50 … Let’...
(Full day) Reproducibility Workshop Nihon
Abstract 9:00 Overview of reproducibility and replicability in economics, including replication packages (presentation) 10:00-10:50 … Let’...
Reproducible Research from Day 1
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
Advanced methods for self-verification of reproducibility
Abstract In this second session, data editors describe a few possible steps to self-check replication packages before submitting them to a journal. It is no...
Data Editor AMA
Abstract Questions and Coffee with AEA Data Editor Lars Vilhuber Are you a researcher in the midst of preparing a replication package and are unsure about ...
Ask a Data Editor Anything
Abstract The growing focus on archiving and curating research data, along with promoting reproducible research, is highly relevant to our faculty and gradua...
Data Editor AMA
Abstract Questions and Coffee with AEA Data Editor Lars Vilhuber Are you a researcher in the midst of preparing a replication package and are unsure about ...
Don’t Worry, Be (Reproducibly) Happy! Reproducibility from Day 1 and Day X
Joint with Marie Connolly (UQAM and CEA Data Editor) and Sofia Encarnación (Cornell University, Assistant Data Editor, AEA) Abstract A brief overview of re...
Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor
Time 2:00pm - 3:30pm Room Wheelock 423 Abstract Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor Are you...
Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor
Time 4:00pm - 5:30pm Room E51-432 Abstract Reproducibility in Economics: Open Q&A with the American Economic Association’s Data Editor Are you a re...
A chat with Data Librarians and the AEA Data Editor
Abstract The NEEDLS group is co-led by Charissa Jefferson, Labor Economics Librarian, Princeton University Library and Whitney Kramer, ILR Research and Data...
École d’été du CIQSS en reproductibilité de la recherche (in French)
Abstract Cette formation fournira une vue d’ensemble des enjeux en matière de reproductibilité de la recherche et proposera la marche à suivre pour réaliser...
QICSS Summer School on Research Reproducibility
Abstract This training will provide an overview of issues related to research reproducibility and will propose the steps to follow to carry out a replicable...
Training on reproducible methods in empirical economics
Preliminary! The session still needs to be confirmed. Details to follow. Abstract Session 1: “Reproducibility from Day 1” [May 31] Link to session Journ...
Reproducibility from Day 1 to Day T
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
Training on reproducible methods in empirical economics
Abstract Session 1: “Reproducibility from Day 1” Journals require that you share your code and data in a replication package upon acceptance. However, effi...
Training on reproducible methods in empirical economics when data are confidential
Abstract Session 1: “Reproducibility from Day 1” Journals require that you share your code and data in a replication package upon acceptance. However, effi...
TBD
Abstract Several top journals have recently initiated efforts to insure that published empirical results can be replicated. The panel will discuss fundamen...
Open Q&A with Data Editors of the AEA, ECTA, and WEAI
Time 5:30pm - 6:30pm Room 310 Abstract Meet w/ Lars Vilhuber (AEA), Joan Llull (Econometrica) & Farasat Bokhari (Economic Inquiry, WEAI) to learn &a...
Open Q&A with the American Economic Association’s Data Editor
Time 1:00pm - 2:30pm Room “National Harbor 1” Abstract Open Q&A with the American Economic Association’s Data Editor Are you a researcher in the mi...
AEA/ES Data Editors’ Tutorial 1
Abstract Journals require that you share your code and data in a replication package upon acceptance. However, efficient reproducibility starts at the begin...
AEA/ES Data Editors’ Tutorial 2
Abstract Data editors describe possible steps to self-check replication packages before submitting them to a journal. It is not meant to be exhaustive, and ...