A discussion about various things
Posts by Collection
guidance
License template
save “LICENSE.txt” as part of your deposit modify the COPYRIGHT line. Modified BSD License (https://opensource.org/licenses/BSD-3-Clause) - applies t...
Licensing Guidance
This site does not provide legal guidance. The information below is provided for discussion and as a suggestion only. Authors should consult with a qualif...
Frequently Asked Questions
… although some are not frequently asked, but might nevertheless be useful. Below questions and answers in random order. Please be sure to check out the offi...
Step by step guidance
The following steps outline what you should expect after conditional a...
Step by step guidance
What to expect next The next steps happen behin...
Preparing your files for verification
This document describes how to best prepare a replication package for an AEA journal. Much of the guidance here is not specific to our journals - the documen...
Guidance on testing replicability of code
The code and data that have been archived should be reproducible and replicable. How do we test that? Generic guidance Generic guidance is provided at the ...
Privately sharing restricted-access data with the AEA Data Editor
In certain cases, you may be able to share data you obtained from somebody (“data provider”) with the AEA Data Editor for the purpose of conducting reproduci...
Creating separate linked data archives
Every time we see that a lot of effort went into creating a data resource, we don’t want to have that sit hidden in a replication package. We want to give da...
Guidance on how to deposit data at the AEA Data and Code Repository
Tutorial For a video tutorial on this process, see this Youtube video. If you are depositing at a different trusted repository, please be sure that your...
Guidance on how to prepare a comment based on a replication
You may have found an issue in a published article related to some of the computations therein, and are preparing a comment. This note describes how you shou...
Sharing of Pre-Publication openICPSR deposits
In certain situations, authors might want to provide access to others (co-authors, persons interested in the replication package) prior to publication of the...
Creating a Restricted Data Deposit for AEA Publications
This guide describes how to create a restricted-access data deposit at ICPSR, associated with an AEA publication. The guide also describes what authors shoul...
Display Guidelines for Trusted Repositories (other than AEA Data and Code Repository)
The AEA accepts replication packages from any trusted repository (see list), as long as they meet certain display criteria, and otherwise satisfy the reprodu...
projects
Migration of legacy replication packages (pending last packages)
Since July 16, 2019, the American Economic Association has used the AEA Data and Code Repository as the default archive for its supplements. The AEA also an...
Improving metadata of migrated replication packages
Improvement of metadata on migrated packages, those deposited before July 2019. see additional info if you received a request to contribute migration i...
Development of standardized README for social science journals
Together with other economics data editors, we developed a standardized README .
Identifying Stata packages used in replication packages
Initiated by one of our student replicators (Lydia Reiner), this project aims to run a static code analysis on replication packages, identifying Stata packag...
publications
surveys
Improving Metadata
Emails sent Authors of articles may have received the following email:
Sharing And Reusing Research Data
Emails sent Members of the Association who are willing to receive occasional surveys about economics and economists received the following email from the AE...
talks
Implementing Increased Transparency and Reproducibility in Economics
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics
(together with cascad) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of rep...
Implementing Increased Transparency and Reproducibility in Economics
(together with cascad) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of rep...
Implementing Increased Transparency and Reproducibility in Economics
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics
(with BITSS) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability...
Implementing Increased Transparency and Reproducibility in Economics
(together with BITSS) Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of repl...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Practices for Data Transparency and Reproducibility
Abstract Description: Reproducibility and replicability are critical elements of credible scientific research. Data provenance is an important, but often ne...
Reproducibility Potpourri - or why we need a standard README
Abstract Short talk on failures of reproducibility, proposing a standardized README. The standard template README, proposed by the Social Science Data Edito...
Demystifying Replication Requirements and Processes: Best Practices Viewed by AEA-Data Editor
Abstract The AEA Data editor, Lars Vilhuber, was interviewed by Leah Boustan of Princeton University. Video recording Video available on the CSWEP resourc...
Improving reproducibility in the social sciences: Challenges
Abstract Presented as part of RDA17 in the session on “Experiments in Preparing Data for Interchange and Openness”, organized by the IG RDARI. Short talk o...
Implementing Increased Transparency and Reproducibility in Economics - Some Lessons
Abstract Replicability is at the core of the scientific enterprise. In the past 30 years, recurring concerns about the extent of replicability (or lack the...
Implementing Increased Transparency and Reproducibility in Economics: Lessons for Register based Research
Abstract Presentation at the Virtual Workshop on “Research with German and Norwegian Register Data on Family Economics” on lessons learned while implementin...
Tutorial: Data Sharing and Archiving for Reproducibility
Abstract Tutorial at “Research Transparency and Reproducibility Training (RT2)” organized by BITSS on how to share data in a persistent, reproducible way, w...
Firm-Academic Research Collaborations in Economics - Journals’ Perspective
Abstract Short talk on the reproducibility, transparency in economic research involving firm (private) data. PDF/PPTX Google Presentation
Data Science Tools Workshop: Working with confidential data
Abstract Tutorial on reproducible practices, in particular when data are confidential. Can be interactive, with R. Handles acquiring and posting data via an...
Improving Transparency and Reproducibility: Lessons from 1,000 economics papers
Abstract Presentation at the University of Wisconsin - Madison’s Center for Demography of Health and Aging in the context of the Demography Training Seminar...
Panel: Challenges and Opportunities of Reproducibility when Data are Proprietary
Abstract Presentation at the NBER conference on “Challenges and Opportunities of Reproducibility when Data are Proprietary” The meeting will be livestreame...
Enhancing accessibility and reproducibility in scientific publications: Improvements on both ends of the pipeline
Abstract Presentation in the Statistics Department (Research Colloquium)
Overview of reproducibility and replicability in economics, with a side trip to provenance
Abstract Presentation at the Banco de Portugal Workshop on Reproducibility of Scientific Results.
Reproducibility and Transparency versus Privacy and Confidentiality: Reflections from a Data Editor
Abstract Presentation by Lars Vilhuber at ASSA 2022 in the Journal of Econometrics Session: “Econometrics and Data in the 21st Century: Reproducibility and ...
Teaching for Large-scale Reproducibility Verification
Abstract Presentation by Lars Vilhuber on how the RAs in the LDI Replication Lab are trained.
Challenges in Reproducibility and Replicability in Labor Economics
Abstract Presentation by Lars Vilhuber at SOLE 2022, joint session with Thibaut Lamadon and Felipe Gonçalves. Video recording Video available on the Corne...
Teaching for Large-scale Reproducibility Verification
Abstract Presentation by Lars Vilhuber on how the RAs in the LDI Replication Lab are trained, at the AEA’s annual CTREE conference.
Rethinking Reproducibility: Bridging the Gaps Between Research Cultures, Publishing Workflows and Scholarly Infrastructures
Abstract Participation by Lars Vilhuber on a panel at the Society for Scholarly Publishing, an annual meeting of publishers and editors of academic journals.
Lessons Learned from Implementing AEA Reproducibility
Abstract Some lessons learned for an academic audience.
Transparency and Reproducibility in Economics: Lessons learned from 1,000 papers
Abstract Presentation by Lars Vilhuber at WEAI 2022, followed by Panel discussion with Tim Salmon, Editor for “Economic Inquiry”, and Kyrani Reneau, openICP...
Reproducibility in the Social Sciences: Lessons learned for students, researchers, and institutions from 1,000 articles
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility in the Social Sciences: Lessons learned for students, researchers, and institutions from 1,000 articles
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Replication and Research Transparency
Abstract Research has to be transparent in order to be considered as credible and valid. Reproduction and replication are practices that seek to establish t...
Transparency and Reproducibility in Economics: Lessons learned from 1,000 papers when data are confidential
Abstract Presentation by Lars Vilhuber on how best to prepare reproducible and transparent packages when data are confidential. Live slides are available a...
Reproducible Research Fundamentals: Why does reproducibility matter for economics research
Abstract Variation of the “Lessons learned” talk, given to new World Bank interns.
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility when data are confidential or big
Abstract Presentation at the Banco de Portugal Workshop on Reproducibility of Scientific Results. URL for live slides is https://larsvilhuber.github.io/repr...
Coffee with Data Editors
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,663 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Replication and Research Transparency in Empirical Economics
Abstract Several top journals (including those of the RES) have recently initiated efforts to insure that published empirical results can be replicated. Not...
Data Editor AMA
Abstract Do you have questions how the data and code availability policy works at the AEA or other journals, or how to prepare a particularly challenging re...
Kontinuierliche Transparenz und Reproduzierbarkeit bei akademischen Publikationen: Ansätze und Techniken
Abstract Part of a Symposium on open science in ecoomics (in German).
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,663 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Reproducibility and Preservation: Lessons learned from 1,663 papers in Economics
Abstract The American Economic Association’s Data Editor has reviewed more than 1,000 empirical articles since July 2019, and worked with authors to improve...
Ten Simple Rules for creating a replication package
Abstract We present a detailed and actionable guide on creating a replication package, relying on our expertise as data editors of leading journals. Thi...
Reproducible Research from Day 1
Abstract Miklós Koren and Lars Vilhuber, data editors of the Review of Economic Studies and the American Economic Association Journals require that you shar...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,800 empirical articles since July 2019, and worked with authors to improve...
Transparency and Reproducibility in Economics: Context and Lessons learned from 1,000 papers
Abstract The American Economic Association’s Data Editor has reviewed more than 1,800 empirical articles since July 2019, and worked with authors to improve...
(Full day) Reproducibility Workshop Nihon
Abstract 9:00 Overview of reproducibility and replicability in economics, including replication packages (presentation) 10:00-10:50 … Let’...
(Full day) Reproducibility Workshop Nihon
Abstract 9:00 Overview of reproducibility and replicability in economics, including replication packages (presentation) 10:00-10:50 … Let’...