An Open Source, DDI-Based Data Curation System For Social Science Data

The Institution for Social and Policy Studies (ISPS) at Yale University and Innovations for Poverty Action (IPA) are partnering to develop a repository for research data from randomized controlled trials in the social sciences. The repository will be an expansion – and major upgrade – of the existing ISPS Data Archive. Together with Colectica, the partners are developing a software platform that leverages DDI Lifecycle, the standard for data documentation. The software structures the curation workflow, which also includes checking data for confidentiality and completeness, creating preservation formats, and reviewing and verifying code. The software will enable a seamless framework for collecting, processing, archiving, and publishing data. This data curation software system combines several off-the-shelf components with a new, open source, Web application that integrates the existing components to create a flexible data pipeline. The software helps automate parts of the data pipeline and unifies the workflow for staff. Default components include Fedora Commons, Colectica Repository, and Drupal, but the software is developed so each of these can be swapped for alternatives. This session will include a live demonstration of the data curation software.