10. Methoden & Evaluation
Prof. Dr. Beatrice Rammstedt (GESIS - Leibniz-Institut für Sozialwissenschaften)
PD Dr. Erich Weichselgartner (Leibniz-Zentrum für Psychologische Information und Dokumentation (ZPID))
The publication of the Reproducibility Project: Psychology results by the Open Science Collaboration in 2015 is yet another grievance in the dissatisfaction with modern science. The overall replication rate did not even reach 50%. Already in 2012, nobel prize-winner Kahneman had appealed to psychologists to restore the credibility of their field by creating a replication ring to check one another’s results. This crisis is not limited to the field of psychology. In health research, it was pointed out that if protocols, full study reports, and participant-level datasets are not available or incomplete, billions of dollars are wasted and bias is introduced.
One way to prevent wasted resources and defend against allegations of faulty scientific practice is to increase the transparency in scientific work by Open Science: disclosure of publications, research data, and procedures. In publications, Open Access to scholarly research is well established and universities and non-university research organizations are providing institutional repositories where researchers can deposit their published articles. Moreover, a long standing infrastructure of well-established research data centers exists in Germany. Thirtyone of these are accredited by the German Data Forum, whose goal is to improve access to high-quality data for scientific research, particularly in the social, behavioral, and economic sciences. Especially relevant to psychology are 7 centers, contributing to the transparency in psychological research by making scientific data available in anonymized form, so-called Scientific Use Files. Easy access, in-depth data description, and long-term archiving are quality criteria for data curation. With their combined effort the data centers make re- and meta-analysis or other forms of scientific secondary use possible and thus contribute to Open Science. In the symposium, the data centers will present the specific value of their data for increasing transparency in behavioral research. Scenarios for secondary use in research and education are discussed.
PISA; PIRLS & CO: The Research Data Centre at the Institute for Educational Quality Improvement
The National Educational Panel Study: Data supply and possibilities for its use in psychological research.
The Research Data Center PIAAC
The Survey of Health Aging and Retirement in Europe – A European Research Infrastructure on Aging
Testing Psychological Theories with the SOEP Innovation Sample
The Research Data Center PsychData: A Service for the Psychology Community
Research Data Centre (RDC) Education –Developing a scientific service for the reuse of video data, questionnaire and assessment items
The German Family Panel (pairfam)