The First Workshop on Reproducibility and Replication of Research Results (RRRR 2022) is part of ETAPS 2022 in Munich, Germany. It provides a forum to present novel approaches to foster reproducibility of research results, and replication studies of existing work, in the broad area of formal methods research. Its goal is to spread the word on best practices, and reward the work invested in replicating results.
Where reproducible research can be independently confirmed by third parties using artifacts provided by the original authors, replicating a result means to independently obtain it using new measurements, data, or implementations. RRRR will improve the knowledge transfer between the many separate initiatives – like artifact evaluations and tool competitions – that today support reproducibility, and provide a venue to formally publish replication studies, recognising their immense benefit to the scientific community and the hard work involved.
RRRR invites submissions in two topics and two formats. All accepted submissions will be collected in informal pre-proceedings.
Submissions are encouraged in, but not limited to, two main topics:
Submissions should be related to research in the broad area of formal methods, being in scope for one of the ETAPS conferences in principle. It is not required that the earlier work that a replication study is based on has been published at ETAPS.
RRRR accepts two types of submissions:
Short papers will undergo a full reviewing process by at least three PC members. Extended abstracts will be selected by the organisers. We encourage, but do not require, short papers to be accompanied by an artifact for reproduction. Authors of accepted submissions will present their work at the workshop, with equal treatment of extended abstracts and short papers. We encourage demonstrations to be integrated in presentations, in particular for replication studies.
Authors of accepted short papers will be invited to submit an extended version to a special issue in the International Journal on Software Tools for Technology Transfer (STTT). We expect these extended versions to be accompanied by an artifact for reproduction that will be permanently archived with a DOI upon publication of the journal paper.
This is the tentative timeline for RRRR 2022 (subject to change). All dates below are in 2022 and all deadlines are "anywhere on Earth" (UTC-12).
(Ludwig-Maximilians-Universität München, Germany),
Arnd Hartmanns (University of Twente, The Netherlands)