The Fourth Workshop on Reproducibility and Replication of Research Results (RRRR 2025) is part of ETAPS 2025 in Hamilton, Canada. It will take place on May 3, 2025, as part of the ETAPS workshops. RRRR provides a forum to present and discuss novel approaches to foster reproducibility of research results, and replication studies of existing work, in the broad area of formal methods and software engineering research. Its goal is to spread the word on best practices, and reward the work invested in replicating results.
Where reproducible research can be independently confirmed by third parties using artifacts provided by the original authors, replicating a result means to independently obtain it using new measurements, data, or implementations. RRRR will improve the knowledge transfer between the many separate initiatives – like artifact evaluations and tool competitions – that today support reproducibility, and provide a venue to formally publish replication studies, recognising their immense benefit to the scientific community and the hard work involved.
The goal of the RRRR workshop is to provide a venue for lively and constructive in-person discussions and knowledge exchange. Submissions should be related to research in the broad area of formal methods and software engineering. Submissions are welcome in, but not limited to, the following topics on reproducibility and replication:
We in particular encourage authors of papers accepted at the main ETAPS conferences to present the reproducibility- and replication-related aspects of their work at RRRR. We also plan a special session on the topic of artifact evaluation, with reports by the chairs of the ETAPS 2025 artifact evaluation committees.
Submissions are handled via EasyChair. All accepted submissions will be informally published via the RRRR website. RRRR accepts presentation abstracts (1-2 pages in LNCS style including references) as well as short papers (around 6 pages in LNCS style plus references). The page limits are flexible. Authors of all accepted submissions will present their work at the workshop (in person).
We plan to invite authors of accepted papers/abstracts to submit an extended/full version of their work to a special issue in the International Journal on Software Tools for Technology Transfer (STTT). All journal submissions will undergo a full reviewing process and are expected to be accompanied by an artifact where applicable.
All dates are in 2025 and all deadlines are "anywhere on Earth" (UTC-12). The timeline may be adjusted if necessary so that the notification happens before the ETAPS 2025 early registration deadline. The organisers would appreciate an early informal indication, via , of the intention to submit to RRRR 2025.
Arnd Hartmanns
(University of Twente, The Netherlands),
Sean Kauffman
(Queen's University, Canada)