TPDL 2026

As part of the conference, the following contribution will be delivered by the Austrian national pilot:

Session: Data Management Plans and FAIR Assessment

Title: Community Metrics and Automated Assessment of Machine-Actionable Data Management Plans

Abstract: Data Management Plans (DMPs) are mandated by funders as instruments for promoting FAIR data practice, yet evaluating their quality remains labour-intensive and does not scale. Machine-actionable DMP (maDMPs), structured according to the RDA DMP Common Standard, open the door to automated assessment, but a community grounded, openly published catalog of evaluation criteria has so far been missing. This paper presents three contributions made within the OSTrails project.

First, we describe a participatory co-design methodology through which practitioners, tool developers, and funder representatives elicited evaluation criteria grounded in real-world DMP workflows.

Second, we present the resulting DMP Evaluation Metrics Catalogue that contains 94 metrics formalised as linked-data records using the FAIR Testing Results (FTR) vocabulary, anchored to RDA DCS schema fields.

Third, we demonstrate automated evaluation of maDMPs against community specific benchmarks, showing that a substantial portion of the catalogue can be applied as deterministic, externally validated tests returning machine-readable, field-level feedback for researchers, data stewards, and funders.

Date & Time: September 23, 2026, 11:15 – 12:45

Authors: Tomasz Miksa(TU WIEN), Andres Tabima Romero (TU WIEN), Maria Kontopidi (ARC) and Elli Papadopoulou (ARC)

Further information about the conference can be found here: TPDL 2026