From principles to metrics to evaluation, increasing TRUST in data repositories

You are here

27 Jan 2021
Group(s) submitting the application: 
Meeting objectives: 

1. Thinking about what the metrics are for measuring the trustworthiness of a repository, following the TRUST principles. The TRUST principles are an aspirational goal for the repository ecosystem, but with more and more repositories saying that they *meet* the principles, what are the more granular metrics for a (any) repository to self-evaluate how it is doing with respect to the TRUST principles? Moreover, although an external body might ultimately evaluate a repository’s performance through a certification that can be mapped back to the TRUST principles, do general metrics derived from the TRUST principles immediately map to certification standards? 

2. Exploring whether the following groups might be established up the IG: 

a. An ‘Engagement Group’ to help the promotion and implementation of the TRUST principles. This might start with a subgroup of the TRUST Principles authors or endorsers to discuss what is needed, but the IG could facilitate the efforts by including some information in presentations where relevant.

b. A Working Group to perform a mapping exercise between the TRUST principles and various certification/repository evaluation schema. An open question is the intended audience of such a mapping.

c. There is growing interest in ensuring that generalist repositories are integrated into the Trustworthy Data Repository ecosystem. However, the three main certification standards (CoreTrustSeal, nestorSeal, and ISO 16363) are built upon the OAIS reference model, which is concerned largely with the notion of the Designated Community, and hence the standards are not optimal for the certification of generalist repositories.  We will look at current efforts that may help generalist repositories to be recognized as trustworthy, including the latest development on the CoreTrustSeal position paper, and the Data Curation Network—an interesting  model of how generalist repositories can get curatorial expertise.

Meeting agenda: 

Collaborative meeting notes: https://docs.google.com/document/d/1lqilrSGrEsCEnJkL71E5VT3Yqz1a_L-2HLmN...

 

1. Welcome and introduction (5 min) - IG Co-chairs
2. Presentation: TRUST Principles as an aspirational goal for a digital repository
ecosystem (5 min)

3. Presentation: Application of the TRUST principles to repository development (2, 5 min. each)
4. Presentation: Challenges to make TRUST trusted (5 min).
5. Presentation: Metrics, towards make a repository trustworthy: case study from a survey of biomedical repositories (10 min).
6. Presentation: How TRUST principles and repository certification apply to a generalist repository (10 min).
7. Discussion: Engagement groups to promote and implement TRUST Principles within various communities, including but not limited to generalist repositories, technology 
and service providers, publishers, professional societies, and repository certification standards (45 min).
8. Next steps and closures (5 min) - IG co-chair

Target Audience: 

Data repositories managers, science publishers, research funders, researchers

Group chair serving as contact person: 
Brief introduction describing the activities and scope of the group: 

Convened in 2014, this RDA Interest Group aims to deliver a comprehensive and inclusive overview, as well as the necessary recommendations and requirements that enables the effective implementation, of certification of digital repositories on national, European, and even global levels. It continues to provide a forum for discussion of repository certification principles and, partially through creation of Working Groups, to facilitate the development of principles and practices in the area of repository certification.

Short Group Status: 

This Interest Group has been in existence since the 3rd Plenary Meeting held in March 2014 in Dublin. One its primary achievements has been to act as the umbrella of two joint RDA Working Groups:

● Repository Audit and Certification DSA–WDS Partnership WG
● WDS/RDA Assessment of Data Fitness for Use WG

The IG was initially Co-chaired by Ingrid Dillo and Michael Diepenbroek. Garry Baker, Rorie Edmunds, Dawei Lin, and Jonathan Petters then took on the role of Chairs at the start of 2019. The new Co-chairs have hosted breakout sessions at P13, P14 and VP16, with the major foci thus far being to introduce the concept of the TRUST Principles that are expected to become an RDA supporting output, and also the issues faced by non-domain repositories in becoming acknowledged as trustworthy components of global research data infrastructure.

Type of Meeting: 
Informative meeting
Avoid conflict with the following group (1): 
Avoid conflict with the following group (2): 
Meeting presenters: 
TBC; the Co-chairs will solicit for presentations from a diverse range of speakers.
Contact for group (email):