Report from the “What is Open?” Workgroup

Initial conclusions

Our workgroup began by considering whether we should focus narrowly on open access as it relates to scholarly publishing, or whether we should take an expansive look at open scholarship writ large across all disciplines, research products and processes. In the end, we chose to view open scholarship in the broadest possible context.

A range of outputs can be made open: articles, journals,¹ monographs, new forms of research, educational resources, data, materials, software code, and where appropriate, hardware. Our group noted that for journal literature, from the perspective of the user, it is the relative openness of an article that is of prime importance. It was also agreed that various versions of the journal article are effectively distinct outputs when we consider openness—for example, the submitted version, accepted version, and final published version can all have different degrees of openness.

Research processes and practices can also be open. Among these processes are research methodologies, peer review, disclosure of funding sources, disclosure of negative results, other research in progress, and so on.

Our workgroup agreed that open is a means to an end, rather than an end in itself, and identified three overarching goals shared by all stakeholders that can be utilized for openness:

• Better research
• More impactful research
• Maximizing value for money.

We noted that open could benefit research in a number of ways aligned to these goals, including, but not limited to:

• More value for research expenditures: Openness does not necessarily drive down costs, but it may increase the value delivered by the investment in research.
• Faster visibility: Users have faster access to research products that are open, which may boost discovery.
• Reproducibility: For openness to serve reproducibility (an important aspect of ensuring verifiable results), the findings, data, methods, materials, and software (the version used, as well as the hardware) must all be described and available.

Describing the range of open

Our workgroup struggled over the question of whether open is a single, absolute state (i.e., something is open only if it meets a specific set of qualities), or whether it could and should be more accurately described as a series of conditions that exist along a spectrum.

We recognized during this deliberation that there are previously articulated definitions of open, including the Budapest definition which defines open access to journal articles as free availability with the functional equivalent of a Creative Commons (CC-BY) license.² We agreed, however, that in addition to these definitions there is a broad spectrum of open attributes not currently articulated, and further, that open could be reasonably viewed as not an end in itself but as a means for achieving better, more impactful research and for maximizing the value of our research expenditures.

Our conclusion was that openness has a number of dimensions and can be conceptualized as a spectrum, rather than at a single defined point. Our group identified a baseline set of attributes that constitute what the scholarly community currently views as being the minimum requirements for “open” (and without which a research output or process is effectively closed)—namely, discoverable, and freely accessible at the point of use. Beyond this baseline, there are attributes that may be more nuanced, and where degrees of openness may occur. Open, therefore, is in many respects a range or scale of less open to more open.

Our group sought to identify points on the openness spectrum without attributing a particular value to these points, in order to avoid designations that would deem some forms of open to be better than others. We leave it to individual users applying the spectrum to determine respective value, both because it addresses numerous content types, disciplines and contexts, and because the views of different stakeholders and disciplines vary regarding what constitutes optimum solutions in moral and practical terms.

Our workgroup then identified four dimensions that have a particular bearing on openness: Discoverability, Accessibility, Reusability, and Transparency (DART). These four DART dimensions exist along a spectrum, rather than as binary values (e.g., yes/no, on/off).

The DART Framework

Dimension	Attributes include	Description
Discoverable	Indexed by search engines Sufficient, good quality discovery metadata Links Persistent unique identifiers Explicit rights statements Open and widely used standards (for all of the above attributes)	This may be the most fundamental baseline condition of open (meaning that if an object is not discoverable, it is not open). However, there is a wide range here, including open with bad metadata or links and no or faulty identifiers.
Accessible	Free (in terms of cost) to all users at point of use, in perpetuity Downloadable (binary) Machine-readable (binary) Timeliness of availability (spectrum)	Generally drives whether we currently consider something to be open, although many variations exist (taking into account embargoes and other conditions).
Reusable	Usable and reusable (including commercial uses) Able to be further disseminated Modifiable	Openness is advanced by having fewer restrictions on reuse, dissemination and modification.
Transparent	Peer review Impact metrics Transparency in the research process (based on the Center for Open Science TOP Guidelines, including data transparency (metadata and level of availability), and software (including version and operating system/hardware) Research design and analytical methods (plus software and versions), including citation standards, pre-registration of studies and of analysis, and replication Author transparency (funding source, affiliations, roles, other disclosures such as conflict of interest)	Serves the research lifecycle, given that outputs of research become inputs. Some of the factors that affect transparency include the software used, inclusion of data, the transparency of the peer review process and analytical methods, and more.

The DART framework was developed over two days of discussions at the OSI meeting in April 2016. We present it now to the community with the aim of expanding the conversations about openness and to help better identify where scholarly artifacts and practices exist along the spectrum of open.

One application of the DART Framework might be to try to identify and assess open spectrums by institution, publication, or discipline, which will allow administrators to design precise, targeted corrections as warranted to improve open access—something that cannot be done with existing methodologies. Another application might be to use this framework to help improve openness across a particular metric (to be determined), such as increasing the number of viewers or users over time.

We welcome comments and input about this framework in order to validate it with the wider community and ensure it reflects thinking and practices from a broad range of stakeholders.

Next steps

The DART Framework provides identifiable end-points and discrete, quantifiable attributes that we hope will be helpful in terms of describing levels of openness. It enables users to focus efforts in particular areas and allows them to compare practices across institutions, publications and disciplines.

We are sharing this draft conceptual framework with the broader community in order to validate this approach. Once we have received feedback, we intend to further assess the value and relevance of the DART Framework.

Ultimately, we agreed that more openness—that is, moving along the spectrum toward becoming more open on one, some or all of the attributes of openness—is a goal that our entire stakeholder community supports in principle, and that could well have many positive repercussions for research and society. Working together to conceptualize openness as a spectrum with a range of attributes is an important addition to our conversations about openness and our efforts toward this common goal.

OSI2016 “What is Open?” Workgroup

Rick Anderson, Associate Dean of Libraries at the University of Utah and President-Elect, Society for Scholarly Publishing (SSP)

Seth Denbo, Director of Scholarly Communication & Digital Initiatives, American Historical Association

Diane Graves, Assistant Vice President for Information Resources and University Librarian, Trinity University and Board member, EDUCAUSE

Susan Haigh, Executive Director, Canadian Association of Research Libraries

Steven Hill, Head of Research Policy, Higher Education Funding Council for England (HEFCE)

Martin Kalfatovic, Associate Director, Digital Program and Initiatives, Smithsonian Libraries

Roy Kaufman, Managing Director, New Ventures, Copyright Clearance Center

Catherine Murray-Rust, Dean of Libraries & Vice Provost for Academic Effectiveness, Georgia Tech

Kathleen Shearer, Executive Director, Confederation of Open Access Repositories

Dick Wilder, Associate General Counsel, Bill & Melinda Gates Foundation

Alicia Wise, Director of Access and Policy, Elsevier

Notes: