Digital resources in the Social Sciences and Humanities OpenEdition Our platforms OpenEdition Books OpenEdition Journals Hypotheses Calenda Libraries OpenEdition Freemium Follow us

Tag: OpenCitations Index

Looking back to look ahead: OpenCitations’ achievements in 2023

The first month of the new year has almost come to an end, and we at OpenCitations have dedicated these weeks after the holiday season to retrace the progress we reached as an open infrastructure throughout 2023, an activity that has become a tradition in the past few years. Looking back to the achievements has proven to be a great practice for our team not only to honour and celebrate the success, but also to visualize the points to focus on to best serve our community when planning future activities. During 2023 we have reached numerous milestones, which can be summarized under the two main topics: technical developments and new connections. 

Technical Developments

1. New sources

At the end of 2022, we had enriched our collection with two more sources, PubMed and DataCite, which were added to Crossref. During 2023 we completed the integration between OpenCitations and the OpenAIRE Graph as concerns open bibliographic and citation data, and in December we included the DOI-to-DOI citation links derived from the Japan Link Center (JaLC). As a result, by the end of 2023, OpenCitations counted almost 2 BILLION open citations available in its collection.

2. A brand-new workflow for an easier consultation

The progressive integration of new sources is one of OpenCitations’ main objectives. However, the recent source increase made it necessary to design a new ingestion workflow to facilitate their management. In November 2023 OpenCitations launched the new workflow, designed to produce just two comprehensive collections: OpenCitations Index, collecting open citation data, and OpenCitations Meta, containing open bibliographic metadata of citing and cited entities involved in citations. This evolution is making it simpler for OpenCitations users to consult the data maintained by our infrastructure without reducing the information content and accuracy.  

New connections 

3. A great event for the community

In October 2023, OpenCitations hosted the Workshop on Open Citations and Open Scholarly Metadata 2023 (WOOC 2023) in the historical location of the University of Bologna. After two online editions, it was exciting to meet in person the researchers, policy makers and service providers who in the past few years have collaborated with OpenCitations in many ways. For two days, almost 80 people from all around the world gathered to discuss the theme “The value of open scholarly metadata for Research Assessment purposes”. The event gave us a picture of a young and enthusiastic research community, aiming to collaborate among different countries to spread the message “Open Science is Better Science”. If you couldn’t attend the workshop, but are interested in the theme, you can find all the presentations from WOOC 2023 on Zenodo. Stay tuned on the WOOC X account and website, we will announce the 2025 edition later in 2024! 

4. New and old partnerships

OpenCitations’ main activities, besides the technical development, are tied to its participation in R&D and funded projects. Since 2019, we have started building a network of collaborations all around the world with institutions which share the same Open Science values. In 2023, our involvement in the SCOSS 2nd funding cycle has come to an end. In the last four years SCOSS has worked as an international showcase for OpenCitations, making it possible for us to get known by many institutions on an international level. We are now proud to keep on collaborating with SCOSS within the SCOSS Family network, a community of practice gathering all the OS infrastructure involved in the SCOSS funding cycles. During 2023, the SCOSS Family was involved in four internal sprints dedicated to planning four actions – collectively advocating the importance of open  infrastructure, communications kit for ‘the post-SCOSS phase’, collective self-assessment towards POSI, and map open science infrastructure ecosystem including SCOSS infrastructures – and the initial outcomes were presented in the Scoss Family Public Webinar 2023. The SCOSS family will continue its activities throughout 2024.

In 2023, we also celebrated the update of the Principles of Open Scholarly Infrastructure (POSI), as a result of the work conducted since 2022 with the “POSI-Adopters” group to make the principles clearer and more inclusive. In June, the OpenAIRE-Nexus project, started back in 2021, formally came to an end, with the release of the index of citations from OpenAIRE. OpenCitations is part of the OpenAIRE Catalogue, which also links to the exhaustive and engaging materials we produced within the project. However, we continue to meet the familiar and friendly faces from the OpenAIRE team in the meetings of GraspOS, a project which started in January 2023 involving several European Open Science institutions, services and infrastructures. In GraspOS, OpenCitations is involved as one of the Data Asset Sources, which provides both the raw and the structured data that can be used to directly support OS-aware RRA processes or to calculate indicators or collect evidence that can be of value in these processes. The researchers from OpenCitations and the University of Bologna are contributing to GraspOS by developing a tool for the extraction of citation data from PDFs, enriched with additional information on the reasons for citing (because the citing entity reuses a method described in the cited entity, for agreeing with the claims of the cited entity, etc.) through the implementation of machine-learning systems. Also, together with GraspOS, OpenAIRE, and many other Coalition members, the OpenCitations personnel at the University of Bologna is among the participants of the CoARA Working Group Towards Open Infrastructures for Responsible Research Assessment (OI4RRA), to work on enabling the research community to be in full control of the data and indicators it relies on in assessments. OpenCitations is always seeking interest from new institutions, and we are proud that our visibility is boasted by some reliable catalogues including the OpenAIRE catalogue, the EOSC Marketplace and, from 2023, also the JISC Catalogue. And soon you’ll find us in a new tool – stay tuned to find out!

5. Our way towards sustainability 

OpenCitations is increasingly gaining a prominent role in the community, establishing itself as a key player in changing research evaluation practices towards greater openness and equity. In recent years, OpenCitations has grown a lot both technically and in popularity, and for this we want to thank the number of members and donors who, even in the last year, have decided to support us and believe in our infrastructure. During 2023, our two Internal Working Groups “Governance Evolution” and “Community Building”, thanks to the participation of some members of the International Advisory Board for OpenCitations, reflected on the sustainability of OpenCitations, discussing strategies both at the management and communication level to ensure the integration of new actors into its subsistence. The groups will continue to meet throughout 2024, and some of the results will be released in the coming months. However, there is still a long way to go towards sustainability, and OpenCitations’ existence still relies on community funding, which is why OpenCitations still needs support: if you are looking for more information on why and how to support OpenCitations, you can read our recent call for action here. Thank you! 

6. Enlarging our team 

It is thanks to the support received that OpenCitations was able to develop its yearly activities, and we are happy to announce that in 2023 a new software developer, Elia Rizzetto, and a new PhD student, Francesca Cappelli, have joined our team to make this progress possible. The OpenCitations team now has a total of 12 members, including research fellows, PhD students, MA students, a Reseach Manager, an Assistant Professor and OpenCitations’ Directors. The number is expected to grow soon, as OpenCitations has recently released a call for the hiring of a System Administrator for technical infrastructure management.  

As can be seen from this brief (and detailed) report of some of the developments that have marked our 2023, OpenCitations is increasingly emerging as a community-based and community-guided infrastructure organization, in which there is an indissoluble link between technical progress and the network of people who guide the planning, work on implementation, and use or promote our services. Throughout 2024, OpenCitations aims to focus even more on harmonizing the relationship between the technical infrastructure and the community, developing more intuitive ways of accessing services and communications, and continuing to weave relationships with new research groups. We look forward to seeing what the year ahead will bring with it, and we hope you will continue to be with us.  

A new revolutionary workflow for a unified collection of citations: say hello to the OpenCitations Index

Blog post by Ivan Heibi (University of Bologna), Arianna Moretti (University of Bologna) and Chiara Di Giambattista (University of Bologna).

In the past five years, the OpenCitations data has been enriched with numerous new indexes of open citation data from different sources. However, the quantity and diversification of the ingested information have raised several issues, which recently made it essential to conduct a complete revision of the ingestion workflow. The result was a revolution in the way OpenCitations data is delivered. In this blog post, we will explain the context and challenges raised by the old procedure. Then, we will present the new ingestion workflow, designed to produce just two comprehensive collections: OpenCitations Index, collecting open citation data, and OpenCitations Meta, for the open bibliographical metadata. 

Once upon a time, there were five OpenCitations indexes…

In 2018, OpenCitations released the kickoff version of its first citation index, COCI (citations from Crossref), which contained around 300 million citation links derived from the subset of the reference lists in the Crossref database, where citing and cited entities were identified using Digital Object Identifiers (DOIs). COCI gathered citations with associated metadata in compliance with the recommendations from the Initiative for Open Citations (I4OC) that citation data should be structured, separable, and open, thus marking a turning point by providing a disruptive and free and open alternative to earlier sources such as Google Scholar, which provided freely accessible data although not downloadable, and Web of Science or Scopus, which demanded paid access. 

In a short time, COCI became a competitive and trusted index of citation data, used by numerous institutional repositories, including B!son and Optimeta. In 2021, COCI was taken into account in a comparative study with the most relevant sources in the landscape, including the proprietary ones, which showed its coverage approaching parity with those of the other sources involved in the analysis (Microsoft Academic, Scopus, Dimensions, and Web of Science). At the time of its most recent update in January 2023, COCI counted more than 1.4 billion citations. The reason behind this outstanding number lies in several factors, including Elsevier’s endorsement of the Declaration on Research Assessment (DORA) in December 2020, leading to the open release via Crossref of the reference lists of the articles published in all its journals, and confirming the value of initiatives such as the Initiative for Open Citations (I4OC). 

However, before this change of heart, in 2019 OpenCitations had tried to narrow the open citations coverage gap by launching its second index, the Crowdsourced Open Citations Index (CROCI). This index allowed publishers and scholars to contribute directly by uploading crowdsourced open citations into the OpenCitations infrastructure.

In December 2022, a new concrete step towards a factual plurality of OpenCitations indexes was taken by the ingestion of new data sources into the infrastructure, with the publication of the inaugural dumps of DOCI (citations from DataCite) and POCI (citations from PubMed). In June 2023, the first version of the OROCI (citations from OpenAIRE) dump was released too, and JOCI (citations from JALC) is expected to be available by the end of November 2023, for a total of five collections from different sources. 

Why a new workflow? The issues with multiple sources management and new challenges

While having such a variety and richness of indexes helped present the extent of OpenCitations sources, the recent increment in the number of sources and the diversification of data integrated led to two primary issues:

    1. the necessity to handle the ingestion of new identifier types in a DOI-based software infrastructure, and
    2. the consequent possibility of encountering the same citation expressed by several sources with different identifiers.

Moreover, it soon became evident the need to optimize the reuse of the already developed software components to facilitate the metadata crosswalk processes between the new sources’ data models and the OpenCitations Data Model, with the aim to define a functional and easily extendable workflow to be easily reused when it comes to incorporating new data sources, which should be: 

    1. sufficiently generic to establish a globally unique procedure; 
    2. customizable enough to capture the necessary information within each of the specific data models and formats. 

As a solution, we decided to use OpenCitations Meta, the new OpenCitations database and tool for managing bibliographic data related to the publications involved in the citations. OpenCitations Meta makes it possible to assign each entity involved in a citation an internal identifier, nominally the OpenCitations Meta Identifier (OMID), to which all the associated persistent identifiers of the same publication are redirected.

As a result, the allocation of an OMID for each bibliographic resource also enabled the unambiguous identification of each citation, regardless of the persistent identifier schema originally used by the data source to identify the resources. This approach allowed us to perform data deduplication and finally make all the sources’ contributions converge into a unified index containing all the unique citations managed by OpenCitations, expressed as OMID to OMID citation links.

The revised workflow

The new workflow is based on three main components with the benefit of optimizing the process both in terms of computational cost and in terms of flexibility. As shown in Fig. 1, in a preliminary step, source-specific software converts the input dataset – structured according to the source data model – to extract two OpenCitations Data Model compliant data collections in tabular format for bibliographic metadata and citation data, respectively.

The following steps are common to the process of each dataset.  

STEP 1: The bibliographic metadata collection is used as input for the META software. At this stage, it is checked whether or not the bibliographic entities have been previously integrated into our infrastructure (coming from other data sources). If so, the existing OMID is linked also to the new alternative identifiers of the new bibliographic resources. New metadata values, if any, are also integrated. A new OMID identifier is produced for entities never previously encountered, uniquely representing the bibliographic resource in OpenCitations. The outputs of the process are: (I) an updated version of the OpenCitations Meta collection that also includes the metadata of the bibliographic entities provided by the new source, and (II) a collection of provenance data. An internal database is constantly refreshed to preserve correspondence between IDs and the associated internal OMIDs.

STEP 2: Starting from the collection of citations expressed as directional links between identifiers of potentially any type (e.g., DOI-DOI, PMID-PMID, PMC-PMID, etc.), the INDEX software queries the internal database mapping IDs to OMIDs to produce an updated version of the OpenCitations Index: unique citations expressed as OMID-OMID links in different formats, accompanied by their corresponding provenance data.

Fig. 1: An overview of the data ingestion workflow, starting from the data source-specific conversion and production of citations and bibliographic metadata tables, progressing through the META process and the assignation of an OMID identifier to each bibliographic record involved in a citation, and culminating with the exposition of the OpenCitations Index collection of OMID-OMID unique citations.

What we have now: The OpenCitations Index 

From now on, OpenCitations will no longer display an index of citation data for each source. Instead, we will publish a single collection of citations into which the contributions from each of the sources will flow, which we will simply call ‘The OpenCitations Index‘. The first version of this unified index of OMID-OMID citations is posted on Figshare. It was produced in RDF, CSV, and SCHOLIX formats, together with a collection of its provenance information, provided in RDF and CSV formats. For each citation, it is possible to trace the source of the information by consulting the Provenance data collection, thanks to the http://www.w3.org/ns/prov#atLocation property, which defines the location of each citation.

This new solution has the benefit of simplifying the consultation of the data maintained by our infrastructure without reducing the information content. In addition, by including efficient handling of the deduplication problem, the new Index not only provides accurate data on the exact number of unique citations exposed by the framework but also verifies the individual contribution of each source, as well as their overlapping data (Fig. 2).

Fig. 2: An overview of the number of citations stored in the OpenCitations Index as of October 31, 2023. The diagonal cells in the table (highlighted in yellow) show the unique contribution of each collection to the OpenCitations Index, while the other cells represent the citations that are shared between the collections. More in detail, the green cells show the overall input of each source, while the pink cells represent the number of overlapping citations between two data sources.

Currently, the Index contains almost 2 billion unique citations. By the end of November, a new version of the collection will be published, including the contribution of the new Japan Link Centre (JaLC) source. 

How to access the OpenCitations Index data

To maximize the reuse of the exposed information and to ensure the greatest possible interoperability, the collection will always be published on Figshare in all formats listed above. In addition, the data will be accessible via an API, a SPARQL endpoint, and a web interface.

The redesign of the ingestion workflow marks a fundamental step for OpenCitations towards a more intuitive and simple access to our services while always preserving and improving the quality of our data. If you need further information on how the new workflow works, please visit our website, contact us at contact@opencitations.net  or leave feedback and/or suggestions in the dedicated card on our public roadmap to help us improve our services and communications. Thank you!