Crossref – OpenCitations blog

A new revolutionary workflow for a unified collection of citations: say hello to the OpenCitations Index

Blog post by Ivan Heibi (University of Bologna), Arianna Moretti (University of Bologna) and Chiara Di Giambattista (University of Bologna).

In the past five years, the OpenCitations data has been enriched with numerous new indexes of open citation data from different sources. However, the quantity and diversification of the ingested information have raised several issues, which recently made it essential to conduct a complete revision of the ingestion workflow. The result was a revolution in the way OpenCitations data is delivered. In this blog post, we will explain the context and challenges raised by the old procedure. Then, we will present the new ingestion workflow, designed to produce just two comprehensive collections: OpenCitations Index, collecting open citation data, and OpenCitations Meta, for the open bibliographical metadata.

Once upon a time, there were five OpenCitations indexes…

In 2018, OpenCitations released the kickoff version of its first citation index, COCI (citations from Crossref), which contained around 300 million citation links derived from the subset of the reference lists in the Crossref database, where citing and cited entities were identified using Digital Object Identifiers (DOIs). COCI gathered citations with associated metadata in compliance with the recommendations from the Initiative for Open Citations (I4OC) that citation data should be structured, separable, and open, thus marking a turning point by providing a disruptive and free and open alternative to earlier sources such as Google Scholar, which provided freely accessible data although not downloadable, and Web of Science or Scopus, which demanded paid access.

In a short time, COCI became a competitive and trusted index of citation data, used by numerous institutional repositories, including B!son and Optimeta. In 2021, COCI was taken into account in a comparative study with the most relevant sources in the landscape, including the proprietary ones, which showed its coverage approaching parity with those of the other sources involved in the analysis (Microsoft Academic, Scopus, Dimensions, and Web of Science). At the time of its most recent update in January 2023, COCI counted more than 1.4 billion citations. The reason behind this outstanding number lies in several factors, including Elsevier’s endorsement of the Declaration on Research Assessment (DORA) in December 2020, leading to the open release via Crossref of the reference lists of the articles published in all its journals, and confirming the value of initiatives such as the Initiative for Open Citations (I4OC).

However, before this change of heart, in 2019 OpenCitations had tried to narrow the open citations coverage gap by launching its second index, the Crowdsourced Open Citations Index (CROCI). This index allowed publishers and scholars to contribute directly by uploading crowdsourced open citations into the OpenCitations infrastructure.

In December 2022, a new concrete step towards a factual plurality of OpenCitations indexes was taken by the ingestion of new data sources into the infrastructure, with the publication of the inaugural dumps of DOCI (citations from DataCite) and POCI (citations from PubMed). In June 2023, the first version of the OROCI (citations from OpenAIRE) dump was released too, and JOCI (citations from JALC) is expected to be available by the end of November 2023, for a total of five collections from different sources.

Why a new workflow? The issues with multiple sources management and new challenges

While having such a variety and richness of indexes helped present the extent of OpenCitations sources, the recent increment in the number of sources and the diversification of data integrated led to two primary issues:

1. the necessity to handle the ingestion of new identifier types in a DOI-based software infrastructure, and
2. the consequent possibility of encountering the same citation expressed by several sources with different identifiers.

Moreover, it soon became evident the need to optimize the reuse of the already developed software components to facilitate the metadata crosswalk processes between the new sources’ data models and the OpenCitations Data Model, with the aim to define a functional and easily extendable workflow to be easily reused when it comes to incorporating new data sources, which should be:

1. sufficiently generic to establish a globally unique procedure;
2. customizable enough to capture the necessary information within each of the specific data models and formats.

As a solution, we decided to use OpenCitations Meta, the new OpenCitations database and tool for managing bibliographic data related to the publications involved in the citations. OpenCitations Meta makes it possible to assign each entity involved in a citation an internal identifier, nominally the OpenCitations Meta Identifier (OMID), to which all the associated persistent identifiers of the same publication are redirected.

As a result, the allocation of an OMID for each bibliographic resource also enabled the unambiguous identification of each citation, regardless of the persistent identifier schema originally used by the data source to identify the resources. This approach allowed us to perform data deduplication and finally make all the sources’ contributions converge into a unified index containing all the unique citations managed by OpenCitations, expressed as OMID to OMID citation links.

The revised workflow

The new workflow is based on three main components with the benefit of optimizing the process both in terms of computational cost and in terms of flexibility. As shown in Fig. 1, in a preliminary step, source-specific software converts the input dataset – structured according to the source data model – to extract two OpenCitations Data Model compliant data collections in tabular format for bibliographic metadata and citation data, respectively.

The following steps are common to the process of each dataset.

STEP 1: The bibliographic metadata collection is used as input for the META software. At this stage, it is checked whether or not the bibliographic entities have been previously integrated into our infrastructure (coming from other data sources). If so, the existing OMID is linked also to the new alternative identifiers of the new bibliographic resources. New metadata values, if any, are also integrated. A new OMID identifier is produced for entities never previously encountered, uniquely representing the bibliographic resource in OpenCitations. The outputs of the process are: (I) an updated version of the OpenCitations Meta collection that also includes the metadata of the bibliographic entities provided by the new source, and (II) a collection of provenance data. An internal database is constantly refreshed to preserve correspondence between IDs and the associated internal OMIDs.

STEP 2: Starting from the collection of citations expressed as directional links between identifiers of potentially any type (e.g., DOI-DOI, PMID-PMID, PMC-PMID, etc.), the INDEX software queries the internal database mapping IDs to OMIDs to produce an updated version of the OpenCitations Index: unique citations expressed as OMID-OMID links in different formats, accompanied by their corresponding provenance data.

Fig. 1: An overview of the data ingestion workflow, starting from the data source-specific conversion and production of citations and bibliographic metadata tables, progressing through the META process and the assignation of an OMID identifier to each bibliographic record involved in a citation, and culminating with the exposition of the OpenCitations Index collection of OMID-OMID unique citations.

What we have now: The OpenCitations Index

From now on, OpenCitations will no longer display an index of citation data for each source. Instead, we will publish a single collection of citations into which the contributions from each of the sources will flow, which we will simply call ‘The OpenCitations Index‘. The first version of this unified index of OMID-OMID citations is posted on Figshare. It was produced in RDF, CSV, and SCHOLIX formats, together with a collection of its provenance information, provided in RDF and CSV formats. For each citation, it is possible to trace the source of the information by consulting the Provenance data collection, thanks to the http://www.w3.org/ns/prov#atLocation property, which defines the location of each citation.

This new solution has the benefit of simplifying the consultation of the data maintained by our infrastructure without reducing the information content. In addition, by including efficient handling of the deduplication problem, the new Index not only provides accurate data on the exact number of unique citations exposed by the framework but also verifies the individual contribution of each source, as well as their overlapping data (Fig. 2).

Fig. 2: An overview of the number of citations stored in the OpenCitations Index as of October 31, 2023. The diagonal cells in the table (highlighted in yellow) show the unique contribution of each collection to the OpenCitations Index, while the other cells represent the citations that are shared between the collections. More in detail, the green cells show the overall input of each source, while the pink cells represent the number of overlapping citations between two data sources.

Currently, the Index contains almost 2 billion unique citations. By the end of November, a new version of the collection will be published, including the contribution of the new Japan Link Centre (JaLC) source.

How to access the OpenCitations Index data

To maximize the reuse of the exposed information and to ensure the greatest possible interoperability, the collection will always be published on Figshare in all formats listed above. In addition, the data will be accessible via an API, a SPARQL endpoint, and a web interface.

The redesign of the ingestion workflow marks a fundamental step for OpenCitations towards a more intuitive and simple access to our services while always preserving and improving the quality of our data. If you need further information on how the new workflow works, please visit our website, contact us at contact@opencitations.net or leave feedback and/or suggestions in the dedicated card on our public roadmap to help us improve our services and communications. Thank you!

A technical overview of OpenCitations Meta

This blog post is the first of a series dedicated to the description and promotion of OpenCitations Meta.

In addition to OpenCitations’ Citation Indexes, OpenCitations is pleased to announce a new service: OpenCitations Meta, a database which stores and delivers bibliographic metadata for all publications involved in the OpenCitations citation indexes.

For each publication, the metadata exposed by OpenCitations Meta includes the publication’s title, type, venue (e.g. journal name), volume number, issue number, page numbers, publication date, and identifiers such as Digital Object Identifiers (DOIs) and PubMed Identifiers (PMIDs). In addition, OpenCitations Meta includes details of the main actors involved in the publication of the document, i.e., the names of the authors, editor, and publisher, each with its own additional metadata and identifier (e.g. ORCID).

Why OpenCitations Meta?

OpenCitations Meta represents a major infrastructural advance for OpenCitations, since it addresses and overcomes some of the limitations previously experienced, providing three major benefits:

1. It permits OpenCitations to respond more quickly to user requests for information.

The OpenCitations Citation Indexes contain citation-related metadata, such as the identifiers for the citing and cited publications, the citation timespan, and other citation-specific metadata, for example whether or not the citation is a self-citation. However, metadata for the citing and cited publications were hitherto not stored by OpenCitations, but rather obtained by on-the-fly API calls to external services such as Crossref, Datacite and ORCID. This dependence on responses from external services significantly slowed the delivery of the required information to users. Since OpenCitations Meta stores in-house the same bibliographic metadata for the citing and cited publications as was previously obtained by those external API calls, the former temporal limitation is now alleviated, thereby accelerating response times for requests made to the OpenCitations REST API services, and thus better supporting our users.

2. It permits OpenCitations to index citations involving publications that lack DOIs.

The second problem that OpenCitations Meta addresses goes beyond the OpenCitations infrastructure and addresses a more general issue of digital publishing, particularly in the Humanities, namely that many scholarly publications lack persistent identifiers such as DOIs and PMIDs. The citations indexed by OpenCitations are themselves treated as first-class data entities, each bearing a unique persistent Open Citation Identifier. According to the Open Citation Identifier definition [1], the entities linked by an indexed citation need to be identified by a persistent identifier (PID) from a recognised scheme such as the Digital Object Identifier scheme. For example, COCI [2] records the DOIs of the citing and cited entities. However, the association of DOIs with published documents is not uniformly spread across all scholarly fields. Indeed, in Scopus and the Web of Science Core Collection, only 50% of the current publications in the Art and Humanities are associated with a DOI [3]. In addition, in many fields, particularly in the Humanities, references are required to pre-digital historical primary sources that lack PIDs. OpenCitations Meta solves this problem by assigning a unique OpenCitations Meta Identifier (OMID) to each document. In this way, it can record the metadata of publications lacking an external identifier and store the citations involving them in one of the OpenCitations Indexes.

3. Use of the OpenCitations Meta Identifier permits de-duplication of records of bibliographic resources having more than one external identifier, such as a DOI and a PMID.

While many scholarly publications lack external PIDs, many others will have more than one external PID, for example a DOI for the record of that publication in Crossref, and a PMID for the record of that same publication in PubMed. This is perfectly legitimate. Since OpenCitations Meta assigns a unique OpenCitations Meta Identifier (OMID) to every entry, and in addition records all external identifiers already assigned to that publication, for example its DOI and its PMID, this permits the automatic de-duplication of such publications within OpenCitations Meta.

The data model

OpenCitations uses Semantic Web technologies to encode all its data, including the bibliographic metadata now stored in OpenCitations Meta. For this purpose, the OpenCitations Data Model (OCDM) [4] uses classes and properties defined in the SPAR Ontologies to represent:

bibliographic entities (fabio:Expression), e.g. a journal article
identifiers (datacite:Identifier), e.g. a DOI
agent roles (pro:RoleInTime), e.g. an author
responsible agents (foaf:Agent), e.g. a person
publication format details (fabio:Manifestation), e.g. first and last pages

Figure 1 depicts relationships between some of the various entities.

Figure 1. A small subset of the OCDM used in OC Meta. Yellow rectangles represent classes, green polygons represent data types, while blue and green arrows represent object properties and data properties, respectively

In addition to storing data, great importance is given to recording provenance and change-tracking of OpenCitations Meta entries, including the agent who processed a specific entity, i.e. creating, deleting, modifying or merging it, the date and time on which this action was performed, and the primary source of the data.

The data

At the release date, 20th December 2022, OpenCitations Meta is using Crossref as its primary source, with the purpose of hosting the metadata describing all citing and cited publications involved in the 1,392,036,835 citations within COCI [2]. From a quantitative point of view, OpenCitations Meta presently contains metadata describing 87,321,593 bibliographic entities, 277,750,235 authors, 2,359,301 editors, 17,268 publishers, and 710,226 publication venues (e.g. journal names). Editors and authors have been counted by their roles, without at this stage disambiguating individuals with the same name. Conversely, bibliographic entities, publishers, and publication venues were counted by their OMIDs. In total, the OpenCitations Meta triplestore presently contains 3,298,335,581 triples.

In the following days, OpenCitations Meta will be expanded to include bibliographic metadata for all citing and cited publications involved in the 169,822,752 citations from DataCite within DOCI, released on 13th December 2022.

Table 1 lists the various types of bibliographic resource represented in OpenCitations Meta. The current dataset contains mostly journal articles (60,683,841), which exceed the number of book chapters (6,288,351) by about ten times and the number of conference proceedings articles (4,917,568) by about twelve times.

Bibliographic resource type	Number of publications
journal article (fabio:JournalArticle)	60,683,841
book chapter (fabio:BookChapter)	6,288,351
proceedings article (fabio:ProceedingsPaper)	4,917,568
journal issue (fabio:JournalIssue)	4,340,894
book (fabio:Book)	3,138,154
journal volume (fabio:JournalVolume)	1,265,884
web content (fabio:WebContent)	285,962
reference book (fabio:ReferenceBook)	201,964
reference entry (fabio:ReferenceEntry)	184,515
dataset (fabio:DataFile)	156,343
report (fabio:ReportDocument)	153,864
journal (fabio:Journal)	133,963
proceedings (fabio:AcademicProceedings)	68,961
book series (fabio:BookSeries)	32,070
dissertation (fabio:Thesis)	20,226
standard (fabio:SpecificationDocument)	13,285
series (fabio:Series)	8546
book section (fabio:ExpressionCollection)	6754
peer review (fr:ReviewVersion)	4319
book part (doco:Part)	2474
book set (fabio:BookSet)	45

Table 1. All the bibliographic resources types involved in OpenCitations Meta, ordered by the number of publications of each type. The reference ontologies are FaBiO (http://purl.org/spar/fabio), DOCO (http://purl.org/spar/doco), and FAIR reviews (http://purl.org/spar/fr)

How to access the metadata in OpenCitations Meta

OpenCitations Meta allows the users to explore the contained metadata either via SPARQL (https://opencitations.net/meta/sparql) or via the OpenCitations Meta REST API (https://opencitations.net/meta/api/v1). In particular, the API will retrieve a list of bibliographic resources and related metadata starting from one or more identifiers including an OpenCitations Meta Identifier (OMID), an author’s ORCID, or an editor’s ORCID.

Finally, all the metadata and provenance information present in OpenCitations Meta are available as dumps in RDF (JSON-LD) or CSV format under a CC0 licence. Every time a citation index is updated, we will update OpenCitations Meta.

Conclusion

OpenCitations Meta makes search operations on the metadata of scholarly publications involved in the citations indexed in the OpenCitations Citation Indexes faster, since the metadata are now held in-house. The use of OpenCitations Meta Identifiers (OMIDs) permits OpenCitations Meta to act as a mapping hub to disambiguate and unify information on single publications identified by more than one external identifier, and makes it possible to characterise citations involving resources lacking an external identifier.

In the future, we will introduce a new API operation to perform text searches. Moreover, OpenCitations Meta will incorporate metadata from other sources in addition to Crossref. As mentioned above, work is already under way to ingest bibliographic metadata from Datacite for the publications involved in the citations newly indexed in DOCI. This will soon be followed with similar OpenCitations Meta entries relating to a new citation index, POCI, containing citations from PubMed, to be released later this year. PubMed metadata will be made available by February 2023.

References

Peroni, S. and Shotton, D. (2019). Open Citation Identifier: Definition. Figshare. https://doi.org/10.6084/m9.figshare.7127816
Heibi, I., Peroni, S. & Shotton, D. Software review: COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations. Scientometrics 121, 1213–1228 (2019). https://doi.org/10.1007/s11192-019-03217-6
Gorraiz, J., Melero-Fuentes, D., Gumpenberger, C., & Valderrama-Zurián, J.-C. (2016). Availability of digital object identifiers (DOIs) in Web of Science and Scopus. Journal of Informetrics, 10 (1), 98–10. https://doi.org/10.1016/j.joi.2015.11.008
Peroni, S. and Shotton, D. (2018). The OpenCitations Data Model. figshare. DOI: https://doi.org/10.6084/m9.figshare.3443876

Tutorial: how to process COCI’s zipped CSV dump without decompressing it

Blog post by Ivan Heibi (Universiy of Bologna) and Arcangelo Massari (University of Bologna).

OpenCitations publishes the COCI dataset after each new release in three main formats: CSV, N-Triples, and Scholix (see https://opencitations.net/download#coci). The CSV format is the most popular and downloaded one due to its comprehensive data organization (i.e. tabular format) and smaller size (compared to the other formats provided). Therefore, this is also the format we suggest using for a local process of the entire COCI dataset.

The CSV dumps of COCI are uploaded on Figshare. You can check and download the last dump released from https://doi.org/10.6084/m9.figshare.6741422. The dump consists of one main ZIP file, including other smaller ZIP archives (one for each release) containing the actual CSV files (Figure 1).

Figure 1. The contents of the COCI CSV dataset (after the August 2022 release)

It is possible to process this data without unzipping the internal archives, thus saving a lot of disk space. In this tutorial, we will see how to achieve this in Python. Same process could be done in other programming languages.

Processing the COCI dump using Python

Step 1) Downloading the COCI dump

First, you need to download the last CSV dump release of COCI from https://doi.org/10.6084/m9.figshare.6741422 and decompress only the external archive. After this operation, you should have a folder containing the internal ZIP files such as in Figure 1.

Note: It is beneficial to decompress the external archive because doing so does not increase the space occupied on the disk (compressing archives results in a compression rate of 0%) and because working on nested archives would significantly increase RAM requirements.

Step 2) Working with the ZIP files

Python provides the built-in zipfile module, whose ZipFile class allows you to create, read, write, edit and list the contents of a ZIP file. Given as input the path of the root directory containing all the ZIP files (FOLDER_PATH), the process elaborates each of these files on a different iteration. Each cycle initializes a ZipFile object by specifying the path to the ZIP file (archive_path).

from zipfile import ZipFile
import os

for archive_name in os.listdir(FOLDER_PATH):        
    archive_path = os.path.join(FOLDER_PATH, archive_name)
    with ZipFile(archive_path) as archive:
        # ...

Step 3) Accessing the ZIP files

Use the namelist() method to return the list of CSV files contained in each archive. Then to open the inner CSV files, simply cycle through the list of names and feed them to the open() method of the ZipFile instance, i.e. archive in the example below.

from zipfile import ZipFile
import os

for archive_name in os.listdir(FOLDER_PATH):
    archive_path = os.path.join(FOLDER_PATH, archive_name)
    with ZipFile(archive_path) as archive:
        for csv_name in archive.namelist():
            with archive.open(csv_name) as csv_file:
                # ...

Step 4) Reading the CSVs

The .open() method returns a buffer. To read the CSV file as a list of dictionaries (i.e. represent each row of the CSV in dictionary format, e.g., {“column1″:”val1”, “column2″:”val2”}) we need to transform the buffer using the TextIOWrapper class and read it using the DictReader class of csv. Then we convert the result of DictReader into a list.

from io import TextIOWrapper
from zipfile import ZipFile
import os

for archive_name in os.listdir(FOLDER_PATH):
    archive_path = os.path.join(FOLDER_PATH, archive_name)
    with ZipFile(archive_path) as archive:
        for csv_name in archive.namelist():
            with archive.open(csv_name) as csv_file:
                reader = csv.DictReader(io.TextIOWrapper(csv_file))
                rows = list(reader)
                # ...

Step 5) Processing the CSVs content

Now you can go through each row of the list and process the citation data as you want. The following example prints the citing and cited entity of each citation in the dump.

from io import TextIOWrapper
from zipfile import ZipFile
import os

for archive_name in os.listdir(FOLDER_PATH):
    archive_path = os.path.join(FOLDER_PATH, archive_name)
    with ZipFile(archive_path) as archive:
        for csv_name in archive.namelist():
            with archive.open(csv_name) as csv_file:
                reader = csv.DictReader(io.TextIOWrapper(csv_file))
                rows = list(reader)
                # Process the CSV here
                for r in rows:
                    print("Citing entity:",r["citing"])
                    print("Cited entity:",r["cited"])

Additional 48 million citations in COCI, including references from IEEE

We announce the August 2022 release of COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations, which is based on open references to works with DOIs within the Crossref dump dated August 2022. This new release extends COCI with more than 48 million additional citations, giving a total number of more than 1.36 billion DOI-to-DOI citation links.

This release includes citations from the articles published over the last four years by IEEE, whose bibliographic references were opened in June 2022.

A fundamental role in pushing the commercial publishers to open their citation data was played by Crossref’s recent announcement to change its reference distribution policy, by making all its metadata open.

Besides IEEE, COCI already includes the citation data derived from Elsevier (open via Crossref since December 2020) and from the last articles published by the American Chemical Society (whose references were opened in February 2021)

You can find more information about COCI in our open-access article

Ivan Heibi, Silvio Peroni & David Shotton (2019). Software review: COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations. Scientometrics, 121 (2): 1213-1228. DOI: https://doi.org/10.1007/s11192-019-03217-6

Finally, just a reminder that the bibliographic and citation data in COCI:

- can be queried using the OpenCitations Indexes SPARQL endpoint;
- can be retrieved by using the COCI REST API;
- can be searched by using the OpenCitations Indexes Search Interface;
- are also available as dumps on Figshare in CSV, N-Triples, and Scholix; and
- can be freely re-used for any purpose.

New documents that present OpenCitations’ mission, unique benefits, present status and future plans

Posted on August 10th 2022 by Chiara Di Giambattista

More than a year ago, Ginny Hendricks, Director of Member & Community Outreach for Crossref, and a valued member of the OpenCitations International Advisory Board, published on the Crossref blog the post “The road ahead: our strategy through 2025”. In order to describe all Crossref’s principles and activities, Ginny presented the Crossref strategic planning framework as a diagram summarizing Crossref’s statements, key messages and truths. The clarity and immediacy of the diagram were such that we adapted it to present OpenCitations’ own statements and goals. The resulting poster “OpenCitations – what does the future hold?” was presented by our Director David Shotton at the OASPA2021 conference, and can be found in this blog post.

Although the poster offered a wide overview of OpenCitations values, unique traits, benefits and plans, it differed slightly from Ginny’s original diagram, in particular because it lacked a “Mission Statement”, scattering the relevant information within the “Values” and “Principles” boxes. Indeed, at that time (September 2021), we didn’t have a clearly defined Mission Statement.

Nevertheless, the creation of that poster was crucial in helping us start to articulate more clearly the purpose and meaning of OpenCitations. As David underlined in his post “From little acorns…a retrospective on OpenCitations”, since 2018 OpenCitations activities have progressively increased and, with them, the number of related journal articles, conference papers and technical definitions. OpenCitations’ involvement in international networks and collaborations (such as SCOSS and the OpenAIRE-Nexus project), together with our need of identifying and reaching out to new stakeholders to assure OpenCitations’ development and sustainability, has made it necessary to publicly define OpenCitations’ mission, unique strengths and next developmental steps.

After numerous revisions, aided by wise advice from members of the OpenCitations Advisory Board members, we’re now happy to publish the following three OpenCitations documents:

OpenCitations Mission Statement,

The Uniqueness of OpenCitations and

OpenCitations – Present Status and Future Plans,

which together provide a summary of why we exist and where we are heading.

We are particularly proud of the definition of OpenCitations’ primary mission, namely

“to harvest and openly publish accurate and comprehensive metadata describing the world’s academic publications and the scholarly citations that link them, and to preserve ongoing access to this information by secure archiving.”

The Mission Statement also presents brief descriptions of the OpenCitations context, our vision, our value proposition and our relationship with the community and stakeholders.

The Uniqueness of OpenCitations provides the answer to the question ‘Why choose to use OpenCitations?’, and is a detailed presentation of OpenCitations’ benefits.

OpenCitations – Present Status and Future Plans summarizes OpenCitations’ ongoing activities, that can be quickly visualized on our public roadmap. It also introduces the OpenCitations Working Groups, served by the members of the OpenCitations International Advisory Board, which are currently working on the themes of governance evolution and community building, with the common purpose of driving OpenCitations along the path from being a ‘sustainable infrastructure’ (in POSI terms) to being an enduring community led and financially sustained infrastructure.

In fulfilling our mission and reaching our goals, the support and vital interest of our community members is fundamental. We request that you, as a member of our community, provide us with feedback on these documents and the ideas they contain, or indeed to ask for clarifications, to help us improving our mission and our communications to explain it. You can reach us here: contact@opencitations.net.

Thank you!

OpenCitations and EC funding: OpenAIRE Nexus and RISIS2

The incentives for new OpenCitations innovative solutions

Two years ago, in their canonical 2020 QSS paper on OpenCitations, Silvio Peroni and David Shotton anticipated the creation of the new database, OpenCitations Meta, able to “offer a faster and richer service” by storing bibliographic metadata “in house”. Meta would “avoid duplication of data by efficiently permitting us to keep […] a single copy of the metadata for each of the bibliographic entities involved as citing or cited entities in the different OpenCitations’ citation indexes”, would remove the requirement for potentially slow API calls to external metadata sources such as Crossref and ORCID, and would enable us to index citations involving entities lacking DOIs.

Important synergies to achieve goals

Today, thanks to the recent involvement of OpenCitations in two EC-funded projects, the OpenAIRE-Nexus Project (Horizon 2020 EU funded project, GA: 101017452) and the RISIS2 Project (Horizon 2020 EU funded project, GA: 824091), the development of OpenCitations Meta has commenced, with a planned release date later in 2022.

The OpenAIRE-Nexus project started in January 2021 to embrace and expand the operation of a portfolio of thirteen services, provided by OpenAIRE infrastructure, public institutions, organisations and universities, classified into three portfolios entitled PUBLISH, MONITOR, and DISCOVER. The OpenAIRE-Nexus portfolios focus on the demands of the three main categories of the research lifecycle. Therefore, OpenAIRE-Nexus makes sure such services are integrated to provide a uniform Open Science Scholarly Communication package for the European Open Science Cloud (EOSC). Within the OpenAIRE Nexus project there is scope for producing not only support materials (factsheet, guides, video tutorials, demos) but also training sessions where the services in the three portfolios will be showcased, anticipating the EOSC onboarding process. The role of OpenCitations in the project is to provide open bibliographic citations, and interconnect and integrate (and vice versa) functionalities with the OpenAIRE Research Graph and more OpenAIRE-Nexus services such as EpiSciences, OpenAIRE MONITOR) the core component of OpenAIRE infrastructure and services and of the EOSC Resource Catalogue.

Additionally, we are happy to announce our recent involvement in the RISIS2 Project. The Research Infrastructure for Science and Innovation Policy Studies (RISIS) is a project funded by the European Union under a Horizon2020 Research and Innovation Programme. RISIS2 involves 18 partners working together to create and maintain a research infrastructure for the field of Science, Technology, and Industry (STI) Studies, and to build an advanced research community in this field. OpenCitations’ contributions to RISIS2 will include not only the creation of OpenCitations Meta but also the development of a new citation index of open references, the OpenCitations Index of DataCite Open Citations (DOCI), which will be based on the open reference holdings of DataCite and, together with COCI, will be cross-searchable through our unified OpenCitations API.

Lessons learnt so far

A year into the OpenAIRE-Nexus project, we have found that one of the most significant benefits for OpenCitations is our involvement with this wide cooperative network of European research infrastructures, services, and communities, within which we can exchange experiences, ideas, and knowledge, and discuss any challenges and outcomes with our colleagues. More importantly, OpenCitations becomes positioned within the Open Science ecosystem, as a valuable innovative infrastructure with strong proof of integration and interoperable operations. Being part of the OpenAIRE-Nexus team has opened up more future challenges and expectations, and raised the bar for the inclusion of more functionalities of value. Thanks to the dedication of its efficient communication team, OpenAIRE is also helping us by communicating OpenCitations services to additional users and stakeholders, by inclusion within the comprehensive OpenAIRE services catalogue, by releasing an OpenCitations factsheet and by permitting us to present the latest information on OpenCitations through established events (i.e. Open Science FAIR 2022). FAIR and openness of information is our motto, and we strongly promote this through all our activities.

Expanding our team

As announced in our previous blog post “Five reasons why 2021 has been a great year for OpenCitations”, the support we receive from the EU as part of OpenAIRE-Nexus has enabled our recent appointment of Arcangelo Massari, a software developer who is now playing a crucial role in the creation and development of OpenCitations Meta.

As the year 2022 progresses, we look forward to bringing you further information about other new goals for OpenCitations, made possible by the support we receive from our numerous partnerships.

Five reasons why 2021 has been a great year for OpenCitations

2021 is just behind us. Since January is “the Monday of the months”, as F. Scott Fitzgerald once wrote[1], it’s a good time to take stock of what happened at OpenCitations during the past year.

Among the numerous events, achievements and challenges that 2021 brought with it, we want to highlight five milestones which make us proud to look back:

1. We extended our coverage to well over one billion citations

During 2021, OpenCitations’ largest index COCI (the OpenCitations Index of Crossref open DOI-to-DOI citations) was able to include for the first time the citation links involving references that had been opened at Crossref by Elsevier and the American Chemical Society, thereby greatly expanding its coverage. The last release of COCI (November 2021) is based on open references to works with DOIs within the Crossref dump dated October 2021, and, as a result, COCI now contains information on more than 1.23 billion citations involving almost 70 million publications.
A recent analysis by Alberto Martìn-Martìn (Facultad de Comunicación y Documentación, Universidad de Granada, Spain), published on the OpenCitations Blog in October, shows that the citation coverage provided by OpenCitations is approaching parity with that of the leading commercial citation indexes, Web of Science and Scopus, offering a viable alternative upon which to base open and reproducible metrics of academic performance.

2. OpenCitations team grew

Last summer, we appointed Claudio Fabbri as our Administrator and Research Manager to take responsibility for the day-to-day administrative and financial activities of OpenCitations; Chiara Di Giambattista as Communications Director and Community Development Manager to take care of all communications and community interactions made on behalf of OpenCitations; and Giuseppe Grieco as our new Software and Systems Developer to take charge of technical development related to the OpenCitations services.

Thanks to the support from the OpenAIRE Nexus project, the team has also recently welcomed Arcangelo Massari as our new Software Developer to take care of the development of the new database OpenCitations Meta. We anticipate further appointments during 2022!

Our International Advisory Board met in November, and we thank its members for the valuable advice they provided. The Board will meet again later this month.

3. We participated in many international meetings

During the past year, OpenCitations’ directors Silvio Peroni and David Shotton took part in numerous international conferences, webinars and workshops, including the LIBER Annual Conference 2021, the OS Fair 2021, OASPA 2021 and FORCE2021. These provided excellent opportunities to describe and promote OpenCitations, to reach out to new potential stakeholders, and to discuss with other experts the main themes of our activities and plans as they relate to Open Science.

The year ended with a bang, with the announcement during the closing session of FORCE2021 that the 2021 Open Publishing Award for Open Data had been awarded to OpenCitations.

4. We received a world of support

In 2021, thanks to our involvement in the SCOSS funding campaign and to our commitment to reaching out to the libraries and universities potentially interested in OpenCitations, we gathered a wide international community of stakeholders and supporters around us. We are deeply thankful to the 6 consortia and 56 institutions across the globe which are now supporting us financially, thus making it possible for us to enhance our services and expand our team. You can find the full list of our supporters on the OpenCitations website and in this recent Thank You video:

Additionally, in January 2021, we started our involvement in the EC-funded OpenAIRE Nexus project, bringing us into closer collaboration with our European colleagues and infrastructures, including OpenAIRE. The main aim of the project is to create a framework of services for assisting in publishing research, monitoring its impact, helping promote its discovery, and integrating it into the European Open Science Cloud (EOSC) “for the benefit of the open science community worldwide”. In OpenCitations, we’re thrilled to be part of this collaborative project by providing open bibliographic citations as part of the open data components of OpenAIRE and the EOSC.

5. We set the stage for future developments

Thanks to the research grants and the support and endorsement we have received from the international scholarly community, we are now working on a variety of new services, thus setting our goals for the coming years. In particular, we want to enhance OpenCitations partnerships and dialogue with the scholarly community; to collaborate with colleagues to develop new services that will expand our citation coverage, including new OpenCitations indexes of NIH-OCC, of DataCite and of other sources of open references, that will all be searchable through a single API; and to create OpenCitations Meta, our new database that will hold comprehensive bibliographic metadata of the publications involved in our indexes citations, thereby enabling faster query responses and the ability to host citations involving publications lacking DOIs[2].

[1] F. Scott Fitzgerald (2002). The beautiful and damned (page 50 in the original 1922 edition); United Kingdom: Dover Publications. https://www.google.it/books/edition/The_Beautiful_and_Damned/-tUoAwAAQBAJ?hl=en&gbpv=0

[2] Silvio Peroni, David Shotton; OpenCitations, an infrastructure organization for open scholarship. Quantitative Science Studies 2020; 1 (1): 428–444. doi: https://doi.org/10.1162/qss_a_00023

Open citations in Informatics: current status and lines of research

This post was first published on QWERTY: musings from the rabbit hole, a blog by Silvio Peroni

A few months ago, I was invited to have a talk at the European Computer Science Symposium on an aspect of my research I particularly care about, that of open citations. What I tried to address during the presentation concerned the current status of open citation availability in a particular domain, Informatics, by using two open datasets, i.e. DBLP for gathering bibliographic metadata about relevant publications and OpenCitations’ COCI for identifying citations where such publications are involved. This post briefly introduces the preliminaries and results obtained from the material used to prepare the talk.

Open citations and where to find them

A citation is a conceptual directional link between a citing entity and a cited entity which is defined by means of specific textual devices contained in the text of the citing entity, e.g. a bibliographic reference denoted by an in-text reference pointer (e.g. “[3]” or “(Doe et al, 2021)”). While reasons for citing may vary, citations are used in academia for acknowledging others’ work and enabling building trails of relations defining how science evolves in time.

The data needed to describe a citation should include, at least, a representation of such a conceptual link and the basic bibliographic metadata to identify the citing and cited entities, i.e. those typically used for defining bibliographic references such as authors’ names, year of publication, the title of the work, venue of publication, pages, identifiers, etc. We say that a citation is open when these citation data are in the public domain and can be retrieved freely (via the HTTP protocol) in a structured and machine-readable format (e.g. JSON or RDF) without accessing the source of citing article defining it, which, potentially, could be behind a paywall.

OpenCitations [full disclosure: I am one of its directors] is one of the founders of the Initiative for Open Citations (I4OC) and one of the open scholarly infrastructures providing open citation data through several channels (REST APIs, SPARQL endpoints, Web interfaces, full dumps in different formats). As of 31 December 2021, it makes available more than 1.2 billion open DOI-to-DOI citation links between more than 69.5 million bibliographic resources, which are mainly journal articles but also include books, book chapters, datasets, and other DOI-identified resources. The entities involved in such citations come from different domains, spanning from Medicine articles to Humanities publications, and have recently approached parity with those included in well-known proprietary services such as Web of Science and Scopus.

What about Informatics

Such a huge mass of open citations available enables us to analyse citation coverage in different scholarly disciplines, e.g. to understand which publishers contributed to the availability of open citation data in a discipline and to check what are the citation trails between different disciplines. However, to compute such citation coverage, we need to have some information that allows us to identify when a particular bibliographic resource involved in a citation belongs to the particular discipline we want to analyse. We can use information about the subject categories of publications (e.g. that of Web of Science), if included in citation indexes, to identify the discipline(s) of a given bibliographic resource. Unluckily, OpenCitations does not provide this information and, as such, we need to rely on external repositories for gathering subject categories of publications, e.g. collections of bibliographic metadata of disciplinary publications.

In the context of Informatics, there is at least one well-known resource gathering and exposing bibliographic metadata of a large part of Computer Science publications, i.e. DBLP. As of 30 December 2021, DBLP contains more than 5.9 million publications published in 1,781 journals and in the proceedings of 5,621 conferences, involving more than 2.9 million authors that are manually curated (and disambiguated) by the DBLP team.

DBLP can be used as a proxy to understand if a particular publication belongs to the Computer Science subject category. Through it, it is possible to understand how many citations in OpenCitations involve Computer Science publications by comparing the DOIs of citing and cited entities with those available in DBLP. In particular, using the OpenCitations’ COCI September 2021 dump and DBLP October dump, I found that more than 80 million citations in COCI involved at least one of the 4,637,865 entities in DBLP (considering only journal articles, conference proceedings papers, books and book chapters). As shown in Figure 1, only 39% of these citations are between citing and cited entities both included in DBLP, while the rest of them either come from or go to publications not listed in DBLP – that, potentially, could not be Computer Science publications.

**Figure 1.** A Venn diagram showing how many citations involving Computer Science publications (obtained from DBLP) are included in OpenCitations.

Additional information about the publishers of such DBLP entities, retrieved by querying the Crossref API and the DataCite API with entities’ DOIs, are shown in Table 1. IEEE is the publisher with the biggest number of entities of those considered for this study, and its entities are involved in more than 18.9 million incoming and 21.5 million outgoing citations. The other bigger publishers, in terms of entities and citations, are Springer, Elsevier, ACM and Wiley. It is worth mentioning that the two publishers responsible for publishing mainly Computer Science journals and a relatively low number of conference proceedings (if any), i.e. Elsevier and Wiley, are those providing the highest number of openly-available references per publication (on average, around 29 and 37 cited works for each publication respectively).

Publisher	DBLP entities	COCI incoming citations	COCI outgoing citations
IEEE	1,730,485	18,930,055	21,582,093
Springer	1,012,534	18,482,132	11,179,566
Elsevier	574,860	15,536,207	17,019,716
ACM	433,188	3,695,255	6,050,342
Wiley	89,662	3,350,183	3,357,065

Table 1. The DBLP entities retrieved in the study grouped by their publisher and their incoming and outgoing citations according to COCI.

Future developments

Of course, this study does not provide full coverage of open citations in Computer Science but just a preliminary insight. First, as anticipated below, DBLP does not have the complete coverage of all CS-related publications since there are some venues that are not listed there (yet). Thus, some relevant open citations could not be extracted from COCI if these involve as citing and cited entity non-DBLP publications that belong to the CS domain. However, it is worth mentioning that no bibliographic and citation database (including commercial and proprietary ones) has a full disciplinary coverage anyway and DBLP is, probably, the most comprehensive collection of Computer Science publications metadata (something that could be assessed in future analysis).

Along the same lines, the index of open citations used, i.e. COCI, does not contain all the citations defined in CS publications, but only DOI-to-DOI citations as retrievable from Crossref data. Although Crossref is the biggest DOI provider and it is used by the majority of the big publishers,citations defined in publications with a non-Crossref DOI (e.g. DataCite) and those not having any DOI assigned (e.g. the papers published in CEUR Workshop Proceedings) are not included in COCI and, consequently, have not been used in the analysis. However, OpenCitations plans to extend its data coverage adding more sources in the next years. Thus, it would be interesting to replicate the same analysis in the future to see if and how much the coverage increase, at least in the context of Computer Science publications.

Still about coverage, currently (i.e. 31 December 2021) the only publisher of those included in Table 1 which is not providing open references through Crossref is IEEE. Indeed, while COCI includes several citations involving IEEE publications as citing entities, there is no availability of such citation after October 2018, when IEEE decided not to allow anymore Crossref Metadata Plus users to access these reference data.

Finally, analysing the preliminary results of this study, it would be interesting to understand which are the main subject categories of non-DBLP publications included in the 61% of citations shown in Figure 1 (e.g. by using the Scimago Journal and Country Rank database to retrieve their subject categories) to understand what are the citation dynamics between Informatics and other disciplines. However, I will leave the answer to this question to future analysis.

A final remark on reproducibility

Since several of the suggestions provided above start from the idea of either replicating or extending this study with additional materials and insights, it is important that all data and software used to perform the analysis are available online to permit its reproducibility. To this end, I have published both the software and the data retrieved online with open licenses to enable anyone to reuse it freely for any purpose.

OpenCitations receives the Open Publishing Award in Open Data

“What role does ‘open’ play in making this project special?”

This apparently easy, but not banal, question was asked in the Open Publishing Awards nomination form, and at OpenCitations we prefaced our answer to it by stating “For OpenCitations, ‘open’ is the crucial value and the final purpose.” We consider the free availability of bibliographic citation data to be a necessary condition for the establishment of an open knowledge graph, and believe that having citations open helps achieve a more transparent, accessible and comprehensive research practice.

Since 2019, the Open Publishing Awards, founded and organized by the Coko Foundation and sponsored by OASPA, Crossref and Cloud68.Co, “celebrate software and content in publishing that use open licenses but also, importantly, provide a chance to reflect on the strategic value of openness”. The award judges considered open access projects divided into five categories: Open Publishing Lifetime Contribution, Open Content, Open Publishing Models, Open Source Software and Open Data.

It is in this final Open Data category of the Open Publishing Awardsthat OpenCitations was selected, as an infrastructure that perfectly represents the open principles, from among the few semantic web and linked open data initiatives currently available in the scholarly communication landscape. The award was announced in the Open Publishing Awards Ceremony, during the closing session of the FORCE2021 conference “Joining Forces to Advance the Future of Research Communication” (7-9 December). You can learn more about the Awards and the other projects selected here: https://openpublishingawards.org/results/2021/index.html

The greatest honour for OpenCitations was receiving the following comment given on behalf of the jury panel, which included open source and scholarly communication experts:

“At the time of writing this review, the largest database provided by OpenCitations contains more than 1.23 billion citations. Compiling this database in a license-friendly way is a feat on its own, but combine that with OpenCitations’ persistence (established 11 years ago), their active and consistent involvement with the community, and the number of works that were made possible by their effort (Google Scholar lists 1440 results), it is clear that OpenCitations is one of the fundamental projects in open publishing, specifically in open scientific publishing”.

We are proud and humbled to count the Open Publishing Award in Open Data among the acknowledgements so far received by OpenCitations. Despite the term “award”, the Open Publishing Awards, in fact, don’t aim to proclaim winners, but rather to “shake the hands” of some projects which seem to be following (and tracing) a right path towards a more open knowledge. All the projects awarded help by defining more concretely what “open”means, and at the same time their example encourages awareness on the variety of the open publishing projects, and a reflection about the common values and goals that gather so many different people, institutions and organizations.

Recognizing the commitment to the openness of knowledge and research of the not-for-profit and collaborative projects like OpenCitations is about community, not competition.

As Silvio recently stated:

“OpenCitations is a plural. Together, we are OpenCitations.”

Coverage of open citation data approaches parity with Web of Science and Scopus

Guest blog post by Alberto Martín-Martín, Facultad de Comunicación y Documentación, Universidad de Granada, Spain <albertomartin@ugr.es>

In this post, as a contribution to Open Access Week, Alberto Martín-Martín shares his comparative analysis of COCI and other sources of open citation data with those from subscription services, and comments on their relative coverage.

Comprehensive bibliographic metadata is essential for the development of effective understanding and analysis across all phases of the research workflow. Commercial actors have historically filled the role of infrastructure providers of bibliographic and citation data, but their choice of subscription-based business models and/or restrictive user licenses has significantly limited how users and other parties can access, build upon, and redistribute the information available on those platforms. Locking bibliographic and citation metadata behind these barriers is problematic, as it hinde r s innovation and is an obstacle to reproducibility.

Fortunately, the process of digital transformation that scientific communication is currently undergoing is providing us with the tools to get closer to the ideal of science as a public good. One of the most successful initiatives in this area is Crossr ef, arguably the single most critical piece of research metadata infrastructure currently in existence. I consider the best thing about it to be its commitment to openness. Not only is Crossref responsible for minting many of the DOIs that are assigned to academic publications, but it also publishes metadata about these publications (for over 120+ million records in their latest public data file) without imposing any access or reuse limitations.

Crossref metadata has already boosted innovation in a variety of academic-oriented tools. New discovery services such as Dimensions, The Lens, and Scilit all take advantage of Crossref metadata to keep their indexes up to date with the latest publications. The open-source reference manager Zotero is able to pull metadata associated with a given DOI from Crossref’s servers, providing an easy way to populate one’s personal reference collection that is more reliable than using Google Scholar. The Unpaywall database uses Crossref metadata (among other data sources) to keep track of which documents are Open Access, and this data is in turn used by Unsub, a service that helps libraries make more informed decisions about their journal subscriptions.

Historically, citation indexing has been a functionality available only from a few subscription-based data sources (most notably Web of Science and Scopus), or from free but largely restricted sources (e.g., Google Scholar). In recent years, however, commercial exclusivity over citation data has been waning. Digital publishing workflows make it easier for publishers to deposit the list of cited references along with the rest of the metadata when they register a new document in Crossref, and many are already doing it. Crossref’s policy is to make these lists of references publicly available by default, although publishers can elect to prevent their public release. From this, it follows that if most publishers deposited their reference lists in Crossref and consented to make them open, a comprehensive open citation index, one that is free of the restrictions present in traditional platforms, could be built.

The Initiative for Open Citations (I4OC) is an advocacy group that has been working since 2017 to achieve this precise goal, and it has already managed to convince a large number publishers (over two thousand) to open the references they deposit in CrossRef. In the first half of 2021, Elsevier, the American Chemical Society, and Wolters Kluwer joined this group, so that today all the major scholarly publishers now support I4OC and have open references at Crossref, with the exception of IEEE (the Institute of Electrical and Electronics Engineers). Thanks to the efforts of I4OC and the collaboration of publishers, 88% of the publications for which publishers have deposited references in CrossRef are now open. This has allowed organizations such as OpenCitations (one of the founding members of I4OC) to create a non-proprietary citation index using these data, namely COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations. Other open citation indexes such as the NIH Open Citation Collection (NIH-OCC) and Refcat have also been recently released.

How do such open citation indexes compare to long-established indexes? In 2019, I set out with colleagues to analyze the coverage of citations contained within the most widely used academic bibliographic data sources (Web of Science, Scopus, and Google Scholar) to a selected corpus of 2,515 highly-cited English-language documents published in 2006 from 252 subject categories, and to compare this to the coverage provided by some of the more recent data sources (Microsoft Academic, Dimensions, and COCI). At that time, COCI was the smallest of the six indexes, containing only 28% of all citations. For comparison, Web of Science contained 52%, and Scopus contained 57%.

There are a number of reasons for those differences: first, at that point some of the larger commercial publishers including Elsevier, IEEE, and ACS, which routinely deposit references in Crossref, had not yet opened them. Second, many smaller publishers still do not deposit their reference lists in Crossref. Third, COCI only captures citation relationships between documents that have DOIs, thus missing citations to publications that lack them. Finally, while for our study data collection from all sources was carried out during May/June of 2019, COCI at that time had not been updated since November 2018, which increased its disadvantage when compared to other data sources with more frequent updates.

Since Elsevier is the largest academic publisher in the world, its recent opening of references at Crossref resulted in a significant increase in the total number of openly available Crossref references. The most recent version of COCI (dated 3 September 2021, and based on open references to works with DOIs within the Crossref dump dated August 2021) now contains both the processed references from Elsevier, and the references in the most recently published articles by ACS (the complete backfile of ACS references will appear in future versions of COCI).

Given these significant developments, how much has the picture changed? To find this out, I updated our 2019 analysis using the version of COCI released on September 3^rd 2021 and the NIH-OCC dataset released in the same month. To carry out a reasonably fair comparison while reusing the data extracted in 2019 from the other sources, I employed the same corpus of target documents, and only used citations in which the citing document was published before the end of June 2019. The intention was to learn how much the coverage of open citation data has grown as a result of the subsequent opening of reference lists in Crossref that were not public in 2019, and similar efforts. The results of this new comparison are published in [1].

The combination of COCI’s and NIH-OCC’s September 2021 releases contained more than 1.62 million citations to our sample corpus of documents from all areas, a 91% increase over the 0.85 million citations that we were able to recover in 2019 from COCI alone. Considering the citations available in all data sources, 53% of all citations are now available from these two open sources under CC0 waivers, up from the 28% we found in 2019. This coverage now surpasses the 52% found by Web of Science, and is much closer to the 54% found by Dimensions, and the 57% covered by Scopus. The relative overlap between COCI and the other data sources has also significantly increased: in 2019 COCI found 47% of the citations available in Web of Science, whereas now open citation data sources find 87% of the WoS citations. In the case of Scopus, in 2019 COCI found 44% of the citations available in Scopus: the percentage available from open sources has now increased to 81%. The number of citations found by COCI but not present in the other data sources has also widened slightly. These data are presented graphically in Figure 1.

Fig. 1. Percentage of citations found by each database, relative to all citations (first row), and relative to the number of citations found by the other databases (subsequent rows).

Where are these new citations coming from? Well, as we might expect, references from articles published in Elsevier journals comprise the lion’s share of the newly found citations in open data sources (close to half of all new citations), as shown in Figure 2. But there are also some IEEE citations here. This is because until recently reference lists from IEEE publications were available in the ‘limited’ Crossref category to members of Crossref Metadata Plus, a paid-for service that provides a few additional advantages over the free services Crossref provides. As a member of Crossref Metadata Plus, OpenCitations obtained these reference lists while they were available and included them in COCI. Subsequently, IEEE decided to make their references completely closed, explaining why references from more recent IEEE publications are not included in COCI.

Fig 2. The increases between 2019 and 2021 of citations indexed by open sources (COCI + NIH-OCC) from the articles of different publishers

There can be no doubt that open citation data is of benefit to the entire academic community. Thanks to COCI, NIH-OCC, and similar initiatives, and despite some setbacks, we are already witnessing how open infrastructure can help us develop models and practices that are better aligned with the opportunities that our current digital environment offers and the challenges that our society faces.

Conclusion: The coverage of citation data available under CC0 waivers from open sources is now comparable to that from subscription sources such as Web of Science and Scopus, offering a viable alternative upon which to base open and reproducible metrics of academic performance.

Reference:

[1] Martín-Martín, A., Thelwall, M., Orduna-Malea, E. et al. Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations. Scientometrics 126, 871–906 (2021). https://doi.org/10.1007/s11192-020-03690-4