Latest blog posts
Amanda Bartell
2022 September 22

What is our role in preserving the integrity of the scholarly record?

The integrity of the scholarly record is an essential aspect of research integrity. Every initiative and service that we have launched since our founding has been focused on documenting and clarifying the scholarly record in an open, machine-actionable and scalable form. All of this has been done to make it easier for the community to assess the trustworthiness of scholarly outputs. Now that the scholarly record itself has evolved beyond the published outputs at the end of the research process – to include both the elements of that process and its aftermath – preserving its integrity poses new challenges that we strive to meet.

...Find out more
Lucy Ofiesh
2022 September 16

2022 Board Election

I’m pleased to share the 2022 board election slate. Crossref’s Nominating Committee received 40 submissions from members worldwide to fill five open board seats. We maintain a balance of eight large member seats and eight small member seats. A member’s size is determined based on the membership fee tier they pay. We look at how our total revenue is generated across the membership tiers and split it down the middle. Like last year, about half of our revenue came from members in the tiers $0 - $1,650, and the other half came from members in tiers $3,900 - $50,000.

...Find out more
Jennifer Kemp
2022 September 06

Accessibility for Crossref DOI Links: Call for comments on proposed new guidelines

Our entire community – members, metadata users, service providers, community organizations and researchers – create and/or use DOIs in some way so making them more accessible is a worthy and overdue effort. For the first time in five years and only the second time ever, we are recommending some changes to our DOI display guidelines (the changes aren’t really for display but more on that below). We don’t take such changes lightly, because we know it means updating established workflows.

...Find out more
Geoffrey Bilder
2022 August 26

Martin Paul Eve is joining our R&D group as a Principal Developer

I’m delighted to say that Martin Paul Eve will be joining Crossref as a Principal R&D Developer starting in January 2023. As a Professor of Literature, Technology, and Publishing at Birkbeck, University of London- Martin has always worked on issues relating to metadata and scholarly infrastructure. In joining the Crossref R&D group, Martin can focus full-time on helping us design and build a new generation of services and tools to help the research community navigate and make sense of the scholarly record.

...Find out more
  • Menu
search

Documentation

DOI crawler report

We test a broad sample of DOIs to ensure resolution. For each journal crawled, a sample of DOIs that equals 5% of the total DOIs for the journal up to a maximum of 50 DOIs is selected. The selected DOIs span prefixes and issues.

The results are recorded in crawler reports, which you can access from the depositor report expanded view. If a title has been crawled, the last crawl date is shown in the appropriate column. Crawled DOIs that generate errors will appear as a bold link:

DOI crawler report

Click Last Crawl Date to view a crawler status report for a title:

Crawler status report for a title

The crawler status report lists the following:

  • Total DOIs: Total number of DOI names for the title in system on last crawl date
  • Checked: number of DOIs crawled
  • Confirmed: crawler found both DOI and article title on landing page
  • Semi-confirmed: crawler found either the DOI or the article title on the landing page
  • Not Confirmed: crawler did not find DOI nor article title on landing page
  • Bad: page contains known phrases indicating article is not available (for example, article not found, no longer available)
  • Login Page: crawler is prompted to log in, no article title or DOI
  • Exception: indicates error in crawler code
  • httpCode: resolution attempt results in error (such as 400, 403, 404, 500)
  • httpFailure: http server connection failed

Select each number to view details. Select re-crawl and enter an email address to crawl again.

Page owner: Isaac Farley   |   Last updated 2020-April-08