find full text does not find PDFs in cases where zotero connector does

joernwilms
Hi,

I have a large collection of papers with DOIs but without attached PDFs. I am currently trying to attach PDFs to these existing articles with "Find Full Text".

There are quite a few different publications where it is not possible to get the journal's PDF with "Find Full Text". Using "View Online" brings me to the correct online page (via the doi resolver) and I can then download the PDF without issues using zotero connector, but I've then manually clean up things by merging the newly generated entry, which is suboptimal.

One example is the paper with DOI 10.1238/Physica.Regular.069a00385

This may be related to the problens discussed 6 weeks ago in https://forums.zotero.org/discussion/122735/pdf-source-

What can I do to help with solving this issue?

  • adamsmith
    edited April 29, 2025
    Are you on campus when you try? And do you have some examples?
  • joernwilms
    Yes, I am in my office on campus when trying. The problem happens both on computers on my institution's eduroam as well as on computers with a public IP4 address.

    One of the examples is the paper with the DOI I give in my initial post, but it also happens with other journals. This is not a problem with individual papers, it's all publications from each journal. As I said above, when using the connector there's no problem, but this makes bulk downloads of papers a problem (what I'm doing here is integrating existing bibtex files with dois listed into zotero, and I'd like to also have the PDFs available).

    I'd be happy to prepare a list of journals or more example DOIs if that helps solving this problem, or do any other checks that might help.
  • dstillman
    We'd want to see a Debug ID for an attempt that fails, but the Physica Scripta article above required me to solve a CAPTCHA when I clicked on it. That would cause a file retrieval from Zotero to fail.
  • joernwilms
    Ok, thanks! Looking at a few examples, the captchas may be the root cause. I'll take a look whether this is consistently the case or not. Due to travel this will take a few days, unfortunately.
  • joernwilms
    edited 24 days ago
    @dstillman : After coming back from travel, I can finally follow up on this.

    I have just submitted Debug ID D936489464 .

    For the example article in question here (https://iopscience.iop.org/article/10.1088/0031-8949/20/1/015 , accessed via its DOI10.1088/0031-8949/20/1/015 ), I do NOT have to solve a captcha when I try to access it on my machine when I have an IP address from my university's system. This is true for both, firefox and chromium, and true when I am physically at the university or when I am accessing the system through a VPN or a ssh tunnel.

    The behavior is the same for other journals provided by IOP, for example Monthly Notices of the Royal Astronomical Society.

    Edit: Correction, I made a mistake when copying the above URLs, the example paper I was referring to when submitting the debug ID is doi:https://doi.org/10.1088/0031-8949/14/1-2/009, https://iopscience.iop.org/article/10.1088/0031-8949/14/1-2/009 . Sorry about this. However, the same problem is also present for the above URLs.
  • dstillman
    (3)(+0000119): HTTP GET https://doi.org/10.1088/0031-8949/14/1-2/009 succeeded with 302

    (3)(+0000001): HTTP GET https://iopscience.iop.org/article/10.1088/0031-8949/14/1-2/009

    (3)(+0000331): HTTP GET https://iopscience.iop.org/article/10.1088/0031-8949/14/1-2/009 succeeded with 302

    (3)(+0000000): HTTP GET https://validate.perfdrive.com/[…]ssk=botmanager_support@radware.com[…]
    Zotero is being redirected to a CAPTCHA.

    We have built-in support for showing CAPTCHAs within the app for ScienceDirect, but I believe you're the first to report this for IOP. If we can reproduce this, we can see if we can show the CAPTCHA.
Sign In or Register to comment.