Trouble with PubMed

PubMed now uses some anti-scrapper / anti-DoS measures, and perhaps because of that Zotero Connector sometimes fails to use the standard PubMed translator fails. The connector falls back to the (PubMed) Web page's metadata, which is not nearly as good (eg, "Neves, João Sérgio" becomes "Js, Neves").

I don't know if there's anything to be done on the developers' end but, as user, when it happens, I grab the PMID from the URL or PubMed's Web page, and add the record to Zotero from the identifier.

Perhaps being logged in to PubMed would avoid all this trouble, but I haven't tested it yet.
  • dstillman Zotero Team
    Can you provide a Debug ID from the Connector for reloading the page and reproducing this?
  • Hi - I have had trouble with PubMed's anti-scraper setup today too. Actually I noticed it on two different websites: PubMed and the other was an article on the publisher's website (JAMA Network).
    I was on my Android phone and was using the pathway from my browser's share command to Zotero (the Android application).
    In both cases, a record was created with the URL and no other publication metadata. The title was recorded as
    "Checking your browser - reCAPTCHA" (from PubMed)
    "Just a moment..." (from JAMA Network)
    I was logged in to PubMed at the time FWIW, and had already completed their captcha challenge at least once earlier today.
    This pathway (mobile browser - share - Zotero) worked fine for some other journal websites today, and is really convenient on the phone. I did have a small hiccup when I tried it on an NEJM article that I was accessing via a proxied URL, but when I reloaded the article page without the proxy, that pathway worked smoothly to create a Zotero record with all the appropriate publication metadata.
    Hope this extra info is relevant and useful.
  • D530327491

    When I loaded PubMed's page, it didn't require a CAPTCHA. But when I tried adding the item to Zotero, what was added was a webpage about solving the CAPTCHA.
  • Leaving aside the mobile app, where I'd expect this to be a bigger issue, I'm not seeing this in the current beta, which has some improvements on that front. If you're having trouble with pubmed, could you test with the beta and see if that makes a difference?
  • Yesterday when I was using Firefox and Zotero desktop on Linux. Right now I'm using Firefox and Zotero desktop on Windows, and couldn't reproduce it after adding more than a dozen items from PubMed via the connector. (As you mentioned, I created the debug ID on Android.) I think I'll have to first reproduce my own issue on Linux first, and then see if on Linux the beta makes a difference.
  • Hm, actually the error in the desktop app is different from the one in the mobile app. While on Android the article on PubMed gets indexed as a Web page about the CAPTCHA, on Linux the article on PubMed gets indexed with the embedded metadata instead of the regular translator:

    D1827818351
  • Indeed, the PubMed translation problem does not seem to occur with beta (10.0.4+03d94060b) and the corresponding connector
Sign In or Register to comment.