[zotero 7] Author information for sciencedirect articles is not available

novwyz
[zotero 7]
[sciencedirect]
Add documents from the sciencedirect web page, there is no author information in zotero. In addition, the verification pop-up window for downloading pdf from sciencedirect also disappeared.
https://s3.amazonaws.com/zotero.org/images/forums/u9231179/1xly2u4j0emwsnlpv37x.png
https://s3.amazonaws.com/zotero.org/images/forums/u9231179/fkljxmycmet5x8qei5ud.png
  • dstillman
    edited July 25, 2024
    The verification popup (CAPTCHA) is only for PDF downloads. It doesn't apply here.

    But you likely are being blocked/rate-limited by Elsevier, just for the metadata in this case.

    Have you been trying to save a large number of items? This could also be due to your geographical location, or some combination of the two.

    Can you provide a Debug ID for reloading the page and reproducing this?
  • novwyz
    Debug ID: D2039736991
    A phenomenon worthy of attention is that the same problem occurs in edge and chrome browsers, but it is normal in firefox and there is no problem.
  • dstillman
    Sorry, in this case we need a Debug ID from the Zotero Connector, not from Zotero.
  • novwyz
    edited July 25, 2024
    ID: 756663504

    [JavaScript Error: "Error: HTTP request to https://www.sciencedirect.com/sdfe/arp/cite?pii=S0957417423029378&format=application/x-research-info-systems&withabstract=true rejected with status 403
    at chrome-extension://ekhagklcjbdpajgpjgmbionohlpdbjgc/messaging_inject.js:79:17
    at async request (chrome-extension://ekhagklcjbdpajgpjgmbionohlpdbjgc/http.js:91:12)
    at async Object.HTTP.request (chrome-extension://ekhagklcjbdpajgpjgmbionohlpdbjgc/messagingGeneric.js:114:16)
    at async chrome-extension://ekhagklcjbdpajgpjgmbionohlpdbjgc/messagingGeneric.js:141:62" {file: "[object Object]"}]
    https://s3.amazonaws.com/zotero.org/images/forums/u9231179/3z8qgh3b9v49w8mgpdw3.png
  • novwyz
    edited July 25, 2024
    [debug output removed — D.S.]
  • dstillman
    edited July 25, 2024
    We only ever want a Debug IDs, not raw output.

    But yes, the metadata request is getting blocked by ScienceDirect.

    You didn't answer my question: have you been trying to save a large number of items? If you have, it could easily work (for a while) in a new browser where you haven't done so, or just in a browser where you've accessed a different array of sites.
  • novwyz
    I only saved 5 documents (using edge browser), and the chrome browser was newly installed today.
    The equally commonly used Firefox browser does not have this problem.
  • dstillman
    What happens if you just click on the above link on this page?

    You can try clearing cookies and/or trying from a different network. You're being blocked by ScienceDirect's anti-bot protection. Unless you're saving multiple items via Zotero, in which case the rate of requests could be an issue, this is unfortunately out of our control.
  • novwyz
    thx
  • dstillman
    You didn't answer my question, though. What happens if you click the above link? Does Zotero offer to import the file, or do you get an error (or CAPTCHA) from ScienceDirect?
  • novwyz
    edited July 25, 2024
    Hello,When the above link is opened, the "Are You A Robot?" page will be displayed, and the RIS file will be downloaded after verification.

    I asked many colleagues and it seems that the school’s IP address is restricted. When I connect to the mobile hotspot, it's completely normal.
  • novwyz
    edited July 25, 2024
    When the above link is opened, the "Are You A Robot?" page will be displayed, and the RIS file will be downloaded after verification.
    https://s3.amazonaws.com/zotero.org/images/forums/u9231179/lcsa5tx77iaq2hmuuxqo.png
  • dstillman
    Right, it's just the same thing I say above — ScienceDirect's anti-bot protections. You can see whether after trying to download a RIS file manually and completing the CAPTCHA you're able to continue using Zotero for a while.

    If your school has a single outgoing IP address, that could certainly result in erroneous blocking. Or their systems may just allow a much lower rate limit from your geographical location.
  • novwyz
    After I verified and downloaded ris, other documents still cannot be used. This should be due to the IP.
  • dstillman
    If you go to Cite → "Export citation to RIS" on the ScienceDirect page, do you get a CAPTCHA ("Are You A Robot?") each time? Or does it start working for a while after you do it once?
  • novwyz
    No, CAPTCHA appears when opening sciencedirect. When clicking "Export citation to RIS", the CAPTCHA will not appear and RIS can be downloaded.
    It can work for a period of time after verification once.
  • dstillman
    But you're seeing the CAPTCHA occasionally just when browsing ScienceDirect when not using Zotero at all?
  • novwyz
    yea
  • dstillman
    OK, thanks.
  • wassmer
    The pdf for open access papers eventually downloads after 2-5 minutes but the author information is missing. This only happens on ScienceDirect - and for a long time. I suspect that Elsevier wants to discourage Zotero users and push their Mendeley tool. Not cool!
  • dstillman
    @wassmer: Can you explain exactly what you're doing and what's happening, and include a screenshot?
  • wassmer
    Same thing as anybody else posting about the Zotero ScienceDirect issue. I use the Zotero Connector to save to the Zotero directory of my choice, the antibot popup appears, I click the checkbox and it goes to metadata because there is an "issue with the ScienceDirect plugin". After a long time (up to 5 minutes), it captures all the info, including the PDF (for open access), but no authors. This is the same for Chrome, Opera, and Edge. In Firefox, it also takes long, but if I select to use the Sciencedirect plugin the author information is retrieved.
  • rnicrosoft
    edited 14 days ago
    @dstillman

    Similar issue for me with the latest Zotero 7.0.10-beta.1+913c50073 (64-bit)
    Here is the Debug ID: 893803345 just now.

    Actually this behavior has lasted for a long time, at least from the mid of this year.
  • AbeJellinek
    @rnicrosoft: I'd recommend trying again via a VPN or a different network, if you have access to one; it could be that ScienceDirect is rejecting requests from your IP for some reason.

    I think every report we've gotten of ScienceDirect returning that error (403) for metadata requests is from users with Chinese IPs, for what it's worth.

    (That's a Report ID, not a Debug ID, but I don't think we really need a Debug ID in this case.)
Sign In or Register to comment.