Hit a Cloudflare wall for APS when saving to Zotero via Extension
Description: I recently started to hit the Cloudflare wall when adding APS papers to Zotero using the Edge Extension. The Extension prompts:
An error occurred while saving this item. See Troubleshooting Translator Issues for more information.
The error message of the extension says:
[JavaScript Error: "HTTP GET https://journals.aps.org/prb/export/10.1103/PhysRevB.41.1863?type=ris&download=true failed with status code 403" {file: "chrome-extension://nmhdhpibnnopknkmonacoephklnflpho/zotero.js" line: 282}]
This should indicate that the RIS fetch failed. I have verified that the RIS URL is correct, by visiting the URL directly in the browser and the .ris file is correctly downloaded. So I further run the following command in the powershell:
Invoke-WebRequest "https://journals.aps.org/prb/export/10.1103/PhysRevB.36.3608?type=ris&download=true" -OutFile test_ref.ris
Invoke-WebRequest: Just a moment...*{box-sizing:border-box;margin:0;padding:0}html{line-height:1.15;-webkit-text-size-adjust:100%;color:#313131;font-family:system-ui,-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,"Helvetica Neue",Arial,"Noto Sans",sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol","Noto Color Emoji"}body{display:flex;flex-direction:column;height:100vh;min-height:100vh}.main-content{margin:8rem auto;padding-left:1.5rem;max-width:60rem}@media (width Enable JavaScript and cookies to continue(function()
This returns the Cloudflare wall. I presume this is the reason for the failure of HTTP GET.
This problem occurs only for APS journal papers. Other journals, like Nature or Science etc. work perfectly fine.
Anybody has any ideas on how to resolve this?
Zotero version: 7.0.24 (64-bit)
Edge extension version: 5.0.183
An error occurred while saving this item. See Troubleshooting Translator Issues for more information.
The error message of the extension says:
[JavaScript Error: "HTTP GET https://journals.aps.org/prb/export/10.1103/PhysRevB.41.1863?type=ris&download=true failed with status code 403" {file: "chrome-extension://nmhdhpibnnopknkmonacoephklnflpho/zotero.js" line: 282}]
This should indicate that the RIS fetch failed. I have verified that the RIS URL is correct, by visiting the URL directly in the browser and the .ris file is correctly downloaded. So I further run the following command in the powershell:
Invoke-WebRequest "https://journals.aps.org/prb/export/10.1103/PhysRevB.36.3608?type=ris&download=true" -OutFile test_ref.ris
Invoke-WebRequest: Just a moment...*{box-sizing:border-box;margin:0;padding:0}html{line-height:1.15;-webkit-text-size-adjust:100%;color:#313131;font-family:system-ui,-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,"Helvetica Neue",Arial,"Noto Sans",sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol","Noto Color Emoji"}body{display:flex;flex-direction:column;height:100vh;min-height:100vh}.main-content{margin:8rem auto;padding-left:1.5rem;max-width:60rem}@media (width Enable JavaScript and cookies to continue(function()
This returns the Cloudflare wall. I presume this is the reason for the failure of HTTP GET.
This problem occurs only for APS journal papers. Other journals, like Nature or Science etc. work perfectly fine.
Anybody has any ideas on how to resolve this?
Zotero version: 7.0.24 (64-bit)
Edge extension version: 5.0.183
-
adomasvenIf you pass the cloudflare check in Edge by manually navigating to the ris file, do saves from Zotero Connector still continue to fail? Zotero Connector uses the authentication of your browser to fetch resources, so if your browser is not blocked, it should generally succeed.
-
chxzhedited yesterday at 7:26pm@adomasven, thanks for your comment. But the situation is that, the browser has passed the cloudflare wall. APS webpage and pdf download are perfectly fine. However, zotero connector still hits the cloudflare wall again.