BUG - Connector does not try to download pdf attachement

LiborA · June 21, 2017

Debug ID D1715452090

I've found a few interesting articles for me. I've opened all in individual tabs in Chrome. I've imported the first to the Zotero correctly including a pdf attachment. The second was imported without attachment - I've seen the red cross. All other articles were imported without attachments, but the connector does not report any errors (red cross) and I have to download it manually - in some cases, I can download them through the connector but in some cases, I can't (second debug ID D22079952)

adomasven · June 21, 2017

Could provide Debug IDs from Zotero Standalone and corresponding URLs?

LiborA · June 21, 2017

the Debug ID from Zotero Standalone is D1354493331 and URL for tested article is http://www.sciencedirect.com.ezproxy.techlib.cz/science/article/pii/S0022169415001249

adomasven · June 21, 2017

In general, ScienceDirect has been a bit of a moving target for translator folks lately. The translator doesn't even have a PDF for this item for me, so it is not unreasonable to assume that Elsevier is A/B testing and serving different sites to different people.

Your Debug Log from Zotero also includes the line
Translate: Not adding attachment: automatic snapshots are disabled
which I guess you are aware of. This option should not affect PDF saving, but something to be aware of.

raffam · June 21, 2017

I confirm that, with the article, posted by LiborA, the connector does not download the PDF file, although I am able to download it manually

LiborA · June 21, 2017

I've disabled snapshots due to conflicts with our institutional rules for LAN drive, which I am using for backup - I got very often error message from real time backup by upload on our LAN drive. So I disable snapshots. Any suggestion?

adomasven · June 21, 2017

I mean, ScienceDirect translators need updating, so that's not a Connector bug. You shouldn't be getting the failed saving cross either -- just no pdf attachments in general.

If you can provide URLs and Debug IDs from pages that fail, we can take a look.

LiborA · June 21, 2017

A am not sure but it can be solved by add the code:
if (!pdfLink) {

		pdfLink = ZU.xpathText(doc, '//div[@class="PdfDownloadButton"]//a[@class="pdf-download-btn-link" and (@title="Download PDF")]/@href');

}
to the function GetPDFlink in ScienceDirect.js

zuphilip · June 21, 2017

Okay, I can try to extend the Science Direct translator to make sure that the PDF will be attached.

zuphilip · June 21, 2017

A translator fix is now up.

LiborA · June 22, 2017

it works, thanks

hhng · July 7, 2017

is there a specific way to update the translator? I did a manual update in Preferences -->General tab --> Miscellaneous section --> "Update Now" and also in the Zotero Chrome plugin. ScienceDirect still does not download PDFs automatically

I am on Windows 7 (x64), Standalone v 4.0.29.17
-------------------------------
connector => true, version => 5.0.5, platform => Win32, locale => en-US, userAgent => Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36, appName => Chrome Connector, zoteroAvailable => true

raffam · July 17, 2017

It seems like the problem re-appeared

Example link: http://www.sciencedirect.com/science/article/pii/S0378426608002690

The problem seems to happen when, clicking on the "Download PDF" button, you are not re-directed to the PDF but instead a drop-down menu appears, which ask you if you want to download the article or article+other articles in this issue

Zotero does not try to download the PDF at all (so there is no red cross, and no pdf file)

adamsmith · July 20, 2017

we're aware of this & looking for a solution -- unfortunately as you can tell, ScienceDirect present a rather fast-moving target.

adamsmith · July 21, 2017

I'm afraid this is going to be a bit trickier than before. @zuphilip if you can take a look and see if you can figure out how to get the PDF link? I'm having no luck with this.

zuphilip · July 21, 2017

Wow, this seems to be really tricky now. The first link seems to open some strange intermediate page, where it looks for me that some flash object is loaded and maybe hiding some important access data, which is needed to open the final url. If I go to the PDF for the same article just some seconds later, then the pdf url will change. I don't see currently how to receive the final parameters for the url with the pdf.

HThole · July 21, 2017

Someone should correct the Title of this Post - it is not a Zotero or Connector problem, but a false game by Elsevier.

I'm shocked that Elsevier even hinders the legal download of PDFs with tools like Zotero inbetween, as it seems to be here! Where will this end?

Rintze · July 28, 2017

@dstillman, would this perhaps warrant some 'brand engagement' between the Zotero and ScienceDirect (https://twitter.com/sciencedirect) twitter accounts, to draw some attention to this issue and to ask what's up with this?

Or does anybody here have a good personal contact at ScienceDirect/Elsevier?

dstillman · July 28, 2017

I have a fix: https://github.com/zotero/translators/pull/1381

praveens1 · August 1, 2017

MOst of the pdf are able to download now from science direct (with article +).
So a fix has been applied?

http://www.sciencedirect.com/science/article/pii/S0022435912000759?_rdoc=1&_fmt=high&_origin=gateway&_docanchor=&md5=b8429449ccfc9c30159a5f9aeaa92ffb

dstillman · August 3, 2017

Yes, this fix has been rolled out. If you're still having trouble on a particular ScienceDirect page (but not all pages), let us know — the site is very inconsistent, so it's hard to know if we've gotten fixed this for all permutations.

praveens1 · August 7, 2017

Hi
I noticed that zotero is not able to get pdf from JSTOR.
Example, http://www.jstor.org/stable/40398993?Search=yes&resultItemClick=true&searchText=co-creation&searchUri=/action/doBasicSearch?Query=co-creation&refreqid=search:b40a9aaf5f7954d4dbb6a796973f2a20&seq=1#page_scan_tab_contents

Can you please help.

Thanks
Praveen

praveens1 · August 7, 2017

Sorry.
Got this solution.
https://forums.zotero.org/discussion/66623/jstor-pdfs/p1

Thanks

Isabelle Perez · August 31, 2017

Hi,
I have Firefox 54.0.1 (32 bits) and Zotero 5.0.17

I can't download automatically the pdf file from Science Direct.

Zotero try to download the pdf file but there is a red cross and the pdf isn't recovered in Zotero (only the reference but not the pdf)

http://www.sciencedirect.com/science/article/pii/S0378426608002690

Could you help me ?
Thank you