New Wiley format

bp_216
Hi,

Wiley seems to have just changed the format of its website, and Zotero does not now recognise papers as such, e.g.

http://onlinelibrary.wiley.com/doi/10.1111/j.1746-692X.2009.00144.x/abstract
http://onlinelibrary.wiley.com/doi/10.1111/j.1469-1795.2010.00381.x/abstract

I'd be very grateful if someone could update the site translators to be able to deal with these (including grabbing the PDF).

Cheers,

Ben
  • humuhumu
    Definitely would like to confirm this error. In the corner of the URL box where it normally shows a piece of paper (when you can save the paper), it only shows the folder (where you can't save the paper). Right now the only way is to manually save the PDF, then add it to your library, then retrieve the metadata.

    Thanks!
  • bp_216
    Bump.

    Please can someone have a look at this. Wiley is a massive publisher so this must be affecting people using a lot of different journals. Instead of the "paper" icon, as humuhumu says, I get a folder icon. Clicking on this saves the reference, but it no longer grabs the PDF.

    Firefox 3.6.8, Zotero 2.0.3

    Thanks!

    Ben
  • ajlyon
    Apparently publishers like to change their sites right as the academic year starts. I will not be working on this today or even tomorrow, but I'll try to take a look in the next week or so.

    The help of other interested developers would be, of course, appreciated.

    You are also encouraged to contact your Wiley and mention that they are welcome to contribute a translator and make their site more useful for the millions of Zotero users. WilsonWeb has recently contributed a translator for their own site; perhaps they can be a good example for other publishers.
  • bp_216
    @ajlyon

    Thanks for offering to help.
    I will also contact Wiley as you suggest.

    All the best,
    Ben
  • dstillman
    edited August 24, 2010
    FWIW, Wiley contacted us via private e-mail. I believe Sean directed them to the dev list, but I don't believe they followed up there (and I don't know if they'd be willing to contribute their own translator).

    Here was the original e-mail:
    I’m contacting you to check you’re aware that Wiley’s InterScience site is being replaced on 7-8 August 2010 by onlinelibrary.wiley.com. All our URLs will be changing, although of course DOIs will still work and URLs for HTML pages will be redirected from the old site. All access rights, licenses and IP ranges will be transferred from Wiley InterScience to Wiley Online Library.

    Please note that the new Wiley Online Library site uses a secure PDF URL format. The URL for a PDF is different for each user session, so our PDFs will not have unique paths that your service can easily pick up.

    There’s an information page at http://info.onlinelibrary.wiley.com. Further information on Wiley Online Library’s OpenURL Interface and DOI Interface, as well as URL syntax is available on our information site: http://info.onlinelibrary.wiley.com/view/0/Technical.html
  • bp_216
    Thanks Dan,

    I will contact them to let them know that I don't think that's good enough. Other publishers are capable of making their systems work with Zotero, why do Wiley have to be different?

    Cheers,
    Ben
  • ajlyon
    Thanks for posting that email. I'm glad to know that they at least tried to provide some warning.

    It looks like I started working on a new version of the translator two weeks ago. I'll get back to it when I can; I don't remember why it wasn't working at that time.
  • dstillman
    Other publishers are capable of making their systems work with Zotero, why do Wiley have to be different?
    Well, to be clear, site changes often break Zotero translators, so this isn't something unique to Wiley—and it's great that they contacted us (even if doing so via private e-mail isn't really helpful). The cases where translators don't break on site changes are when there's a well-documented API (such as on Amazon, which almost never breaks) or where the site provides high-quality embedded metadata.

    But short of that, it'd be great if publishers such as Wiley would maintain their own site translators.
  • ajlyon
    Ben,

    Keep in mind that in fact almost no commercial publishers have actively made their sites work with Zotero. WilsonWeb just submitted a translator 1-2 weeks ago-- and they are the first such submission I know of.

    The fact that many other sites work with Zotero is a combination of those sites choosing easily parsed layouts for their sites, and (more vitally) hundreds of hours of developer time by dozens of volunteers and Zotero staff.

    So don't take too stern a tone with Wiley if you do write to them -- they're far from an exception here.
  • chad.davis
    Thank you for pointing out that this only seems to effect the PDF auto-download. It's not as broken as it seemed. Meta-data extraction seems to working fine still. It's only a slight inconvenience to download the PDF as an extra step, but having to manually enter the meta-data would have been a show-stopper.
  • syregnask
    As noted elsewhere I would like to add that since the change of site structure at Wiley, I have also had these additional problems:
    - page numbers often missing in saved citation
    - journal abbreviation sometimes correct, but sometimes full journal name instead
  • JonEP
    Not sure what the status of this is, but I am having problems with Wiley -- there's no zotero icon in the address bar, and when I use "export citation" (Wiley's button), I'm asked if I'd like to save the file or open it, etc., by Mozilla.
  • hansi linderoth
    Just like to second the above question. Wiley's is a huge and important publisher; is their interface simply impossible to read for Zotero or is a translator in the pipeline?
  • ajlyon
    This isn't impossible; it isn't even that hard. This hasn't been done simply because I haven't gotten to it, and I'm currently the only person actively working on translators. I'm a volunteer, and I often try to focus on my own research and work.

    The needed metadata is all in the document header in Google's de facto standard format for citation metadata, so maybe this will happen soon. Alternatively, you could engage a developer yourself to do the job -- it wouldn't be hard.
  • ajlyon
    I took my advice and built this little translator that does most of what you need.

    It doesn't yet do search results or tables of contents, but I think it should work well enough for those of you who are desperate. I will also extend it to cover other item types in Wiley -- books, manuals, datasets.

    Please go to http://github.com/ajlyon/zotero-bits/raw/master/Wiley InterScience.js and save the file to the translators directory of your Zotero data directory (http://www.zotero.org/support/zotero_data).

    Feedback is very much encouraged. I'm using a different metadata source than usual, so let me know if it is faulty. Also, PDF and HTML full-text should work, but I couldn't confirm that for myself.
  • lucas
    Thanks very much ajlyon! This works for me in Firefox, although it does not seem to pick up PDF's.

    Note, also, that it doesn't seem to be working in Chrome. I don't get a Zotero icon, and I get these error messages in the Chrome console:

    Failed to load resource: the server responded with a status of 503 (Service Unavailable) detect

    Uncaught ReferenceError: zoteroOnFailure is not defined global_common.js:117

    req.onreadystatechange global_common.js:117

    (This is on Chrome 9.0.597.84 with OS X 10.6.6)
  • grubs
    edited March 6, 2011
    How to add this to standalone?

    I downloaded http://github.com/ajlyon/zotero-bits/raw/master/Wiley%20InterScience.js and saved it inside the translators.zip (as 310.js) in the Zotero standalone directory and updated translators.index by hand by reading the info a the top of the .js and added "310.js,fe728bc9-595a-4f03-98fc-766f1d8d0936,Wiley Online Library,2009-08-03 01:25:00"

    Is there a translator import function somewhere that I cant seem to locate? (yes I googled)

    anyway - after my manual install and restarting standalone and chrome I didnt get the import icon visiting http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2427.2010.02508.x/abstract

    perhaps my installation kludge is at fault?
  • ajlyon
    Modifying translators.zip will do nothing.

    Go to http://github.com/ajlyon/zotero-bits/raw/master/Wiley InterScience.js and save the file to the translators directory of your Zotero data directory (http://www.zotero.org/support/zotero_data).

    I'll see about polishing this translator and getting it to all clients soon -- it had fallen through the cracks in its unfinished state.
  • grubs
    Doh! Sorry - I found the translators directory in the *data* directory. I was looking in the program directory and when I couldnt find it I assumed the standalone was somehow different. *facepalm*
  • ajlyon
    Please go to http://github.com/ajlyon/zotero-bits/raw/master/Wiley Online Library.js and save the file to the translators directory of your Zotero data directory (http://www.zotero.org/support/zotero_data).

    This now supports multiple item saves, and whatnot. Please test, so we can get this out to all users.
  • mjversluis
    Thanks for the update. Saving article information from Wiley works smoothly now. However no PDF's are being stored. Is there something that I am doing wrong, or is this simply impossible with the updated Wiley site?
  • adamsmith
    no pdfs from Wiley, no - that's not currently possible due to the way they are embedded.
  • ajlyon
    There's now a version of Wiley that should support PDFs -- please go to http://github.com/ajlyon/translators/raw/master/Wiley Online Library.js and save the file to the translators directory of your Zotero data directory (http://www.zotero.org/support/zotero_data).

    It should start working. If this works for you, please post here.
  • masiewert
    Great, works for me!
Sign In or Register to comment.