ProCite to Zotero Conversion: Translator, RIS, and Testing

1235
  • edited April 16, 2012
    SER stands for serial (though I guess ProCite uses it for manuscript). Zotero doesn't have a way to represent a serial publication in and of its, so I think book is a decent mapping. What is the Workform for these records in ProCite?
    Manuscript is the workform in ProCite. A lot of times it refers to an unpublished manuscript of some kind, or in some instances a report or a document published online (like a paper in pdf format). The most common use is for unpublished manuscripts that might have been given to the person for review.

    For Manuscripts, it is also important to preserve the availability field, as sometimes manuscripts refer to papers or collections in archives. Or they might just be hard to find, and need that field to help the user locate them, since they were not published in a normal way.

    Should I change SER to something else in the RIS-Endnote file?
    "As I mentioned previously, there is some functionality missing in Zotero with reports. There is no "Editor" only "Series Editor", which makes the "creator" field in the list view look blank, because series editor is not listed there.

    Therefore this isn't so much an error, as something that doesn't fit... but Author Role is not mapping correctly. Presumably because there is no editor, only series editor. I do think that this is something Zotero overall should change though, if possible. What do you think? Otherwise, at worst, the Author role field should be copied to notes in this case to let the user know that these authors are really editors.."

    I'm not an expert on reports, but perhaps there's a good reason there is no editor. I would post this in a new thread and someone with better knowledge of how this is handled will hopefully answer you.
    I tried that but haven't had a response. http://forums.zotero.org/discussion/22740/in-report-a-series-editor-not-displayed-in-creator-field-in-list-view/#Item_1
    In the meantime, what would be the better stop-gap measure?

    I do think that reports will have normal editors fairly frequently. Not all reports are made in series, i.e. a one time archaeological site report for a specific dig.
    "Conference Proceedings seems to have some serious problems mapping"
    "Are you referring here to the same problems as above?"

    "I think the consensus right now is that date and place represent publication information. See http://forums.zotero.org/discussion/22911/conference-paper-date-and-place/#Comment_122944 I will make sure that these fields are placed in the notes."
    Yes basically, place of meeting not mapping etc. Thanks for making sure they go in notes. Adam said in the other thread that those changes are "covered in the list of field changes/updates for the next Zotero version." So we can assume this will be available as a feature sooner or later?

    "It looks like these kinds of "book long form" entries would be better off being imported as chapters? Should I actually change CHAP to BOOK?

    is there anything to help us get around which are actually books vs. which are chapters/articles within books within series?"

    I'm going to try and make the translator figure out if book or chapter is more appropriate. Don't hold your breath though. The problem is that I need to make sure this doesn't break anything with regular RIS files that have not been exported from ProCite.
    So where did we land on this issue? Should I change the BOOK back to CHAP? Or wait for an update?

    Thanks for all of your help.

    I am trying to get a semi-clean version together so we can start using it asap. :)
  • Conference Proceeding:

    Date of Meeting: if there is no other publication date given for the proceedings, the date of meeting should fill the date field. It should definitely go into comments, as I am looking at another record where it is totally missing.
  • Should I change SER to something else in the RIS-Endnote file?
    RIS specification defines "TY - MANSCPT" for manuscripts. You may change that in the output style.
    I tried that but haven't had a response. http://forums.zotero.org/discussion/22740/in-report-a-series-editor-not-displayed-in-creator-field-in-list-view/#Item_1
    In the meantime, what would be the better stop-gap measure?

    I do think that reports will have normal editors fairly frequently. Not all reports are made in series, i.e. a one time archaeological site report for a specific dig.
    I don't think your post coneys the message I was getting at. I replied to your post in that thread, but what I was suggesting you post about is adding an Editor role to report in addition to Series Editor.

    I'm not sure it will solve your problem, however.
    Yes basically, place of meeting not mapping etc. Thanks for making sure they go in notes. Adam said in the other thread that those changes are "covered in the list of field changes/updates for the next Zotero version." So we can assume this will be available as a feature sooner or later?
    Yes
    So where did we land on this issue? Should I change the BOOK back to CHAP? Or wait for an update?
    In retrospect, one should use a single workform for a single item type (contrary to ProCite's frequent indications otherwise). But now that the work is done and you have two types of items cited as "Book Long Form", I don't think changing the style is a good idea for you, since you will be mistyping one or the other.

    You could change the workform for either chapters or books to a more appropriate type and re-export.

    I will be able to fiddle around with the code later today, so perhaps you may want to wait for an update.
  • edited April 16, 2012
    I changed SER to MANSCRPT and re-exported those citations.

    Error:
    "Collection Title (9):" not going into notes or elsewhere.

    both screens together below:
    http://dl.dropbox.com/u/19141190/error_colltitle_manscrpt.png

    TY - MANSCPT
    N1 - Record Number: 6073
    A1 - Mulhare, Eileen M.
    T1 - Barrios
    T3 - The Oxford Encyclopedia of Mesoamerican Cultures
    PY - 1998
    N1 - Notes: have
    KW - mesoamerica
    KW - settlement patterns
    ER -

    EDIT: this error re-appears in other manuscript entries.
  • Issue ID is uncommon in Book Section/Chapter type, but it does appear in Procite. While there is no field for issue in Book Section in Zotero, could you please preserve this field in the notes section?

    I would also suggest it as a change in general for Zotero in the future..

    example record:

    TY - CHAP
    N1 - 15453
    A1 - Bruun, Ole
    A1 - Narangoa, Li
    T2 - A New Moment in Mongol History: The Rise of the Cosmopolitan City
    N1 - Connective Phrase: in
    A2 - Bruun, Ole
    A2 - Narangoa, Li
    N1 - Author Role: eds.
    T2 - Mongols: From Country to City Floating Boundaries, Pastoralism and
    City Life in the Mongol Lands
    RP - In File
    PB - NIAS press
    PY - 2006
    N1 - Issue ID: 34
    N1 - Series Title: Studies in Asian Topics
    N2 - The radical changes in the general circumstances of life and the shift from
    a rural to a~ urban orientation in a nation of previously, and still partly,
    pastoral people in Central Asia make up the theme of this book. From
    mainly historical and anthropological perspectives it examines the complex relationship
    between rural and urban Mongol people, settlements and identities,
    generated over the last century.
    Few other nations have experienced changes as rapid and radical as the Mongols:
    from littLesedentary life in 1900 to cosmopolitan city life in the 2000s; from
    scattered settlements to intense urbanization and demographic concentration;
    from nomadic pastoralism to Chinese and Soviet plan economics to market
    liberalism; from Buddhist monastic learning to modern education; and from
    imperial domination to separate autonomous and independent polities. During
    the same period Mongols experienced a series of political revolutions: the overthrow
    of Manchu rule in 1911, the Communist revolution of 1921 in Outer
    Mongolia, the Communist revolution of 1949 in Inner Mongolia, the Chinese
    Cultural Revolution of 1966, the Chinese shift to market socialism, the break-up
    of the Soviet Union and the political shift to democracy and private ownership
    at the establishment of the Mongolian republic in 1990.
    Even so, the short intervals between revolutions apparently brought more
    significant changes than the revolutions themselves. The anti-Buddhist purges
    of the 1930s and the collectivization drives of the 1950s to 1970s both changed
    the texture of society, while the shifting international alliances in the same period
    dramatically changed the political power balance in the region. Above all, living
    spaces, material circumstances of lifeand social structures have been revolutionized
    within the span of a few generations. The entire Mongol lands have seen exceptional
    changes within a single century, demanding creative cultural and political responses
    as well as new economic strategies on the part of its inhabitants.
    KW - Mongolia
    KW - pastoralism
    KW - political organization
    ER -
  • edited April 17, 2012
    Series Editor goes in as contributor in Book Chapter/Section in Zotero.

    See record in Procite:
    http://dl.dropbox.com/u/19141190/error_booksection_serieseditor_ascontrib.png

    TY - CHAP
    N1 - 11833
    A1 - Fitzhugh, William W.
    T2 - Arctic and Circumpolar Regions
    RP - In File
    CY - New York
    PB - Elsevier
    PY - 2008
    N1 - Volume ID: 1
    SP - 247-271
    A3 - Deborah M. Pearsall
    N1 - Series Title: Encylopedia of Archaeology
    KW - archaeology
    KW - ethnoarchaeology
    KW - North America
    ER -

    EDIT:
    another example of the same problem, series editor going in as contributor in zotero.

    TY - CHAP
    N1 - 12153
    A1 - Smith, Michael E.
    T2 - Aztec City-States
    T2 - A Comparative Study of Thirty City-State Cultures: An Investigation Conducted by the Copenhagen Polis Centre
    CY - Copenhagen, Denmark
    PB - The Royal Danish Academy of Sciences and Letters
    SP - 581-595
    A3 - Hansen, Mogens Herman
    KW - history
    KW - social organization
    ER -

    EDIT 2:

    I thought it might be happening because there is no series title in some of them, but this entry disproves that. Also all series editors are made contributors. See side by side Procite vs Zotero Screenshot:
    http://dl.dropbox.com/u/19141190/error_booksection_serieseditor_ascontrib_more.png

    TY - CHAP
    N1 - 16733
    A1 - Pines, Yuri
    T2 - Beasts or Humans: Pre-Imperial Origins of the "Sino-Barbarian" Dichotomy
    A2 - Amitai, Reuven
    A2 - Biran, Michal
    N1 - Author Role: Editors
    T2 - Mongols, Turks, and Others: Eurasian Monads and the Sedentary World
    CY - Boston
    PB - Brill
    PY - 2005
    SP - 59-102
    A3 - Di Cosmo, Nicola
    A3 - Deweese, Devin
    A3 - Humphrey, Caroline

    N1 - Series Title: Brill's Inner Asian Library
    N1 - Series Volume ID: 11
    KW - Asia
    KW - China
    KW - culture change
    KW - culture contact
    KW - Mongolia
    KW - empire
    KW - ethnohistory
    ER -

    Edit 4:

    This time series editors went in as authors,even though they had an additional author role, editors listed.

    screenshot:
    http://dl.dropbox.com/u/19141190/error_booksec_seriesed_inzotas_author.png

    TY - CHAP
    N1 - 17363
    A1 - Drompp, Michael R.
    T2 - The Uighur-Chinese Conflict of 840-848
    N1 - Connective Phrase: In
    A2 - Di Cosmo, Nicola
    N1 - Author Role: Editor
    T2 - Warfare in Inner Asian History (500-1800)
    CY - Boston
    PB - Brill
    PY - 2002
    N1 - Volume ID: 6
    SP - 73-103
    A3 - Sinor, Denis
    A3 - Di Cosmo, Nicola
    N1 - Series Editor Role: Editors

    N1 - Series Title: Handbook of Oriental Studies
    N1 - Series Volume ID: Section 8- Central Asia
    KW - Asia
    KW - China
    KW - culture contact
    KW - war
    ER -
  • also for Book Section/ Chapter

    Author Monographic (7): in procite is going in as contributor in book section in zotero, when it should be "Book Author"

    Here is the Procite view: http://dl.dropbox.com/u/19141190/error_booksec_authormono_inzotas_contrib.png

    It looks like the output is not very clear, compared to the clear designation that she is the book author in procite..:

    TY - CHAP
    N1 - 20093
    A1 - Lawson, Barbara
    T2 - Artifact Collecting and Anthropology
    N1 - Connective Phrase: In
    A2 - Lawson, Barbara
    T2 - Collected Curios: Missionary Tales from the South Seas
    CY - Montreal
    PB - McGill University
    PY - 1994
    SP - 1-20
    KW - material change
    KW - museum studies
    ER -
  • I have added additional examples to author as contributor and editor as contributor issues above...
  • I am testing the last few workforms right now, but here is what I have as an error log. It is complete for the past few days as far as I can tell, though I didn't go back and look at all the posts.

    Hope this helps. I uploaded the document, since it was formatted, and pasting it here made it not easy to read.

    Summary Bug Log by Workform:
    http://dl.dropbox.com/u/19141190/Summary Bug Log by Workform April 17.doc
  • Can we also please make sure that connective phrase transfers into notes for dissertations? Obviously poor data entry on someone's part, but there are occasionally important fields there in this database.

    TY - THES
    N1 - Record Number: 13603
    A1 - Fernández-Giménez, Maria E.
    T1 - Landscapes, Livestock, and Livelihoods: Social, Ecological, and Land-Use Change among the Nomadic Pastoralists of Mongolia
    RP - In File
    N1 - Place of Publication: Berkeley
    PB - University of California, Berkeley
    PY - 1997
    N1 - Connective Phrase: Ph.D. dissertation, Wildlife Resource Science
    N1 - Notes: Seen.
    KW - pastoralism
    KW - ecology
    KW - environment
    KW - Mongolia
    KW - rangeland
    ER -
  • Sorry for the delay. This was actually a bit more tricky than I expected.

    The updated translator is at https://raw.github.com/aurimasv/translators/RIS-maevepotter/RIS-ProCite.js

    Note that this is now a separate translator from the main RIS translator, so make sure to save that file as "RIS-ProCite.js" It will work along-side the original RIS translator and updates will not overwrite it.

    That particular file is sort of a custom version for you, which preserves Record ID and Record Number. Those fields would be dropped in the public translator.

    So I think I addressed most of the concerns above except for a few:

    There's no reliable way to figure out if the record is supposed to be a book or a chapter if it is marked as CHAP. If you can figure out some algorithm let me know. The biggest problem is that sometimes T2 is actually meant as T1 and so on. Basically, you will have to figure out which one is which manually before importing.

    AV is not stored in Archive, but it is not dropped now either.

    There is no field in Zotero for Series Issue ID as you point out, so this is not handled. Stored in notes.

    Some highlights of the improvements:

    Fields are not dropped, but are stored in notes instead. Items that have these automatic notes attached are now marked with a tag that informs the user to enter this data manually.

    Creator roles should now be handled better.

    Some date handling improvements.
  • Thanks Aurimas!

    I am noticing there is still a problem in the manuscript records with transferring author role to editor. Is that a quick fix? Author role did go into notes..

    TY - MANSCPT
    N1 - Record Number: 2400
    A1 - Bender, Barbara
    A1 - Gledhill, J.
    A1 - Larsen, M.
    N1 - Author Role: editors
    T1 - The Roots of Inequality
    N1 - Connective Phrase: In
    T3 - State and Society: The Emergence and Development of Social Hierarchy and Political Centralization
    PY - 1989
    N1 - Notes: In press, Allen and Unwin, London
    KW - cultural evolution
    KW - chiefdoms
    KW - social organization
    KW - archaeological theory
    ER -
  • edited April 23, 2012
    yeah, something might have broken the editor mapping, because when I re-imported some files after the new Procite.js above, some books also failed to have author map to editor, when the author role stated editor or editors. It did work with the same data with only the previous RIS file.

    Edit: however, it looks like the editor mapping never worked for the "Manuscript" type, so that part may just be missing the necessary coding.

    Edit 2: "Report" type also does not map author role: editors into editors on the drop down author tab in Zotero. This happened both pre and post update, so I think it was never there. Thanks!
  • some books also failed to have author map to editor, when the author role stated editor or editors.
    Could you provide an example?
    however, it looks like the editor mapping never worked for the "Manuscript" type, so that part may just be missing the necessary coding.
    Manuscript doesn't have an editor type. The choices are author, contributor, translator. This will likely be addressed in the new Zotero release.
    "Report" type also does not map author role: editors into editors on the drop down author tab in Zotero.
    Same here, though with "report" you have an option of series editor as talked about above.

    My thought on this is to map editors to contributors in both cases and add a note about the proper title. Possibly set a tag that says there's something missing. How does that sound?
  • edited April 23, 2012
    Manuscript doesn't have an editor type. The choices are author, contributor, translator. This will likely be addressed in the new Zotero release.
    Ah yes sorry... so hard to keep which fields have what straight. Sorry about that.
    Same here, though with "report" you have an option of series editor as talked about above.

    My thought on this is to map editors to contributors in both cases and add a note about the proper title. Possibly set a tag that says there's something missing. How does that sound?
    That would probably work if that will help other people. For now, I just went ahead and fixed the reports manually to try and make that role clear, so you can add or not at your discretion. Luckily we only had about 100 or so of those. They were still dropping series titles completely, like the record below:

    TY - RPRT
    N1 - Record Number: 1073
    A1 - Hurt, Wesley R. Jr.
    T1 - Report of the Investigation of the Spotted Bear Site, 39HU26, and the Cottonwood Site, 39HU43, Hughes County, South Dakota, 1953
    CY - Pierre
    PB - South Dakota Archaeological Commission
    PY - 1954
    T3 - Archaeological Studies Circular (was lost)
    N1 - Series Volume ID: 6 (went into notes)
    N1 - Notes: have, seen
    KW - Plains
    KW - Arikara archaeology
    ER -
    some books also failed to have author map to editor, when the author role stated editor or editors.

    Could you provide an example?
    It was an oddball one, in ProCite as Monograph:

    TY - SER
    N1 - Record Number: 16113
    A1 - Behnke, R.
    A1 - Scoones, I.
    A1 - Kerven, C.
    N1 - Author Role: editors
    T1 - Range Ecology at Disequilibrium
    CY - London
    PB - ODI, IIED and Commonwealth Secretariat
    PY - 1993
    N1 - Notes: cited in Sneath 2001
    Notes the importance of mobility and flexibility for East African pastoral systems.
    KW - rangeland
    KW - ecology
    KW - Africa
    KW - pastoralism
    ER -

    There were not too many of these either so I fixed them manually.

    The workforms I am still working on are:

    Book Chapters
    Book Long Form
    Book Short Form
    Manuscripts
    Conference Proceedings: Was the "Date of Meeting" and "Date of Publication" added to notes in the update?
  • Sorry, I think I messed something up with the RIS file. Try updating now.
    Conference Proceedings: Was the "Date of Meeting" and "Date of Publication" added to notes in the update?
    yes, at least now it will be.
  • Problems with Conference Paper type:

    a. proceeding title does not map. goes into notes.


    TY - CONF
    N1 - Record Number: 330
    A1 - Allard, Francis
    T1 - Investigating the Bronze Age of Khanuy Valley, Central Mongolia
    N1 - Connective Phrase: In
    A2 - Hanks, Bryan
    A2 - Linduff, Kathy
    N1 - Proceedings Title: New Research Directions in Eurasian Steppe Archaeology: The Emergence of Complex Societies in the Third to First Millennia BCE
    Y2 - 2006/02/10-2006/02/10
    N1 - Place of Meeting: University of Pittsburgh
    CY - Pittsburgh
    PB - Department of Anthropology & Center for Russian and East European Studies
    PY - 2006
    N1 - Notes: have, seen
    Allard 2006

    1. Herders in the Khanuy valley move their camps 2 to 4 times per year. 1
    2. A few families cultivate vegetables on small plots. 1
    3. Herders in the valley move camp 2 to 4 times per year, “with maximum movements not exceeding 10 km. 6
    4. Russian ethnographer A.D. Simukov identified a mobility pattern he called “Hangai”. Considering the productivity of the region camps did not move far in response to drought. 6
    5. Simukov “estimated the diameter of the annual movement cycle to be no more than 7-8 km.” 6
    6. “Nomadic pastoralism is politically centrifugal, militating against central and hierarchical power… Nomadic mobility, in consequence, has a dampening effect on hierarchy and centralization and on chiefly coercion and oppression…. Chiefships arise in nomadic tribes in confrontation with powerful external populations (Irons 1979). Thus, acephalous, egalitarian, decentralized, nomadic tribes are more likely to be found in remote regions far from centers of power, population, and trade, and nomadic tribal chiefdoms are more likely to be found in proximity to agricultural settlements, cities, state agencies, and major markets” (2004).” 7 [we need to deal with this perspective within the household model]

    KW - Mongolia
    KW - pastoralism
    ER -
  • Yes, same link as above right? Want me to try one more time?
  • Try again, because it imports fine on my end. If it still does not work, we'll try to find what's at fault.
  • Ok will do first thing tomorrow.. out for the night. Have a good evening, Aurimas!
  • Oh now that works! maybe something went wrong when I downloaded it the first time.

    Fancy with the tag! *some fields not mapped* I like it. :)

    Thanks very much Aurimas!

    I am going to try again with the books now, so I'll likely post again soon...
  • edited April 24, 2012
    One suggestion "Document Type (35):" in ProCite's "Manuscript" workform, should map to the "Type" field in Zotero. It currently only goes to notes.

    example:

    TY - MANSCPT
    N1 - Record Number: 2837
    A1 - Bogan, Michael A.
    T1 - Spiro Textile Analysis
    PY - 1977
    N1 - Document Type: Unpublished report
    AV - On file, Department of Anthropology, National Museum of Natural History, Washington, D.C.
    N2 - Report on analysis of Spiro textiles in the NMNH collection
    KW - Spiro
    KW - Oklahoma
    KW - technology
    ER -
  • edited April 24, 2012
    "Collection Title" in Procite's "manuscript" workform are still not transferring to notes. This is a really serious problem, as that helps you find the manuscript. It's odd that Zotero doesn't have a field for this under manuscripts. If you could send this to notes, as well as to the abstract or type field that would be good.

    A manuscript collection needs the title of the specific part in the collection, like "Excavation Records for 39ST1" as well as a collection title, like "River Basin Survey Papers" below. Are the developers going to be adding collection title to manuscript? I think that type needs to be more robust than it is currently.

    TY - MANSCPT
    N1 - Record Number: 2190
    A1 - Wedel, Waldo R.
    T1 - Excavation Records for 39ST1
    N1 - Connective Phrase: In
    T3 - River Basin Survey Papers
    PY - 1951
    AV - National Anthropological Archives, Smithsonian Institution, Washington, D.C.
    UR - Ms. on file,
    KW - Plains
    KW - Arikara archaeology
    ER -

    Another example (T3 represents field "Collection Title 09:" in ProCite.):


    TY - MANSCPT
    N1 - Record Number: 2233
    A1 - Willey, Gordon Randolph
    T1 - Appraisal of the Archaeological Resources of Ft. Gibson Reservoir, Grand (Neosho) River, Oklahoma
    T3 - Smithsonian Institution, River Basin Surveys
    PY - 1947
    UR - Ms. on file, NAA, Washington, DC
    N1 - Notes: (typewritten) Ref. in Bell, 1978
    N2 - Not examined
    KW - Oklahoma
    ER -
  • Fixed it. It now goes into notes as "Series Title: ...."
  • great thanks, Aurimas. :)
  • edited May 7, 2012
    Hello again, back from a little break. Hope you've been doing well. I found a bit of an error:

    It seems that workform "Book Short Form" is not importing multiple authors correctly.

    See screenshot: http://dl.dropbox.com/u/19141190/error with multauthors slashes.png

    The // between names are not being registered as separating the authors. Perhaps because there are no spaces? Because it will only do the first authors "name//nextauthorslastname" and then nothing else because of the comma after the second authors name. So those names after the second authors last name are being lost completely. This is true across all multiple author records I have looked at so far. I am using the new ProCite.js file from above.

    here is the examples RIS test:

    TY - BOOK
    N1 - Record ID: 2753
    A1 - Bloomer, Kent//Moore, Charles
    T1 - Body, Memory, and Architecture
    CY - New Haven
    PB - Yale University Press
    PY - 1977
    KW - spatial analysis
    ER -
  • Also, do you have any good suggestions for how to sort the book long form workform? I am trying to separate those things that should be book chapters, from books. Otherwise they don't get cited/imported correctly. i.e. instead of a title and book title for the chapter and book title sections, it will do the chapter as the main book title and the book title as the series title. (This is if a book long form type is imported as "BOOK" instead of "CHAP". The trouble is I am not sure how to try to weed these out and make them into "CHAP"s without manually going through the 1356 records of that type that I have.)

    Any ideas for shortcuts in ProCite to do this?
  • Try searching for Workform = "Book Long Form" AND #4 = EMPTY I think books don't have "Title, Analytic"

    Workform = "Book Long Form" AND #4 = NOT EMPTY should return all journal articles.
  • Thanks! That works great so far. The book chapters do seem to be #4 = NOT EMPTY.

    I am still checking, but I think this may have solved the larger part of my problems. :)
Sign In or Register to comment.