ProCite to Zotero Conversion: Translator, RIS, and Testing

maevepotter · April 10, 2012

Sorry, its hard to explain... here's a picture:

http://dl.dropbox.com/u/19141190/zoteroseriestitleerror.png

Does that help? See how "Series Title" is repeated as words in Zotero?

aurimas · April 10, 2012

Try this, copy the entry you posted above. Open Zotero, go to the gear menu (the main menu) and select import from clipboard. Does it still have the same problem?

maevepotter · April 10, 2012

yeah then it does do it correctly. That's odd.

Problem is there are multiple files like that, so I would have to find every one with a series and cull them out of the large RIS file. :/

Wonder why is does it like that?

maevepotter · April 10, 2012

or could I just clipboard the whole lot?

aurimas · April 10, 2012

Seems to me, though I could be wrong, that this started when you modified the T2 field in the RIS export file. Now that we can handle the double T2 entries, I would suggest restoring your RIS-EndNote export file to the original, modifying the Book Long Form entry again (since we didn't fix that) and re-exporting.

Alternatively, you can go back to the RIS export style and see if you changed it correctly for Book Chapter. Their styles have a lot of weird characters that may be easily overlooked and I have very little experience in that area, so I would suggest starting from a fresh output style.

aurimas · April 10, 2012

Oh, I guess I forgot to ask an important question.

The entry you posted above, is that from the same file you are trying to import? If yes, then hold on with the changes I suggested above.

EDIT: post the file you are importing on dropbox or github

maevepotter · April 10, 2012

aurimas · April 10, 2012

Why do you think that it affects the "series title" field being read as part of the name of the series?
I had this convoluted scenario in my head and rushed to the conclusions. It may have nothing to do with your modifications. In case you missed my post above, could you post the RIS file you are importing (dropbox or github)?

maevepotter · April 10, 2012

The entry you posted above, is that from the same file you are trying to import? If yes, then hold on with the changes I suggested above.

Yes that is a sample entry from the Book Chapters file linked below:

Book Chapters only
http://dl.dropbox.com/u/19141190/RISbookchaptersonlyUpdate.txt

Book Long Form only
http://dl.dropbox.com/u/19141190/RISbooklongform_update.txt

aurimas · April 10, 2012

OK. I see. It seems that in ProCite for that record (and possibly a couple others) the Series Title (32) reads "Series Title: Bonn Contributions to Asian Archaeology"

Also, the entry you posted above does not actually correspond to the entry in the file. The one in the "RISbookchaptersonlyUpdate.txt" file reads:

TY - CHAP
N1 - 19043
A1 - Brosseder, Ursula
T1 - Xiongnu terrace tombs and their interpretation as elite burials
N1 - Connective Phrase: In
A2 - Bemmann, Jan
A2 - Parzinger, Hermann
A2 - Pohl, Ernst
A2 - Tseveendorzh, Damdinsüren
N1 - Author Role: editors
T2 - Current Archaeological Research in Mongolia: Papers from the First International Conference on "Archaeological Research in Mongolia"held in Ulaanbaatar, August 19th-23rd, 2007
CY - Bonn
PB - Bonn University Press
PY - 2009
SP - 247-280
T3 - Series Title: Bonn Contributions to Asian Archaeology
N1 - Series Volume ID: 4
KW - archaeology
KW - mortuary analysis
KW - Mongolia
KW - empire
KW - pastoralism
ER -

Not:

TY - CHAP
N1 - 19043
A1 - Brosseder, Ursula
T1 - Xiongnu terrace tombs and their interpretation as elite burials
N1 - Connective Phrase: In
A2 - Bemmann, Jan
A2 - Parzinger, Hermann
A2 - Pohl, Ernst
A2 - Tseveendorzh, Damdinsüren
N1 - Author Role: editors
T2 - Current Archaeological Research in Mongolia: Papers from the First International Conference on "Archaeological Research in Mongolia"held in Ulaanbaatar, August 19th-23rd, 2007
CY - Bonn
PB - Bonn University Press
PY - 2009
SP - 247-280
N1 - Series Title: Bonn Contributions to Asian Archaeology
N1 - Series Volume ID: 4
KW - archaeology
KW - mortuary analysis
KW - Mongolia
KW - empire
KW - pastoralism
ER -

You have a couple options.

Edit the entries in ProCite. This is probably tedious.

Use a text editor that can do search and replace on the exported RIS file to replace T3 - Series Title: (Note the double space after T3) with T3 - (Note the double and single space)

Or we can modify the RIS translator, but since this seems to be a fault with entering data into procite, I don't think it's a good idea.

EDIT: The second code field above reads T3<space><space>-<space>

aurimas · April 10, 2012

Edit the entries in ProCite. This is probably tedious.

This may be less tedious if you use the Search function and look for
#32 BEGINS WITH "Series Title:"

maevepotter · April 11, 2012

See actually, I don't think this is actually ProCite's fault, because it ("series title" that is) doesn't appear in the field there, but just when it is exported.

See this screenshot: http://dl.dropbox.com/u/19141190/brosseder series title example.png

Also you were right about the "T3 - Series Title: Bonn Contributions to Asian Archaeology" I opened up the non-updated file. I did import the T3 version, and it did the "series title" repeat thing.

Does this make a difference? Do I just go and edit the output file?

aurimas · April 11, 2012

I'm a little confused as to what you mean by updated and non-updated file? If you just mark that record and export it, how does the export look?

aurimas · April 11, 2012

I've tried to replicate this on my installation of ProCite, but I can't get the same results. Did you figure out what was wrong?

EDIT: The only thing any of this makes sense is if your RIS style is messed up. I got mine from http://www.procite.com/support/pcsupport.asp under bibliographic output style.

maevepotter · April 12, 2012

Sorry, I was talking about updated/not updated as far as my own files. I just had made several exports after the changes you told me to make to the RIS style. So that's not important.

I also downloaded the RIS style from procite.

Not sure why that happened.

If you use the basic RIS from procite, without any modifications to the style, this is what comes out:

TY - CHAP
N1 - 19043
A1 - Brosseder, Ursula
T2 - Xiongnu terrace tombs and their interpretation as elite burials
N1 - Connective Phrase: In
A2 - Bemmann, Jan
A2 - Parzinger, Hermann
A2 - Pohl, Ernst
A2 - Tseveendorzh, Damdinsüren
N1 - Author Role: editors
T2 - Current Archaeological Research in Mongolia: Papers from the First International Conference on "Archaeological Research in Mongolia"held in Ulaanbaatar, August 19th-23rd, 2007
CY - Bonn
PB - Bonn University Press
PY - 2009
SP - 247-280
N1 - Series Title: Bonn Contributions to Asian Archaeology
N1 - Series Volume ID: 4
KW - archaeology
KW - mortuary analysis
KW - Mongolia
KW - empire
KW - pastoralism
ER -

If modified, it was as above with the T3 field etc...

aurimas · April 12, 2012

I'm not sure how that modification happened. I recommend using the original (i.e. from ProCite) RIS export style file and only modify the TY field for Book Long Form from CHAP to BOOK. I believe everything else should work properly.

maevepotter · April 12, 2012

series title should be T3, but wait for Aurimas - he may want to change this in the translator instead.

I tried this to see if it would work, so I think that's how. I also had changed it before when you all told me to, so there were several changes. But you think its coded well enough now to use only the original style then, other than CHAP to BOOK?

Thanks, I will try this on Monday when I am back at work.

aurimas · April 12, 2012

Ah, yes. That would have done it. If I recall correctly, everything except for Book Long Form issue should now be handled by the translator.

maevepotter · April 12, 2012

great thanks Aurimas. :) I will try again and get back to you.

maevepotter · April 16, 2012

Hi,

So to confirm before I reload it all again:

1. I downloaded a fresh copy of RIS-Endnote for Procite, and the only thing I needed to change was Book Long Form from CHAP to BOOK.

That should fix the series title problem and everything else should import correctly?

Thanks. :)

maevepotter · April 16, 2012

Error: Book Long Form

Well I tried Book Long Form again, and was looking through some entries. Many look good, but I found an entry with both a section or article title, with a book title, and a series title.

It looks like these kinds of "book long form" entries would be better off being imported as chapters? Should I actually change CHAP to BOOK?

Record in Procite
http://dl.dropbox.com/u/19141190/booklongformerror_section_title_series.png

Record in Zotero: (note that series title was not preserved in notes either)
http://dl.dropbox.com/u/19141190/booklongformerror_section_title_series_zotero.png

This is the record with CHAP changed to BOOK

TY - BOOK
N1 - Record ID: 86
A1 - Baerreis, David A.
T1 - A Quantitative Approach to Culture Change: The Delaware Indians as an Ethnohistoric Case Study.
N1 - Connective Phrase: In
A2 - Dunnell, Robert C.
A2 - Grayson, Donald K.
N1 - Author Role: edited by
T2 - Lulu Linear Punctated: Essays in Honor of George Irving Quimby
CY - Ann Arbor
PB - Museum of Anthropology, University of Michigan
PY - 1983
SP - 185-207
T3 - Anthropological Papers
N1 - Series Volume ID: No. 72
N1 - Notes: seen
KW - ethnohistory
KW - historic archaeology
KW - Dissertation
ER -

maevepotter · April 16, 2012

When I imported the above record as a chapter, it imported correctly. I am going to check some of the others...

is there anything to help us get around which are actually books vs. which are chapters/articles within books within series?

maevepotter · April 16, 2012

Error: Generic workform, no workform chosen (low priority)

this is low priority, but on a generic record with no workform chosen, the N1 field did not import as notes or anywhere else. The original field was "Packaging Method (27):" Extent of work also did not transfer. Finally, the AV field below for availability, did transfer to notes, but should probably be mapped to Archive in Zotero, or Extra.

TY - GEN
N1 - Record ID: 157
A1 - Bear, Stella
T1 - Arikara Creation Myth
A2 - Sloan, Elizabeth C.
N1 - Author Role: Collected by
PY - n.d.
N1 - Extent of Work: 2
N1 - Packaging Method: pages, handwritten
AV - National Anthropological Archives, Smithsonian Institution, Washington, D.C.
UR - Ms. on file
N1 - Notes: May have been published in JAFL, date unknown
KW - Arikara
KW - ethnohistory
ER -

maevepotter · April 16, 2012

Conference Proceedings are also not transferring exactly right. Bolded fields (see below) were left out, or transferred incorrectly. "Date of Meeting" (Y2 below), should probably be mapped to notes, as there is no spot for meeting date, in addition to publication date of the proceedings in Zotero. Place of meeting should probably be transferred to Place instead of the CY field being put there, as the CY field is supposed to indicate where it was published. Since "Place" in zotero is directly under Conference Name, I imagine they want the place of the conference there, not where the proceedings were published. Finally, Editors were mapped as contributors (editor/compliler field #7 in ProCite).

in procite:
http://dl.dropbox.com/u/19141190/error_conferenceproceeding.png
in zotero:
http://dl.dropbox.com/u/19141190/error_conferenceproceeding_zot.png

TY - CONF
N1 - Record Number: 320
A1 - Barfield, Thomas J.
T1 - Political centralization on the Mongolian steppe: dueling models of the past
N1 - Connective Phrase: In
A2 - Hanks, Bryan
A2 - Linduff, Kathy
N1 - Proceedings Title: New Research Directions in Eurasian Steppe Archaeology: The Emergence of Complex Societies in the Third to First Millennia BCE
Y2 - 2006/02/10-2006/02/10
N1 - Place of Meeting: University of Pittsburgh
CY - Pittsburgh
PB - Department of Anthropology & Center for Russian and East European Studies
PY - 2006
KW - Mongolia
KW - political organization
KW - pastoralism
ER -

maevepotter · April 16, 2012

Conference Proceedings seems to have some serious problems mapping:

http://dl.dropbox.com/u/19141190/error_conf_proceeeding_ex2.png
[edit wrong link before] http://dl.dropbox.com/u/19141190/error_conf_proceeeding_ex2_zot.png

TY - CONF
N1 - Record Number: 257
A1 - Bender, Barbara
T1 - Middle Rangers' in Prehistory
N1 - Connective Phrase: Paper presented at the
A2 - Upham, Steadman
N1 - Editor/Compiler Role: Chairperson
N1 - Proceedings Title: The Development of Political Systems in Prehistoric Sedentary Societies Advanced Seminar
N1 - Place of Meeting: School of American Research
CY - Santa Fe
PY - 1987
N1 - Notes: have, seen
KW - culture change
KW - chiefdoms
ER -

Thanks again Aurimas... Sorry for all of the tedious errors.

Another very low priority one is mapping version to computer program type. We have almost none of these, so its not so important for this database, but might be for someone else in the future:
TY - COMP
N1 - Record Number: 4103
T1 - OxCal v3.9
A1 - Bronk Ramsey, Christopher
IS - 3.9
CY - Oxford, England
PB - Research Laboratory for Archaeology, Oxford University
PY - 2002
N1 - Date of Copyright: 2002
N1 - Notes: have, seen
KW - C-14
KW - method
KW - statistics
ER -

maevepotter · April 16, 2012

Reports:

As I mentioned previously, there is some functionality missing in Zotero with reports. There is no "Editor" only "Series Editor", which makes the "creator" field in the list view look blank, because series editor is not listed there.

Therefore this isn't so much an error, as something that doesn't fit... but Author Role is not mapping correctly. Presumably because there is no editor, only series editor. I do think that this is something Zotero overall should change though, if possible. What do you think? Otherwise, at worst, the Author role field should be copied to notes in this case to let the user know that these authors are really editors..

http://dl.dropbox.com/u/19141190/report_error_zot.png
http://dl.dropbox.com/u/19141190/report_error.png

TY - RPRT
N1 - Record Number: 2926
A1 - Ahler, Stanley A.
A1 - Toom, Dennis L.
N1 - Author Role, Analytic: editors
T1 - Archeology of the Medicine Crow Site Complex (39BF2), Buffalo County, South Dakota
CY - Denver, CO
PB - Branch of Interagency Archeological Services, U.S. National Park Service, Rocky Mountain Regional Office
PY - 1989
VL - A report prepared in partial fulfillment of Contract No. CX 1200-6-3547 (originally Contract No. CX 1595-6-0010) by Illinois State Museum Society for the Rocky Mountain Regional Office, U.S. National Park Service
N1 - Notes: DR's
KW - Arikara archaeology
KW - Medicine Crow
ER -

maevepotter · April 16, 2012

Report:

Error in transferring series title and series ID.

http://dl.dropbox.com/u/19141190/report_error.png
http://dl.dropbox.com/u/19141190/error_report_seriestitleandID.png

TY - RPRT
N1 - Record Number: 13663
A1 - Cooper, Louise
N1 - Connective Phrase: in
T1 - Wealth and Poverty in the Mongolian Pastoral Economy
CY - University of Sussex: Institute of Development Studies
PY - 1995
T3 - PALD Research Report
N1 - Series Issue ID: No. II
KW - Mongolia
KW - pastoralism
ER -

maevepotter · April 16, 2012

Error: Manuscripts are mapping as books

TY - SER
N1 - Record Number: 5833
A1 - Flynn, Gillian
T1 - Portraying Difficult and Controversial Subjects
PY - December 18, 2000
N1 - Notes: have
KW - museum studies
ER -

Extent of work is also not mapping

TY - SER
N1 - Record Number: 20353
A1 - Dickson, Michael
A1 - Littleton, Judith
A1 - Frohlich, Bruno
A1 - Amgalantögs, Tsend
A1 - Karstens, Sarah
A1 - Floyd, Bruce
N1 - Author Role: Authors
T1 - How many bodies makes a burial? Mongolian khirigsuurs and burials
RP - In File
N1 - Extent of Work: 30
N1 - Notes: have pdf
N2 - One of the difficulties dealing with burials and with human remains in general is how to interpret their absence. Kirigsuurs are the distinctive built stone mounds of the late Bronze Age/early Iron Age in the Mongolian steppe and Baikal region of Siberia (Cybiktarov 2003). Their monumentality attracts archaeological interest and consequently produces a range of interpretations (Allard & Erdenebaatar 2005, Honeychurch et al. 2009, Houle 2010). One of the central points of dispute is whether these structures are burials. The debate about khirigsuurs is reminiscent of other debates surrounding graves without burials (e.g. Bethell & Carver 1987; Littleton 1995). Our aim in this paper is to argue that khirigsuurs are indeed primarily burials, that in controlled and detailed excavations taphonomic processes account for the absent human remains, and that interpretations about their symbolic role need to take this primary function as a starting point rather than as an incidental possibility.
KW - Mongolia
KW - Bronze Age
KW - mortuary analysis
ER -

"Address/Availability (37):" field in ProCite is going into notes. Should be mapped into either Extra or Archive in Zotero.

aurimas · April 16, 2012

It looks like these kinds of "book long form" entries would be better off being imported as chapters? Should I actually change CHAP to BOOK?

is there anything to help us get around which are actually books vs. which are chapters/articles within books within series?

I'm going to try and make the translator figure out if book or chapter is more appropriate. Don't hold your breath though. The problem is that I need to make sure this doesn't break anything with regular RIS files that have not been exported from ProCite.

on a generic record with no workform chosen, the N1 field did not import as notes or anywhere else. The original field was "Packaging Method (27):" Extent of work also did not transfer.

Packaging Method and Extent of Work for that record were placed in the Number of Pages field, but Journal Article (the default type for GEN record) does not have that field, so it was dropped. I will add some checking to make sure that fields are never dropped.

Finally, the AV field below for availability, did transfer to notes, but should probably be mapped to Archive in Zotero, or Extra.

AV is not technically part of the RIS specification. This is ProCite specific. While we can be a little lenient and accommodate this, I wonder if this may conflict with AV field used for a different purpose somewhere else. I'll need to take a look at ProCite more closely to make sure that it's at least consistent within their software before I make this change.

Conference Proceedings are also not transferring exactly right. Bolded fields (see below) were left out, or transferred incorrectly. "Date of Meeting" (Y2 below), should probably be mapped to notes, as there is no spot for meeting date, in addition to publication date of the proceedings in Zotero. Place of meeting should probably be transferred to Place instead of the CY field being put there, as the CY field is supposed to indicate where it was published. Since "Place" in zotero is directly under Conference Name, I imagine they want the place of the conference there, not where the proceedings were published.

I think the consensus right now is that date and place represent publication information. See http://forums.zotero.org/discussion/22911/conference-paper-date-and-place/#Comment_122944 I will make sure that these fields are placed in the notes.

Finally, Editors were mapped as contributors (editor/compliler field #7 in ProCite).

I can try to improve the author role algorithm, but because we have to cover a lot of generic cases, I can't promise that this will always map correctly. In this case, it probably should though.

Conference Proceedings seems to have some serious problems mapping:

Are you referring here to the same problems as above?

Sorry for all of the tedious errors.

On the contrary, these reports are great. There's no way I have time to go through this many records and figure out where our algorithm will go wrong. Thanks for all your work.

mapping version to computer program type

IS - 3.9

This is rather annoying. Program version should be represented with the ET field. This is an error in the export style. I'll accommodate this, but now I have to do extra checking to make sure we don't overwrite actual version.

As I mentioned previously, there is some functionality missing in Zotero with reports. There is no "Editor" only "Series Editor", which makes the "creator" field in the list view look blank, because series editor is not listed there.

Therefore this isn't so much an error, as something that doesn't fit... but Author Role is not mapping correctly. Presumably because there is no editor, only series editor. I do think that this is something Zotero overall should change though, if possible. What do you think? Otherwise, at worst, the Author role field should be copied to notes in this case to let the user know that these authors are really editors..

I'm not an expert on reports, but perhaps there's a good reason there is no editor. I would post this in a new thread and someone with better knowledge of how this is handled will hopefully answer you.

Error in transferring series title and series ID.

The former appears to be a slight inconsistency within Zotero (investigating) and the latter is an inconsistency in ProCite (I'll fix that)

Error: Manuscripts are mapping as books
TY - SER

SER stands for serial (though I guess ProCite uses it for manuscript). Zotero doesn't have a way to represent a serial publication in and of its, so I think book is a decent mapping. What is the Workform for these records in ProCite?

aurimas · April 16, 2012

Extent of work is also not mapping
.....
RP - In File
N1 - Extent of Work: 30
N1 - Notes: have pdf

The unit for the extent is not indicated, so we can't be sure that this is pages and not volumes. Though for serial, this is likely pages. I don't think it's worth the risk to try and figure it out.