Importing takes very long + fails
Hi there,
for a migration to Zotero, I am trying to import a bib file with ~14000 entries (~10 mb filesize) into Zotero. Unfortunately, it's very slow (500 entries take around 60 minutes to process on a SSD). I've tried disabling synchronization for now, but this doesn't seem to help.
Additionally, what's really bothering me is that the import sometimes just doesn't continue. I think that's because there are some broken entries in the bib file (it's from like 2003 and has evolved with several people using it), but is there a way to ignore broken entries or restart/continue imports without creating duplicates and waiting for everything to import again? I've now started it with debug output to see where the error lies, but it would be amazing to be able to continue the import where it left off so I don't have to wait 10 hrs just to start it again.
I would be glad if you could help me out with the speed and error issues. Thank you so much.
for a migration to Zotero, I am trying to import a bib file with ~14000 entries (~10 mb filesize) into Zotero. Unfortunately, it's very slow (500 entries take around 60 minutes to process on a SSD). I've tried disabling synchronization for now, but this doesn't seem to help.
Additionally, what's really bothering me is that the import sometimes just doesn't continue. I think that's because there are some broken entries in the bib file (it's from like 2003 and has evolved with several people using it), but is there a way to ignore broken entries or restart/continue imports without creating duplicates and waiting for everything to import again? I've now started it with debug output to see where the error lies, but it would be amazing to be able to continue the import where it left off so I don't have to wait 10 hrs just to start it again.
I would be glad if you could help me out with the speed and error issues. Thank you so much.
Maybe it could also have to do something with this issue: https://github.com/zotero/zotero/issues/1574 as we do have file names containing characters like ä,ö,ü,ß in their pdf filenames. I will be able to tell you what the debug output says tomorrow. But the issue reporter says it just silently fails which does not match my problems 1:1.
To what bug exactly were you referring? And what problems? The speed, the duplicates, continuing import where you "paused" it?
Repeated file imports always create duplicates (except when using the Mendeley import option), so if an import process is interrupted you'd want to either first delete those items and empty the trash or edit the BibTeX file to remove the entries that were imported successfully before continuing.
I just ran it with the latest beta + debug output and it seems to be pretty slow. If I turn of the debug output, it's definitely faster. Is that intended behaviour? That the import speed depends on the "print speed" of the debug window? I didn't want to close it in case it stops again, but for now I've closed it. Let's see how fast it goes now
[JavaScript Error: "Discarding invalid field 'place' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'publisher' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'place' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'publisher' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'place' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'publisher' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 33 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 33 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'publisher' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 33 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 33 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'issue' for type 33 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 4 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'series' for type 15 for item 1/null"]
[JavaScript Error: "Discarding invalid field 'type' for type 2 for item 1/null"]
version => 5.0.61-beta.20+ad27e0c5f, platform => Linux x86_64, oscpu => Linux x86_64, locale => de, appName => Zotero, appVersion => 5.0.61-beta.20+ad27e0c5f, extensions => Zotero LibreOffice Integration (5.0.14.SA.5.0.61-beta.20+ad27e0c5f, extension)
I've created an issue to address the hanging.