Problems associated with large Zotero database

I am using a Zotero (v. 5.0.74) database with 13k+ entries on a Mac (OS 10.14.6 (18G95)). The zotero.sqlite.bak file is 2.1GB. I am also using betterbibtex (BBT, v. 5.1.139) in connection with RStudio (Version 1.2.1335) and the citr package (0.3.2).

In general, the large Zotero database has caused trouble, whenever citeproc-js is involved because the database is "too large" (so I am told), for example if I want to use the citation features in Zettlr (https://github.com/Zettlr/Zettlr). Exporting my database to a bibtex file (using BBT) takes a considerable time (30-40 minutes), even though I have omitted abstract, note, file, tag, attachment from the export and results in a large .bib file with 6.3MB).

In order to speed up the integration of Zotero with RStudio using citr (which is simply awesome), I wondered if there is any way to slim down my Zotero database (outside of the obvious, such as deleting duplicates, which I have done, or deleting entries, which is not really an option)?

For example:

- I have a lot of attachments, some of the large > would it help not to have an index? That would of course limit the functionality of Zotero and search, but as a trade-off to increase speed in the integration it might be worth doing. Right now I have 322k+ words there in the cache according to the search/index tab in Zotero.

Any suggestion? Or am I simply left with no options here? Thanks for your support!
  • citr unfortunately really just is very inefficient by trying to load your entire database bib file into memory at once. I recommend using rbbt instead to integrate RStudio with BBT.
    https://github.com/paleolimbot/rbbt
  • 30 minutes is long - sounds to me like your export is not using the BBT cache. Changing BBT preferences will drop the cache, but that should refill with subsequent exports, so it shouldn't remain slow. For exports where you have selected to export attachments (regardless of whether you have the attachments field removed), the cache is always off.
Sign In or Register to comment.