Zotero has been becoming slower and slower over the last weeks. Also hangs appear.
In our research group (~20 people) we use a Zotero group biblipgraphic library with many items. About three weeks ago, I received the first complaints of team members that Zotero is becoming slower when using it (the start-up loading of the library always takes some time, but we got used to it). We realized the slow-down when searching the library, adding full-texts, but particularly with citations from within Word or Writer. Now additionally to these slow-downs, people (including myself) also get hangs of Zotero (when adding full-texts and citing from within the word processor).
Most of us use Windows 7 with Firefox/Zotero, some with Zotero standalone. A few use MacOS X with the Standalone. Some use Ubuntu 13.04 with Firefox/Zotero. Word processors in use are Word 2010 and LibreOffice 4.0.x
What can we do to improve the speed again? Is it a bug? Or is there any problem with our Zotero group library in general?
Most of us use Windows 7 with Firefox/Zotero, some with Zotero standalone. A few use MacOS X with the Standalone. Some use Ubuntu 13.04 with Firefox/Zotero. Word processors in use are Word 2010 and LibreOffice 4.0.x
What can we do to improve the speed again? Is it a bug? Or is there any problem with our Zotero group library in general?
I have read gerald`s post with big interest caus we have the same problem. We also use a group library and zotero works very, very slow or shuts down. Me and my colleagues need a lot of patience when working with zotero.
I am looking forward for your advice.
Are there some special settings in gerenal when working with group librarys?
Thank U
Sara
(both top-level and total items)
I will try to report the slow-downs and temporary freezes as detailled as possible and - if possible - ad a debug ID http://www.zotero.org/support/debug_output (Thanks, adamsmith, for the link). However, in many cases the slow-downs seem to come random. At least, it will be difficult to reproduce them. Anyhow, I will try.
Here is the first Debug ID: D1117503505. Attaching a document (300kb) to an entry froze Zotero for ~30 seconds and Firefox asked me whether I want to kill the process. The computer is an Intel core i5 with 4GB, so this is not the limiting factor.
I will add more debug IDs soon.
After cold start of computer and Firefox, I started Zotero (clicking on the Zotero tab). This took 28 seconds until Firefox responded again and Zotero finally was active and entries were selectable.
Then I selected one of the entries and hit Control+A to highlight all entries. This temporarily froze Zotero for 50 seconds. I even got an error message: "Firefox is not responding, do you want to wait?".
For the start-up hang, I suspect you'll find that that goes away if you temporarily disable file syncing for groups in the Sync pane of the Zotero preferences. We're currently debugging freezing at sync time for people with libraries with many files, as Zotero checks for locally modified files. I don't believe this is a new issue, but as people's libraries grow it becomes more apparent. We're determining the best way to address this.
For the hang while saving an item, I'd try disabling full-text indexing by setting the two max values to 0 in the Search pane of the Zotero preferences. I think the issue there is a very large full-text index. This would likely be more noticeable on the computers of the people who've been adding more documents, since currently the full-text index doesn't sync and files aren't indexed automatically on other computers.
Let me know if those two changes make a difference.
Yes, by "mark all entries" I mean "Select all" (Ctrl-A)
Do I understand you right that someone in the group who has a very large database (several groups and my library) can have an impact on slowdowns of other people in the group?
Is it also correct that you do not mean by "size of the database" the size of the zotero.sqlite, but rather the total number of items in all groups and my library on the particular system?
Is my assumption right that a large full-text index in the zotero.sqlite database does not impact speed much?
Here the results of some testing:
* Start situation: Cold start avg. 45 seconds, after restart of Firefox avg. 9 seconds. Temporary hangs after a few seconds of usage long a described in my trouble description.
* Disabling file syncing did not help much: Avg. 43 seconds, 8 seconds. Still temporary hangs after a few seconds of usage, I think a bit better.
* Setting the two max entries of full text indexing did not really change a lot when attaching files.
What helped quite well:
* I deleted one old group library with roughly 2k toplevel items and emptied all trashbins deleting another 1.5k toplevel items. This lead to a reduction of the zotero.sqlite from 129MB to 113 MB. Zotero was somewhat quicker, but not good yet.
* I deleted the entire full-text index. The result was a reduction of zotero.sqlite from 113 to 24MB. The system was much quicker now: Cold start avg. 28 seconds and after restarting Firefox avg. 6sec. I did not encounter temporarily hangs.
* Now it is getting *really* funny: I let Zotero do a complete full-text re-indexing and this increased the zotero.sqlite to 399 MB. Average cold start time has decreased(!) down to 16 seconds, and after restarting firefox it stays at 6 seconds. How can it be explained that the existence of a large full-text index increases start-up speed? I did a couple of tests. This seems to be consistent. However, now again I encounter a few temporary hangs.
* P.S. I did a couple of OS reboots between the tests. Also, no other software was running besides a file manager and Firefox.
Dan probably has more on the hangs.
The database can become fragmented over time, and the full-text index might be particularly susceptible to that, but just clearing and recreating the full-text index wouldn't defragment other parts of the database, so it shouldn't have any effect on non-full-text-search-related Zotero performance. Are you positive that you restarted between all of the tests? It seems more likely to me that regenerating the index just caused the system to cache more of the database in memory. I suppose it also could have caused the system to relocate the database file on disk in a way that increased performance. In any case, I wouldn't read too much into those results.
I'm happy to look at Debug IDs for other slow operations.
Answers to your short questions:
* There is no saved search
* I always restarted the computer between the test results (not if I indicated "just restarted Firefox")
* There was not relocation of files on my system. Everything, including the database file sits exactly there /home/user/.mozilla/firefox/profilexyz/zotero where it was before.
Here some more test results:
* There is absolutely no difference if I activate or disable automatic syncing in the Zotero preferences (for both, group libraries and mylibrary):
** The cold start time of Zotero varies between 16 sec and 34 sec, independently of manual or automatic syncing setting.
** In both cases, I encounter a long time lag (Firefox hangs) of about 51 seconds. This hang *always* begins after start-up of Zotero and the possibility to click on one of the entries. The duration of the hang is the same for automatic and manual syncing.
I did the same test when the computer was offline (and set to manual syncing). The start-up time is not different from the cases when being online. But, when offline I do not encounter any of these hangs that immediately start after successful start-up of Zotero.
Settings: computer online, manual file sync.
Results: Zotero cold start 16 sec. Hang after successful start-up 48 seconds. After that, I submitted the debug ID.
When I refer to manual syncing, I always referred to the settings "attached files in [mylibrary or group library] syncing with" under the heading File-syncing. I had disabled these and set to manual/on demand.
In my testing above, I had never changed the setting automatic-synching under the heading "Zotero sync server". I just did that now and in fact there is no hang, just like when being offline.
(cold start time in this situation (automatic-synching disabled and computer online) was 17 sec).
To sum up:
The long after-start-up hangs disapear when being offline or when automatic syncing (under the heading ZoteroSyncServer) is disabled.
Sorry for the confusion.
So, then, with auto-sync disabled, are there other slowdowns that you're still experiencing?
Whereas the stable version 4.0.9 has a cold start time of (first test/second test) 18sec/32sec, it always has the temporary hang immediately after the successful Zotero start of 52sec/57sec.
With version 4.0.9.r11352, the start-up performance has not changed (22sec/30sec), but the after-Zotero-startup-hangs are completely gone. I can immediately work after Zotero shows up. This is already a very great relief and improvement, because these hangs have not only appeared immediately after the Zotero start-up but also from time to time. The latter I haven't tried out yet. I will use the Branch version for half day to test this, and will then switch back to the stable 4.0.9 for safety reasons.
A big thank to you!
Since a few days I added/changed tags in the group library and I encounter (again) very long delays that appear frequently after changing/adding some tags. Here is a bug ID that I let run while tagging for a while (during this time Firefox asked three times whether I want to kill Firefox or to wait), BugID: D1981219566
I switched the auto-sync off and there was no hang anymore. So, it seems to be a problem with auto-syncing.