"Loading items..." issue

shannonmatloob

Debug ID: D786458242
I followed the instructions in the Debug Output Logging support article. I'm in a similar situation as this person, but I have a MacBook Air.

dstillman

Can you go to Tools → Developer → Run JavaScript, run the following code, and let us know the output?

return await Zotero.DB.valueQueryAsync('SELECT COUNT(*) FROM itemDataValues') + ' ' + await Zotero.DB.valueQueryAsync('SELECT COUNT(*) FROM itemData') + ' ' + [...await Zotero.DB.queryAsync('PRAGMA index_list("itemData")')].map(x => x.name)

shannonmatloob

There was no output.
https://s3.amazonaws.com/zotero.org/images/forums/u13382599/sk86lc8wzieb6ur2eqpp.png
Here's the browser console:
https://s3.amazonaws.com/zotero.org/images/forums/u13382599/g23bbxbpxs9t1yr9w3f8.png
Here's the new Debug ID: D1909352363

dstillman

You should temporarily disable auto-sync from the Sync pane of the Zotero settings, restart Zotero, and let it run for a while — overnight, even. Then try running that line.

dstillman

@shannonmatloob: Actually, you're on a Mac, so just open Terminal from Spotlight, paste this in, and press Return, and then paste the full output here:

stat -f%z ~/Zotero/zotero.sqlite ; echo 'SELECT COUNT(*) FROM itemDataValues; PRAGMA index_list("itemData");' | sqlite3 ~/Zotero/zotero.sqlite

shannonmatloob

1107787776
782208
0|itemData_valueID|0|c|0
1|itemData_fieldID|0|c|0
2|sqlite_autoindex_itemData_1|1|pk|0

Separately, I left this group months ago and don't want to keep syncing with it, but if I disable sync in my settings, will that disable syncing with my RSS feeds?
https://s3.amazonaws.com/zotero.org/images/forums/u13382599/qjsk3tgmm6rk5op4ppmf.png

shannonmatloob

@dstillman 1.11 GB to answer the question re: how big the zotero.sqlite file is in my Zotero data directory.

dstillman

Could you close Zotero, run this from Terminal, and let us know the output?

echo "SELECT COUNT(*) FROM items JOIN libraries USING (libraryID) WHERE type!='feed'; SELECT COUNT(*) FROM items JOIN libraries USING (libraryID) WHERE type='feed';" | sqlite3 ~/Zotero/zotero.sqlite

And then you can try this:

time echo "DELETE FROM itemDataValues WHERE valueID NOT IN (SELECT valueID FROM itemData);" | sqlite3 ~/Zotero/zotero.sqlite

This is the command that's slow within Zotero, so this might take a while to run. When it finishes, let us know the output (which will say how long it ran for).

Then open Zotero and see if the problem is fixed.

Finally, close Zotero again and run this:

echo "VACUUM;" | sqlite3 ~/Zotero/zotero.sqlite

After that, let us know the new size of zotero.sqlite.

shannonmatloob

Hi @dstillman, sorry for the delayed response.


echo "SELECT COUNT(*) FROM items JOIN libraries USING (libraryID) WHERE type!='feed'; SELECT COUNT(*) FROM items JOIN libraries USING (libraryID) WHERE type='feed';" | sqlite3 ~/Zotero/zotero.sqlite


8467
42485


time echo "DELETE FROM itemDataValues WHERE valueID NOT IN (SELECT valueID FROM itemData);" | sqlite3 ~/Zotero/zotero.sqlite


echo 0.00s user 0.00s system 36% cpu 0.002 total
sqlite3 ~/Zotero/zotero.sqlite 2.25s user 8.80s system 41% cpu 26.349 total

Note: it didn't take a while to run, but it did fix the problem!


echo "VACUUM;" | sqlite3 ~/Zotero/zotero.sqlite


Size of zotero.sqlite = 360.5 MB

Thank you!!

Would you mind telling me what happened (i.e. where I messed up) to prevent it recurring?