All references dissapeared from a group library, folders still there
Hello, I have managed a group library with over a dozen people for nearly 3 years. I had opened and synced all the references to my zotero today and confirmed we had all the references. When I added another user later, that user said the library was empty. I have confirmed this is true. Our folder structure is in the library, but every single reference has disappeared. None of the group members has done anything to the library today.
My sql lite backup was from a long time ago, so I do not have any of the recent work.
What in the world happened to the references?
I have gone through these procedures:
https://www.zotero.org/support/zotero_data#restoring_your_zotero_data_from_a_backup1
Unfortunately, none of those work. All group member use Sync and the Zotero app is an updated version (most people are recent within the last year).
Current file: zotero.sqlite (362 MB)
Backup file: zotero.sqlite.bak (423MB). Note: I cannot simply restore from these backup because I have about 20 group libraries shared amongst dozens of researchers and colleagues.
There is a storage folder, but it does not contain folders with dates. They are all hexadecimal. There are about 5,500 items in the storage folder.
My current directory is my home directory. I have full admin privileges.
I just used Zotero today on my computer. I moved one file from a folder and then closed. I then have my colleague
My sql lite backup was from a long time ago, so I do not have any of the recent work.
What in the world happened to the references?
I have gone through these procedures:
https://www.zotero.org/support/zotero_data#restoring_your_zotero_data_from_a_backup1
Unfortunately, none of those work. All group member use Sync and the Zotero app is an updated version (most people are recent within the last year).
Current file: zotero.sqlite (362 MB)
Backup file: zotero.sqlite.bak (423MB). Note: I cannot simply restore from these backup because I have about 20 group libraries shared amongst dozens of researchers and colleagues.
There is a storage folder, but it does not contain folders with dates. They are all hexadecimal. There are about 5,500 items in the storage folder.
My current directory is my home directory. I have full admin privileges.
I just used Zotero today on my computer. I moved one file from a folder and then closed. I then have my colleague
Again, though, you probably just need to restore the items from the trash.
I'm looking back at the instructions on restoring here: https://www.zotero.org/support/zotero_data
The instructions do link to the Replace Online Library as a sub items within restoring Zotero data. I did not look through that thoroughly because when I discovered my back up was over a month ago, that was not a good option because many more references have been added since then.
It would be helpful to indicate that restoring could be from an individuals automatic backup or and group members most recent (good) sqlite file.
In the meantime, I am seeing if anyone in my group has a more recent sqlite file that we can try the Replace Online Library function with.
It would be lovely to have a mechanism to restore a group/library online, just as there is a backups locally. Some kind of version control would allow us to see the counts of the number of references. I could then easily see when a specific group went from hundreds (or thousands) to zero.
That's very odd, because yesterday her and I both saw all the references.
So, the only option now is for me to restore from a month ago or if there are other options you can identify.
The only think I think that may have triggered this is when I added another person who then performed a sync and everything somehow disappeared. Again, nothing is in the trash.
Just adding a member and having them sync would never do this. Someone has to have deleted all items and emptied the trash.
As for backups, anyone using Zotero regularly should have zotero.sqlite.bak and zotero.sqlite.1.bak files from the last couple days. If someone hasn’t been using Zotero, those files would be older. Beyond that, it would just be any backups someone made of their own system (e.g., automated hourly Time Machine backups on a Mac).
Those items were deleted — along with three collections — and purged from the trash on August 5. Again, if you email us, we can tell you the group member that did this.
These deletions would've been synced down to anyone who synced since August 5th. If you saw the items more recently, you just hadn't synced that library — perhaps you have auto-sync disabled and have been syncing manually, or you started up Zotero after not using it for a while and the initial auto-sync was still going when you first looked at the group.
So that means that if someone had been using Zotero and had been syncing, this change would've occurred weeks ago, so the items wouldn't be present in any recent automatic backups. But it also means that your backup from a month ago may not be that out of date — there couldn't have been any changes in this library since the 5th.
Thank you for your help.
In the future, it would be great to have version control online so we can backup a single group that way.
First question, if a group member deleted the references (which I know would be an accident), why are they not in my trash?
Second, question, is a group member able to delete a group? My group still shows up, but it is empty.
Any group member that had been syncing would've been able to restore the group data for at least a couple days with the automatic local backups Zotero makes, but beyond that you would need your own backup (e.g., the automated backups from Time Machine on a Mac). They can't delete the group itself, but they can make changes to it, and that by necessity involves deletions. We could consider making it impossible for non-admins to purge items (and soon collections) from the trash for 30 days, but there are downsides to that — e.g., it's fairly easy to save an item to the wrong library, so if someone saved something personal to a group by mistake, making it impossible to delete an item isn't ideal. There could perhaps be some sort of time limit — e.g., you could purge an item from the trash if it was created within the last 15 minutes.
At some level, it would be advantageous to notify the group owner if a significant number of references were deleted (or purged) so there was some kind of warning and a way of addressing this.
In our case, I'm certain this was an accident. I don't have all the details yet, but it sounds like a student was turning in a borrowed university laptop and they were trying to delete everything from their computer. I think this person didn't realize it was deleting everything from all users in the group.
So, providing an owner with a notification would be great, as would a notification to the user if they are deleting an entire folder and purging the contents (e.g. a warning that this will remove from all other shared users in the group).
I.
Move to Bin
"Are you sure you want to move the selected items to the Bin?"
-> You can directly press
Enter
to validateOk
.II.
Delete
"Are you sure you want to delete the selected items?"
-> You can directly press
Enter
to validateOk
.I think that the easiest things to improve would be:
1) Add the warning suggested above at step II in a shared library: "⚠️ The items will be permanently deleted for all members of this shared library." A similar warning could also be given in step I, but that is probably obvious and and less critical anyway. So better keep the warning at the most important step only to make it more efficient.
2) Change
Delete
toDelete Permanently
at step II and the text below to "Are you sure you want to delete permanently the selected items?" (for both personal and shared libraries). This would be more consistent with the option given in the right-click menu on items in the Bin. And it does not cost much to be extra clear about this.3) Make the default option to be
Cancel
instead ofOk
when pressingEnter
at step II (for both personal and shared libraries). Purging the trash of a library is not something that needs to be optimized for efficiency. So the small extra effort needed to pressOk
is probably well worth it considering the extra protection it provides.You can argue that no one reads dialogs anyway, but I still believe that giving more precise information in the delete popup is important.
Beyond these simple steps, in line with your ideas, an "Admin Bin" could probably be a good solution:
- Only admins can purge the bin permanently, with the additional warnings mentionned above.
- Other members can purge the bin for all users, but it goes to an
Admin Bin
sub-collection of theBin
collection only visible by admins, where they need to make a final purge to make it permanent. The member should be notified about this when purging the bin.- Members can still make a permanent purge of the items that they have added to the shared collection. But all the items selected to be purged must be added by that same user. And eventually add an extra layer of validation (a tick
Also delete permanently for the Admins
before validating the purge) to make sure this is the intended behaviour. This is intended only for confidential items that were added by mistake, so it makes sense to make the process more painful.- At step II, admins will always see the option to also purge the
Admin Bin
by clicking inside a tick box if the Admin Bin is not empty (which means that another member has purged the bin). This keeps the normal maintenance of the shared library very simple, with just a simple additional step triggered by purging event by other members.It seems though, having an Admin bin that only allows permanent purging would be far more reasonable and a good fail-safe.