WebDAV in 2023?
Has anyone had any luck with WebDAV services in the last little while?
My current workflow is to bring PDFs into Zotero, where Zotfile immediately renames and moves the files. Then, one by one, I bring PDFs back into Zotero storage until I am roughly around 250mb of storage. These sync to my iPad where I annotate them; when finished, I 'offload' them by running them through Zotfile again.
Since Zotfile's move functionality (only renaming) isn't making it to Zotero 7, I've been considering WebDAV as a possible replacement for the above workflow. However, valid WebDAV options seem to be dwindling rapidly. I've included below the WebDAV services I've tried and my experiences with them.
- 4shared - WebDAV no longer offered to free accounts
- CloudMe - WebDAV no longer appears to function
- Google Drive - DAV-pocket doesn't seem to work anymore; WebDAV bridge is self-hosted and runs into the same issues as self-hosted (see below)
- IDriveSync - WebDAV no longer offered to free accounts
- Koofr - Multiple reports of issues in recent weeks
- pCloud - No longer offered to free accounts
- Yandex Disk - WebDAV responds with '402 - Payment Required'. Yandex site then asks for personal information before unlocking the disk (Phone number, passport, etc) which is not something I want to provide
It seems a bunch of these are related to the recent wave of malware that is being distributed via WebDAV, and so WebDAV providers are rightly closing up access to free/anonymous accounts to prevent abuse.
Bonus Attempts:
- Self-Hosted - Zotero requires a valid certificate from a CA. Self-hosted thus appears to require a domain, a valid certificate, and a complex WebDAV setup. While a self-signed certificate can be 'sideloaded' using Firefox on the PC, the iPad environment isn't so forgiving.
- NextCloud (hosted) - Worked for a day before the service provider deactivated the account. Multiple reports of users having free accounts deactivated if not paid within X amount of time. Self-hosted would have same issue as above.
- Azure - As a cloud dev, I've got a bit of wiggle room in Azure but none of the storage containers there provide WebDAV support. It's possible to spin up a VM server running a WebDAV service connecting to a storage account, but it gets expensive and complicated fast.
- OneDrive - OneDrive seems to provide a valid WebDAV service in all ways *except* a failure to respond to an OPTIONS request with DAV: 1. This is because there's a redirect during the WebDAV request. Several other WebDAV clients support this but Zotero is sticking with the spec (no judgement here, just pointing it out).
While the obvious answer is to give up and pay/support Zotero, I'm not an academic but a public servant / data engineer and my work doesn't involve Zotero at all. My usage of Zotero is purely for hobby and I'm not sure I can even justify the strain that the 300mb 'swapping' is putting on Zotero (there must be ingress/egress costs involved here).
Anyone have any luck with WebDAV in recent days, and what is their current setup?
My current workflow is to bring PDFs into Zotero, where Zotfile immediately renames and moves the files. Then, one by one, I bring PDFs back into Zotero storage until I am roughly around 250mb of storage. These sync to my iPad where I annotate them; when finished, I 'offload' them by running them through Zotfile again.
Since Zotfile's move functionality (only renaming) isn't making it to Zotero 7, I've been considering WebDAV as a possible replacement for the above workflow. However, valid WebDAV options seem to be dwindling rapidly. I've included below the WebDAV services I've tried and my experiences with them.
- 4shared - WebDAV no longer offered to free accounts
- CloudMe - WebDAV no longer appears to function
- Google Drive - DAV-pocket doesn't seem to work anymore; WebDAV bridge is self-hosted and runs into the same issues as self-hosted (see below)
- IDriveSync - WebDAV no longer offered to free accounts
- Koofr - Multiple reports of issues in recent weeks
- pCloud - No longer offered to free accounts
- Yandex Disk - WebDAV responds with '402 - Payment Required'. Yandex site then asks for personal information before unlocking the disk (Phone number, passport, etc) which is not something I want to provide
It seems a bunch of these are related to the recent wave of malware that is being distributed via WebDAV, and so WebDAV providers are rightly closing up access to free/anonymous accounts to prevent abuse.
Bonus Attempts:
- Self-Hosted - Zotero requires a valid certificate from a CA. Self-hosted thus appears to require a domain, a valid certificate, and a complex WebDAV setup. While a self-signed certificate can be 'sideloaded' using Firefox on the PC, the iPad environment isn't so forgiving.
- NextCloud (hosted) - Worked for a day before the service provider deactivated the account. Multiple reports of users having free accounts deactivated if not paid within X amount of time. Self-hosted would have same issue as above.
- Azure - As a cloud dev, I've got a bit of wiggle room in Azure but none of the storage containers there provide WebDAV support. It's possible to spin up a VM server running a WebDAV service connecting to a storage account, but it gets expensive and complicated fast.
- OneDrive - OneDrive seems to provide a valid WebDAV service in all ways *except* a failure to respond to an OPTIONS request with DAV: 1. This is because there's a redirect during the WebDAV request. Several other WebDAV clients support this but Zotero is sticking with the spec (no judgement here, just pointing it out).
While the obvious answer is to give up and pay/support Zotero, I'm not an academic but a public servant / data engineer and my work doesn't involve Zotero at all. My usage of Zotero is purely for hobby and I'm not sure I can even justify the strain that the 300mb 'swapping' is putting on Zotero (there must be ingress/egress costs involved here).
Anyone have any luck with WebDAV in recent days, and what is their current setup?
https://github.com/wileyyugioh/zotmoov
https://forums.zotero.org/discussion/104858/on-zotfile-development-and-zotero-7
BTW your workflow of storing only a subset of file-synced PDFs (< 300 mb) in local Zotero storage, when you intend to annotate them in the mobile app (while keeping the rest as linked files in Zotfile's Custom Location), is neat. That would seem to still be possible in v7 while using the new plugin to manage linked files.
As for storing a subset in Zotero storage; I've noticed that sometimes the downloaded PDF files on the iPad remain even after being converted to linked files on the PC. Annotating these 'phantom' files works identically to the real thing and they're synced back to PC just fine. Eventually Zotero realizes they were moved out of Zotero storage, though, and removes the file. If I could recreate this reliably, it means I could load the iPad up with a lot more files, 300mb at a time, while keeping the Zotero storage clean and only using it as a temporary landing point. This doesn't seem to be intended, however.
https://infini-cloud.net/en/
I've been using it for a month and works well.
I know it's a pretty specific case, but posting it just in case someone's wondering.
or koofr. I got to see up to 3 MBytes speed at particular points in time.
Anyway, I guess there is room for a higher speed in WebDAV considering the speed of my Internet connection, 95Mbps, is much faster than the speed I see in WebDAV. The slow speed I see in WebDAV makes using Zotero unfeasible.
How did you overcome this?
Thanks
I want to reproduce it, but I cannot figure out how.
As far as I understood, there are three steps:
1. bring PDFs into Zotero, where Zotfile immediately renames and moves the files. 2. One by one, bring PDFs back into Zotero storage (these sync to my iPad, where I annotate them)
3. when finished, 'offload' them by running them through Zotfile again
I don't know how to perform steps 2. and 3.
for 2., if I just move them manually in the file explorer, Zotero cannot find the files anymore
for 3., I don't know how to run them through Zotfile again
Essentially, the workflow is as follows:
1. Bring the file into Zotero - ZotMoov (replaces ZotFile) can move this to the 'offload' folder automatically.
2. When you're ready to work with the file, highlight the files you want to work with and choose Tools -> Manage Attachments -> Convert Linked Files to Stored Files...
3. The files will be turned into Stored Files in Zotero, which will then sync to whichever service you're using (Zotero Storage or WebDAV), and then down to your mobile device
4. Work with the files on Mobile for annotation / metadata updating / etc. When finished, go back to your PC and choose ZotMoov: Move Selected to Directory on the item.
5. The files will be deleted from your mobile device eventually, but all your annotations are still accurate and saved in Zotero.
ZotMoov has also introduced a 'ZotMoov: Move Selected *from* Directory' option that ZotFile didn't have, and this might be a better option for step 2 above.
However, I keep getting an error when setting it up: when adding the webdav login details, Zotero keeps saying security certificate is invalid, unknown issuer (Error code: SEC_ERROR_UNKNOWN_ISSUER). Any workaround?
>> UPDATE: never mind, I was running Zotero version 6. After updating to version 7 the problem is resolved.