3.4 file sync stuff

The file sync seems to work nicely in 3.4. I re-enable file sync after the update and hit sync to see whether it would upload the attachments added since last week. It did (I could see the files being added to my WebDAV account). When I knew it had hit the last one, the stop file sync button duly disappeared for the metadata sync to take over.

After that it reappeared again, with a dreadfully empty progress bar (and little progress). I stopped it for fear of what was happening (reuploading all my stuff?). Stopping it worked. Later I saw it had presumably reuploaded some existing files (the number of files didn't change).

Restarting with the debug console, I see that it has 189 upload requests to go. The 12 I've seen passing by now all involve files that haven't been changed at all since last time, and that are already present on the WebDAV hosting (I can check this because the uploading takes time and the debug console tells me which zip file is going to uploaded).

In what kind of scenario does this happen? My hypothesis is that it's because of the cancelled file upload last week that seemed to have stalled. Apparently some sync info hasn't been saved then, despite files being uploaded.

But from a user perspective, this is still too much a black box. What is the sync doing all the time? Is it downloading stuff, uploading stuff? What changes are being made right now to my library, if any? Can I now quit Firefox or do I have to wait? If I hit stop now, is the whole operation cancelled or does it keep track of the progress made? That is the kind of information one would like to be available somehow or other.
  • What happens with files that are not found remotely, and how could that happen?


    zotero(3): Remote file not found for item 8R66Q3FE

    zotero(3): Finishing download request '8R66Q3FE'

    zotero(3): Finished requests: 1
  • But from a user perspective, this is still too much a black box. What is the sync doing all the time? Is it downloading stuff, uploading stuff?
    Have you tried hovering over the progress bar?
    Restarting with the debug console, I see that it has 189 upload requests to go. The 12 I've seen passing by now all involve files that haven't been changed at all since last time, and that are already present on the WebDAV hosting [...] In what kind of scenario does this happen?
    If you send the debug output to support@, I can take a look, but we do know of some timezone/timestamp-related bugs on Windows that can cause erroneous re-uploads and that we haven't found solutions for yet.
    If I hit stop now, is the whole operation cancelled or does it keep track of the progress made?
    Files already uploaded and downloaded remain. You can safely stop the file sync at any time. (This is why it's just a stop button and not a pause button.)
  • What happens with files that are not found remotely, and how could that happen?
    For now, it'll just keep trying them on every sync, though we'll need a better solution than that.

    The most likely way that could happen is if those files are missing locally, in which case it marks them as "to download" and tries to get them from the server.
  • Have you tried hovering over the progress bar?
    Lovely! The byte counter and the file counter together are a really fine form of feedback. BTW I don't get a progress bar currently, and the hover message says "NaN%" for progress. Big download sync on client 2; report errors not active.
  • edited December 3, 2008
    we do know of some timezone/timestamp-related bugs on Windows that can cause erroneous re-uploads and that we haven't found solutions for yet.
    I think I'm running into those, for yesterday client 2 has uploaded some 400 unchanged files, which client 1 has now downloaded dutifully (actually it hung halfway). Unfortunately I have no saved debug logs (it's sooo slow to run Zotero in Windows with debug mode on that I'm trying to avoid that).

    And now again (after a restart of FF) client 1 thinks it has to upload 281 files. I've not changed anything anywhere. It seems like this is going to be a never-ending cycle of the clients fooling each other into uploading and downloading stuff.

    Worse, the stop file sync button has now stopped responding. Error 131425023 says:

    [JavaScript Error: "[Exception... "'Trying to update a finished request in Zotero.Sync.Storage.Request.onProgress()' when calling method: [nsIProgressEventSink::onProgress]" nsresult: "0x8057001e (NS_ERROR_XPC_JS_THREW_STRING)" location: "" data: no]"]
  • See http://forums.zotero.org/discussion/4828/date-problem/ for the timestamp issue, and post the results there if you're seeing the same issue.
  • Okay, I replied over there.
  • Since it sounds like you're not seeing the same issue as over there, we'll probably need to look at debug output on one of the sides for the next upload attempt after a clean download. You can stop it after it has tried to upload a few files and send the output to support@.

This is an old discussion that has not been active in a long time. Instead of commenting here, you should start a new discussion. If you think the content of this discussion is still relevant, you can link to it from your new discussion.