Nuanced duplicate check

tomabel

Hi there,

I'm currently working with a Zotero library with about 1300 sources, and I've noticed a number of cases that haven't been recognized by the built-in duplicate tool because the title isn't an exact duplicate (e.g. one title might have a "the" at the beginning, and another doesn't). This is an issue because it's for a manuscript that's been worked on over a number of years by a number of people.

Is there a method with which I can run a more "nuanced" duplicate check that detects these types of cases? I'm very much an AI novice, but I wonder if there might be a third-party application I can utilize for this?

Appreciate any suggestions,
Tom

tomabel

Hi there - just following up on this. Thanks!

gustms

What if you add the same DOI to both entries?

tomabel

@gustms that would still require me to go through all records manually though, wouldn't it? I'm looking for a tool/process that can detect small discrepancies in the title or author fields.

thalient

.

tomabel

Here's an example. It's not a duplicate per-se, since it's the same book from two different publishers (and one of them is "forthcoming"). But it's the type of thing I'd like to identify, since I ultimately only want to reference one of them in the text.

tomabel

thalient

.

p0094188

it says 'SyntaxError: expected expression, got end of script'

thalient

.