fclones

Efficient duplicate file finder and remover. More information: https://github.com/pkolaczk/fclones.

• Search for duplicate files in the current directory:

fclones group .

• Search multiple directories for duplicate files and cache the results:

fclones group --cache path/to/directory1 path/to/directory2

• Search only the specified directory for duplicate files, skipping subdirectories and save the results into a file:

fclones group path/to/directory --depth 1 > path/to/file.txt

• Move the duplicate files in a TXT file to a different directory:

fclones move path/to/target_directory < path/to/file.txt

• Perform a dry run for soft links in a TXT file without actually linking:

fclones link --soft < path/to/file.txt --dry-run 2 > /dev/null

• Delete the newest duplicates from the current directory without storing them in a file:

fclones group . | fclones remove --priority newest

• Preprocess JPEG files in the current directory by using an external command to strip their EXIF data before matching for duplicates:

fclones group . --name '*.jpg' -i --transform 'exiv2 -d a $IN' --in-place