A fast file deduplicator
-
Updated
Oct 10, 2025 - Rust
#
file-deduplication
Here are 19 public repositories matching this topic...
Yet Another Dupes Finder
-
Updated
Sep 2, 2025 - Rust
Smash through to find duplicate files super fast by slicing files intelligently!
go windows macos linux cli freebsd duplicate-files deduplication cli-tool file-deduplication file-deduplication-tool
-
Updated
Jan 30, 2026 - Go
.NET 10 API for document file format identification, text/metadata/attachment/embedded object/sensitive item (PII/PHI/FERPA)/entity extraction.
metadata sdk csharp dotnet email text extraction indexing text-extraction archive pst embedded-objects file-format-detection entity-extraction phi file-deduplication pii microsoft-office pii-detection file-identification
-
Updated
Mar 3, 2026 - C#
Case study using dotfurther's Open Discover Platform with the RavenDB document store to rapidly create a full-text search/eDiscovery/information governance capable demonstration application.
metadata text-extraction full-text full-text-search ravendb ediscovery indexing-engine file-format-detection data-breach file-deduplication pii information-governance-catalog personally-identifiable-information archive-extractor pii-detection file-identification full-text-extraction document-ingestion information-governance
-
Updated
May 28, 2024
fast, parallel duplicate file detection
fast command-line file-deduplication statically-linked duplicate-file-finder duplicate-file-detection
-
Updated
Nov 18, 2025 - C
File deduplicator
-
Updated
Apr 27, 2022 - Rust
Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.
-
Updated
Mar 7, 2026 - C#
CloneZapper is a Python script that hunts down identical files within a directory and its subdirectories, ruthlessly eliminating them!
-
Updated
Jun 1, 2024 - Python
Этот проект представляет собой мощный инструмент для поиска и анализа дублирующихся файлов в указанной директории. Программа позволяет эффективно выявлять одинаковые файлы на основе их содержимого, используя алгоритм хеширования SHA-256. Она поддерживает настройку параметров, таких как минимальный размер файла для проверки и игнорирование определен
python hashing productivity multithreading data-deduplication file-system sha256 file-management system-utility cli-tool dev-tools file-deduplication file-comparison disk-cleanup command-line-utility duplicate-file-finder
-
Updated
Feb 14, 2025 - Python
Golang Deduplication Utility Library
-
Updated
Dec 29, 2017 - Go
A simple command line utility that identifies groups of identical files and displays them to the console.
-
Updated
Mar 5, 2025 - Rust
Find duplicate files in multiple folder(s) scanning .txt or/and .torrent files and depending on the selected mode (readonly: true | false) get information about duplicated files /+ extract them into new folders
nodejs cli typescript functional-programming file-scanner inquirer fp-ts file-deduplication eslint-plugin-functional inquirer-fuzzy-path
-
Updated
Mar 17, 2026 - TypeScript
A high-performance file deduplication tool that detects and manages duplicate files using content hashing and intelligent similarity analysis.
go golang files file file-deduplication file-checker file-duplicator file-duplicate file-deduplication-tool file-deduplication-windows file-duplicates-cleanup-windows
-
Updated
Dec 19, 2025 - Go
A fast, configurable Zsh shell function for macOS that detects and moves duplicate files into organised DUPLICATE_FILE_TYPE_<EXT>/ folders — by content hash, name, size, or type. Non-destructive. Safe to re-run.
macos zsh productivity automation terminal utilities command-line duplicate-files developer-tools shell-script sha256 file-management deduplication macos-utility zsh-functions cli-tool file-deduplication duplicate-finder file-organizer zsh-script
-
Updated
Mar 10, 2026 - Shell
Dedupy: a file deduplication tool
-
Updated
Mar 17, 2025 - Python
Improve this page
Add a description, image, and links to the file-deduplication topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the file-deduplication topic, visit your repo's landing page and select "manage topics."