Fast, secure, efficient backup program
-
Updated
Dec 9, 2024 - Go
#
dedupe
Here are 78 public repositories matching this topic...
🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
python clustering dedupe record-linkage python-library entity-resolution datamade dedupe-library de-duplicating
-
Updated
Nov 25, 2024 - Python
Deduplication tool for yarn.lock files
-
Updated
Dec 4, 2024 - TypeScript
A powerful and modular toolkit for record linkage and duplicate detection in Python
python machine-learning privacy dedupe record-linkage python-library entity-resolution similarity string-distance deduplication data-matching utrecht-university
-
Updated
Feb 21, 2024 - Python
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
identity data-science identity-resolution spark etl analytics dedupe entity-resolution data-transformation ml fuzzy-matching deduplication datalake masterdata dataengineering fuzzymatch dataquality analytics-engineering data-transformations modern-data-stack
-
Updated
Dec 10, 2024 - Java
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
c dictionary dedupe password wordlist remove-duplicates uniq hashes cracking wordlist-generator hashcat unique duplicate-detection password-cracking wordlists
-
Updated
Jun 25, 2022 - C
Make CSS easier and more maintainable by using JavaScript
-
Updated
Jan 18, 2024 - TypeScript
🆔 Command line tool for deduplicating CSV files
-
Updated
Mar 31, 2020 - Python
🆔 Examples for using the dedupe library
-
Updated
Aug 10, 2024 - Python
Identifying and removing near-duplicate images using perceptual hashing.
-
Updated
Nov 22, 2022 - Python
A fast file deduplicator
-
Updated
Sep 4, 2023 - Rust
Fast block-level out-of-band BTRFS deduplication tool.
-
Updated
Nov 3, 2024 - Python
Daxus is a server state management library for React that provides full control over data, leading to a better user experience.
-
Updated
Oct 14, 2024 - TypeScript
Yet Another Dupes Finder
-
Updated
Nov 4, 2024 - Rust
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
resolution identity awesome identity-resolution resource dedupe record-linkage entity-resolution entities fuzzy-matching entity disambiguation deduplication entity-linking fuzzymatch entity-matching data-matching senzing de-duplicating senzing-community
-
Updated
Dec 5, 2024 - Python
A simple command line interface to the datamade/dedupe library.
-
Updated
Dec 26, 2022 - Jupyter Notebook
Self-contained C# library for data deduplication using Sqlite
compression storage nuget dedupe sqlite-database data-deduplication chunk compress deduplication chunk-data duplicate-data chunk-key
-
Updated
Apr 7, 2023 - C#
Improve this page
Add a description, image, and links to the dedupe topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the dedupe topic, visit your repo's landing page and select "manage topics."