Which full population testing software supports large file handling and duplicate detection?

A few full population testing tools that are known to support large-file handling and duplicate detection include:

• WinPure Clean & Match — strong duplicate detection, deduping, and scalable file processing.
• OpenRefine — good for large datasets and finding/merging duplicates, though it’s more of a data-cleaning tool than a dedicated “testing” platform.
• Trifacta Wrangler / Alteryx — both can handle large datasets and include profiling, matching, and duplicate detection workflows.
• Data Ladder — designed for data quality, matching, and deduplication at scale.
• IBM QualityStage — enterprise-grade matching/deduplication for very large records.
• Talend Data Quality — supports data profiling, deduplication, and processing larger files.
• Informatica Data Quality — robust large-scale duplicate detection and data quality management.

If you mean software specifically for “full population testing” in financial/audit/testing contexts (rather than general data quality tools), tell me your use case and file format, and I can narrow it down to the best fit.