We deliver data integration and workflow automation solutions. Check out our Case Studies here

Compare: A Powerful Data Comparison Tool

Dispatch Integration’s smart data comparison engine compares millions of records in minutes.

Data Records Comparison System

Most enterprises have dozens or hundreds of datasets that need to be analyzed and validated whenever systems, processes, or populations change. Dataset analysis can be a tedious and repetitive job, even when using advanced Excel functions.

Dispatch Integration’s Compare is a fully automated, secure, and easy-to-use desktop application that rapidly compares .csv and other comma-delimited files to find differences between datasets. It is a smart, simple and fast data comparison solution that eliminates hours of work normally required to compare data within large files.

Compare has greatly reduced the amount of time I need to analyse “before” and “after” files for our semi-annual upgrade testing.  It allows me to quickly focus on where the differences in data are and easily code them as “explainable” or “unexplainable”.

Lisa
Senior Business Analyst – Retail

Features And Benefits

,

Easy To Use

Compare is a powerful data comparison tool designed to be simple and easy to use.

m

Multiple Uses

Compare can be used by business analysts, data scientists, integration specialists, and other software professionals to quickly and accurately find the differences between datasets.

Powerful

Large files consisting of hundreds of columns and hundreds of thousands of rows can be processed in a matter of minutes.

~

Secure

Compare is secure. All data processing occurs on your local machine. Nothing is transmitted or processed in the cloud.

}

Speed

Compare automatically processes millions of records per minute and outputs the results to Excel, where more analysis can occur.

Support

Dispatch Integration supports everything we build. We prioritize servicing your needs throughout the data integration and workflow development lifecycle.

How Compare Works

Step 1: Select Files to Compare

Select two comma-delimited files with the same column headers. The ID number of each file is used to match the records between the files.

Step 2: Select Key Fields

After selecting the files that need to be compared, select a key field by using the options available (column headers from the files). More that one field can be selected.

Step 3: Select Output Options

The output file will contain more columns than the original files being compared. This allows the user to filter files that have differences in datasets, and decide how to deal with the identified discrepancies.

Step 4: Compare Output In Excel

The output highlights the discrepancies between files and provides users with information such as the number of records in each file, the number of unique records between the two files, the number of differences detected, and the total number of warnings (e.g. records with identical ID numbers).

Compare Saves Valuable Software Development Time and Resources – and Eliminates Problems Caused by Bad Data

Request a free trial today to find out how.

Compare Is For You!

Who Uses Compare

Developers

Enterprise Systems Developers use Compare to determine if their code is delivering the output they expect. Compare is a simple tool to use while doing unit tests to validate that output of systems in development matches legacy code and business requirements.

Engineers, Researchers, and many more professions

Engineers, Researchers and many more professionals use Compare as a simple and fast tool to help them analyze data quickly.  Compare saves time and eliminates tedium, regardless of the type of data.

Data Scientists

Data scientists use Compare to quickly determine differences between datasets.  Data scientists typically have many analytical tools at their disposal, but Compare is the simplest and fastest way to look for quickly find differences between data files.

IT Professionals

IT professionals use Compare to help with regression testing during system upgrades. When applications are modified, reconfigured, upgraded, or replaced, Compare can save hours of time during testing to confirm system output is the same before and after any change.

Simply take a “known-good” output file and compare it to a file generated by the changed system.  Compare will flag any differences between the files in minutes.

Business Analysts

Business Analysts use Compare to quickly analyze datasets to find anomalies. Cleaning datasets that have gotten out of sync is easier and faster using Compare. Differences can quickly be tagged for further review and correction or accepted as is.

The output is in Excel format and can include both the original datasets plus a rich comparison sheet to conveniently conduct more analysis if required. 

Quality Assurance Professionals

Compare can help QA professionals quickly analyze datasets to pinpoint quality issues or anomalies.  Whether you’re looking for temporal changes, piece-to-piece changes, within piece changes or population to population changes, Compare will help you quickly discover potential quality problems.

Data Migration Specialists

Data Migration Specialists move data between internal and external systems. Compare lets Data Migration Specialists compare data loads from different times or systems to ensure differences are understood and bad data doesn’t inadvertently pollute systems.

Differences can easily be flagged in the output file for further investigation or acceptance.

Frequently Asked Questions

What does Compare do?
Compare analyzes two data files containing similar lists of unique records and generates an excel sheet summarizing the differences between the two files. For an overview video on how to use Compare, click here
How do I install Compare?

If you haven’t already downloaded the installation file, click on this link to be taken to a site to initiate the download.

Once you have filled out the form and accepted the Terms & Conditions, you will be taken to a secure download page. On this page you can download the Compare installation program, some sample data files to get you started, and some installation instructions.

When the application has finished downloading, run the installation program.

To try out Compare for the first time, download the two practice files located on the application download site:

Compare Practice Data File 1.csv
Compare Practice Data File 2.csv

You can use these files to try the application before using your own data files.

If you have any issues with installation, please contact us at compare@dispatchintegration.com

What type of files can be compared?
Compare works with a common data file type called “comma delimited format”. These are plain text files with each row representing one record, and each record consisting of one or more fields, separated by commas.  They most often have a .csv file extension, although this is not mandatory.

For more information on these kinds of files, see here

Do my files need to have a .csv extension?
Compare works with comma delimited files, but does not require a .csv extension.  Many systems output in comma delimited format but use their own proprietary file extensions.  These files will work with Compare.
What kinds of differences can Compare detect?
Compare detects non-matching cell values such as:

  • Simple differences (e.g. “LOA” vs. “Leave of Absence”)
  • Capitalization (e.g. “atlantic” vs. “Atlantic”)
  • Leading or trailing spaces (e.g. ” Weekly” vs. “Weekly” vs. “Weekly “)
  • Special characters (e.g. “Cafe” vs. “Café”)

Any records that only exist on one of the files will be identified, as well as any records where the unique identifier is repeated.

The records in the files are matched based on unique identifiers (one or more fields that uniquely identify a record), so it does not matter if the records in the two files are in a different order.

Can I use files without headers?
We recommend you always use files with defined header rows. Compare always assumes the first row in the files you select is the header row.

If the first row just contains data, it may be difficult to select key columns and the output data may be difficult to interpret. In some cases, Compare may not be able to interpret files without headers at all, in which case you will see an error similar to this:

 

If you see this error, please open the source files, add the same headers to each file, and re-save as csv files.

How does Compare handle extended character sets?
Compare works with standard ASCII encoded files and extended character set UTF-8 encoded files. UTF-8 encoded files preserve non-English language characters and other special formats.  If these files are saved as ASCII encoded CSV files, the extended character sets will be lost.

Note: Compare requires both files to have the same encoding – either ASCII or UTF-8.

Please note: there are multiple CSV file encoding formats and no easy way to tell how a file is encoded.  Take caution when opening and saving these kinds of files to ensure appropriate encoding is preserved.

What happens if I have duplicate column header names?
You can compare files that have duplicate column headers, but for the comparison to work properly, these duplicate columns should not be selected as “key fields”. 

If you want to include one or both of the duplicate column headers as key fields, we recommend renaming the headers to unique names before you load the files.

Can I use files that have a semicolon or pipe as delimiter?
At this time Compare only works with files which have records delimited by commas.

Sometimes other delimiters are used in data files such as pipes (“|”) and semicolons (“;”). If you can convert these files to comma delimited, they can be processed by Compare.

When converting these files, it is important to ensure the records themselves don’t have commas in them, as these commas would be interpreted as delimiters. This may cause Compare to fail, or make the results invalid.  Therefore, we recommend the following steps for conversion:

  1. Open each file to be compared in a text editor
  2. Search for commas and replace those commas with another character (such as a dash). You may want to choose a character that isn’t used elsewhere in the file.
  3. Search for the delimiter (most often | or ; and replace them with commas.
  4. Save a copy of each file. Be sure the file is saved as plain text.
  5. Run Compare using these modified files.
Why can't I sort columns in the output file numerically?
Compare formats all data as text. In order to sort a column on the output file numerically, simply select all of the values in that column (control-shift), click on the exclamation mark next to the top cell, and select “convert to number”. Now a filter on that column can sort numerically.

What happens if I often analyze similar types of files?
The first time you analyze files using Compare, the analytics engine creates a fingerprint of the file structure and the key columns you select.

Compare saves that fingerprint so that the next time you analyze the same type of file, the key(s) are automatically selected. This allows you to skip this step and start the process of comparing right away.

Why is the output in .xlsx format?
Excel remains the most popular general purpose analytics tool for business users. By outputting in .xlsx, Compare can add some additional functionality such as the ability to use color to denote records with differences, and dropdowns to select next actions.
How long does it take to process a file?
Compare uses a powerful data processing engine that can complete large files with millions of records in minutes.

Processing speed is a function of file size, file configuration, options selected and the speed and memory of your computer.

If you are comparing large files with many columns (fields), we recommend selecting the option to output only differences and to exclude original data sheets.

Writing output is the most intensive part of the Compare process, so if you select the options to output all records and include original sheets, the process can take 2 or more hours.

Is there a maximum file size?
The maximum file size Compare can handle is as follows:

Each record (row) cannot exceed 255 fields (columns).

Each record (row) cannot be longer than 8,192 characters.

The maximum number of rows that Compare can process is limited by memory on your machine. Note that Excel cannot load files larger than 1 million rows.

The amount of available RAM on your computer may further limit file size that can be processed by Compare.

Is my data secure?
Yes. Compare is a desktop only application. No data is ever moved off of your machine, and all processing occurs on your computer.

You can safely process files containing confidential data, personally identifiable information (PII) or private health information (PHI).  

Note: the output files will contain data from the input files, so these should also be treated with the same level of security and privacy controls as the input files.

What happens if input files or output files are open in Excel when running Compare?
Excel “locks” files when in use, which prevents files from being changed by other applications while opened in Excel.

This means that you must ensure Excel does not have input files open when selecting them.  You must also ensure the output file is not opened in Excel when starting the compare. If you see errors related to this, just close the files in Excel and re-start the compare.

 

How does licensing work with Compare?
Compare is available as an annual subscription. Each subscription license entitles the user to install the application on a single computer. If you need to change computers during the year, you can update your license details at any time.
How does the free trial work?
You can download an unlimited use two-month free trial version of Compare for evaluation. There are no limitations on file size or number of compares done during the trial.  At the end of the trial, the application will be locked until you purchase a subscription license.
How do I purchase more than one license?
If you’re a manager or team leader who would like to purchase license subscriptions for your team members, you can select this option during checkout.

You can manage and assign licenses to team members and individual computers. If team members change roles, you can reassign licenses to different people.

What are the system requirements to run Compare?
Compare works on Windows 7 Professional or greater.  Screen resolution of at least 1290 x 800 is required.
How do I know whether I'm running the up-to-date version of Compare?
In Compare, click on the “Help” menu, and “Check for Updates”. If there is a newer version available, you will have the option to download and update Compare automatically

 

How do I report a bug, or provide other feedback?
Click on “Help”, and “Support”. This will open your web browser and take you to our support portal where you can send us a support ticket. You can also email us at compare@dispatchintegration.com.

 

I am getting the following error message: Unable to complete processing: Index was outside the bounds of the array.

This error occurs if an input file has rows with more records than the header. In this case, the software cannot determine what column the extra record belongs to.

If you get this error, check the input files to make sure all rows have the same number of columns as the header row.

 

Get Compare Today

2 MONTH FREE TRIAL

$89/year (USD)

  • Compare two comma-delimited files automatically
  • Output to Excel
  • Selection of single or multiple keys
  • Choose to show all records or just differences
  • Secure – all data remains on your computer
  • Powerful – file size only limited to memory on your computer

We’re Here to Help

Contact us if you need support or have questions regarding Compare

  • This field is for validation purposes and should be left unchanged.