How to compare two csv files using Robot Framework

Question

I would like to compare difference between two csv files using robot framework .Test case should fail if there is difference and pass if there is no difference.I have tried DiffLibrary in Robot framework but is returning pass status when records are not sorted. Can someone guide me how this can be achieved or if there is any alternative way to do this.

My first.csv file is having data like below

Benchmark Name,Policy Name,No of Rules,Policy Measurement SLO,Policy Remediation SLO,No of Rules Compliant in MSLO,No of Rules Non-Compliant in RSLO,No of Rules Non-Compliant OUT RSLO
CIS Red Hat Enterprise Linux 6 Benchmark v1.0.0,PCI,281,1 MONTHS,1 MONTHS,150,130
CIS Red Hat Enterprise Linux 7 Benchmark v1.2.0,PCI,281,5 MONTHS,1 MONTHS,150,137
CIS Red Hat Enterprise Linux 7 Benchmark v1.5.0,PCI,281,1 MONTHS,1 MONTHS,150,135

And my second.csv file is having data like below

Benchmark Name,Policy Name,No of Rules,Policy Measurement SLO,Policy Remediation SLO,No of Rules Compliant in MSLO,No of Rules Non-Compliant in RSLO,No of Rules Non-Compliant OUT RSLO
CIS Red Hat Enterprise Linux 7 Benchmark v1.2.0,PCI,281,5 MONTHS,1 MONTHS,150,137
CIS Red Hat Enterprise Linux 6 Benchmark v1.0.0,PCI,281,1 MONTHS,1 MONTHS,150,130
CIS Red Hat Enterprise Linux 7 Benchmark v1.5.0,PCI,281,1 MONTHS,1 MONTHS,150,135

Robot code is below

*** Settings ***
Library  DiffLibrary
Library  OperatingSystem


*** Test Cases ***


Diffing two files one being different
    Run Keyword And Expect Error  differences*  Diff Files  first.csv  second.csv

Lubos Jerabek · Accepted Answer · 2017-06-07 11:15:05Z

2

How about just using BuiltIn's Should Be Equal As Strings?

# Using Get File you easily get a file's content into a string variable
${csvA} =    Get File    ${filePathA}
${csvB} =    Get File    ${filePathB}
Should Be Equal As Strings    ${csvA}    ${csvB}

I use that model for comparing lines only, you might need to edit the file string in case there's difference in file encoding (BOM leaves a special BOM character in the beginning of the file, etc.)

answered Jun 7, 2017 at 11:15

Lubos Jerabek

8334 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Auto-learner Over a year ago

Hi Lubos, Thanks for your response. Will it give same result even if rows are not sorted ?

A. Kootstra Over a year ago

No, because the entire file would be considered a single string and any changes in line order would make it unequal.

Lubos Jerabek Over a year ago

If you do not care about lines order just do following: ${csvA} = Get File ${filePathA} ${csvA} = Split To Lines ${csvA} ${csvB} = Get File ${filePathB} ${csvB} = Split To Lines ${csvB} Sort List ${csvA} Sort List ${csvB} Should Be Equal As Strings ${csvA} ${csvB}

Auto-learner · Accepted Answer · 2017-06-08 05:48:53Z

This answer worked for me ,even if data is sorted .It will give the result as pass if there is no mismatch and fail if data mismatches.

csv_difference.py

import sys
     def csv_diff(file_f,file_g):
        #file_f = sys.argv[1]
        #file_g = sys.argv[2]
        set_f = set()
        set_g = set()
        with open(file_f) as f:
            line = f.readline().strip()
            while line:
                set_f.add(line)
                line = f.readline().strip()
        with open(file_g) as g:
            line = g.readline().strip()
            while line:
                set_g.add(line)
                line = g.readline().strip()
        diff = set_f - set_g

        # print set_f
        # print set_g
        # print diff
        if diff:
            #print "Data mismatch between the files"
            return False
        else:
            #print " Data Matches "
            return True

csv-difference.robot

*** Settings ***
    Library     OperatingSystem
    Library      csv_difference.py


    *** Test Cases ***
    CSV file comparison 
         ${output}=   Run keyword  csv diff   first.csv   second.csv
        Should Be True  '${output}' == 'True'

Cork Kochi · Accepted Answer · 2021-01-21 16:49:51Z

0

def csv_diff(file_f,file_g):
    with open(file_f) as f:
        textf = f.readlines()
        textf.pop(1)
        set_f = set(textf)
    with open(file_g) as g:
        textg = g.readlines()
        textg.pop(1)
        set_g = set(textg)
    if set_f == set_g:
        return True
    return False

answered Jan 21, 2021 at 16:49

Cork Kochi

1,9218 gold badges32 silver badges53 bronze badges

Comments

user3110010 · Accepted Answer · 2022-09-22 14:12:20Z

0

basicly, I transfer csv to dict and use jsondeepcompare library to compare csv. thanks

answered Sep 22, 2022 at 14:12

user3110010

563 bronze badges

1 Comment

pigrammer Over a year ago

This does not provide an answer to the question. Once you have sufficient reputation you will be able to comment on any post; instead, provide answers that don't require clarification from the asker. - From Review

Collectives™ on Stack Overflow

How to compare two csv files using Robot Framework

4 Answers 4

3 Comments

Comments

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

3 Comments

Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related