Python script to count number of files in a folder based on matching string within the files

Question

I have a folder containing multiple files. I want to count the number of files that contains matching text say "Pathology" or a pattern say "ORC|||||xxxxxxxx||||||" inside it from those files present inside the folder. I have tried following scripts :

import re, os
import glob

list_of_files = glob.glob('./*.hl7')

for fileName in list_of_files:
    fin = open( fileName, "r" )
    count = 0

for line in fin:
    if re.match("Pathology", line):
            count +=1
fin.close()

print count

This gives me result as 0. I am using python 2.6.6. and have no options of upgrading my python. Please suggest a way to do this.

how if you use like if 'Pathology' in line:..count +=1? Also why every time you make count=0 for each file? see stackoverflow.com/questions/11162711/… — Jayesh Bhoi
– Jayesh Bhoi, Commented Jul 31, 2014 at 11:32
Please look at the question and make sure the indentation of the code is correct. — Aaron Digulla
– Aaron Digulla, Commented Jul 31, 2014 at 11:54

Borodin · Accepted Answer · 2014-07-31 11:36:12Z

1

If you will accept a Perl solution then this fits the bill.

As it stands it prints the names of all the matching files. If you really want just the count then remove the line print $ARGV, "\n"

use strict;
use warnings;

local @ARGV = glob './*.hl7';

my $count;

while (<>) {
  next unless /Pathology/i;
  ++$count;
  print $ARGV, "\n";
  close ARGV;
}

print "\n\n$count files found\n";

answered Jul 31, 2014 at 11:36

Borodin

127k9 gold badges72 silver badges146 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Debarshi Over a year ago

Can I check whether a line begins with ORC and the length of that line is atleast 10 then count otherwise not

Borodin Over a year ago

@Debarshi: So you want to count the number of files that contain at least one record beginning ORC that has at least ten characters?

Aaron Digulla · Accepted Answer · 2014-07-31 11:55:47Z

1

You can do this with grep and wc:

grep Pathology *.hl7 | wc -l

gives you the number of hits.

grep -c Pathology *.hl7

will list the files with hits and then the number of hits per file.

answered Jul 31, 2014 at 11:55

Aaron Digulla

330k111 gold badges626 silver badges840 bronze badges

Comments

Steve Barnes · Accepted Answer · 2014-07-31 12:07:11Z

0

Easiest is to just use grep --files-with-matches StringOrPattern *.hl7 or grep -l StringOrPattern *.hl7 but if you need to do it in python you need to fix your indentation as your current code as posted will only report the number of matches in the last file.

import re, os
import glob

list_of_files = glob.glob('./*.hl7')
files_with_matches = 0

for fileName in list_of_files:
    fin = open( fileName, "r" )
    count = 0

    for line in fin:
        if re.match("Pathology", line):
            count +=1
    fin.close()

    if count > 0:
        files_with_matches += 1
        print filename, count

print "Done", files_with_matches, "Matches"

answered Jul 31, 2014 at 12:07

Steve Barnes

28.6k6 gold badges68 silver badges80 bronze badges

Collectives™ on Stack Overflow

Python script to count number of files in a folder based on matching string within the files

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related