Sorting a txt file with Python

Question

I need some help printing out a sorted txt logfile. there is no problem with the printing except that I dont want to print out the same IP number more than once.

This is my code.

    text_file = open("access_log.txt")
entire_file = text_file.readlines()
text_file.close()

for line in reversed(entire_file):
    try:
        arr = line.split(' ')
        date = arr[3] 
        print arr[0], "- - ", date[1:], " ",arr[6] 
    except IndexError, e:
        error = e

As you se I just want to print out the IP number, the date and page that been visited. But only once from similar IP.

Well as you maybe see Im a total beginner =) Thanks

eumiro · Accepted Answer · 2011-10-05 11:45:24Z

4

# empty set of already seen ips:
seen_ips = set()

with open("access_log.txt") as f:
    for line in lines:
        arr = line.split(' ')
        date = arr[3] 

        # if the ip still not seen, then print and add it to the seen_ips set:
        if arr[0] not in seen_ips:
            print arr[0], "- - ", date[1:], " ",arr[6]
            seen_ips.add(arr[0])
        # else (i.e. ip already seen) ignore and go on with the next line

edited Oct 5, 2011 at 11:45

answered Oct 5, 2011 at 11:13

eumiro

214k36 gold badges307 silver badges264 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Fred Foo Over a year ago

No need to read the entire file into memory with readlines. Just for line in f would suffice after opening.

Dymond Over a year ago

Thank you, the only thing that got screwed up was the date sorting. But I think I can figure it out :)

eumiro Over a year ago

@larsmans - you're right, I removed the OP's reversed() function call later and forgot to let the program read lines one after another... fixed.

Austin Marshall · Accepted Answer · 2011-10-05 15:28:13Z

0

You can use groupby() from itertools to group an iterable by a key that you specify, and then only operate on the key (or the first item in a group), so long as it's sorted:

split=lambda l: l.split(' ')
for key, group in groupby(sorted(map(split, f)), key=itemgetter(0)):
    line=next(group)
    print key, "- - ", line[3][1:], " ", line[6]

answered Oct 5, 2011 at 15:28

Austin Marshall

3,10519 silver badges14 bronze badges

Collectives™ on Stack Overflow

Sorting a txt file with Python

2 Answers 2

3 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related