.Split() method for parsing url paths python

Question

How can I split urls like this (which are coming from a django object selection):

[<PathsOfDomain: www.somesite.com/>, <PathsOfDomain: somesite.com/prof.php?pID=589>, <PathsOfDomain: www.somesite.com/some/path/here/paramid=6, <PathsOfDomain: www.somesite.com/prof.php?pID=317>, <PathsOfDomain: www.somesite.com/prof.php?pID=523>]

I have code:

if self.path_object is not None:
    dictpath = {}
    for path in self.path_object:
        print path #debugging only
        self.params = path.pathToScan.split("?")[1].split("&")
        out = list(map(lambda v: v.split("=")[0] +"=" + self.fuzz_vectors, self.params))
        dictpath[path] = out
    print dictpath

I'm getting an error of:

self.params = path.pathToScan.split("?")[1].split("&")
IndexError: list index out of range

What am I doing wrong here?

Thank you!

It looks like a django queryset. Show PathsOfDomain model definition. Thanks. — alecxe
– alecxe, Commented May 27, 2014 at 20:52
can you give an actual example of what you want the dictionary to be after you are done? — Winston Ewert
– Winston Ewert, Commented May 27, 2014 at 21:17
If there's no querystring in the URL, then split("?")[1] will be out of range, as you can see, e.g. "www.somesite.com".split("?") equals ["www.somesite.com"]. — Simon MᶜKenzie
– Simon MᶜKenzie, Commented May 28, 2014 at 1:53

Winston Ewert · Accepted Answer · 2014-05-27 21:31:16Z

2

self.params = path.split("?")[1].split("&")

should be

self.params = path.path.split("?")[1].split("&")

path is the PathsOfDomain object, but you need path.path which the actual string containing the path.

You should also look at the urlparse module which contains code to help parsing urls. You can use it simplify your code here.

answered May 27, 2014 at 21:31

Winston Ewert

45.2k10 gold badges70 silver badges86 bronze badges

Sign up to request clarification or add additional context in comments.

10 Comments

CodeTalk Over a year ago

Thanks for the code snippets, however, I'm still receiving an error of: IndexError: list index out of range

CodeTalk Over a year ago

Any thoughts on this?

Winston Ewert Over a year ago

I can see the problem, but I'm going to have to see some initiative in figuring it out before telling you what it is.

CodeTalk Over a year ago

I did some background on this error, it appears as I loop over the paths, its decrementing the list by one and thus throwing off the loop? Since its trying to access indices which no longer exist? Is this what is happening here Winston?

Winston Ewert Over a year ago

No, that particular issue isn't happening here. That happens when you somehow modify the list you are operating on. But you aren't modifying the list so you are safe from that. Can you determine which path it fails on?

|

Collectives™ on Stack Overflow

.Split() method for parsing url paths python

1 Answer 1

10 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

10 Comments

Your Answer

Sign up or log in

Post as a guest

Related