PHP: Convert url in html to fully-fledged url?

Question

I am able to scrape a page for URLs, but I want to know what is the easiest way to convert the various formats that these links can be in, into a fully fledged url. For example:

If I scrape: www.mysite.com/some/place/in/space.html

And I get the following urls:

../img.jpg
img.jpg
../../bla.jpg
inc/bla.jpg
/
./

They should resolve to

www.mysite.com/some/place/img.jpg
www.mysite.com/some/place/in/img.jpg
www.mysite.com/some/bla.jpg
www.mysite.com/some/place/in/inc/bla.jpg
www.mysite.com/some/place/in/
www.mysite.com/some/place/in/

Is there a function that does this for all cases or is it something I would have to code?

dynamic · Accepted Answer · 2012-02-11 16:33:20Z

1

I use this function for a crawler i wrote long time ago: http://codepad.org/1VxMECNj

call the function with host prepended:

relativeUrl('http://host/dir/dir2/../../file.html');
//> returns http://host/file.html

edited Feb 11, 2012 at 16:33

answered Feb 11, 2012 at 11:16

dynamic

48.2k56 gold badges163 silver badges236 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Richard · Accepted Answer · 2012-02-11 11:13:46Z

0

You can just add www.mysite.com/some/place/in/ in front of the urls.. www.mysite.com/some/place/in/../img.jpg should resolve I think.

answered Feb 11, 2012 at 11:13

Richard

4,4267 gold badges38 silver badges58 bronze badges

Comments

Stelian Matei · Accepted Answer · 2012-02-11 11:14:30Z

0

You could do a REGEX to replace the relative links with the absolute URLs:

$data = preg_replace('#(href|src)="([^:"]*)("|(?:(?:%20|\s|\+)[^"]*"))#', '$1="' . $site_url . '$2$3', $data);

answered Feb 11, 2012 at 11:14

Stelian Matei

11.6k3 gold badges28 silver badges29 bronze badges

Collectives™ on Stack Overflow

PHP: Convert url in html to fully-fledged url?

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related