php script stops executing and shows no errors

Question

I have a php script that scrapes the web and inserts the scraped data into a database.
This php script runs for a very long time(about a couple of hours).
Sometimes, after the script runs for a long time, the php script just stops executing and shows no error.
The problem isn't caused due to the amount of execution time of the script because i set the php script to an unlimited amount of execution time.

ini_set('max_execution_time', 0);

I also set the php script to show all errors.

ini_set('display_errors',1);
error_reporting(E_ALL);

But I get no error after the php script stops execution.
I also ran the script in several other computers and i still encounter the same problem, so the problem isn't due to server restrictions either.

I researched the issue and apparently it's a networking problem.
The php script stops communicating with the server and disconnects from it(probably because the php script sent a http request and didn't receive any response).

My question is this:

Is there any way I can check for network disconnections through the php script, and resume the script and try to reconnect if there was a network disconnection?

"100000" is not "unlimited". It's 27.7777 hours. If you want unlimited, it should be 0. — Marc B
– Marc B, Commented Dec 10, 2014 at 14:07
The only way PHP will do unlimited timing, is if the parameter is 0. 100000 equates to 27.7 hours. — Anthony
– Anthony, Commented Dec 10, 2014 at 14:07
check your environment, i had this on virtualbox and just needed to reboot everything including the host machine — Robert Sinclair
– Robert Sinclair, Commented Jan 20, 2021 at 17:24

morantis · Accepted Answer · 2014-12-10 14:06:55Z

0

First "set_time_limit" is a better way to use that function and I would check your server's rules and regulations. If it is your private server, then great. If you are renting a VPS or other type of server, it is highly possible that they have restrictions to prevent misuse, like SPAMing and such. Make sure that you are within their rules and go from there.

answered Dec 10, 2014 at 14:06

morantis

1068 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

yuval Over a year ago

well sometimes the script stops execution and sometimes it works and finishes the execution fully.If i would have restrictions from my server to prevent misuse, the script would never work properly.I also ran the script in several other computers and i still encounter the same problem.I probably just didn't receive a response from an http request, and the php script just stopped execution.

morantis Over a year ago

Not sure what it is that you are doing, but you can also be getting issues from the server of the page that you are trying to work with. It is possible that your structure is much like a Denial of Service attack.

yuval Over a year ago

It's unlikely that it's a Denial of Service attack, but even if it is i would still like some code that tries to restart the script, or detect the problem that is occurring.

Collectives™ on Stack Overflow

php script stops executing and shows no errors

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related