Maximize RAM for PHP/MYSQL query

Question

I have some php scripts that are parsing huge amounts of data from csv files (100gb+) into MYSQL tables. I want to allocate every possible amount of memory to this task.

Does this line of code allow me to increase the memory allocated to the script and if so what is the max amount of RAM I can set it to?

ini_set('memory_limit', '2G');

My PC has: Windows 8 16gb RAM

May be you need to chunk data and make some cron jobs with your app. Btw your question is unclear. — HddnTHA
– HddnTHA, Commented Aug 24, 2014 at 19:45
Does the ini_set('memory_limit', '2G') mean I can only parse 2GB of data? If not, how much can I parse at most? Ive heard with Windows 8 I have more resources. I am hoping for something constructive rather than sarcastic comments. Thank you. — Arjun Singh
– Arjun Singh, Commented Aug 26, 2014 at 3:00
@ArjunSingh oh well, you can do it with 2 gb ram via chunking data for eg 100 mb. It spends a lot of time and time == money (primarily opinion based.) As @pguardiario said; how do you keep a huge data with a small memory? I also dont recommend inserting a big data to mysql via php. Find a better way. — HddnTHA
– HddnTHA, Commented Aug 26, 2014 at 8:25

Adam Kopeć · Accepted Answer · 2014-08-27 12:06:49Z

1

No, shorthand notation works only in php.ini ( http://php.net/manual/en/faq.using.php#faq.using.shorthandbytes ). Use integer value in bytes instead.

answered Aug 27, 2014 at 12:06

Adam Kopeć

463 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

user3524389 · Accepted Answer · 2014-08-24 19:53:12Z

0

yes this line of code should work, but why do you make this in php for 100gb+ :O ?

answered Aug 24, 2014 at 19:53

user3524389

831 silver badge3 bronze badges

Collectives™ on Stack Overflow

Maximize RAM for PHP/MYSQL query

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related