PHP only store 1048576 characters in array

Question

I'm working on a project that parses huge text files and store some of the information in MySQL DB. I noticed one of the field was missing info when it was displayed, however, when checking the DB (from phpmyadmin), it shows the data is complete, so the problem must be with the php, before the length of the array field is 1048576, whereas there are 1235597 characters in DB.

My php info shows memory_limit is 2048M, Mysql config shows: [mysqld] key_buffer = 32M max_allowed_packet = 32M

I don't know what else could have caused the problem... someone please help!!!

Thanks, Sean

1048576 would seem to be one megabyte - I'd assume you were running into an internal storage limit in PHP. — andrewsi
– andrewsi, Commented Apr 25, 2013 at 20:11
@andrewsi: No way there would be such a small internal limit to anything. — Jon
– Jon, Commented Apr 25, 2013 at 20:14
I think we need a little more info. If you could extract the code that's giving you trouble from the project we could probably come up with something. — Chris Hanson
– Chris Hanson, Commented Apr 25, 2013 at 20:23

Verron Knowles · Accepted Answer · 2015-07-03 10:21:31Z

2

PDO's default buffer size is 1 MB (1048576), try bumping it up to 2 MB (2097152)

If you are using PDO directly, pass this as the 4th argument

$pdo = new PDO(
    $dsn,
    $username,
    $password,
    array(PDO::MYSQL_ATTR_MAX_BUFFER_SIZE => 2097152)
);

If you are using Laravel, this can be done via the config/database.php file by adding an array of options to your connection

// ...
    'mysql' => array(
        'driver'    => 'mysql',
        // ...
        'charset'   => 'utf8',
        'collation' => 'utf8_unicode_ci',
        'prefix'    => '',
        'options'   => array(
            PDO::MYSQL_ATTR_MAX_BUFFER_SIZE => 2097152
        ),
    ),
// ...

answered Jul 3, 2015 at 10:21

Verron Knowles

9739 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

PHP only store 1048576 characters in array

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related