PHP MySQL LOAD DATA - exclude duplicates

Question

Currently I'm using the following to import a CSV file in to a table.

$query = <<<eof
    LOAD DATA LOCAL INFILE 'list.csv'
     INTO TABLE pupils
     FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY '"'
     LINES TERMINATED BY '\n'
    ( -- Field List -- )
eof;

if ($conn->query($query) === TRUE) {
  echo "Data Imported successfully";
} else {
  echo "Error importing data: " . $conn->error;
}

-- Field List -- is a comma separated list of fields.

This works well and imports the data from the CSV file in to the table.

I've got a new CSV to import and there are going to be some entries that already exist in the database. During the import is it possible to check if a entry already exists ?

My Database has a field called remote ip which will be unique for each entry. Is there anyway to check if it exists and it it does don't import that row from the CSV ?

Thanks

Mike Robinson · Accepted Answer · 2021-03-24 16:06:09Z

1

No. LOAD DATA INFILE does exactly what it says. You will have to remove the duplicates separately.

answered Mar 24, 2021 at 16:06

Mike Robinson

9,0516 gold badges33 silver badges50 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Tom Over a year ago

Thanks. I'll clean the data before importing it.

Collectives™ on Stack Overflow

PHP MySQL LOAD DATA - exclude duplicates

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related