Import Large CSV files into SQL Server using C#

Question

I want to import data from a csv file into SQL Server through C#. CSV file has over 2000 columns when converted.

What is the best way to approach this?

It's going to be an ongoing process and I am looking to perform CRUD operations.

I tried converting csv into datatable and used SQLBulkCopy to insert which seems to work for me. I am confused on how to structure the SQL table, since there is a limit of 1024 columns.

You mentioned SqlBulkCopy worked fine for you, did it work fine with 2000 columns? — Amit Kumar
– Amit Kumar, Commented Mar 30, 2019 at 2:29
The problem is when saving it to the SQL table. It throws me an exception of having more than 1024 columns. — Kunwar
– Kunwar, Commented Mar 30, 2019 at 2:30
You can split your Table into two tables of 1000 columns each, related by common primary key value. In C# side as well split your datatable into two. — Amit Kumar
– Amit Kumar, Commented Mar 30, 2019 at 2:34
Similar question may be helpful: stackoverflow.com/questions/54658240/… — Richardissimo
– Richardissimo, Commented Mar 30, 2019 at 5:30

halfer · Accepted Answer · 2019-04-14 21:32:34Z

1

You can split your Table into two tables of 1000 columns each, related by common primary key value. In C# side as well split your datatable into two.

edited Apr 14, 2019 at 21:32

halfer

20.2k20 gold badges110 silver badges207 bronze badges

answered Apr 3, 2019 at 10:37

Amit Kumar

3702 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Import Large CSV files into SQL Server using C#

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related