Uploading blob file to parse it and insert rows in sql azure

Question

For one subject in college I need to use Windows Azure. Notice that I am Java dev and a total newbie to Windows itself and cs.

My project is quite simple. I am going to do a Layar server.

I already have a Service which returs a mocked point of interest in json format. Now I would like to do my massive insert in the sql azure db to do spatial searches afterwards.

I was thinking of:

Creating a cvs file with all rows.
Upload it as blob.
Parse it with a Worker role and insert it in the sql azure db.

Questions:

Do you think this is the correct approach?
Is cvs fine?
What do you use for a massive insertion to sql azure?
Is there a way to "Annotate" my model class to create an entity in my db? Should I do the mapping by hand?

Why not to import the CSV file directly to the database using bcp.exe or do you necessarily want to leverage the worker role? — Denis Ivin
– Denis Ivin, Commented Nov 29, 2010 at 7:46
This utility allows you to bulk copy data between MSSQL and data files msdn.microsoft.com/en-us/library/ms162802(SQL.105).aspx and it's included in any MSSQL installation but I think you already googled that. But if you decide to go the "worker role way", make sure you leverage the Bulk Copy API - msdn.microsoft.com/en-us/library/… Otherwise your insertion operations will be painfully slow and in addition you will end up with a huge transaction log (hence this leads to a bigger database size). — Denis Ivin
– Denis Ivin, Commented Nov 29, 2010 at 19:39

Shiraz Bhaiji · Accepted Answer · 2010-11-29 15:51:52Z

1

There are various ways to import data into sql azure, here: http://blogs.msdn.com/b/sqlcat/archive/2010/07/30/loading-data-to-sql-azure-the-fast-way.aspx

You have basically the following options:

SQL Server BCP Utility,
SQL Server Integration Services (SSIS)
Import and Export Data and SQL Server Studio (SSMS).
Bulk Copy API

answered Nov 29, 2010 at 15:51

Shiraz Bhaiji

65.7k37 gold badges149 silver badges260 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Uploading blob file to parse it and insert rows in sql azure

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related