Java - Reading Text File Into Database

Question

I have a text file listing a bunch of text books (its an 8mb .txt file!!) I am supposed to write script to read in the file and write the information into a database we have setup. Each book is a row in the database. The textfile looks like so:

Book_Title: some title here
ISBN: some ISBN

.........................
Book_Title: the title
(etc...)

Each book is separated by the periods, and the "Key: Value" pairs are the database column name before the colon and the value to store after the colon. How shoul I go about reading in the information? I tried using scanner and sayiying the delimiter is ":", but there is a field "Updated_On: ... at 10:30:28" .. Any other suggestions?

1054211 · Accepted Answer · 2012-12-04 22:00:40Z

2

I hope the following pseudo-code will be simple enough. 8Mb is not that much so it all can be done in memory.

Read file into a string
Split the string on the record separator which is "........................." in your case.
Iterate over the array of records, split each element in the records array on "\n", this will produce concatenated array of name/value pairs for each element in the records array.
Iterate over the array of the concatenated name/value pairs and split each ":", this will produce separated arrays of names and values.

It will be memory hungry, something like O(3N), but, for files under couple of gigs it should work fairly well.

To read the file into a string you can use Apache Commons, FileUtils. FileUtils JavaDoc

edited Dec 4, 2012 at 22:00

answered Dec 4, 2012 at 20:06

1054211

4422 silver badges6 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Java - Reading Text File Into Database

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related