golang csv.write not writing but no errors

Question

I am trying to open an existing csv file and write to it; however, the file returns empty. This is my code.

file, err := os.Open("file.csv")
    if err != nil {
        log.WithError(err)
    }

    defer file.Close()

    w := csv.NewWriter(file)
    defer w.Flush()

    var headers = []string{"h1", "h2", "h3", "h4"}
    writeHeadersErr := w.Write(headers)
    if writeHeadersErr != nil {
        log.WithError(writeHeadersErr)
        file.Close()
    }

Not sure how to approach this as I do not see any errors logged.

You need to open the file in write mode play.golang.org/p/Gd-3n45d_HQ — null
– null, Commented Sep 20, 2021 at 16:18
@null still should check Write/Flush potential errors via csv.Writer.Error() — colm.anseo
– colm.anseo, Commented Sep 20, 2021 at 16:23

blackgreen · Accepted Answer · 2021-09-20 18:35:40Z

2

os.Open opens a file in read-only mode. You should use os.OpenFile instead:

os.OpenFile("file.csv", os.O_CREATE|os.O_WRONLY|os.O_APPEND, 0644)

FYI, note that os.Create also works but it will truncate the file if it already exists, as you mention. This may or may not be what you want.

As of why you see no error, it's because writes are buffered and the content isn't actually written until you call w.Flush. This is mentioned in w.Write documentation:

Writes are buffered, so Flush must eventually be called to ensure that the record is written to the underlying io.Writer.

Though w.Flush itself is deferred in your code, and doesn't return an error anyway. You can check for errors with w.Error().

If you place the two calls at the end of your function, as follows, you will eventually see the error:

    file, err := os.Open("file.csv")
    if err != nil {
        log.WithError(err)
    }
    defer file.Close()

    w := csv.NewWriter(file)
    // ... write to the file
    w.Flush()
    err = w.Error() // write file.csv: bad file descriptor

And as a matter of fact the error means that you opened the file with the wrong mode flags. More details in: Golang bad file descriptor

If you want to keep deferring w.Flush(), place it together with w.Error() in a function literal, which if used in combination with named return params, allows you to propagate the error, if any.

For example:

func writeToCsv() (err error) {
    
    // ...open file
    w := csv.NewWriter(file)
    defer func() {
        w.Flush()
        err = w.Error()
    }()
    // ...rest of the function
}

edited Sep 20, 2021 at 18:35

answered Sep 20, 2021 at 16:21

blackgreen♦

46.8k29 gold badges171 silver badges162 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Jasmine Wong Over a year ago

modified it to be os.OpenFile("file.csv", os.O_CREATE|os.O_APPEND|os.O_WRONLY, 0644), which worked!

blackgreen Over a year ago

yes if the file doesn't exist

colm.anseo · Accepted Answer · 2021-09-20 16:16:25Z

1

You need to check the error from Flush():

w.Flush()

if err := w.Error(); err != nil {
    log.Fatal(err) // write file.csv: bad file descriptor
}

which will show that you are opening a file for reading not writing. So to fix:

//file, err := os.Open("file.csv") // read file
file, err := os.Create("file.csv") // create file
if err != nil {
    log.Fatal(err)
}

https://play.golang.org/p/QhpYnrc7cmR

answered Sep 20, 2021 at 16:16

colm.anseo

22.7k5 gold badges50 silver badges64 bronze badges

Collectives™ on Stack Overflow

golang csv.write not writing but no errors

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related