Java test with mongodb database

Question

Description

I am testing a bulk insert in a mobgoDB database, in the @BeforeEach method I instantiate the database, in the@AfterEach I delete all documents created in the puzzles-today collection.

But the last one always fails, have random result, sometimes the test passes sometimes it displays this 367 or 366 or 364 or 364.

I added @RepeatedTest(4) To make sure it doesn't vary.

The code :

Class test

import static org.junit.jupiter.api.Assertions.assertEquals;
import static org.junit.jupiter.api.Assertions.assertTrue;

import java.util.List;

import com.github.mathieusoysal.codingame_stats.CodinGame;
import com.github.mathieusoysal.codingame_stats.puzzle.Puzzle;

import org.bson.Document;
import org.junit.jupiter.api.AfterEach;
import org.junit.jupiter.api.BeforeEach;
import org.junit.jupiter.api.RepeatedTest;
import org.junit.jupiter.api.Test;

import io.github.mathieusoysal.util.MongoDBMockTest;

public class PuzzleDaoTest extends MongoDBMockTest {

    private PuzzlesDao puzzleDao;

    @BeforeEach
    public void setUp() throws Exception {
        super.setUp();
        puzzleDao = new PuzzlesDao(mongoClient, "CodinGame-stats");
    }

    @AfterEach
    public void tearDown() throws Exception {
        mongoClient.getDatabase("CodinGame-stats")
                .getCollection(PuzzlesDao.PUZZLES_HISTORY_COLLECTION)
                .deleteMany(new Document());
        super.tearDown();
    }

    @Test
    void testSaveAll_shouldReturnTrue_withTwoPuzzles() {
        List<Puzzle> puzzles = new CodinGame().getPuzzles().subList(0, 2);
        assertTrue(puzzleDao.saveAll(puzzles));
    }

    @Test
    void testSaveAll_shouldAugmentCollectionSize_withTwoPuzzles() {
        List<Puzzle> puzzles = new CodinGame().getPuzzles().subList(0, 2);
        puzzleDao.saveAll(puzzles);
        assertEquals(puzzles.size(), countDocuments());
    }

    @RepeatedTest(4)
    void testSaveAll_shouldAugmentCollectionSize_withAllPuzzles() {
        List<Puzzle> puzzles = new CodinGame().getPuzzles();
        puzzleDao.saveAll(puzzles);
        assertEquals(puzzles.size(), countDocuments());
    }

    private long countDocuments() {
        return mongoClient.getDatabase("CodinGame-stats")
                .getCollection(PuzzlesDao.PUZZLES_HISTORY_COLLECTION)
                .countDocuments();
    }

}

Clone the project

To easily replicate this, you can clone the repository in the dev branch https://github.com/MathieuSoysal/CodinGame-Puzzles-stats-saver/tree/dev

Error displayed :

But this result is random, sometimes the test passes sometimes it displays a error.

anyone have any idea to fix this?

There’s too much unknown stuff going on here. I suggest you create a minimum example with all details to replicate your problem. Otherwise it’s hard to figure it out for outside people. — johanneslink
– johanneslink, Commented Jan 4, 2022 at 20:54
@johanneslink Thank for your feed-back, I added more details to replicate the problem. — ThrowsError
– ThrowsError, Commented Jan 4, 2022 at 21:03
If you want to raise chances that somebody will help figure out your problem, make replicating the issue for them as easy as possible. Having to put my own pom.xml together and copying several sources into a project that I have to configure myself is way beyond my threshold. Other people‘s mileage may vary. — johanneslink
– johanneslink, Commented Jan 6, 2022 at 16:13

johanneslink · Accepted Answer · 2022-01-07 10:23:18Z

The problem you have is not a test problem, but an implementation problem. Look at:

class PuzzlesDao...
    public boolean saveAll(List<Puzzle> puzzles) {
        List<WriteModel<Document>> bulkWrites = new ArrayList<>();
        GsonBuilder builder = new GsonBuilder();
        Gson gson = builder.create();
        puzzles.parallelStream()
                .forEach(puzzle -> bulkWrites.add(new InsertOneModel<>(Document.parse(gson.toJson(puzzle)))));
        BulkWriteOptions bulkWriteOptions = new BulkWriteOptions().ordered(false);
        BulkWriteResult bulkWriteResult = collection.bulkWrite(bulkWrites, bulkWriteOptions);
        return bulkWriteResult.wasAcknowledged();
    }

You are using parallelStream() without a closing operation like collect(..) or count(). The forEach code is still being executed while the bulk operation is already running. Thus the resulting behaviour is unpredictable. One heuristic is to never use any side-effects in forEach(). If you have to then using a simple for loop is the better choice in my opinion.

I recommend the following change:

public boolean saveAll(List<Puzzle> puzzles) {
    GsonBuilder builder = new GsonBuilder();
    Gson gson = builder.create();
    List<WriteModel<Document>> bulkWrites =
            puzzles.parallelStream()
                    .map(puzzle -> new InsertOneModel<>(Document.parse(gson.toJson(puzzle))))
                    .collect(Collectors.toList());
    BulkWriteOptions bulkWriteOptions = new BulkWriteOptions().ordered(false);
    BulkWriteResult bulkWriteResult = collection.bulkWrite(bulkWrites, bulkWriteOptions);
    return bulkWriteResult.wasAcknowledged();
}

I personally hardly ever use parallelStream() unless I can show that it improves performance in a worthwhile way, which it usually does not. Using just stream() gets rid of the intricacies of parallelism.

Thank you for your answer ! I just changed .toList() instead of .collect(Collectors.toList()).

Collectives™ on Stack Overflow

Java test with mongodb database

Description

The code :

Class test

Clone the project

Error displayed :

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

Description

The code :

Class test

Clone the project

Error displayed :

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related