How to fail the build pipeline if "Tests Failed" in azure pipelines?

Question

I want to fail the build pipeline if a single test failed with azure pipelines.

Azure can successfully detect that my tests entered a failed state however it gives a success state to the entire build pipeline:

The question is how to make azure give a failed build state if the tests stage failed?

Here's my azure-pipelines.yml :

# Build ASP.NET Core project using Azure Pipelines
# https://learn.microsoft.com/azure/devops/pipelines/languages/dotnet-core?view=vsts

pool:
  vmImage: 'Ubuntu 16.04'

variables:
  buildConfiguration: 'Release'

steps:
- script: |
    dotnet build --configuration $(buildConfiguration)
    dotnet test dotnetcore-tests --configuration $(buildConfiguration) --logger trx
    dotnet publish --configuration $(buildConfiguration) --output $BUILD_ARTIFACTSTAGINGDIRECTORY

- task: PublishTestResults@2
  inputs:
    testRunner: VSTest
    testResultsFiles: '**/*.trx'

- task: PublishBuildArtifacts@1

Hi, did you try my answer?

Shayki Abramczyk
– Shayki Abramczyk

2019-04-16 10:42:50 +00:00
Commented Apr 16, 2019 at 10:42 — Shayki Abramczyk
– Shayki Abramczyk, Commented Apr 16, 2019 at 10:42

Benjh · Accepted Answer · 2019-10-16 14:28:33Z

17

The original answer didn't work for me, but it looks like there was a lot of discussion on this, and there's now a failTaskOnFailedTests param for the task. That seems to work.


- task: PublishTestResults@2
  inputs:
    testRunner: VSTest
    testResultsFiles: '**/*.trx'
    failTaskOnFailedTests: true

I'm still surprised this wasn't default behavior.

edited Oct 16, 2019 at 14:28

Benjh

54 bronze badges

answered May 30, 2019 at 21:41

Jake Kreider

9987 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Shayki Abramczyk · Accepted Answer · 2018-10-14 10:42:32Z

6

Try to add failOnStandardError: 'true' in the task inputs:

- task: PublishTestResults@2
  inputs:
    testRunner: VSTest
    testResultsFiles: '**/*.trx'
    failOnStandardError: 'true'

answered Oct 14, 2018 at 10:42

Shayki Abramczyk

42.5k17 gold badges113 silver badges135 bronze badges

Comments

tech-gayan · Accepted Answer · 2020-07-06 15:07:02Z

1

Untick the below-highlighted option

answered Jul 6, 2020 at 15:07

tech-gayan

1,4431 gold badge11 silver badges25 bronze badges

1 Comment

fr332lanc3 Over a year ago

This is a good answer too because it allows you to do this at the pipeline level where you could have multiple pipelines with different behavior, using the code approach is good too but would then give you identical results in each pipeline where this doesn't. So it depends on your outcome, this is valid.

Collectives™ on Stack Overflow

How to fail the build pipeline if "Tests Failed" in azure pipelines?

3 Answers 3

Comments

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related