How to expect a failure in robot framework in Python?

Question

We use robot framework at work to do some automated testing, and I need to add a few tests. This format is already in the repo, I cannot change anything drastically.

I am using a keywords file that looks like this:

#!/usr/bin/env python3
# -*- coding: utf-8 -*-

from robot.api.deco import keyword

class testkeywords(object):
   """
   """

   def __init__(self):
      pass

   @keyword('I compare ${first_number} with ${second_number}')
   def compare(self, first_number, second_number):
      if (int(first_number) != int(second_number)):
         raise ValueError('Numbers are not the same.')

The .robot file has two tests, one that passes and one that fails:

*** Settings ***
Library         testkeywords.py

*** Variables ***
${num_a}       5
${num_b}       6

*** Test Cases ***
Compare same numbers
   I compare ${num_a} with ${num_a}

Compare different numbers
   I compare ${num_a} with ${num_b}

The Compare different numbers test fails as expected, but it's still a FAIL. How can I set it to expect a failure and hence pass the keyword?

Downvoter please explain. I provided a minimum example and the question was pretty clear. — Catsunami
– Catsunami, Commented Jun 1, 2018 at 17:58
In my view the question is well written and the examples provided are clear. What made me think, and perhaps the downvoter too, was that the question was shortly followed up by your own answer. This would indicate to me that the amount of time spent researching wasn't that high. Given that the solution was an out-of-the-box keyword suggests that to me too. Learn from the experience and perhaps read the help on level of investigation prior to asking a question is expected. — A. Kootstra
– A. Kootstra, Commented Jun 2, 2018 at 17:16
@A.Kootstra, while I certainly saw the keyword in my search, I did not notice the double spaced required to get the keyword to be recognized. The format of the .robot files that I was looking at did not match anything I saw online and I thought it might require different keywords. I actually spent a few hours playing around with it until I noticed the double space. Maybe the documentation for the framework should be a bit better. For what it's worth, most python questions on SO can be solved by looking at documentation. At least I bothered posting an answer... — Catsunami
– Catsunami, Commented Jun 4, 2018 at 3:09

Catsunami · Accepted Answer · 2018-06-01 17:03:19Z

2

I figured it out. You can just modify the test to expect an error as follows:

Compare different numbers
   Run Keyword And Expect Error  *  I compare ${num_a} with ${num_b}

Alternatively to look for a specific error (rather than wildcard):

Compare different numbers
       Run Keyword And Expect Error  ValueError: Numbers are not the same.  I compare ${num_a} with ${num_b}

Note the double space between the command, error and keyword.

answered Jun 1, 2018 at 17:03

Catsunami

5791 gold badge6 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Dan Constantinescu · Accepted Answer · 2021-11-11 16:43:50Z

1

You can also expect a sub-string from the complete error by using this format:

Compare different numbers
   Run Keyword And Expect Error  *are not the same*  I compare ${num_a} with ${num_b}

Documentation: Run Keyword And Expect Error

edited Nov 11, 2021 at 16:43

answered Aug 27, 2021 at 8:29

Dan Constantinescu

1,5561 gold badge11 silver badges12 bronze badges

1 Comment

Community Over a year ago

Please add further details to expand on your answer, such as working code or documentation citations.

Collectives™ on Stack Overflow

How to expect a failure in robot framework in Python?

2 Answers 2

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related