Using GivenScenarios causes failed tests to be forgotten

Description

We have multiple related scenarios within the same JBehave script. This seems to be supported functionality but a major issue came to light earlier: using GivenScenarios at the start of a later scenario will cause any failed scenarios thus far to be forgotten. For example:

""
Story: Test showing that using a given scenario skews the overall result

Scenario: Fail

GivenScenarios: com/example/sandpit/jbehave/noop
Given I do nothing
Then I fail

Scenario: Succeed

GivenScenarios: com/example/sandpit/jbehave/noop
Given I do nothing
Then I pass
""

The JUnit result for running a scenario with the above script is a pass, even though the "I fail" step threw an exception. If you remove the GivenScenarios line from the Succeed case then the JUnit result is a fail.

Attached is an Eclipse project that demonstrates this. This is a major issue for us: we run the JBehave tests from our build farm in an automated process. This bug would give us the green light for the whole build despite tests failing.

Activity

Fixed

Details

Assignee

Reporter

Components

Fix versions

Affects versions

Priority

Created May 5, 2010 at 1:27 PM
Updated May 22, 2015 at 8:24 AM
Resolved May 5, 2010 at 9:45 PM

Flag notifications