Hello,
I am not being successful in sending my xml report from TeamCity to ALM Octane.
I have followed the documentation on https://admhelp.microfocus.com/octane/en/16.1.100-16.2.100/Online/Content/AdminGuide/how-setup-testing-integration.htm.
I'm using ALM Octane 16.1.100.152 and cucumber-jvm 7.0.0. The Octane plugin for TeamCity is 1.4.6.
My initial questions are regarding the report file as they might solve my problem:
- configuration for sharing the report with Octane: considering I have the plugin installed in TeamCity, from the documentation it sounds that it suffices to place the xml report in an artifact folder whose name is in the configuration parameter gherkin_artifact_folder_for_octane and set Testing_framework=cucumber_jvm for the report to be shared with Octane by the plugin when the job is finished. If the gherkin test already exists in Octane, the result is then shown there, otherwise a new entry is created. Is that correct or is there another step that is needed for the result to be injected?
- xml report format: Since the results in the generated xml report wasn't injected to Octane, I suppose the reason might be the format. From the documentation, it seems that the name of the report would be "_OctaneGherkinResults.xml". That made me think that I need to convert my initial report to a different format for Octane to read it.
I saw on https://admhelp.microfocus.com/octane/en/16.1.100-16.2.100/Online/Content/UserGuide/how_automate_gherkin.htm#mt-item-4 that if I'm using octane-cucumber-jvm, the standard name of the report is OctaneGherkinResults.xml. This lead me to think I should use that library. However, on its GitHub page it says it's only for cucumber up to 4.8.1 and that the newer tool is bdd2octane.
So I used bdd2octane to generate this other report. As before, TeamCity was set to save it in the artifacts folder "gherkin" and the configuration parameters gherkin_artifact_folder_for_octane was set to "gherkin" and Testing_framework to "cucumber_jvm".
However, Octane still does not find this test result. It does recognize that the build with the corresponding number was successful or not and when it started/ended. But the test results are not injected.
Hopefully someone can point me toward the right direction.
I'm adding the general format of the xml reports below in case it helps.
Thanks!
Denise
Here is the general format of the xml report generated after my test runs:
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<testsuite errors=… failure… name… skpiied… tests… time…>
<testcase classname=… name=… time=…>
<system-out><![CDATA[Given… passed
When… ….passed
Then… ….passed]]>
</system-out>
</testcase>
</testsuite>
And here is the general format of the xml report generated when running bdd2octane with the above as input:
<?xml version="1.0" ?>
<!--Generated by bdd2octane 1.1.2-->
<features version="1">
<feature name=… path=… started=… tag={this is the Octane tag used to identify this feature}>
<file>
<![CDATA[#Auto generated Octane revision tag
{here is the whole feature file}]]>
</file>
<scenarios>
<scenario name… outlineIndex=…>
<steps>
<step name=Given… duration=… status=…></step>
<step name=When… …></step>
<step…></step>
</steps>
</scenario>
</scenarios>
</feature>
</features>