Allure Life Cycle Not Triggered When Running Tests via jar file

[santhosh0419]

Title:
Allure Results Not Generated When Running JAR File with -Dallure.results.directory Property

Description:
We are facing an issue where Allure test results are not being generated in the expected directory when running our test project as a standalone JAR file. The system property allure.results.directory is set via the -D argument at runtime, and when accessed within the tests using System.getProperty("allure.results.directory"), it returns the expected path. However, no Allure result files are actually created in the specified location.

Current Setup:

1. Project Build Process:

   • The project is built using Gradle and packaged into a fat JAR file containing all dependencies.
   • The tests are executed using the JUnit 5 platform.
   • Allure dependencies are included within the JAR.

2. Execution Command:
   The JAR is executed with the following command:

   java -Dallure.results.directory=C:\path\to\allure-results -jar test-automation-1.0-SNAPSHOT-all.jar

3. Code Snippet to Verify Property:
   Inside the test runner, the following code is used to verify the property value:

   System.out.println("Allure results directory: " + System.getProperty("allure.results.directory"));

   The correct path is printed, confirming that the system property is being set properly.

---

Issue Details:

• The tests execute successfully without any errors.
• The specified allure.results.directory path is correctly read within the test code.
• However, no Allure result files are generated in the specified directory.
• Running the tests directly via the IDE (without the JAR) generates results correctly in the specified directory.
  - Upon research it was found that the allure lifecycle is triggered by junit, but in this case since the run is triggered as java -jar the life cycle is not generated. How the Lifecycle can be setup?

---

Troubleshooting Steps Taken:

1. Validated Property Setting:

   • Printed the value of System.getProperty("allure.results.directory") to confirm it's correctly set at runtime.

2. Checked JAR Execution Behavior:

   • Ensured that the tests execute successfully with no runtime exceptions.
   • Verified if any Allure-related logs indicate issues.

3. Manual Directory Verification:

   • Created the allure-results directory manually before running the tests.
   • Tried setting the path with both relative and absolute values.

4. Build Configuration Checks:

   • Ensured the correct Allure dependencies are bundled in the JAR (allure-junit5, allure-commandline).
   • Verified test execution plugins in the build.gradle file.

5. Execution Order:

   • Confirmed the correct order of JVM arguments to ensure the -D property is passed before -jar.
   • Tried executing with different JVM versions.

6. Tried adding the Allure.step("Sample Test") statement explicitly:

• This statement properly runs from the Junit
• But when I run it in the jar I get the below exceptions

13:26:25.005 [ForkJoinPool-1-worker-2] ERROR io.qameta.allure.AllureLifecycle -- Could not start step: no test case running
13:26:25.009 [ForkJoinPool-1-worker-2] ERROR io.qameta.allure.AllureLifecycle -- Could not stop step: step with uuid 6540d59f-9993-4cd6-b251-234f94d4a369 not found

Request for Help:
We would appreciate insights or suggestions on:

1. Why Allure results are not being written to the specified directory when running from the JAR file.
2. Whether any additional configuration is required to ensure Allure can access the result directory correctly.
3. Any known issues related to running Allure with JUnit 5 in a fat JAR setup.

[santhosh0419]

@baev - I'm sorry for bothering you by tagging, but if you get a chance, could you please review this issue? It has been a blocker for a long time, and I haven't found any relevant answers in the community. Thank you.

[santhosh0419]

I found the root cause for the issue -
In a local JUnit5 environment, Allure-JUnit and Allure-RestAssured automatically handle the lifecycle setup. However, when running from a JAR, this automatic lifecycle management doesn't occur.
The key difference is the test execution context. In a local environment, JUnit provides this context automatically, but in a JAR execution, it's missing. This is why manual lifecycle management or a custom listener becomes necessary to ensure Allure reports are generated correctly.
To resolve this, I have to explicitly manage the Allure lifecycle, either through a custom listener or by manually initializing the lifecycle before test execution

[baev]

Most likely, the issue can be solved by setting junit.jupiter.extensions.autodetection.enabled to true; see https://junit.org/junit5/docs/current/user-guide/#extensions-registration-automatic-enabling