Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

January 2025 Dry-run Triage JDK8 #5853

Open
Haroon-Khel opened this issue Jan 14, 2025 · 3 comments
Open

January 2025 Dry-run Triage JDK8 #5853

Haroon-Khel opened this issue Jan 14, 2025 · 3 comments
Labels
release triage

Comments

@Haroon-Khel
Copy link
Contributor

Haroon-Khel commented Jan 14, 2025 •
edited
Loading

Release Summary Report for release-openjdk8-pipeline

Report generated at: Tue, 14 Jan 2025 11:50:04 GMT

TRSS Build and TRSS Grid View
Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk8-pipeline/74/
Started by upstream project "build-scripts/utils/releaseTrigger_jdk8u" build number 3995 at 10/01/2025, 17:15:32

jdk8u-release-linux-aarch64-temurin ⚠️ UNSTABLE ⚠️

refactor_openjdk_release_tool ❌ undefined ❌

sign_temurin_gpg ❌ undefined ❌

sign_temurin_jsf ❌ undefined ❌

Test_openjdk8_hs_extended.openjdk_aarch64_linux ⚠️ UNSTABLE ⚠️ ✅

Test_openjdk8_hs_extended.openjdk_aarch64_linux_rerun ⚠️ UNSTABLE ⚠️
Rerun failed

java -version 
openjdk version "1.8.0_442"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_442-b05)
OpenJDK 64-Bit Server VM (Temurin)(build 25.442-b05, mixed mode)

Test_openjdk8_hs_extended.openjdk_aarch64_linux_testList_0 ⚠️ UNSTABLE ⚠️
jdk_security3_0 => deep history 6/11 passed | possible issues
jdk_security3_1 => deep history 7/11 passed | possible issues

Test_openjdk8_hs_extended.openjdk_aarch64_linux_testList_2 ⚠️ UNSTABLE ⚠️
jdk_jfr_0 => deep history 2/3 passed | possible issues

Test_openjdk8_hs_extended.openjdk_aarch64_linux_testList_3 ⚠️ UNSTABLE ⚠️
jdk_rmi_1 => deep history 2/3 passed | possible issues
jdk_net_1 => deep history 0/1 passed | possible issues

After the rerun only these tests remain failing

 java/rmi/registry/readTest/readTest.sh
 java/rmi/registry/reexport/Reexport.java
 jdk/jfr/event/runtime/TestThreadCpuTimeEvent.java

Rerunning failed tests multiple iterations:

java/rmi/registry/readTest/readTest.sh
https://ci.adoptium.net/job/Grinder/12222/console ✅

java/rmi/registry/reexport/Reexport.java
https://ci.adoptium.net/job/Grinder/12225/console ✅

jdk/jfr/event/runtime/TestThreadCpuTimeEvent.java
https://ci.adoptium.net/job/Grinder/12228/console ✅

Test_openjdk8_hs_extended.system_aarch64_linux ⚠️ UNSTABLE ⚠️
Rerun failed

java -version 
openjdk version "1.8.0_442"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_442-b05)
OpenJDK 64-Bit Server VM (Temurin)(build 25.442-b05, mixed mode)

OAuthTest_0 => deep history 16/19 passed | possible issues

Test_openjdk8_hs_extended.system_aarch64_linux_rerun ⚠️ UNSTABLE ⚠️
Rerun failed

java -version 
openjdk version "1.8.0_442"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_442-b05)
OpenJDK 64-Bit Server VM (Temurin)(build 25.442-b05, mixed mode)

Rerunning failling OAuthTest, 5 iterations
https://ci.adoptium.net/job/Grinder/12218/console ✅
@Haroon-Khel
Copy link
Contributor Author

Haroon-Khel commented Jan 14, 2025 •
edited
Loading

TRSS isnt able to generate the release summary report for https://ci.adoptium.net/job/build-scripts/job/release-openjdk8-pipeline/73/ https://trss.adoptium.net/resultSummary?parentId=6780ff35f66194006d2f4e71

sparcv9_solaris and x86-64_solaris pipelines failed

Failed tests:

ppc64_aix ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.openjdk_ppc64_aix/819/

Failed tests:
tools/javah/ReadOldClass.sh

The full path to this test in jdk8u is langtools/test/tools/javah/ReadOldClass.sh Raise tests issue
Looks like it deliberately fails on AIX, excluding #5855. Excluded ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.system_ppc64_aix/632/

Failures from the reun https://ci.adoptium.net/job/Test_openjdk8_hs_extended.system_ppc64_aix_rerun/8/
MiniMix_5m_0,MiniMix_5m_1,MiniMix_10m_0,MiniMix_10m_1,MiniMix_aot_5m_0

Rerun https://ci.adoptium.net/job/Grinder/12244/console ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.system_ppc64_aix/633/

Failed tests from rerun https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.system_ppc64_aix_rerun/9/

MauveSingleThrdLoad_HS_5m_0,MauveSingleThrdLoad_HS_5m_1,MauveSingleInvocLoad_HS_5m_0,MauveSingleInvocLoad_HS_5m_1,MauveMultiThrdLoad_5m_0,MauveMultiThrdLoad_5m_1

Rerun https://ci.adoptium.net/job/Grinder/12245/console ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_ppc64_aix/167/

Failed test:

serviceability/dcmd/DynLibDcmdTest.java

Rerun https://ci.adoptium.net/job/Grinder/12246/console

Unsupported on AIX, excluding #5855. Excluded ✅

ppc64le_linux ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_ppc64le_linux/195/

Failed tests:
runtime/7158988/FieldMonitor.java

Passed in rerun https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_ppc64le_linux_rerun/33/testReport/

x86-64_alpine-linux ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_x86-64_alpine-linux/125/

Failed tests:
TEST: java/net/Inet6Address/B6206527.java
TEST: java/net/ipv6tests/B6521014.java

Passed in rerun https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_x86-64_alpine-linux_rerun/21/testReport/

x86-64_linux ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.system_x86-64_linux/1217/

Failed tests:
MauveSingleThrdLoad_HS_5m_0,MauveSingleThrdLoad_HS_5m_1,MauveSingleInvocLoad_HS_5m_0,MauveSingleInvocLoad_HS_5m_1,MauveMultiThrdLoad_5m_0,MauveMultiThrdLoad_5m_1

Rerun https://ci.adoptium.net/job/Grinder/12231/console ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_x86-64_linux/221/

Failed tests:
sun/security/pkcs11/fips/TestTLS12.java
Rerun on fedora39 https://ci.adoptium.net/job/Grinder/12234/console ✅
Rerun on ubuntu16 https://ci.adoptium.net/job/Grinder/12235/console ✅

x86-64_mac ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_x86-64_mac/223/

Failed tests:

compiler/5091921/Test7005594.java
javax/net/ssl/ServerName/SSLEngineExplorerMatchedSNI.java

Both passed in the rerun https://ci.adoptium.net/job/Test_openjdk8_hs_extended.openjdk_x86-64_mac_rerun/27/testReport/

x86-64_windows ✅

https://ci.adoptium.net/job/Test_openjdk8_hs_extended.perf_x86-64_windows/191/

Rerun on test-azure-win2022-x64-1 https://ci.adoptium.net/job/Grinder/12236/console ✅

@Haroon-Khel
Copy link
Contributor Author

Haroon-Khel commented Jan 16, 2025 •
edited
Loading

Arm linux ✅

Release Summary Report for release-openjdk8-pipeline

Report generated at: Thu, 16 Jan 2025 11:21:26 GMT

TRSS Build and TRSS Grid View
Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk8-pipeline/75/
Started by upstream project "build-scripts/utils/releaseTrigger_jdk8u" build number 3995 at 15/01/2025, 15:52:22

jdk8u-release-linux-arm-temurin ⚠️ UNSTABLE ⚠️

refactor_openjdk_release_tool ❌ undefined ❌

sign_temurin_gpg ❌ undefined ❌

sign_temurin_jsf ❌ undefined ❌

Test_openjdk8_hs_extended.openjdk_arm_linux ⚠️ UNSTABLE ⚠️

Test_openjdk8_hs_extended.openjdk_arm_linux_rerun ⚠️ UNSTABLE ⚠️
Rerun failed

java -version 
openjdk version "1.8.0_442"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_442-b05)
OpenJDK Client VM (Temurin)(build 25.442-b05, mixed mode)

Test_openjdk8_hs_extended.openjdk_arm_linux_testList_0 ⚠️ UNSTABLE ⚠️
jdk_other_2 => deep history 3/5 passed | possible issues
jdk_jfr_2 => deep history 0/6 passed | possible issues
jdk_security3_2 => deep history 0/6 passed | possible issues

Test_openjdk8_hs_extended.openjdk_arm_linux_testList_1 ⚠️ UNSTABLE ⚠️
jdk_imageio_2 => deep history 5/6 passed | possible issues

After rerun, these targets remain failing

jdk_security3_2 and jdk_jfr_2
Rerunning https://ci.adoptium.net/job/Grinder/12316/console odroid ✅

Test_openjdk8_hs_sanity.openjdk_arm_linux ⚠️ UNSTABLE ⚠️ ✅
Rerun failed

java -version 
openjdk version "1.8.0_442"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_442-b05)
OpenJDK Client VM (Temurin)(build 25.442-b05, mixed mode)

langtools_all_0 => deep history 0/1 passed | possible issues
jdk_util_2 => deep history 0/6 passed | possible issues
jdk_jdi_jdk8_2 => deep history 1/6 passed | possible issues
jdk_lang_2 => deep history 3/6 passed | possible issues

Test_openjdk8_hs_sanity.openjdk_arm_linux_rerun ⚠️ UNSTABLE ⚠️
Rerun failed

java -version 
openjdk version "1.8.0_442"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_442-b05)
OpenJDK Client VM (Temurin)(build 25.442-b05, mixed mode)

After the rerun, only jdk_util_2 remains failing. Rerunning on odroid machine https://ci.adoptium.net/job/Grinder/12286/console ✅

@sxa
Copy link
Member

sxa commented Jan 16, 2025 •
edited
Loading

Solaris. The mauve and MiniMix ones are known and are some issue with the new method of executing the tests. Others need analysis:

Solaris/x64

From the output of curl -s https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-temurin-simpletest/64/consoleText | awk '/FAILED test targets/,/FAILED:/':

Summary output from original test run on x64 
FAILED test targets:
	jdk_lang_0 - Test results: passed: 471; failed: 1 
		Failed test cases: 
			TEST: jdk/lambda/vm/InterfaceAccessFlagsTest.java
        

TOTAL: 23   EXECUTED: 9   PASSED: 8   FAILED: 1   DISABLED: 0   SKIPPED: 14
FAILED test targets:
	MauveSingleThrdLoad_HS_5m_0
	MauveSingleInvocLoad_HS_5m_0
	MauveMultiThrdLoad_5m_0

TOTAL: 60   EXECUTED: 24   PASSED: 21   FAILED: 3   DISABLED: 6   SKIPPED: 30
FAILED test targets:
	MiniMix_5m_0
	MiniMix_10m_0
	MiniMix_aot_5m_0

TOTAL: 41   EXECUTED: 20   PASSED: 17   FAILED: 3   DISABLED: 3   SKIPPED: 18
FAILED test targets:
	jdk_beans_0 - Test results: passed: 340; failed: 10 
		Failed test cases: 
			TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClass.java
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClass.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        
	jdk_security3_0 - Test results: passed: 615; failed: 1; error: 2 
		Failed test cases: 
			TEST: javax/net/ssl/ciphersuites/DisabledAlgorithms.java
        TEST: javax/net/ssl/ServerName/SSLEngineExplorerWithCli.java
        TEST: sun/security/ssl/SSLEngineImpl/SSLEngineDeadlock.java
        
	jdk_management_0 - Test results: passed: 110; failed: 1 
		Failed test cases: 
			TEST: sun/management/jmxremote/bootstrap/SSLConfigFilePermissionTest.sh
        
	jdk_rmi_0 - Test results: passed: 138; failed: 1 
		Failed test cases: 
			TEST: java/rmi/transport/dgcDeadLock/DGCDeadLock.java
        
	jdk_imageio_0 - Test results: passed: 141; failed: 2 
		Failed test cases: 
			TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        TEST: javax/imageio/AppletResourceTest.java

Solaris/SPARC

From the output of curl -s https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-sparcv9-temurin-simpletest/64/consoleText | awk '/FAILED test targets/,/FAILED:/':

Summary output from original test run on SPARC 
FAILED test targets:
	jdk_lang_0 - Test results: passed: 472; failed: 1 
		Failed test cases: 
			TEST: jdk/lambda/vm/InterfaceAccessFlagsTest.java
        

TOTAL: 23   EXECUTED: 9   PASSED: 8   FAILED: 1   DISABLED: 0   SKIPPED: 14
FAILED test targets:
	MauveSingleThrdLoad_HS_5m_0
	MauveSingleInvocLoad_HS_5m_0
	MauveMultiThrdLoad_5m_0

TOTAL: 60   EXECUTED: 24   PASSED: 21   FAILED: 3   DISABLED: 6   SKIPPED: 30
FAILED test targets:
	MiniMix_5m_0
	MiniMix_10m_0
	MiniMix_aot_5m_0

TOTAL: 41   EXECUTED: 19   PASSED: 16   FAILED: 3   DISABLED: 4   SKIPPED: 18
FAILED test targets:
	hotspot_jdk_0 - Test results: passed: 810; error: 1 
		Failed test cases: 
			TEST: serviceability/sa/jmap-hashcode/Test8028623.java
        
	jdk_beans_0 - Test results: passed: 340; failed: 10 
		Failed test cases: 
			TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClass.java
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClass.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        
	jdk_security3_0 - Test results: passed: 607; failed: 1 
		Failed test cases: 
			TEST: sun/security/ssl/SSLSocketImpl/ClientSocketCloseHang.java
        
	jdk_imageio_0 - Test results: passed: 141; failed: 2 
		Failed test cases: 
			TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        TEST: javax/imageio/AppletResourceTest.java

SPARC vs x64 differences are:

  • hotspot_jdk_0 - serviceability/sa/jmap-hashcode/Test8028623.java only failed on SPARC
  • jdk_security3_0:
    • x64 failed javax/net/ssl/ciphersuites/DisabledAlgorithms.java, javax/net/ssl/ServerName/SSLEngineExplorerWithCli.java, sun/security/ssl/SSLEngineImpl/SSLEngineDeadlock.java. The first two failed in the last sanity.openjdk run, the third (SSLEngineDeadlock) passed. However it should be noted that the exact set of failures in this set seems to change between runs.
    • SPARC failed sun/security/ssl/SSLSocketImpl/ClientSocketCloseHang.java
  • jdk_management_0 - sun/management/jmxremote/bootstrap/SSLConfigFilePermissionTest.sh only failed on x64 (Also failed in last sanity.openjdk run)
  • jdk_rmi_0 - java/rmi/transport/dgcDeadLock/DGCDeadLock.java only failed on x64 (passed in last sanity.openjdk run, and did not fail in all previous runs, so likely intermittent)

All beans and jdk_imageio tests except java_awt_ScrollPane are failing due to No X11 DISPLAY variable was set which should be an easy fix.

UPDATE 17/Jan/2025:

  • Starting an Xvfb manually on display :5 on each of the test machines and setting an explicit DISPLAY=:5; export DISPLAY in the scripts allowed a number of the failing tests to pass (jdk_beans_0 (including java_awt_ScrollPane.java) and jdk_imageio_0: x64 and SPARC
  • I've added in some code to the solaris "simpletest" job which will explicitly download mauve.jar before running the system tests. That should allow the Mauve and MiniMix tests to pass. (EDIT: sanity.system is now good, assumin MiniMix in extended.system will be ok too)
  • Other than ones that fail intermittently this leaves us with the following consistent failures:
    • sanity.openjdk - jdk_lang_0: jdk/lambda/vm/InterfaceAccessFlagsTest.java (Passes in sanity.openjdk job)
    • extended.openjdk - jdk_security3_0: javax/net/ssl/ciphersuites/DisabledAlgorithms.java and javax/net/ssl/ServerName/SSLEngineExplorerWithCli.java (Both fail in extended.openjdk job)
    • extended.openjdk - jdk_management_0: sun/management/jmxremote/bootstrap/SSLConfigFilePermissionTest.sh (Fails in extended.openjdk job)

OpenJDK Grinder re-run links (Includes all the failures above including the intermittent ones:

x64 jdk | x64 hotspot (Modify PLATFORM to be sparcv9_solaris if desired and ensure SD_RESOURCE is correct). Results with 10 iterations on x64 and SPARC.

Running with 10 iterations:

Suite Build x64 SPARC notes
jdk_custom nightly G#12342
jdk_custom simple G#12352 G#12371 G#12353 SPARC only failed ClientSocketCloseHang 2/10 times. Others ok. x64 failed DisabledAlgorithms 10/10 times, and 2/10 fails for each of SSLEngineExplorerWithCli and SSLEngineDeadlock
hotspot_custom simple G#12355 G#12356 SPARC failed 2/10 times again (!) x64 passed 10/10

Unclear at present whether some of these failures are occurring due to the new simple/proxy piplines but it looks like we can probably get a full set of passes. I'm running another full dry-run simple pipeline on the proxy systems here which includes the mauve and Xvfb fixes:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
release triage
Projects
Adoptium Backlog
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sxa @Haroon-Khel