Hi, I have a bug in TestOps-Test Management - Executions
Execution results “spinner” never stops, results do not appear complete. See image 1.
Attempted to complete import by clicking “re-import” and all results have disappeared. See image 2.
I also tried “completing” test run and the green check was displayed.
What is causing the results to not load and what should I do to correct it?
Is there a limitation on Test Set size(test count) that prevents the data from loading into TestOps?
Hi @jim.sears,
When the #330 execution ran, it updated current status of execution to TO, but didn’t submit results to TO, so when reimporting, it shows nothing here. Please run it again, if you still get this behavior, send us your katalon studio log file to investigate.
Hi Thong,
This execution is in TestOps using the CLI Katalon ‘c’ version. I don’t have a Katalon Studio log file to send you. If CLI has a log file then can you tell me where would it be?
Hi @jim.sears,
The log folder is printed in console log. Please follow the path and send us your log files.
log.zip (5.6 KB)
I have attached the requested log file. This test set is API testing and contains XML that may have broken tags, mismatches, etc. I don’t know if that affects your process for uploading results.
Another thing, the test set contains one test but it is processing 800+ rows of data for 800+ API calls. The logs are going to be long if it works correctly.
Hi KS team, I have not experienced the endless upload of test results in the last week.
If this is labelled as a bug, then it can be closed.
Jim
Hi @jim.sears
This is a known bug that causes KRE could not parse invalid XML characters in the execution0.log file and it will be fixed in v7.8.2.
Thanks for your report
Hello everyone
The issue of not being able to generate execution reports when WebUI.comment contains invalid XML characters is fixed in version 7.8.2, which is available for upgrade.
Learn more about this version.
Happy Testing
Jass
debug.log-NullPointer.zip (363.1 KB)
I have tried v7.8.2 and am experiencing null pointer during upload.
See attached debug.log file from TestOps execution where at the very end, upload has failed.
This log file contains xml with invalid characters (as expected) for test failures.
Jim
HI,
I am experiencing the issue still and this log might be helpful or it might be a different issue.
I upgraded to 7.9 and the latest CI package from the Katalon releases page.
I removed all existing Katalon versions and selected version 7.9 on the TestOps Plan.
The issue is that I’m using the plug-in for dynamic test set. This plugin has loaded in past executions on the TestAgent but not today. Please see log for details.
The query provider is called “built-in” (see screenshot) and is added as part of the plug-in. However, the log file states “it is not available”. The plug-in license is valid because I’m using Katalon Enterprise.
The reason I think this is related to this issue is that the results never complete loading in TestOps even though the test failed. Note the duration is 39 seconds but the test run was 15 minutes ago and the test run is still in progress. Note: I refreshed the page twice and nothing changed.
I also executed the Plan twice with the same result.
debug-MissingPlugin.log (8.7 KB)
Hi, the upload issue is spreading to other test-runs that once worked.
Do you have any update on this issue?
I found this bug listing on Katalon Github. Is this where I should look for updates?
Hi all, @Jass
I have to admit that I’ve given up on TestOps. The reports are not loading and I’ve asked for updates but it’s been dead silence.
I thought I could at least get basic reporting (pass/fail) using Jenkins but Katalon is unable to generate the xml reports. I see by your earlier comments that this was fixed in 7.8.2. I’m using 7.9 and still see the error. I’ve attached a log snippet. Let me know if you need something else in the logs or the project.
“Message: An invalid XML character (Unicode: 0x0) was found in the element content of the document.”
Thanks,
Jim
[2021-02-28T22:24:18.054] 2021-02-28 22:24:18.054 INFO k.k.c.m.CustomKeywordDelegatingMetaClass - com.database.MySql.updateLibraryTestExecStatus is PASSED [2021-02-28T22:24:18.054] 2021-02-28 22:24:18.054 INFO com.kms.katalon.core.util.KeywordUtil - TestOps Agent List [TWA-QAAUTO-04;;TWA-QAAUTO-08] [2021-02-28T22:24:18.055] 2021-02-28 22:24:18.055 INFO com.kms.katalon.core.util.KeywordUtil - Current Agent [TWA-QAAUTO-04] in Agent List [TWA-QAAUTO-04;;TWA-QAAUTO-08]. [2021-02-28T22:24:18.061] 2021-02-28 22:24:18.061 INFO k.k.c.m.CustomKeywordDelegatingMetaClass - com.database.MySql.updateTestExecStatus is PASSED [2021-02-28T22:24:18.062] 2021-02-28 22:24:18.062 INFO c.k.katalon.core.main.TestCaseExecutor - END Test Cases/SCENARIO/SACMD/NONSUPERUSER/TA_SaCmdWaitingAllDependenciesNonSU [2021-02-28T22:24:18.063] 2021-02-28 22:24:18.063 INFO com.kms.katalon.core.util.KeywordUtil - TestOps Agent List [TWA-QAAUTO-04;;TWA-QAAUTO-08] [2021-02-28T22:24:18.063] 2021-02-28 22:24:18.063 INFO com.kms.katalon.core.util.KeywordUtil - Current Agent [TWA-QAAUTO-04] in Agent List [TWA-QAAUTO-04;;TWA-QAAUTO-08]. [2021-02-28T22:24:18.443] 2021-02-28 22:24:18.443 INFO com.kms.katalon.core.util.KeywordUtil - Start generating HTML report folder at: c:\jenkins\workspace\TIDAL\SACMD_NONSU\Reports\20210228_220528\SACMD\SACMD_NONSU\20210228_220532… [2021-02-28T22:24:18.589] 2021-02-28 22:24:18.589 INFO com.kms.katalon.core.util.KeywordUtil - HTML report generated [2021-02-28T22:24:18.590] 2021-02-28 22:24:18.589 INFO com.kms.katalon.core.util.KeywordUtil - Start generating CSV report folder at: c:\jenkins\workspace\TIDAL\SACMD_NONSU\Reports\20210228_220528\SACMD\SACMD_NONSU\20210228_220532… [2021-02-28T22:24:18.619] 2021-02-28 22:24:18.619 INFO com.kms.katalon.core.util.KeywordUtil - CSV report generated [2021-02-28T22:24:18.670] 2021-02-28 22:24:18.670 INFO c.k.katalon.core.main.TestSuiteExecutor - -------------------- [2021-02-28T22:24:18.670] 2021-02-28 22:24:18.670 INFO c.k.katalon.core.main.TestSuiteExecutor - END Test Suites/SACMD/SACMD_NONSU [2021-02-28T22:24:18.670] 2021-02-28 22:24:18.670 INFO c.k.katalon.core.main.TestSuiteExecutor - ==================== [2021-02-28T22:24:18.673] Launcher status after execution process completed: Running [2021-02-28T22:24:19.139] [2021-02-28T22:24:19.139] Sun Feb 28 22:24:19 CST 2021 [2021-02-28T22:24:19.142] javax.xml.stream.XMLStreamException: ParseError at [row,col]:[18653,1] [2021-02-28T22:24:19.142] Message: An invalid XML character (Unicode: 0x0) was found in the element content of the document. [2021-02-28T22:24:19.142] at com.sun.org.apache.xerces.internal.impl.XMLStreamReaderImpl.next(XMLStreamReaderImpl.java:604) [2021-02-28T22:24:19.142] at com.kms.katalon.core.logging.TestSuiteXMLLogParser.processFile(TestSuiteXMLLogParser.java:86) [2021-02-28T22:24:19.142] at com.kms.katalon.core.logging.TestSuiteXMLLogParser.readTestSuiteLogFromXMLFiles(TestSuiteXMLLogParser.java:63) [2021-02-28T22:24:19.142] at com.kms.katalon.core.reporting.ReportUtil.generate(ReportUtil.java:453) [2021-02-28T22:24:19.142] at com.kms.katalon.core.reporting.ReportUtil.generate(ReportUtil.java:463) [2021-02-28T22:24:19.142] at com.kms.katalon.execution.launcher.ReportableLauncher.prepareReport(ReportableLauncher.java:353) [2021-02-28T22:24:19.142] at com.kms.katalon.execution.launcher.ReportableLauncher.preExecutionComplete(ReportableLauncher.java:144) [2021-02-28T22:24:19.142] at com.kms.katalon.execution.launcher.ProcessLauncher.onWatchdogComplete(ProcessLauncher.java:194) [2021-02-28T22:24:19.142] at com.kms.katalon.execution.launcher.LaunchWatchdog.notifyProcessTerminated(LaunchWatchdog.java:136) [2021-02-28T22:24:19.142] at com.kms.katalon.execution.launcher.LaunchWatchdog.run(LaunchWatchdog.java:66) [2021-02-28T22:24:19.142] at java.lang.Thread.run(Thread.java:748) [2021-02-28T22:24:19.142] [2021-02-28T22:24:19.142] [2021-02-28T22:24:19.150] For real-time monitoring and better reporting capabilities please integrate this project with Katalon TestOps (more details at https://docs.katalon.com/katalon-analytics/docs/integration-with-katalon-studio.html#enable-integration) [2021-02-28T22:24:32.821] [2021-02-28T22:24:32.821] -------------------------------------------------------------------------------- [2021-02-28T22:24:32.821] Test Suites/SACMD/SACMD_NONSU - Chrome - 20210228_220532…67/67(100%) [2021-02-28T22:24:32.821] -------------------------------------------------------------------------------- [2021-02-28T22:24:32.821] [2021-02-28T22:24:32.821] NLS missing message: ConsoleMain_MSG_NON_DEVOPS_LICENSE_COMPATIBLITY in: com.kms.katalon.execution.constants.executionMessages [2021-02-28T22:24:32.824] Execution completed. Exit code: 1. [2021-02-28T22:24:32.825] Start clean up session [2021-02-28T22:24:32.827] End check license task [2021-02-28T22:24:32.828] End clean up session [2021-02-28T22:24:32.830] Start release license task [2021-02-28T22:24:33.877] License released [2021-02-28T22:24:33.879] End release license task [2021-02-28T22:24:33.881] All launchers terminated Build step ‘Execute Katalon Studio Tests’ marked build as failure Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Finished: FAILURE
