Small issues with reporting and log viewer

learning
critical

#1

Hello Support,

**OS **(Windows 8.1 64bit):

Katalon Studio Version (Katalon Studio Version: 5.2.0 Build: 1)

## Katalon Studio logs:

See attached

## Environment (for Web testing)

Browser (Internet Explorer 11 & Chrome 63.0.3239.84)

First of all, Great WORK!
Katalon is a very precious tool for all of us.
I am trying to help participating on forum and providing feedback.
The bellow defects are not critically blocking, but they would be good to have fixed:

## Steps to reproduce -

  1. Log & TC Progress issue
    I have a test suite with 2 test cases. One of the test case is run with 13 scenarios/links from an Excel. So it’s run takes some time ~>10 minutes. Another particular thing about my suite would be that I have this test case calling another test case inside, but it works very well on that part.
    **## Expected Behavior
    **The Log Viewer should show progressively 1/14, 2/14, 3/14… a review of current execution of 0/14 runs but this does not progress at all.
    **## Actual Behavior -
    **The issue is that the Log Viewer shows a review of current execution of 0/14 runs but this does not progress at all. It only reaches 14/14 at the end of the run.
    ## Screenshots / VideosWhat I noticed is that, on the headless Chrome run, this review is correctly listed during the execution progress.
  2. **## Steps to reproduce
    **On the same scenario described at point 1, with reporting setting made to record video of both successful and failing test case runs.
    **## Expected Behavior -
    **video should be present in the Reporting folder/interface
    **## Actual Behavior - **the video recording of the execution is not successful , all I find in the Reporting Video folder is a file named “test_1.tmp” with 0 kb, so something must go wrong there.
    This seems to have to do, again, with the 13 scenarios/links from Excel test case that takes >10 minutes to execute, because if I am running only test case 1 in the suite, I find the videos as expected in the report folder.

Thank you and keep up the good work.
We are here trying to help you.
Happy holidays!

Thank you,
Cornel Neacsu

Katalon Studio small log review issue 2017-12-19 13.50.12.png

Katalon Studio - Video reporting missing on long suite run 2017-12-19 14.04.09.png

.log


#2

Hi Cornel Neacsu,

Thanks for your feedback so much :). Regard to your posted issue, I would like to clarify these things first:
1. Looks this this issue does not always happen, is that right? Because based on your posted issue, I can see that it does not happen on Chrome (headless) but on IE instead.
2. Is that abnormal execution on IE executed successfully, or is it just an issue from Log Viewer
2. Have you tried with Firefox and see if it happens in Firefox?

Regards


#3

Hello Vinh,

Issue no 1) is present when running the test suite on Chrome, IE, Firefox (did not try on Safari at all). The only way I see it listing as expected is on Chrome headless.
Also the log tree seems to freeze (please see the first printscreen atached , it stops after listing only 4 lines:

  1. Logging run data ‘hostname’…

  2. Logging run data ‘os’…

  3. Logging run data ‘hostAddress’…

  4. Logging run data ‘katalonVersion’…

The Console tab is updating information as epxected, after each step. Only the ‘Log Viewer’ seems frozen.

Issue no 2)
I am not sure I understand what you mean by “Is that abnormal execution on IE executed successfully”. This issue appears on all browsers executions, it is not relevant that left run in the printscreen was made on IE and right run was made on Chrome.
The difference consists of:
In left printscreen I have runned One test case + 13 iterations of another test case => no video recorded.
In right side of the printscreen I have deactivated the second test case(13 excel links) from the test suite and only run it with the first TC active. In this case the video was there as expected, both in the UI and in the Report->Video folder.
From the katalon log file, can this be relevant?

Exception in thread "Thread-268" java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at com.kms.katalon.execution.video.VideoRecorderService.getCurrentReportItem(VideoRecorderService.java:214)
at com.kms.katalon.execution.video.VideoRecorderService.initVideoRecorder(VideoRecorderService.java:204)
at com.kms.katalon.execution.video.VideoRecorderService.handleLogUpdated(VideoRecorderService.java:111)
at com.kms.katalon.execution.video.VideoRecorderService.handleLauncherEvent(VideoRecorderService.java:76)
at com.kms.katalon.execution.launcher.BasicLauncher.notifyLauncherChanged(BasicLauncher.java:30)
at com.kms.katalon.execution.launcher.LoggableLauncher.onUpdateRecord(LoggableLauncher.java:105)
at com.kms.katalon.execution.launcher.LoggableLauncher.addLogRecords(LoggableLauncher.java:53)
at com.kms.katalon.execution.logging.SocketWatcher.run(SocketWatcher.java:58)
at java.lang.Thread.run(Thread.java:745)

Thank you,
Cornel Neacsu


#4

Hi Cornel,

Does this issue always happen in all test suites, or is it just happen for this specific test suite? Can you help to try to remove all test cases from that test suite, then add one by one previous test cases and execute it to see if there is any specific test case causing this problem?

Regards


#5

Hi Cornel,

I’ve figured out the root cause of your issue already. This issue happens when you enable video capturing option and execute a test suite using data-driven approach, so that’s why Log Viewer doesn’t show real-time logs upon execution.

I’ve added a ticket for it and it will be fixed in next release.

Regards


#6

I have the similar problem…
OS: macOS Sierra -version: 10.1.12.6
Katalon version: 5.10.1

As you can see in the screenshot the log viewer and report folder is always empty for both firefox and chrome, headless or not.
However, if you navigate to the folder you can find video and screenshot if there is some failed tests.

Moreover, in console the following error is showing
Unable to create logger. Root cause (/.../execution0.log.lck).


#7