Unable to capture objects : Web Driver Exception

@Chris_Trevarthen

Thank you. This helps for capturing the test objects.

Now I have a problem setting a value on the captured testobjects. Type of objects when captured is “ImageView”. It is not possible to execute “setText” or “sendKeys” on this type of objects. Even after “tapping” on it I cannot set text. Usually you can only set value on an input object like EditText. But this ImageView seems not to transform into an input object after tapping it.

How can I set the value on a testobject on a secure page?

PS: it is not possible to unset the “secure” flag because it is an external closed-source app.

Captured objects of type ImageView:
49

The secret page with pin input (6 seperate fields)

Hi @mdmmzm,

Thanks for the screenshot and explanation, that’s helpful. You’re correct that you can only set text on text fields, and not images.

I’m thinking that if we can get the keyboard to come up at least, we can access the keys. When you are using the app normally (not testing) how do you get the keyboard to come up so that you can enter the PIN? Do you have to tap one of the circles first? I think we can make the test do the same thing.

Once the keyboard is up, you could try pressing the keys on the keypad like this post mentions:

Hope this helps,

Chris

Hi @Chris_Trevarthen ,
Yes this works! Thank you.
A standard keyword would be helpful for typing via keyboard as you are gonna need it more than one time.

1 Like

Hi @Chris_Trevarthen

I have created a Gist for this purpose: Keyboard.groovy: Fill out numbers using Android Keyboard

1 Like

Hi, I have the same mistake, can you resolve it? .

Hi @ariel.villalobos,

Can you share what version of Katalon Studio and Appium you’re using? Could you also share any screenshots or logs from Katalon you are seeing?

—Chris

Hi Chris:

I got the information:

Katalon Studio
Version: 6.3.2
Build: 4

appium --version : 1.14.1

Hi @ariel.villalobos,

As far as I know, Appium 1.12.1 is the latest supported version. Could you try downgrading to that version and see if that helps?

npm install -g appium@1.12.1

Hope this helps,

Chris

1 Like

thank you very much!

Hi @Chris_Trevarthen , im getting the same issue. but i cant dismiss the “Capturing Information” message.

So, i cant capture the rest of the objects.

Any idea how to solve this problem?

Thanks!

Hi @Gaston_Marichal,

Can you provide a little more info about the versions of Katalon Studio, Appium, and Android SDK you’re using? Are you capturing on a real device or an emulator? Can you tell me the Android version of on the device?

Thanks,

Chris

Yeah, sure!
Katalon Studio: 6.3.3 build 11
Android-SDK: 27
Appium: V 1.15.0

I tried with both device type, (Real and Emulator) Running Android 9

Thanks for your help!

Hi @Gaston_Marichal,

As far as I know, Appium 1.12.1 is the latest supported version. Could you try downgrading to that version and see if that helps?

npm install -g appium@1.12.1

Hope this helps,

Chris

Hello Chris, I downgrade to v 1.12.1 and it seems to work

Thank for your help!

Hi All,

I am very new to Katalon, at mobile testing I am getting below error

java.util.concurrent.ExecutionException: org.openqa.selenium.SessionNotCreatedException: Unable to create a new remote session. Please check the server log for more details. Original error: An unknown server-side error occurred while processing the command. Original error: Cannot start the 'com.sap.fsm' application. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting. Original error: 'com.coresuite.android.AppStartActivity' or 'com.sap.fsm.com.coresuite.android.AppStartActivity' never started. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53' System info: host: 'INLN50939184A', ip: '10.136.226.154', os.name: 'Windows 10', os.arch: 'amd64', os.version: '10.0', java.version: '1.8.0_181' Driver info: driver.version: SwipeableAndroidDriver remote stacktrace: UnknownError: An unknown server-side error occurred while processing the command. Original error: Cannot start the 'com.sap.fsm' application. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting. Original error: 'com.coresuite.android.AppStartActivity' or 'com.sap.fsm.com.coresuite.android.AppStartActivity' never started. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting at getResponseForW3CError (C:\Users\I3540\AppData\Roaming\npm\node_modules\appium\node_modules\appium-base-driver\lib\protocol\errors.js:804:9) at asyncHandler (C:\Users\I354\AppData\Roaming\npm\node_modules\appium\node_modules\appium-base-driver\lib\protocol\protocol.js:388:37) Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53' System info: host: 'INLN50939184A', ip: '10.136.226.154', os.name: 'Windows 10', os.arch: 'amd64', os.version: '10.0', java.version: '1.8.0_181' Driver info: driver.version: SwipeableAndroidDriver at com.kms.katalon.composer.components.impl.dialogs.ProgressMonitorDialogWithThread.runAndWait(ProgressMonitorDialogWithThread.java:49) at com.kms.katalon.composer.mobile.objectspy.components.MobileLocalAppComposite$12.run(MobileLocalAppComposite.java:474) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:119) Caused by: org.openqa.selenium.SessionNotCreatedException: Unable to create a new remote session. Please check the server log for more details. Original error: An unknown server-side error occurred while processing the command. Original error: Cannot start the 'com.sap.fsm' application. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting. Original error: 'com.coresuite.android.AppStartActivity' or 'com.sap.fsm.com.coresuite.android.AppStartActivity' never started. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53' System info: host: 'INL', ip: '10.136.226.154', os.name: 'Windows 10', os.arch: 'amd64', os.version: '10.0', java.version: '1.8.0_181' Driver info: driver.version: SwipeableAndroidDriver remote stacktrace: UnknownError: An unknown server-side error occurred while processing the command. Original error: Cannot start the 'com.sap.fsm' application. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting. Original error: 'com.coresuite.android.AppStartActivity' or 'com.sap.fsm.com.coresuite.android.AppStartActivity' never started. Visit https://github.com/appium/appium/blob/master/docs/en/writing-running-appium/android/activity-startup.md for troubleshooting at getResponseForW3CError (C:\Users\I354008\AppData\Roaming\npm\node_modules\appium\node_modules\appium-base-driver\lib\protocol\errors.js:804:9) at asyncHandler (C:\Users\I354008\AppData\Roaming\npm\node_modules\appium\node_modules\appium-base-driver\lib\protocol\protocol.js:388:37) Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53' System info: host: 'INLN50939184A', ip: '10.136.226.154', os.name: 'Windows 10', os.arch: 'amd64', os.version: '10.0', java.version: '1.8.0_181' Driver info: driver.version: SwipeableAndroidDriver at io.appium.java_client.remote.AppiumCommandExecutor$1.createSession(AppiumCommandExecutor.java:208) at io.appium.java_client.remote.AppiumCommandExecutor.createSession(AppiumCommandExecutor.java:217) at io.appium.java_client.remote.AppiumCommandExecutor.execute(AppiumCommandExecutor.java:239) at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:552) at io.appium.java_client.DefaultGenericMobileDriver.execute(DefaultGenericMobileDriver.java:42) at io.appium.java_client.AppiumDriver.execute(AppiumDriver.java:1) at io.appium.java_client.android.AndroidDriver.execute(AndroidDriver.java:1) at com.kms.katalon.core.appium.driver.SwipeableAndroidDriver.execute(SwipeableAndroidDriver.java:1) at org.openqa.selenium.remote.RemoteWebDriver.startSession(RemoteWebDriver.java:213) at org.openqa.selenium.remote.RemoteWebDriver.<init>(RemoteWebDriver.java:131) at io.appium.java_client.DefaultGenericMobileDriver.<init>(DefaultGenericMobileDriver.java:38) at io.appium.java_client.AppiumDriver.<init>(AppiumDriver.java:84) at io.appium.java_client.android.AndroidDriver.<init>(AndroidDriver.java:85) at com.kms.katalon.core.appium.driver.SwipeableAndroidDriver.<init>(SwipeableAndroidDriver.java:24) at com.kms.katalon.core.appium.driver.AppiumDriverManager.createMobileDriver(AppiumDriverManager.java:497) at com.kms.katalon.core.appium.driver.AppiumDriverManager.createMobileDriver(AppiumDriverManager.java:479) at com.kms.katalon.core.mobile.keyword.internal.MobileDriverFactory.startLocalMobileDriver(MobileDriverFactory.java:458)

and when I select Application ID instead of file it throws unable to capture objects reason screenshot exception. Please help me.

Thanks,
Raja

@Chris_Trevarthen,

I am not able to capture the object during the mobile test recording.On Clicking the ‘Capture object’ option not loading the objects.
Katalon Version : 7.1.0
appium version: 1.15.1
Android SDK : 29

Whether downgrading any of the above will solve the problem ?

Hi @Catch,

Are you seeing an error when you click “Capture Object”? Could you share a screenshot of what your app looks like at the time you’re trying to capture?

– Chris

Hi @rajasingh.vimlax,

Something you could look at for why the app isn’t starting is to set the appWaitActivity in your project:

As for not being able to capture the object due to the screenshot exception, this can occur when you are trying to capture a screen that is marked as “secure” - this can be on login screens to prevent capturing of username and passwords. See this post for more on that:

Hope this helps,

Chris

I am not seeing any error, on clicking the capture object it is not loading the object for client id , username and password. I was able to capture it before and all on sudden when i run the test with captured object , it gave me the error fail to settext to clientid, username and password. Then i try to record again and found that during recording on clicking the capture object; it fail to load the object of the clientid, username and password.

Hi @Catch

It looks like the login form is in a webview, is that correct? Does the app use any other webviews other than the login screen? If so, are you able to capture objects on those screens? I’m wondering if there is something different about the login screen that prevents capturing objects.

You could try downgrading to Appium 1.12.1 to see if that makes any difference on your ability to capture a webview.

– Chris