Discussion about the trend of AI in testing

Recently, I observed ChatGPT expanding throughout the world and I really like to use it. I wonder if any of AI tools and technique can be applied in testing. Generally, What are some of the latest trends in using AI for testing? And can anyone share with forum some examples? I really do not know how AI has been used in testing.

2 Likes

Other than generating code snippets prone to errors?

Perhaps the Visual Testing feature proposed by Katalon may have more sense, altough it is prone to error too.

Shortly speaking, as long as a certain AI it is not able to (continuously) learn from (new) mistakes, it has no relevance for the testing process but only to generate more and more wrong solutions.

It is yet another trained monkey.
Trained wrong will allways give wrong solutions.
Trained ‘well’ may give acceptable solutions… for a while.
Will never use such.

In our case, it helps us to evaluate different test cases that we can take into account with respect to the functionalities we describe.
In terms of code, they are more queries of methods in libraries or versions of the same code. To “play” a little bit.
But it is true that it is practical for non-technical profiles or those who are starting to automate.
Any more examples to consider?

I’ve seen a lot of shops use AI when creating Test Data. I’ve also seen a lot of shops do a very “High Level” of code reviews using AI. Chatgpt is just one aspect of AI.
Years ago and not chatgpt related, I created a system that was learning from multiple instances of of CI and jira That helped predict and future bug risks as well as future budget planning.

I’ve found the best people that can really envision solutions here come with a creative mind but have very sound engineering capabilities.

Cheers.

3 Likes

Exactly. That’s where we are right now (with ChatGPT at least).

2 Likes

Well, that’s the key. Learning!
Our company uses AI technologies to analyze data comming from various networking appliances to help in debug and predict various issues.
So, yeah, AI can help with a lot of things, if used properly.

ChatGPT as it is now? I don’t see any real value of it.
So I am treating such implementations only as demo version, to show what it may do.
How those will evolve, time will tell

1 Like

Oh, lots of perspectives. Do you guys think it will be valuable to share some more AI tools & techniques and give people tutorials how to approach? I love to play around with those. Maybe for fun or for learning.

2 Likes

Sure! Maybe for fun or for learning. We can use AI as a “complement”. We can view the developing at market and diferent points of views. Nowadays, Ai’s are evolving faster, it is not only abot chatgpt.

1 Like

I found an article which claimed that AI will not be replacing Manual QA Engineers any time soon…

Some of the points the author made seems pretty valid such as:

  1. Limited Understanding of Context: While AI models are trained on large datasets, they still cannot fully understand the context of a specific application or business domain. This is in contrast with manual QA engineers, who can better understand the product and its business objective.

  2. Manual QA engineers are better at understanding the users’ experiences with their product that AI, at the moment, cannot. An engineer can put themselves into the shoes of a user and assess how user-friendly a program, service, or application is, while AI is better suited to finding discrepancies in coding and errors.

  3. Manual QA engineers can understand the context of bugs which make them better at debugging than AI. Again, AI algorithms can detect simple errors and can be taught to analyze code, but they cannot comprehend why certain conditions cause issues or how the system works as a whole.

@albert.vu Agreed. All summed up by “product knowledge” and “situational awareness”.

However, if ATG can be shown to provide a wealth of coverage that would otherwise take a human many man-months to develop and ratify, there may be some orgs that promote its use to get a solid head start.

Of course, a human will be involved to ratify ATG’s output. :sunglasses:

2 Likes