Ranorex and JPlanner (Graphics2D)

Technology specific object identification, supported applications, web technologies, and 3rd party controls.
jdk
Certified Professional
Certified Professional
Posts: 9
Joined: Wed Oct 24, 2012 3:19 pm

Ranorex and JPlanner (Graphics2D)

Post by jdk » Wed Feb 15, 2017 4:44 pm

Hello,

We're looking into using JPlanner (http://mindfusion.eu/jplanner.html) as a planner module inside our Java Swing client. Developers are happy, it brings us a lot of what we want, saves a lot of implementation. But the Test Specialist, me, I'm less enthousiastic.

The JPlanner component on high level is Java Swing, but on lower level, most of the items it displays are not Swing components, but UI painted using Graphics2D. Something Ranorex does not recognise.

Does anybody know of a way to deal with this (other than: look for another planner module or build it yourself)? I really want to be able to check for appointments within JPlanner. I can't think of a way to do this (not without reverting to image comparison), any thoughts appreciated.

As an example, see the two images below. Only the scrollbar + up/down button and the left/right button to switch to the previous/next day are recognised by Ranorex. The appointments that you can see in the view are not visible to Ranorex.
JPlanner_view.png
Ranorex Spy (64bit) - Live_2017-02-15_12-39-28.png
You do not have the required permissions to view the files attached to this post.

User avatar
Support Team
Site Admin
Site Admin
Posts: 12145
Joined: Fri Jul 07, 2006 4:30 pm
Location: Houston, Texas, USA
Contact:

Re: Ranorex and JPlanner (Graphics2D)

Post by Support Team » Thu Feb 16, 2017 10:12 am

Hi jdk,
UI painted using Graphics2D
Well, I'm afraid that Ranorex (or any other tool/software) can't recognize painted parts of applications as accessible objects. Coordinate/image based object recognition would be the only way to automate those "objects".

Sincerely,
Robert

jdk
Certified Professional
Certified Professional
Posts: 9
Joined: Wed Oct 24, 2012 3:19 pm

Re: Ranorex and JPlanner (Graphics2D)

Post by jdk » Thu Feb 16, 2017 10:18 am

Support Team wrote:Hi jdk,
UI painted using Graphics2D
Well, I'm afraid that Ranorex (or any other tool/software) can't recognize painted parts of applications as accessible objects. Coordinate/image based object recognition would be the only way to automate those "objects".
Hello Robert,
Well, that was in fact the answer I expected. Moving to image based tests will make the tests more fragile; the strength of Ranorex is in object recognition. Thanks for the confirmation. We might need to reconsider our choice of using JPlanner.

User avatar
Stub
Posts: 515
Joined: Fri Jul 15, 2016 1:35 pm

Re: Ranorex and JPlanner (Graphics2D)

Post by Stub » Thu Feb 16, 2017 12:39 pm

I know nothing of Java/Swing but I've had a similar issue with some ancient C++ grid controls I'm working with. Fortunately GDI Capture within Ranorex lets me detect RawText elements, and this has allowed me to find, read and edit cells on my grid.