Object Recognition on remote device apps

Technology specific object identification, supported applications, web technologies, and 3rd party controls.
Posts: 67
Joined: Fri Nov 26, 2010 3:39 pm

Object Recognition on remote device apps

Post by anja » Wed Jan 05, 2011 8:33 am


recently we tried to test an application which is installed on an mobile device (Windows mobile OS).
Via ActiveSync and RemoteDisplayControl it is possible to connect to the device and get the display of the mobile device on the PC monitor. Now we tried to access the elements in the application, but they were not possible to identify (even with the GDI-Plugin it was not possible). Only the application for getting the remote connection was possible to access...

Are there any experiences in testing such applications?

Thank you!

Best regards

User avatar
Posts: 1336
Joined: Thu Oct 16, 2008 6:46 pm
Location: Arizona, USA

Re: Object Recognition on remote device apps

Post by Ciege » Wed Jan 05, 2011 4:29 pm

The window of the mobile device is just one big picture, much like a remote desktop connection. Therefore, there really are no objects or elements to identify. You will need to use image automation and/or absolute coordinates to automate the information within the remote display control.
If this or any response has helped you, please reply to the thread stating that it worked so other people with a similar issue will know how you fixed your issue!