Mandalika's scratchpad [ Work blog @Oracle | My Music Compositions ]

Old Posts: 09.04  10.04  11.04  12.04  01.05  02.05  03.05  04.05  05.05  06.05  07.05  08.05  09.05  10.05  11.05  12.05  01.06  02.06  03.06  04.06  05.06  06.06  07.06  08.06  09.06  10.06  11.06  12.06  01.07  02.07  03.07  04.07  05.07  06.07  08.07  09.07  10.07  11.07  12.07  01.08  02.08  03.08  04.08  05.08  06.08  07.08  08.08  09.08  10.08  11.08  12.08  01.09  02.09  03.09  04.09  05.09  06.09  07.09  08.09  09.09  10.09  11.09  12.09  01.10  02.10  03.10  04.10  05.10  06.10  07.10  08.10  09.10  10.10  11.10  12.10  01.11  02.11  03.11  04.11  05.11  07.11  08.11  09.11  10.11  11.11  12.11  01.12  02.12  03.12  04.12  05.12  06.12  07.12  08.12  09.12  10.12  11.12  12.12  01.13  02.13  03.13  04.13  05.13  06.13  07.13  08.13  09.13  10.13  11.13  12.13  01.14  02.14  03.14  04.14  05.14  06.14  07.14  09.14  10.14  11.14  12.14  01.15  02.15  03.15  04.15  06.15  09.15  12.15  01.16  03.16  04.16  05.16  06.16  07.16  08.16  09.16  12.16  01.17  02.17  03.17  04.17  06.17  07.17  08.17  09.17  10.17  12.17  01.18  02.18  03.18  04.18  05.18  06.18  07.18  08.18  09.18  11.18  12.18  01.19  02.19  05.19  06.19  08.19  10.19  11.19  05.20  10.20  11.20  12.20  09.21  11.21  12.22 


Thursday, June 19, 2008
 
QuickTest Pro Performance : VNC or Remote Desktop?

For the past few months I have been struggling with the mysteriously poor performing QuickTest Professional (QTP) on Windows. When tested similar transactions using the LoadRunner (LR) tool, the average response times were satisfactory -- mostly under 2 seconds. However when tested with QTP, the averages were unusually high - they are mostly between 2 and 4 seconds. LoadRunner data eliminated the web and application servers from the picture. Because the LR reported averages are in the expected range, the web and app servers might be performing well. Hence there is no apparent reason to suspect web/app servers for the slowness observed through the QTP tool. That leaves the QTP client as the primary suspect.

There is no improvement in the average transaction response times even after downgrading the version of QTP tool and the Internet Explorer web browser. Luckily one of my colleagues at work noticed slight improvement to the averages when we are not monitoring the QTP test running through our VNC viewers. The response times were better when we either close the VNC viewer window completely or minimize it. That was an interesting observation. VNC service appears to be interfering with the web browser's rendering performance; and due to that the recorded response times were poor. So I stopped the VNC server/service on the QTP client machine; and connected to the QTP client through the "Remote Desktop connection" from another PC. Finally I re-ran the same QTP test that I ran earlier when I was connecting through the VNC. Voila! the QTP response times are almost coinciding with the LoadRunner reported response times.

To make it more attractive, here is some sample data that shows the difference between the response times when connected through the VNC and the Remote Desktop connections:

----------------------------------------------------
VNC Remote
Viewer Desktop
----------------------------------------------------
Average Logon 2.59 sec 0.76 sec
Avg. Page Load 2.91 sec 0.77 sec
Avg. Page Save 3.82 sec 2.05 sec
----------------------------------------------------

Moral of the story:

When running performance tests with QuckTest Pro (QTP) tool on remote clients, consider connecting to the remote client using "Remote Desktop" connection. Web browser might perform suboptimally under the VNC, which might skew the overall performance data.

And of course, I do not have any evidence other than the above data that proves VNC guilty. It was just my observation.
________________
Technorati Tags:
| | | | | |


Comments:
First of all. Thanks very much for your useful post.

I just came across your blog and wanted to drop you a note telling you how impressed I was with the information you have posted here.

Please let me introduce you some info related to this post and I hope that it is useful for software testing community.

There is a good Software Testing resource site, Have alook

http://SoftwareTestingNet.com

simi
 
So this is Windows? I would be very curious to see this same test conducted with Windows built in Remote desktop and some third party remote desktop software. I have a feeling the MS offering would not be able to match the performance, but I would actually be pleasantly surprised if it turned out that I was wrong about that.
 
Post a Comment



<< Home


2004-2019 

This page is powered by Blogger. Isn't yours?