Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

Always a student
Hi All,



Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub. Are there any such limitations with microsot Test Manger & Test Agent setup execution aswell. i do believe Test Agent doesnt work with threads but instead copys the whole code to the Test Agent and then executes. But I just wanted to know if there is any limtiation on how mancy machines I can execute my test on if I trigger the execution from a single machine by distributing the test cases on different machines.

Thanks in Advance :)

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

⇜Krishnan Mahadevan⇝

>>>> Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub.

 

I would be really curious to learn how did you conclude on this? Can you please help share with us, on some background behind this analysis?

 

AFAIK, the number of processors has got nothing to do with the Grid’s max value in terms of parallel tests.  The number of processors is usually a factor that folks who work on Java consider, before deducing the maximum number of threads they should be spinning off, when doing concurrent programming.

 

But that theory is not applicable here when it comes to the Hub, because the Hub is merely playing the role of a postman+matcher, forwarding actions to the nodes and matching new session requests to the nodes. It’s the nodes that are actually doing all the heavy lifting.

 

All said and done, the Node can be tweaked to control the number of concurrent sessions that can run at the same time. See here https://rationaleemotions.github.io/gridopadesham/NODE_CONFIG.html#maxsession

 

To get an overview and the set of customizations that are possible with the Grid, you can refer to my book/tutorial: https://rationaleemotions.github.io/gridopadesham/

 

Thanks & Regards

Krishnan Mahadevan

 

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

 

From: <[hidden email]> on behalf of Always a student <[hidden email]>
Reply-To: <[hidden email]>
Date: Friday, December 1, 2017 at 2:15 AM
To: Selenium Users <[hidden email]>
Subject: [selenium-users] Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

 

Hi All,

 

 

 

Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub. Are there any such limitations with microsot Test Manger & Test Agent setup execution aswell. i do believe Test Agent doesnt work with threads but instead copys the whole code to the Test Agent and then executes. But I just wanted to know if there is any limtiation on how mancy machines I can execute my test on if I trigger the execution from a single machine by distributing the test cases on different machines.

 

Thanks in Advance :)

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/BDECA991-B159-4C6B-A432-19DC6AF81F55%40gmail.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

Always a student
Thanks very much for the answer @Krishnan.

I could have been wrong in the case of the processor & Hub limitation. I got my info from here https://groups.google.com/forum/#!topic/selenium-users/b_xgdCAK8ac . Nice to know there isnt any such limitation as I was thinking.  However, I do want to know if I can for example, say run my tests on 50 machines triggering from a single hub and (only one session on each) by selecting the tests from Text Explorer. Is this possible?

I do know that you can change the number of sessions on a node. However, I have to have only one session on a node at a time because I use Autoit for some OS related actions and there is a good chance of unexpected clicks and actions happening on unexpected windows because of multiple parallel sessions.

I did try MTM but figured out that the on-demand Automation test execution works only with XAML builds and Microsoft has decided to get rid of them (Making our life difficult :( ). Newer versions of Visual Studio and VSTS use vNext builds and MTM setup's Test Controller doesn't recongnize it. (Source : https://msdn.microsoft.com/en-us/library/dd380741.aspx)

I have been working hard to figure out a solution to my issue and have been stuck.  Any help would be appreciated :)





On Thursday, November 30, 2017 at 8:35:25 PM UTC-5, Krishnan Mahadevan wrote:

>>>> Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub.

 

I would be really curious to learn how did you conclude on this? Can you please help share with us, on some background behind this analysis?

 

AFAIK, the number of processors has got nothing to do with the Grid’s max value in terms of parallel tests.  The number of processors is usually a factor that folks who work on Java consider, before deducing the maximum number of threads they should be spinning off, when doing concurrent programming.

 

But that theory is not applicable here when it comes to the Hub, because the Hub is merely playing the role of a postman+matcher, forwarding actions to the nodes and matching new session requests to the nodes. It’s the nodes that are actually doing all the heavy lifting.

 

All said and done, the Node can be tweaked to control the number of concurrent sessions that can run at the same time. See here <a href="https://rationaleemotions.github.io/gridopadesham/NODE_CONFIG.html#maxsession" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Frationaleemotions.github.io%2Fgridopadesham%2FNODE_CONFIG.html%23maxsession\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNH6RU3WQiN21q45dDaHVwydoInBYA&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Frationaleemotions.github.io%2Fgridopadesham%2FNODE_CONFIG.html%23maxsession\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNH6RU3WQiN21q45dDaHVwydoInBYA&#39;;return true;">https://rationaleemotions.github.io/gridopadesham/NODE_CONFIG.html#maxsession

 

To get an overview and the set of customizations that are possible with the Grid, you can refer to my book/tutorial: <a href="https://rationaleemotions.github.io/gridopadesham/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Frationaleemotions.github.io%2Fgridopadesham%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHZS_mAQfgGhBI8NPuOvXbzS3f6Ug&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Frationaleemotions.github.io%2Fgridopadesham%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHZS_mAQfgGhBI8NPuOvXbzS3f6Ug&#39;;return true;">https://rationaleemotions.github.io/gridopadesham/

 

Thanks & Regards

Krishnan Mahadevan

 

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ <a href="http://wakened-cognition.blogspot.com/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwakened-cognition.blogspot.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzOdYJCASIDF_28vQtkp9gnKAYSQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwakened-cognition.blogspot.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzOdYJCASIDF_28vQtkp9gnKAYSQ&#39;;return true;">http://wakened-cognition.blogspot.com/

My Technical Scribbings @ <a href="http://rationaleemotions.wordpress.com/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Frationaleemotions.wordpress.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEcBOKyRn0lpL8LDbBuyAlKdwgXwQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Frationaleemotions.wordpress.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEcBOKyRn0lpL8LDbBuyAlKdwgXwQ&#39;;return true;">http://rationaleemotions.wordpress.com/

 

From: <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="QCpcRjv4BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">seleniu...@googlegroups.com> on behalf of Always a student <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="QCpcRjv4BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alik...@...>
Reply-To: <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="QCpcRjv4BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">seleniu...@googlegroups.com>
Date: Friday, December 1, 2017 at 2:15 AM
To: Selenium Users <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="QCpcRjv4BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">seleniu...@googlegroups.com>
Subject: [selenium-users] Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

 

Hi All,

 

 

 

Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub. Are there any such limitations with microsot Test Manger & Test Agent setup execution aswell. i do believe Test Agent doesnt work with threads but instead copys the whole code to the Test Agent and then executes. But I just wanted to know if there is any limtiation on how mancy machines I can execute my test on if I trigger the execution from a single machine by distributing the test cases on different machines.

 

Thanks in Advance :)

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="QCpcRjv4BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">selenium-user...@googlegroups.com.
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="QCpcRjv4BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">seleniu...@googlegroups.com.
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com?utm_medium=email&amp;utm_source=footer" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com?utm_medium\x3demail\x26utm_source\x3dfooter&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com?utm_medium\x3demail\x26utm_source\x3dfooter&#39;;return true;">https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/b5640257-15af-4e75-852c-c1de5e2b044a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

⇜Krishnan Mahadevan⇝

>>>> However, I do want to know if I can for example, say run my tests on 50 machines triggering from a single hub and (only one session on each) by selecting the tests from Text Explorer. Is this possible?

 

If you have 50 nodes attached to your hub and if you have configured maxSession per node as 1, then yes, you should be able to do this. Grid doesn’t deal with triggering your tests in parallel. So make sure whatever testrunner you are using, can kick off 50 tests concurrently.

 

 

Thanks & Regards

Krishnan Mahadevan

 

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

 

From: <[hidden email]> on behalf of Always a student <[hidden email]>
Reply-To: <[hidden email]>
Date: Wednesday, December 6, 2017 at 4:02 AM
To: Selenium Users <[hidden email]>
Subject: Re: [selenium-users] Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

 

Thanks very much for the answer @Krishnan.

 

I could have been wrong in the case of the processor & Hub limitation. I got my info from here https://groups.google.com/forum/#!topic/selenium-users/b_xgdCAK8ac . Nice to know there isnt any such limitation as I was thinking.  However, I do want to know if I can for example, say run my tests on 50 machines triggering from a single hub and (only one session on each) by selecting the tests from Text Explorer. Is this possible?

 

I do know that you can change the number of sessions on a node. However, I have to have only one session on a node at a time because I use Autoit for some OS related actions and there is a good chance of unexpected clicks and actions happening on unexpected windows because of multiple parallel sessions.

 

I did try MTM but figured out that the on-demand Automation test execution works only with XAML builds and Microsoft has decided to get rid of them (Making our life difficult :( ). Newer versions of Visual Studio and VSTS use vNext builds and MTM setup's Test Controller doesn't recongnize it. (Source : https://msdn.microsoft.com/en-us/library/dd380741.aspx)

 

I have been working hard to figure out a solution to my issue and have been stuck.  Any help would be appreciated :)

 

 

 



On Thursday, November 30, 2017 at 8:35:25 PM UTC-5, Krishnan Mahadevan wrote:

>>>> Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub.

 

I would be really curious to learn how did you conclude on this? Can you please help share with us, on some background behind this analysis?

 

AFAIK, the number of processors has got nothing to do with the Grid’s max value in terms of parallel tests.  The number of processors is usually a factor that folks who work on Java consider, before deducing the maximum number of threads they should be spinning off, when doing concurrent programming.

 

But that theory is not applicable here when it comes to the Hub, because the Hub is merely playing the role of a postman+matcher, forwarding actions to the nodes and matching new session requests to the nodes. It’s the nodes that are actually doing all the heavy lifting.

 

All said and done, the Node can be tweaked to control the number of concurrent sessions that can run at the same time. See here https://rationaleemotions.github.io/gridopadesham/NODE_CONFIG.html#maxsession

 

To get an overview and the set of customizations that are possible with the Grid, you can refer to my book/tutorial: https://rationaleemotions.github.io/gridopadesham/

 

Thanks & Regards

Krishnan Mahadevan

 

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

 

From: <<a href="javascript:" target="_blank">seleniu...@...> on behalf of Always a student <<a href="javascript:" target="_blank">alik...@...>
Reply-To: <<a href="javascript:" target="_blank">seleniu...@...>
Date: Friday, December 1, 2017 at 2:15 AM
To: Selenium Users <<a href="javascript:" target="_blank">seleniu...@...>
Subject: [selenium-users] Maximum number of Test Agents/ Remote machined with Microsoft Test Manager

 

Hi All,

 

 

 

Selenium Grid has a limitation where the number of parallel tests is tied to the number of processors on the hub. Are there any such limitations with microsot Test Manger & Test Agent setup execution aswell. i do believe Test Agent doesnt work with threads but instead copys the whole code to the Test Agent and then executes. But I just wanted to know if there is any limtiation on how mancy machines I can execute my test on if I trigger the execution from a single machine by distributing the test cases on different machines.

 

Thanks in Advance :)

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank">selenium-user...@....
To post to this group, send email to <a href="javascript:" target="_blank">seleniu...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/bd0ee52c-bb8e-4b73-8acc-e75ce28536c6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/b5640257-15af-4e75-852c-c1de5e2b044a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/8979D848-9FA8-453C-88EA-6965149ED14C%40gmail.com.
For more options, visit https://groups.google.com/d/optout.