Need Info : Running docker in cloud with Selenium Grid - which is best service ?

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Need Info : Running docker in cloud with Selenium Grid - which is best service ?

Vikram
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/8907ab5b-dfc2-4101-9611-19b4dca27d11%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need Info : Running docker in cloud with Selenium Grid - which is best service ?

Jeff H.
I've found it very easy to run Selenium Grid via an EC2 instance in Amazon's AWS.  I use docker-compose to manage the containers, which really simplifies things.  There is an existing Selenium Docker project:

https://github.com/SeleniumHQ/docker-selenium

...so you don't have to create your own images.

This blog post will give you an idea of what's involved (you can ignore the part about building your own images if you use the selenium-docker images):

http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/



On Thursday, March 3, 2016 at 2:45:25 AM UTC-8, Vikram wrote:
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/01ccd8a0-6cbf-40d0-8859-1f73c9587ea3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need Info : Running docker in cloud with Selenium Grid - which is best service ?

Vikram
Hi Jeff,

thanks a ton for this awesome info.

I will try it out and update back on this thread by this week.

Regards,
Vikram

On Thursday, March 3, 2016 at 6:37:27 PM UTC+1, Jeff H. wrote:
I've found it very easy to run Selenium Grid via an EC2 instance in Amazon's AWS.  I use docker-compose to manage the containers, which really simplifies things.  There is an existing Selenium Docker project:

<a href="https://github.com/SeleniumHQ/docker-selenium" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;">https://github.com/SeleniumHQ/docker-selenium

...so you don't have to create your own images.

This blog post will give you an idea of what's involved (you can ignore the part about building your own images if you use the selenium-docker images):

<a href="http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;">http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/



On Thursday, March 3, 2016 at 2:45:25 AM UTC-8, Vikram wrote:
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/7b0f136c-8247-44b0-b096-52307ae1ab79%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need Info : Running docker in cloud with Selenium Grid - which is best service ?

Vikram
In reply to this post by Jeff H.
Hi Jeff,

Here is some update with blocking issue


Earlier I had docker setup on MAC mini and everything works perfectly.

Now I'm trying to replicate same setup on Linux VM ( Azure cloud )  + Docker ;  but getting below error and all the test cases are failing.

java.awt.HeadlessException:
No X11 DISPLAY variable was set, but this program performed an operation which requires it.


I have installed xvbf , chrome browser and chrome driver successfully on Linux VM
. Please let me know if you had encountered this issue earlier

Thanks & Regards,
Vikram



On Thursday, March 3, 2016 at 6:37:27 PM UTC+1, Jeff H. wrote:
I've found it very easy to run Selenium Grid via an EC2 instance in Amazon's AWS.  I use docker-compose to manage the containers, which really simplifies things.  There is an existing Selenium Docker project:

<a href="https://github.com/SeleniumHQ/docker-selenium" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;">https://github.com/SeleniumHQ/docker-selenium

...so you don't have to create your own images.

This blog post will give you an idea of what's involved (you can ignore the part about building your own images if you use the selenium-docker images):

<a href="http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;">http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/



On Thursday, March 3, 2016 at 2:45:25 AM UTC-8, Vikram wrote:
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/bd3f9845-4edd-416f-96df-300002bdce54%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need Info : Running docker in cloud with Selenium Grid - which is best service ?

Jeff H.
Vikram, I have not run into that particular error before, and if you're using images from the docker-selenium project, it should not be an issue, since xvfb is built in; see for example:

https://github.com/SeleniumHQ/docker-selenium/blob/master/NodeBase/Dockerfile#L35

I would suggest verifying that the Selenium Grid hub is definitely up-and-running as expected, using a URL like this:

http://<hostname>:4444/grid/console

If you see the Grid console at the URL, along with whatever browser nodes you chose to start, then you should be in business.  If you don't see the Grid console at that URL, then something has happened with the hub startup, and I'd suggest looking at the Selenium logs at that point to try and determine the source of the problem.


On Friday, March 11, 2016 at 5:50:45 AM UTC-8, Vikram wrote:
Hi Jeff,

Here is some update with blocking issue


Earlier I had docker setup on MAC mini and everything works perfectly.

Now I'm trying to replicate same setup on Linux VM ( Azure cloud )  + Docker ;  but getting below error and all the test cases are failing.

java.awt.HeadlessException:
No X11 DISPLAY variable was set, but this program performed an operation which requires it.


I have installed xvbf , chrome browser and chrome driver successfully on Linux VM
. Please let me know if you had encountered this issue earlier

Thanks & Regards,
Vikram



On Thursday, March 3, 2016 at 6:37:27 PM UTC+1, Jeff H. wrote:
I've found it very easy to run Selenium Grid via an EC2 instance in Amazon's AWS.  I use docker-compose to manage the containers, which really simplifies things.  There is an existing Selenium Docker project:

<a href="https://github.com/SeleniumHQ/docker-selenium" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;">https://github.com/SeleniumHQ/docker-selenium

...so you don't have to create your own images.

This blog post will give you an idea of what's involved (you can ignore the part about building your own images if you use the selenium-docker images):

<a href="http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;">http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/



On Thursday, March 3, 2016 at 2:45:25 AM UTC-8, Vikram wrote:
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/c48c8a0a-527b-4234-87b0-c79ef1a0f530%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need Info : Running docker in cloud with Selenium Grid - which is best service ?

Vikram
Hi Jeff,

Thanks for reply.

I could get the issue resolved at last , details here https://github.com/serenity-bdd/serenity-core/issues/353

Here is git repo if somebody wants to try it out with Docker setup

https://github.com/vikramvi/junit-webtests-parallel-grid-docker-jenkins-debug/tree/master/junit-webtests


Now the next challenge is to integrate this whole setup with Jenkins , so that anyone within company network can run in cloud VM.

I'll update once I get it working on Azure Linux VM

Regards,
Vikram


On Friday, March 11, 2016 at 6:25:01 PM UTC+1, Jeff H. wrote:
Vikram, I have not run into that particular error before, and if you're using images from the docker-selenium project, it should not be an issue, since xvfb is built in; see for example:

<a href="https://github.com/SeleniumHQ/docker-selenium/blob/master/NodeBase/Dockerfile#L35" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium%2Fblob%2Fmaster%2FNodeBase%2FDockerfile%23L35\46sa\75D\46sntz\0751\46usg\75AFQjCNGchwhK6nbP36DVO-oE1IG6o9FFAQ&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium%2Fblob%2Fmaster%2FNodeBase%2FDockerfile%23L35\46sa\75D\46sntz\0751\46usg\75AFQjCNGchwhK6nbP36DVO-oE1IG6o9FFAQ&#39;;return true;">https://github.com/SeleniumHQ/docker-selenium/blob/master/NodeBase/Dockerfile#L35

I would suggest verifying that the Selenium Grid hub is definitely up-and-running as expected, using a URL like this:

http://<hostname>:4444/grid/console

If you see the Grid console at the URL, along with whatever browser nodes you chose to start, then you should be in business.  If you don't see the Grid console at that URL, then something has happened with the hub startup, and I'd suggest looking at the Selenium logs at that point to try and determine the source of the problem.


On Friday, March 11, 2016 at 5:50:45 AM UTC-8, Vikram wrote:
Hi Jeff,

Here is some update with blocking issue


Earlier I had docker setup on MAC mini and everything works perfectly.

Now I'm trying to replicate same setup on Linux VM ( Azure cloud )  + Docker ;  but getting below error and all the test cases are failing.

java.awt.HeadlessException:
No X11 DISPLAY variable was set, but this program performed an operation which requires it.


I have installed xvbf , chrome browser and chrome driver successfully on Linux VM
. Please let me know if you had encountered this issue earlier

Thanks & Regards,
Vikram



On Thursday, March 3, 2016 at 6:37:27 PM UTC+1, Jeff H. wrote:
I've found it very easy to run Selenium Grid via an EC2 instance in Amazon's AWS.  I use docker-compose to manage the containers, which really simplifies things.  There is an existing Selenium Docker project:

<a href="https://github.com/SeleniumHQ/docker-selenium" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2FSeleniumHQ%2Fdocker-selenium\46sa\75D\46sntz\0751\46usg\75AFQjCNFT_jrB9-NNMVGhRZMHbvdPQMIPig&#39;;return true;">https://github.com/SeleniumHQ/docker-selenium

...so you don't have to create your own images.

This blog post will give you an idea of what's involved (you can ignore the part about building your own images if you use the selenium-docker images):

<a href="http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\75http%3A%2F%2Fwww.conductor.com%2Fnightlight%2Frunning-selenium-grid-using-docker-compose%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEntloIhOEYDSidqUWvmJ-kruqZDQ&#39;;return true;">http://www.conductor.com/nightlight/running-selenium-grid-using-docker-compose/



On Thursday, March 3, 2016 at 2:45:25 AM UTC-8, Vikram wrote:
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/da8f0cb3-43de-42c6-b718-f1e68ee0ea81%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need Info : Running docker in cloud with Selenium Grid - which is best service ?

vinayait
In reply to this post by Vikram
Hi All,

I need help in following. I just started workign on DevOps tools and cloud. Can you someone please guide me with the below points. Much appreciate your help

This is what I have till now,
1. I have installed Jenkins in azure VM and created a sample job which uses simple github project 
2. Able to run the github project from Jenkins with the github project having configured testNG suite, POM.xml has dependency added with seleniumHQ and webdriver

Need help for below
1. I have installed selenium grid plugin in the Jenkins. Have created a sample node. Question - how to tun tests on the node created ?
2. Do I need to create seperate VM in azure and install selenium Hq seperately there?
3. If yes to the 2nd question, How to direct the first instance of Jenkins to talk to selenium installed in seperate VM ?
4. Is there any sample scala project you can guide me into to execute selenium tests?

Thanks in advance,
Vinay 

On Thursday, March 3, 2016 at 4:15:25 PM UTC+5:30, Vikram wrote:
Hi All,

Is there any cost effective way of running Selenium grid + Docker in cloud ? Which is best service for this ?

Main purpose is any developer should be able to run automation suite on her/his branch

Thanks in advance.

Regards,
Vikram

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/dbf7a484-3577-4074-95a4-17dd8fd534f3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.