Tests are failing randomly on CI - testng/linux/docker

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Tests are failing randomly on CI - testng/linux/docker

garvitagirotraev
Hi,

I am facing strange issue, my test run perfectly fine on local everytime. I tried on others system as well, windows/linux both. Everytime it works fine. But on CI, everytime  a new error comes. Sometimes its on wait, sometime son click, sometimes stale element.  

As CI runs in docker headless mode, i really dont know how to debug this thing. All this started after updating chrome to 66 (thats my assumption). 

I am using :
webdriver 3.11
testng 6.13
allure 2.35
chromedriver 2.38
chrome 66

Can someone help me with ways to debug this . There is no consistent error, its failing anywhere. I tried running headless mode in local, again no issue. I have mostly used explicit waits in framework, there is no hard coded/thread.sleep that can cause inconsistent behaviour on CI.

Thanks !!

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/d82ee7c6-4d08-4ae8-9b2d-ebad5444bcf6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Tests are failing randomly on CI - testng/linux/docker

David
When you run locally, are you running using docker or just on your localhost OS in headless mode? Hopefully the former to better try reproduce the issue.

On Sunday, May 27, 2018 at 9:08:01 PM UTC-7, [hidden email] wrote:
Hi,

I am facing strange issue, my test run perfectly fine on local everytime. I tried on others system as well, windows/linux both. Everytime it works fine. But on CI, everytime  a new error comes. Sometimes its on wait, sometime son click, sometimes stale element.  

As CI runs in docker headless mode, i really dont know how to debug this thing. All this started after updating chrome to 66 (thats my assumption). 

I am using :
webdriver 3.11
testng 6.13
allure 2.35
chromedriver 2.38
chrome 66

Can someone help me with ways to debug this . There is no consistent error, its failing anywhere. I tried running headless mode in local, again no issue. I have mostly used explicit waits in framework, there is no hard coded/thread.sleep that can cause inconsistent behaviour on CI.

Thanks !!

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/79497d40-726c-4b1d-916d-0acbcd51312d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Tests are failing randomly on CI - testng/linux/docker

garvitagirotraev
David,

I am running without docker on local. on your localhost OS in headless mode. Site is not accessible publicly thats why i was not able to provide code to reproduce issue. 

Thanks !! 

On Tuesday, May 29, 2018 at 12:13:47 AM UTC+5:30, David wrote:
When you run locally, are you running using docker or just on your localhost OS in headless mode? Hopefully the former to better try reproduce the issue.

On Sunday, May 27, 2018 at 9:08:01 PM UTC-7, [hidden email] wrote:
Hi,

I am facing strange issue, my test run perfectly fine on local everytime. I tried on others system as well, windows/linux both. Everytime it works fine. But on CI, everytime  a new error comes. Sometimes its on wait, sometime son click, sometimes stale element.  

As CI runs in docker headless mode, i really dont know how to debug this thing. All this started after updating chrome to 66 (thats my assumption). 

I am using :
webdriver 3.11
testng 6.13
allure 2.35
chromedriver 2.38
chrome 66

Can someone help me with ways to debug this . There is no consistent error, its failing anywhere. I tried running headless mode in local, again no issue. I have mostly used explicit waits in framework, there is no hard coded/thread.sleep that can cause inconsistent behaviour on CI.

Thanks !!

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/efd17763-f6dc-4072-b33c-b3c919cd4e1b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Tests are failing randomly on CI - testng/linux/docker

David
It could be a docker issue, so I suggest you try running test via the docker setup locally. If you can't run docker on your localhost, try finding a machine that can besides CI server/service.

Also for the CI issue, also recommend you run it in CI in debug mode if the CI has such option. e.g. if using CircleCI, you can SSH into the CI job container and try things out to debug rather than just watch the build progress, that would help to see if it just fails during normal CI or if it also fails in debug mode too (which would be a more serious issue). If it fails in normal CI run only, then that's likely a timing, race condition issue.

The local docker debugging is to determine if issue is with docker setup or with docker within the CI environment

On Tuesday, May 29, 2018 at 12:36:03 AM UTC-7, [hidden email] wrote:
David,

I am running without docker on local. on your localhost OS in headless mode. Site is not accessible publicly thats why i was not able to provide code to reproduce issue. 

Thanks !! 

On Tuesday, May 29, 2018 at 12:13:47 AM UTC+5:30, David wrote:
When you run locally, are you running using docker or just on your localhost OS in headless mode? Hopefully the former to better try reproduce the issue.

On Sunday, May 27, 2018 at 9:08:01 PM UTC-7, [hidden email] wrote:
Hi,

I am facing strange issue, my test run perfectly fine on local everytime. I tried on others system as well, windows/linux both. Everytime it works fine. But on CI, everytime  a new error comes. Sometimes its on wait, sometime son click, sometimes stale element.  

As CI runs in docker headless mode, i really dont know how to debug this thing. All this started after updating chrome to 66 (thats my assumption). 

I am using :
webdriver 3.11
testng 6.13
allure 2.35
chromedriver 2.38
chrome 66

Can someone help me with ways to debug this . There is no consistent error, its failing anywhere. I tried running headless mode in local, again no issue. I have mostly used explicit waits in framework, there is no hard coded/thread.sleep that can cause inconsistent behaviour on CI.

Thanks !!

--
You received this message because you are subscribed to the Google Groups "Selenium Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To post to this group, send email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/9824bded-f503-444b-8f69-4ac64251bcd1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.