Testing Talks Conference 2022 | Techniques to Eradicate Flaky Tests скачать в хорошем качестве

Testing Talks Conference 2022 | Techniques to Eradicate Flaky Tests

Have you heard of “flaky tests”? There are a lot of articles, blog posts, podcasts, conference talks about what are “Flaky tests” and how to avoid them. Some of the ideas proposed are: 1.) Automatically rerun failed tests a couple of times, and hope they pass 2.) Automatically retry certain operations in the test (e.g. retry click / checking for visibility of elements, etc.) and hope the test can proceed Unfortunately, I do not agree with the above ideas, and I would term these as anti-patterns for fixing flaky / intermittent tests. We need to understand the reasons for flaky / intermittent tests. Some of these reasons could be because of issues like: 1.) timing issues (i.e. page loading taking time) 2.) network issues 3.) browser-timing issues (different for different browsers / devices) 4.) data related (dynamic, changing, validity, etc.) 5.) poor locator strategy (ex: weird & hard-wired xpaths / locators) 6.) environment issue 7.) actual issue in the product-under-test In this session, with the help of demos, we will look at the following techniques you can use to reduce / eliminate the flakiness of your test execution: 1.) Reduce number of UI tests 2.) Use Visual Assertions instead of Functional Assertions 3.) Remove external dependencies via Intelligent Virtualization