Free Certified Tester Test Automation Engineer Exam CT-TAE Exam Practice Test

The Test Automation Manager has asked you to provide a solution for collecting metrics from the TAS that measures code coverage every time the automated regression test pack is run. The metrics must be trend based to ensure that the scope of the regression test pack continues to reflect enhancements made to the SUT coverage must not drop and should ideally increase. The solution must be as automated as possible to avoid unnecessary manual overheads and errors. Which of the following approaches would BEST meet these requirements?

• Test automation cannot measure code coverage for the SUT, only the code for the automation tools and scripts. The automated test cases would need to be run manually with a code coverage and reporting tool running in the background.
• The automated testware would record overall code coverage for each run and add the figure to a new row in a pre-formatted Excel spreadsheet. You would then present the spreadsheet to stakeholders so they could look for changes in coverage.
• The automated testware would record overall code coverage for each run, export the data to a pre-formatted Excel spreadsheet that automatically updates a trend analysis bar chart for you to distribute to stakeholders.
• The automated testware would record the pass/fail rate of each regression test case, export the data to a pre-formatted Excel spreadsheet that automatically updates a trend analysis success rate bar chart and emails it to stakeholders.

Your project is transitioning from manual to automated testing. You have decided to implement a pilot project so that lessons learned can inform future time estimates and schedules. Which two of the following represent the types of test cases that are MOST suited to a test automation pilot project? a) High added value test cases that require little effort to automate. b) Test that are run infrequently as these will be simpler to automate c) Reliability test cases that can show added value soon d) Technically challenging test cases to provide the best validation of manual test conversion e) Tests that are least Important to the business as these are safer to trial

• a and b
• a and c
• b and d
• c and e

As the TAE, you are working with the organisation's Test Manager to decide which external metrics and which internal metrics should be gathered for the new TAS. Which of the following represents the BEST internal metric that would help measure the quality of the TAS and the number of problems associated with the TAS?

• The average maintenance cost to keep an automated test in sync with the SUT
• The number of hours of manual test effort saved by implementing a TAS
• A measure of defect density within the TAS automation code
• A measure of how many automated tests pass and fail

You are working as a TAE for a company who have been using a web test execution tool for a number of years. The tool has been used successfully on ten web applications in the past. The company are developing a new web application which has a friendly User Interface, but the developers have used an object throughout the application which the tool is unable to recognise. As a result, you have no way of capturing the object or verifying the contents using the automation tool. What is the first thing you should do about this problem?

• See if the application can be run on a desktop and if the object can be recognised on the desktop by the tool.
• Investigate whether the object can be recognised by other test execution tools in the market
• Ask the developers to remove the object and replace it with some text fields
• Ask the developers if they can change the object to something that can be recognised by the tool

A web application was released into production one year ago, it has regular release which follow a V-model lifecycle and testing is well-established and fully integration into the development lifecycle. You have been asked to implement a TAS for the regression test suite. The regression tests have been developed via the GUI and are expected to be run at least four times a month, for each planned release, for the whole operation solution life of thesystem (six years). Each screen of the GUI uses several third-party controls which are not compatible with the existing automation solutions. The environment for the automation will be stable, fully controllable and separated from other environments (development, staging, production). What could be the MOST problematic for this TAS?

• Maturity of the test process
• Complexity to automate
• Frequency of use
• Sustainability of the automated environment

You are testing a major enhancement to an air traffic control user interface. You have use of a sophisticated pre-production test environment, created specifically for large scale automated regression, performance and security testing. The window for regression testing is limited and must successfully conclude, with no major regressions remaining, before the non-functional testing starts. You have been using the same version of the TAS for the last few releases, each time completing the automated regression test suite in a single overnight run. However, due to the latest enhancements for the SUT, you believe there is a risk that the test suite may no longer complete overnight and therefore delay performance and security testing. Which option would be the BEST and MOST cost-efficient approach to mitigate this risk?

• Create a mirror of the pre-production test environment and split the regression test suite to run in parallel across the environments.
• Split the regression test suite into multiple parts, running in the environment across consecutive nights.
• Analyse the regression test suite and remove test coverage duplication and redundancy.
• Introduce better coding practices for the automation scripts, including coding guidelines, reviews and improved static analysis.

You are currently designing the TAA of a TAS. You have been asked to adopt an approach for automatically generating and executing test cases from a model that defines the SUT. The SUT is a state-based and event-driven that is described by a finite-state machine and exposes its functionality via an API. The behavior of the SUT depends on hardware and communication links that can be unreliable. Which of the following aspects is MOST important when designing the TAA in this scenario?

• Looking for tools that allows direct denoting of exceptions and actions depending on the SUT events.
• Adopting a test definition strategy based on classification tree coverage for the test definition layer.
• Looking for tools that allow performing setup and teardown of the test suites and the SUT.
• Adopting a test definition strategy based on use case/exception case coverage for the definition layer.

Which of the following is NOT a technical design consideration for a TAA?

• The number of users for the SUT
• Availability of interfaces for the SUT to be testable
• Standards and Legal requirements, e.g data privacy
• Data used by the SUT, e.g configuration, users

Your functional regression test automation suite ran successfully for the first two sprints and no failures were encountered during the runs. The automation suite records the status of each test case as either 'pass' or 'fail' and has excellent recovery capability built in. For the third sprint, the TAS log reported several test cases with a status of 'fail'. You investigated each test case and found that most failures were due to a defect in one of the keyword scripts, rather than in the SUT. For those where the failure was in the SUT, defectreports were raised but several were returned by the developers asking for more information to enable them to reproduce the problem. Which additional log items SHOULD you add to the TAS that would BEST improve failure analysis and defect reporting for future sprints? a) Dynamic measurement information about the SUT. b) A status of TAS error’, in additional to pass' and 'fail', for each test case. c) Use of a colour coding scheme so that 'pass’ is in red and fail' is in green. d) A counter to determine how many times each test case has been executed. e) System configuration information including software/firmware and operating system versions. f) A copy of the source code for all Keyword scripts executed.

• a and b
• d and e
• a and c
• b and e

Which of the following BEST describes why it is important to separate test definition from test execution in a TAA?

• It allows developing steps of the test process without being closely tied to the SUT interface.
• It allow choosing different paradigms (e.g event-driven) for the interaction TAS and SUT
• It allows specify test cases without being closely tied to the tool to run them against the SUT
• It allows testers to find more defects on the SUT