ISTQB - Test - Questions
5) Which one of the following statements describes the collaboration between business analysts and testers BEST? Select ONE option, explain why others are incorrect. a) Business analysts collaborate on test planning and risk analysis to ensure that further on, appropriate test cases are developed and prioritized b) Business analysts usually cannot review acceptance tests, because they do not understand the technical details c) Testers participate in identifying business needs of stakeholders to better understand the business needs and related requirements d) Once the requirements and acceptance criteria have been defined, business analysts are no longer involved in testing activities
"Business analysts collaborate on test planning and risk analysis to ensure that further on, appropriate test cases are developed and prioritized" a) Is correct: collaboration on test planning based on risk analysis is a good opportunity to ensure that the appropriate test cases will be developed and prioritized. b) Is not correct: acceptance tests do not include technical details instead they focus on checking business acceptance criteria and can and should be therefore reviewed by business analysts. c) Is not correct: this is the role of a business analyst. Testers can support requirements review to ensure acceptance criteria are clear and measurable. d) Is not correct: Business analysts should be involved in other test activities, including testing preparation, execution and reporting too.
What are some QA activities for acceptance testing?
-Review of acceptance criteria, review of acceptance test cases, traceability, coverage analysis based on traceability, review of test reports.
2) Which one of the following statements regarding acceptance criteria is true? Select ONE option, explain why others are incorrect. a) Acceptance criteria are specific to agile frameworks where they correspond to functional requirements b) Testers should not be involved in writing acceptance criteria to make sure that the test is independent c) In acceptance test-driven development (ATDD), acceptance criteria replace acceptance tests d) Acceptance criteria specify what shall be tested to verify that a requirement or user story has been implemented correctly.
Acceptance criteria specify what shall be tested to verify that a requirement or user story has been implemented correctly d) Is correct: Acceptance criteria represent the test conditions which determine "what" to test. a) Is not correct: Acceptance criteria are not limited to agile development. b) Is not correct: Independent testers should be involved to ensure early verification of the criteria.
Can acceptance testing be augmented with other testing techniques? (If so, name a few).
Acceptance testing may be augmented with other test techniques or approaches: Business process-based testing, possibly combined with decision table testing, validates business processes and rules (see Section 3.2). Experience-based testing leverages the tester's experience, knowledge and intuition (see Section 2.3.1) Risk-based testing is based on risk types and levels. Prioritization and thoroughness of testing depends on previously identified product risks. Model-based testing uses graphical (or textual) models to obtain acceptance tests
What should acceptance testing test for?
Acceptance testing should cover both functional and non-functional requirements. Nonfunctional requirements are becoming more important with respect to acceptance testing due to the increased use of software in everyday life, data-driven processes, and the development of integrated services that rely heavily on complex software systems and on systems of systems.
What is usability? As defined by the
According to ISO 25010, usability is "the degree to which a product or system can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. Usability can either be specified or measured as a product quality characteristic in terms of its sub-characteristics, or specified or measured directly by measures that are a subset of quality in use
What are some outcomes that can happen to a system under test?
Based on the test summary report, decision makers should be able to determine whether the system under test has reached the necessary pre-defined level of quality and may be released to production or not. Several outcomes are possible, including the following: The system may be released "as is" and rolled out without restrictions. The system may be released with reservations. Known errors which have a workaround are communicated to the user and the support team. For defects that represent an important risk, the related feature (or sub-system) may be excluded from roll-out. The system is rejected until critical defects have been fixed and re-tested. Roll-out is either postponed or replaced by alternative solutions.
What do business analysts do?
Business analysts first must understand the organization's overall business goals and identify current business processes and stakeholders.
1) Which one of the following statements describes the relation between business goals, business needs and requirements BEST? Explain why the others are incorrect. a) Business goals and business needs are synonyms b) Business goals, business needs and requirements describe at different levels of abstraction, what shall be achieved c) Business needs address the business solution whereas business requirements define the business problem or opportunity d) To derive the business needs, the business analyst first has to understand the business goals and requirements
Business goals, business needs and requirements describe at different levels of abstraction, what shall be achieved. b) As stated in [AcT Syllabus], business goals, business needs, business requirements, and product requirements describe, at different levels of abstraction, what shall be achieved. a ) Is not correct: Business goals and needs have different levels of abstraction. c) Is not correct: Business needs define the business problem or opportunity, which business analysts have to understand in order to recommend appropriate solutions through business requirements
What is BPMN?
Business process/rule models describe the business flow and the expected behavior of the test object. Representing business processes and rules to be tested using a graphical notation helps to establish a common understanding of what is expected. A business process corresponds to a flow of tasks, alternative paths, and the various events at the start, the end or possibly during the control flow. Business rules define explicit criteria for guiding behavior, shaping judgments, or making decisions.
How do we test usability in acceptance testing?
Checklist-based evaluations: Users evaluate the system or product under test according to checklists [Rubin08] to evaluate, compare and qualify their experience. Expert reviews: Usability experts evaluate the usability of the system or product according to pre-defined criteria or checklists based upon usability heuristics to identify strong and weak points of an interface. Walkthrough and think-aloud techniques: Users explore the product or systems and describe their actions and impressions out loud while doing so [ISTQB_UT_SYL]. They may be given specific tasks to accomplish to identify how they interact with the product and to learn about expectations or difficulties. Biometrics-based evaluations: User behavior is monitored with specific biometric devices (e.g., eye-movement recording, mouse-eye-movement recording) to understand how the user interacts with a page or a system, what attracts their attention, or what is more or less visible. Log files analysis: Retrospective analysis is conducted to review how the users interacted with the system to discover areas for possible improvement and to verify if actual use correlates with the intended profile/use.
What can automation test generation techniques be used with in BPMN?
Combined with Keyword-driven testing, and data-driven testing.
What are some subcharacteristcs for context coverage?
Context Completeness, Flexibility.
What are some sub characteristics for quality in use feature context coverage?
Context completeness and flexibility.
What should business processes models include?
Coverage-based test selection follows the principle that the business analyst and tester agree on the coverage items that shall be fully tested. Typical coverage items for business process models when generating acceptance tests include the following: User stories, requirements, and risks annotated in the business process model Decisions in the decision tables describing the business rules User scenarios defined by different paths through the business process model All paths (usually without loops) through the business process model.
What is DMN?
DMN is a modeling language and notation for the precise specification of business decisions and business rules. DMN is easily readable by the different types of people involved in decision management.
Who does defect analysis? How is it done?
Defect analysis is a joint activity of testers and business analysts. Usually, the tester identifies the acceptance criteria that are not satisfied. The business analyst may then be asked to analyze its impact on the related business processes. This includes determining the priority of the defect (e.g., low, medium, high, critical) with respect to its potential business impact on system usage. To analyze the business impact of a defect, the business analyst and tester may do the following: Explore the path(s) in the business process models in which the defect(s) was found Explore the business rules which were not implemented correctly and analyze the priority of the defect from a usage point of view. The impact analysis and the resulting decision regarding further actions to be taken are documented in the defect report.
What is OAT?
During acceptance testing, performance tests are particularly addressed during Operational Acceptance Testing (OAT), usually by the operating teams. However, business analysts and testers should also be involved when developing acceptance criteria and related test cases
What is exploratory testing? How is it done?
Exploratory testing [Whittaker09] is an experience-based test technique that is not based on detailed predefined test procedures. In exploratory testing, all activities are carried out within an uninterrupted period of time called a session. The testers are domain experts. They are familiar with user needs, requirements and business processes, but they are not necessarily familiar with the product under test. During an exploratory testing session, the tester accomplishes the following: Learns how to work with the product Designs the tests Performs the tests Interprets the results
What is performance acceptance criteria?
From a user perspective, the perceived response time reflects the user's real experience with the system. For example, users may abandon a web site if the response time is more than 10 seconds. From a business perspective, the number of concurrent users, the types of scenarios or transactions performed, and the expected response times are factors to be considered. Higher numbers of concurrent users performing resource intensive transactions will result in longer response times. Other factors might also influence the response time based on location, time or time zone. From a technical perspective, available system resources (e.g., network bandwidth, CPU usage, RAM capacity) and system architecture, (e.g., server load balancing, use of data caching) are factors which influence performance efficiency. For example, web-based systems with limited network bandwidth will tend to have lower performance efficiency, especially when subjected to high loads caused by large numbers of users conducting tasks that generate significant network traffic.
What are some ways you can keep team cohesion high between business analysts and testers?
Get to know and understand each other to keep the team cohesion high (e.g., who's who, common goals and realizations, areas in common) Communicate openly in an environment of trust and respect and express their doubts, concerns or fears to identify, analyze and overcome problems (e.g., Taboo free communication, experience, perception, image) Envision the common objectives, the general vision, and the necessary steps to achieve them (e.g., what if it succeeds / what if it fails, what people and means are necessary, what is success). Defuse major problems with humor, positive communication or appropriate negotiation techniques [Ury12] (e.g., principled negotiation, caricature, role play / comics).
What are some things the QA team should be engaged in often?
High quality acceptance tests are crucial to manage business risks associated with defects escaping to production. Quality assurance should be applied during acceptance testing activities, including the following: Review of acceptance criteria: The business analyst and tester verify whether the acceptance criteria are clear, consistent and comprehensive. Good acceptance criteria also cover non-functional characteristics and provide measurable pass/fail criteria. Review of acceptance test cases: The acceptance test cases should cover the previously defined acceptance criteria as well as business processes, business rules and business risks. Traceability: Traceability between requirements / user stories, acceptance criteria, test cases, and defects facilitates acceptance testing as it clarifies dependencies and provides simple access to related information. Coverage analysis based on traceability: If bi-directional traceability is established, it is possible to perform a systematic coverage analysis. Review of test reports: Test reports should be clear, consistent and comprehensive. They should contain all information provided by the tester to support decisions about the release.
What is ATDD?
In Acceptance Test-Driven Development (ATDD) [Pugh11], acceptance tests are produced collaboratively during requirements analysis by business analysts, product owners, testers and developers.
How does a tester derive test cases in a requirements-based approach?
In a requirements-based approach to acceptance testing, the tester derives test cases from the acceptance criteria related to each requirement or user story using black-box techniques such as equivalence partitioning or boundary value analysis (
6) Which one of the following statements regarding ATDD / BDD is true? a) Behavior-Driven Development (BDD) considers acceptance test design as an activity to be handled by the test team after requirements have been finalized b) In both Acceptance-Test Driven Development (ATDD) and Behavior-Driven Development (BDD), test cases provide examples of product use c) In Acceptance-Test Driven Development (ATDD), test cases are written prior to the acceptance criteria d) In both Acceptance-Test Driven Development (ATDD) and Behavior-Driven Development (BDD), acceptance test cases are written by a test automation engineer as test automation code Select ONE option.
In both Acceptance-Test Driven Development (ATDD) and Behavior-Driven Development (BDD), test cases provide examples of product use b) Is correct: as stated in [AcT Syllabus], acceptance test cases represent scenarios of usage of the product. a) Is not correct: BDD involves creation of acceptance tests at early stage. In this approach acceptance criteria and acceptance test cases should be created before requirements finalization to have a greater impact on the overall development of the solution. c) Is not correct: Acceptance criteria define "what" (what to test) and acceptance test cases define "how". They can be defined in the same working session, but it does not make sense to define "how" before "what"
What is a test charter?
It is a good practice in exploratory testing to use a test charter. The test charter is prepared prior to the testing session (possibly jointly by the business analyst and the tester) and is used by the person in charge of the exploratory session (either a business analyst, tester or another stakeholder). It includes information about the purpose, target, and scope of the exploratory session, the test setup, the duration of the session, and possibly some tactics to be used during the session (such as the type of user that shall be simulated during the exploratory session). T
Which of the following are good practices for BPMN and and DMN notation?
It is not necessary to describe everything in a business process model. The graphical representations of business processes in BPMN should focus on requirements to be tested. Therefore, workflow descriptions that only partially cover the behavior of related software systems are acceptable, as long as they represent what is to be tested. Especially for rule-based business processes, using decision tables helps manage dependencies. DMN supports the definition of conditions and outcomes corresponding to the business rules under test. Diagrams should be as simple as possible and be structured in sub-processes when needed to limit the number of graphical elements in a single business process diagram. This improves readability and facilitates reviews. Business process modeling for acceptance testing should be a collaborative work between business analysts and testers. Artifacts produced should be shared between and reviewed by both roles. Early and close communication between those two roles improves the quality of requirements or user stories as well as tests. (This is true for all test levels.) Additional information such as links to user stories, requirements, risks, priorities and any other information useful for acceptance testing should be added to the diagrams using annotations. By keeping all relevant information in a single location, it becomes easier to make decisions and reasons are better documented.
What is OMG ?
Object Management Group -> BPMN and DMN are maintained by the OMG.
What is the coverage criteria for BPMN models?
Once the coverage items are defined, the tester then identifies a set of test cases that covers those items. Full coverage is achieved if the test suite covers each occurrence of the coverage item in the model at least once during execution. Different coverage criteria may be combined to meet the acceptance testing objectives. For example, the objective may be to cover all paths of a given main scenario, but only one path of each alternative scenario.
25) Given the following attributes: Select ONE option, explain why others are incorrect. i. Commercializability ii. Functional suitability iii. Viability iv. Reliability v. Security vi. Cognitive ability vii. Maintainability Which one of the following answers contains quality attributes that are MOST relevant for acceptance testing? a) ii, v and vi b) ii, v and vii c) i, ii and vi d) iii, iv and v Select ONE option.
Quality characteristics defined in ISO/IEC 25010 are: • functional suitability • reliability • performance efficiency • usability • security • compatibility • maintainability • portability Which means that ii, v and vii are correct. Therefore: a) Is not correct: see justification above b) Is correct: see justification above c) Is not correct: see justification above d) Is not correct: see justification above
What is the quality in use model?
Quality in use characteristics are particularly helpful in acceptance testing as they relate to the user's experience with the system
What are some activities for QA during acceptance testing?
Review of acceptance criteria, review of acceptance test cases, traceability. coverage analysis based on traceability, review of test reports.
What are some sub characterstics of quality in use?
Satisfaction -> Usefulness, Trust, Pleasure, Comfort.
8) As an acceptance tester you are analyzing the following user story for a computer web-based massively multiplayer online role-playing game (MMORPG): Select ONE option, explain why others are incorrect. As an unregistered player I want to be able to register myself by defining my e-mail, login and password in a registration form so that I become a registered player Consider the following propositions of the acceptance criteria: i. A registration form is displayed on the screen ii. The form is written in the Groovy language; the cursor is initially set on the 'login' field; after pushing the TAB button the cursor switches to 'password', 'repeat password', 'mail', and 'repeat mail' forms iii. I cannot register myself if the login I choose is used by another player iv. After successful registration process I am informed about it by an e-mail Which of the above statements would you consider as well-written acceptance criteria?
Statement ii) includes technical solutions, which should be avoided in the acceptance criteria. All the other acceptance criteria are well written, as they are precise, measureable and understandable by the stakeholders. Hence: d) Is correct a) Is not correct b) Is not correct c) Is not correct d) Is correct
What are types of performance testing we can do to our application?
Steady state, increasing and scenario based.
What should you AVOID when writing acceptance criteria?
Technical Jargon!
What does the GIVEN block aim to do? What does the WHEN block aim to do?
The "Given" block aims to put the test object in a state before performing test actions in the "When" block. The "Then" block specifies the consequences that can be observed from the actions defined in the "When" block. Test cases written in Gherkin do not refer to user interface elements but rather to user actions on the system. They are structured natural language test cases that can be understood by all relevant stakeholders.
What are some non-functional quality characteristics of quality software?
The ISO 25010 standard [ISO 25010:2011] introduces a system and software product quality model that categorizes product quality properties. It includes seven non-functional characteristics, which are further detailed in sub-characteristics. The following table lists the sub-characteristics associated with the non-functional characteristics
How do business analysts and testers collaborate with one another?
The common goal for business analysts and testers is to support the production of products with the highest possible value for the customer. Given their position within the organization, business analysts and testers have various opportunities to collaborate during the acceptance testing activities described in the previous section. Apart from joint discussions and reviews of generated artifacts, business analysts and testers collaborate in other areas. For example, collaboration on test planning based on risk analysis is a good opportunity to ensure that the appropriate test cases will be developed and prioritized.
20) As an acceptance tester you want to test the $100 withdrawal process described by the following BPMN model.Select ONE option, explain why others are incorrect. You would like to achieve decision coverage. Consider the following test cases: Test 1: balance = $100, receipt = YES Test 2: balance = $99 Test 3: balance = $120, receipt = NO Test 4: balance = $2500, receipt = YES Which of the following is the minimal set of test cases allowing to achieve full decision coverage? a) Test 1, Test 2, Test 4 b) Test 1, Test 2 c) Test 2, Test 3 d) Test 1, Test 2, Test 3 Select ONE option.
There are two decisions (denoted by the rhombuses with the X sign). The first one has two outcomes: balance >= $100 and balance < $100. The second one has also two outcomes: YES and NO. To achieve full decision coverage we need to cover all these outcomes. Notice that the rhombus with the plus sign denotes a parallel sequence, so it is not a decision. Test 1 and Test 4 cover balance >= $100 and YES Test 2 covers balance < $100 Test 3 covers balance >= $100 and NO Hence, we need three test cases (1, 2, 3 or 2, 3, 4) to achieve the decision coverage. Therefore: a) Is not correct: see justification above b) Is not correct: see justification above c) Is not correct: see justification above d) Is correct: see justification above
What do expert reviews do during usability testing?
They evaluate the usability of a system. According to pre-defined criteria checklists and heuristics to identify strong and weak points of the design.
What is time boxing? What does it mean to work as a team during exploratory testing?
Time-boxed sessions help to control the time and effort Certified Tester Foundation Level Syllabus - Acceptance Testing Version 2019 Page 18 of 40 21 June 2019 © ISTQB® dedicated to the exploratory session. It is also good practice to perform exploratory testing in pairs or as team work.
Which of the following techniques is most likely applied to ensure the quality of acceptance testing activities?
Traceability between requirements / user stories, acceptance criteria, test cases, and defects clarify dependencies and provide simple access to related information.
What are the four pillars of UX requirements? What is User, task, context and competition analysis?
UX requirements analysis is based upon the following four pillars: User analysis: Users are categorized in terms such as physical and intellectual characteristics, technical skills, business knowledge, socio-economic, and cultural background.Business analysts can also use models (e.g., based on personas [ISTQB_FL_AT_SYL]). Task analysis: Functionality is identified and formalized (e.g., through use cases and scenarios). User behavior and expectations are analyzed to design an optimized system or product. Context analysis: The context in which the system or product will be used is analyzed. External conditions (e.g. light, temperature, movement, humidity or dust), physical conditions (e.g., sitting, standing, lying, moving, hands-free) or "psychological" conditions (e.g. stress level, motivation, or the difference between private and professional usage) are considered to give directions to the subsequent design steps. Devices, platforms and form-factors (device-specific display) are also considered as part of the context. Competition analysis: Unless creating a disruptive design is the goal, business analysts should analyze the competitors and take inspiration from the successful implementation of their solutions to retain or attract users and customers. Another source of inspiration can come from successful solutions found in similar or even different sectors.
Is Beta testing systematic? Is there documentation in Beta testing? What is the purpose of beta testing?
Unlike other acceptance testing forms, beta testing is performed by potential or existing users at their own location. Beta tests neither impose predefined test procedures nor a test charter. Apart from the observed findings, the test activities are usually not documented at all. Because the product is tested in various realistic configurations by actual users in their business process context, beta testing may discover defects that escaped during the development process and previous test levels. Resolving issues found by beta tests helps organizations avoid costly hotfixes or product recalls on a larger scale. Acceptance testing should not be limited to beta testing. Beta testing is not systematic or measurable. There is no guarantee that all requirements or user stories are covered by the tests. Moreover, beta testing is performed late in the development process whereas tests based on acceptance criteria support the "Early Testing" principle.
What is user analysis? Task analysis? Contextual analysis? Competitive analysis?
User analysis: Users are categorized in terms such as physical and intellectual characteristics, technical skills, business knowledge, socio-economic, and cultural background. Business analysts can also use models (e.g., based on personas [ISTQB_FL_AT_SYL]). Task analysis: Functionality is identified and formalized (e.g., through use cases and scenarios). User behavior and expectations are analyzed to design an optimized system or product. Context analysis: The context in which the system or product will be used is analyzed. External conditions (e.g. light, temperature, movement, humidity or dust), physical conditions (e.g., sitting, standing, lying, moving, hands-free) or "psychological" conditions (e.g. stress level, motivation, or the difference between private and professional usage) are considered to give directions to the subsequent design steps. Devices, platforms and form-factors (device-specific display) are also considered as part of the context. Competition analysis: Unless creat
What is User Experience?
User eXperience (UX) expands the term usability to include aesthetic and emotional factors such as an appealing, desirable design, aspects of confidence building, or satisfaction to use (e.g., pleasure, comfort). The context of using the system has a strong influence on the user experience as it may totally differ based on a number of factors such as location (e.g., the user is sitting behind a desk, driving a car or hiking), weather (e.g., sun, rain, cold), health conditions of the user (e.g., fatigue, age), environment (e.g., stressful, noisy)
3) Which one of the following statements regarding the quality of requirements is MOST correct? Select ONE option, explain why others are incorrect. a) Vague or ambiguous requirements may lead to misunderstandings both during implementation and testing b) In Agile development lifecycle models, requirement engineering becomes less important due to the product owner role. c) INVEST is a technique that ensure the quality of user stories or requirements, thus replacing regular reviews. d) Testers may complete unclear requirements by assumptions, as long as they discuss those assumptions with at least one stakeholder. Select ONE option. Explain why the others are incorrect.
Vague or ambiguous requirements may lead to misunderstandings both during implementation and testing a) Is correct: unclear requirements may lead to incorrect acceptance criteria, and the resulting tests will be flawed. This will lead to rework or, even worse, the running of invalid tests, thus creating unnecessary costs. b) Is not correct: in Agile, requirements engineering still needs to be performed and proper skills are required from both the product owner and the team members. c) Is not correct: INVEST is not replacing reviews, it defines quality characteristics for user stories, that may be used by business analysts / product owners and testers to ensure the quality of user stories.
26) The standard ISO 25010 defines a quality in use model with characteristics and sub characteristics. Which elements of the following list is a characteristic of quality in use according to this standard? Select ONE option, explain why others are incorrect. a) Efficiency b) Usability c) Compatibility d) Portability Select ONE option
a) Is correct: Efficiency is one out of five characteristics in the ISO 25010 quality in use model. b) Is not correct: Usability is part of the non-functional characteristics according to ISO 25010 but is not part of the quality in use model. c) Is not correct: Compatibility is part of the non-functional characteristics according to ISO 25010 but is not part of the quality in use model. d) Is not correct: Portability is part of the non-functional characteristics according to ISO 25010 but is not part of the quality in use model.
9) Which one of the following statements describes correctly how acceptance testing may be augmented with other test techniques or approaches? Select ONE option, explain why others are incorrect. a) In a model-based testing approach, acceptance tests are generated from graphical or textual models b) In a priority-based testing approach, prioritization of acceptance tests depends on identified product risks c) In a risk-based testing approach, acceptance criteria are derived from the tester's experience and intuition d) In a black-box testing approach, acceptance test scenarios follow the implemented sequence of function calls in the code. Select ONE option.
a) Is correct: Model-based testing uses graphical (or textual) models to obtain acceptance tests. b) Is not correct: prioritization of acceptance tests based on identified product risks relate to risk-based testing approach. c) Is not correct: in a risk-based testing approach, prioritization and intensity of testing depends on previously identified product risks, not on experience.
19)
a) Is correct: Test 1 covers all the tasks except 'Remove card (withdrawal rejected)', which in turn is covered by Test 3. Hence, these two tests achieve the desired coverage. Notice that in Test 1 both the tasks 'Take receipt' and 'Withdraw $100, remove card' are covered, as they are executed in parallel. b) Is not correct: This set of test cases achieves the required coverage, but it is not the minimal set of test cases (which is answer a with only two test cases). c) Is not correct: Test 3 covers only two out of five tasks. d) Is not correct: Test 4 is incorrectly constructed, as having balance $20 does not allow us to select the receipt printing
14) Which one of the following statements describes an exploratory test charter BEST?Select ONE option, explain why others are incorrect. a) Indicating that the tester should take the role of a novice user can be part of an exploratory test charter. b) The test charter is elaborated during the testing session according to test execution results c) Each exploratory test charter is based on a previously defined list of activities that would be interesting to test d) Acceptance testers use the exploratory test charter during the testing session to define the test oracle
a) Is correct: as stated in [AcT Syllabus], the test charter possibly contains tactics to be used during the session (such as the type of user that shall be simulated during the exploratory session). b) Is not correct: the test charter is prepared prior to the testing session and is used by the tester during the session. c) Is not correct: test charter includes information on the role the tester takes during the session, the particular objective to be achieved during the session, the setup, the activities that would be interesting to test, the test oracle and other information - in exploratory testing there is no predefined list of activities to be followed. d) Is not correct: test oracle should be defined in a test charter, before the session.
37) Which of the following information is most likely part of an acceptance test summary report? Select ONE option, explain why others are incorrect. a) Information to evaluate the level of risk for product release b) Technical details on defect fixes c) Test strategy and test design methods d) Test procedure information Select ONE option.
a) Is correct: based on the test summary report, decision makers should be able to determine whether the system under test has reached the necessary pre-defined level of quality and may be released to production or not. b) Is not correct: defect fixes are documented in the related defect report. c) Is not correct: test strategy and test design methods are part of the test plan. d) Is not correct: test procedure information is contained in the test procedure specification. They may be part of a test report, but not of the test summary report.
34) You are leading a brand new project team whose members are coming from all over the organization and have no former experience in working together. You need to build a common vision and team spirit. What workshop would fit BEST? Select ONE option, explain why others are incorrect. a) You invite the team members and ask them to design their own (team-wise) emblem representing their values, beliefs, goals, tasks together than a common motto b) You invite every member in turn to describe his/her past experience and his/her major achievements in the organization or in their former job c) You ask every member in turn to write down three things he/she likes and dislikes in the organization and to post them on a wall. A volunteer is then chosen to read randomly some posts that are then discussed with the group d) You draw a staircase with 11 steps, each of them representing a major milestone of the project. The bottom of the stairs corresponds to the first day of the project and the upper step means that the project is released. You locate the present situation in the top of the stairs. The team is asked to identify and discuss the major steps downwards Select ONE option.
a) Is correct: by representing their values, beliefs, goals, tasks, the team's members will get a complete definition of the team's identity and you will align all the members on the same vision. b) Is not correct: you might either break the ice or get a very boring meeting but you will for sure completely miss the goal c) Is not correct: this workshop is rather used for expressing the unsaid. It will neither bring any team spirit nor will it align the team on a common objective. d) Is not correct: this workshop is pretty useless unless the goal is to remember the good old days (as it only allows to envision the past steps when the project is achieved).
36) Which of the following activities is most likely performed by the business analyst as part of defect analysis? Select ONE option, explain why others are incorrect. a) Identify the requirements / user stories that are not satisfied b) Assess the impact of corrective actions on other parts of the system's implementation c) Analyze the function that failed step by step to identify the cause of the defect d) Check, whether other paths in the business process model perform as intended Select ONE option.
a) Is correct: during defect analysis activities, the business analyst identifies the acceptance criteria that are not satisfied to analyze the defect. Those criteria are part of a requirement / user story. b) Is not correct: the business analyst does not have sufficient insight in the implementation to be able to assess the impact of changes on other parts of the system's implementation. Developers do have this insight. c) Is not correct: Debugging is a developer's task. d) Is not correct: in individual cases, business analysts may perform this check to gather confidence in the system, but in general, the other paths are covered by other tests which are performed by testers.
39) Which one of the following sentences describes BEST a major advantage when business analysts and testers review the acceptance criteria together? Select ONE option, explain why others are incorrect. a) A shared vision between the business analyst and the tester on acceptance criteria facilitates the design of acceptance test cases b) A joint review ensures that non-functional quality criteria are taken into account c) The review of acceptance criteria helps to verify that acceptance test cases cover business processes, business rules and business risks d) The review of acceptance criteria is a good practice to improve the quality of test reports Select ONE option.
a) Is correct: good acceptance provide measurable pass/fail criteria, which facilitates the design of the corresponding test cases. b) Is not correct: a joint review certainly reduces the risk of forgetting about non-functional quality criteria, but it is not a guarantee. c) Is not correct: this is more an advantage of the review of acceptance test cases. d) Is not correct: this is more an advantage of the review of test reports.
12) Which of the following is the BEST example of a Gherkin-style test for a web-based banking application? a) GIVEN I have $5000 on my personal account X AND I have $200 on my personal account Y WHEN I transfer $1000 from X to Y THEN I should have balance $4000 on my personal account X AND I should have balance $1200 on my personal account Y b) GIVEN I have $5000 on my personal account X AND I have $200 on my personal account Y WHEN I click 'Make transfer' button AND I enter '3000' into 'Amount' field AND I enter 'X' into 'From which account' field AND I enter 'Y' into 'To which account' field AND I click 'Confirm transaction' button THEN I should have balance $2000 on my personal account X AND I should have balance $3200 on my personal account Y c) GIVEN I have $5000 on my personal account X and $600 on my personal account Y WHEN I transfer $500 from Y to X THEN I should have balance $4500 on X and balance $1100 on Y d) GIVEN I have $5000 on my personal account X WHEN I have $600 on my personal account Y THEN I have $5600 in total on my personal accounts X and Y Select ONE option, explain why others are incorrect.
a) Is correct: this is a good example of a Gherkin-style test: GIVEN section describes the preconditions (a situation; a precondition), WHEN - a specified behavior (an action on the system) and THEN - the expected result (post condition, expected change) b) Is not correct: according to [AcT Syllabus], WHEN section should not refer to the user interface elements, but should only describe the action we want to invoke. c) Is not correct: this scenario contains an error in the THEN section - it should state that we have $5500 on X and $100 on Y. d) Is not correct: this scenario states an obvious state on the system resulted from simple calculation that does not need to be a part of acceptance test scenario.
17) Suppose you are testing a new professional exam support system. As input the system takes two grades from two exams. For each exam the possible grade is 0 or 1 point. As output the system returns a single string - the decision about the entitlements: if the total score is 2, the candidate receives full entitlements. If the total score is 1, she receives partial entitlements. If the total score is 0, the candidate fails and receives no entitlements. Select ONE option, explain why others are incorrect. Which of the following is the correct Decision Model and Notation (DMN) model for this situation?Select ONE option, explain why others are incorrect.
a) Is correct: this is correct DMN decision table with 2 inputs and one output. b) Is not correct: the table show no inputs - this is not DMN table. c) Is not correct: the format of output presentation is not correct. d) Is not correct: this is not a DMN decision table (because of the 'Result' column and incorrect format of the 'Output' column).
11) Assume you are testing functionality of the interface of an elevator. One of the requirements is that the elevator can work only if the total weight of the passengers does not exceed 200 kg. The elevator can reach the following floors: Ground Floor, 1st floor and 2nd floor. You want to create an acceptance test using the Gherkin language. You can use the following phrases for this purpose: i. The total weight of passengers is greater than 200 kg ii. The elevator is on the ground floor iii. A button '1st floor' was pressed iv. The elevator goes to the 1st floor v. A passenger standing at the 2nd floor calls the elevator vi. A message 'too many passengers' is displayed on the screen Which of the following statements correctly matches constructs of Given/When/Then with a relevant phrase in order to create a correct test case for the given requirement? Select ONE option, explain why others are incorrect. a) GIVEN ii. WHEN i. THEN vi. b) GIVEN ii. WHEN iv. THEN v. c) GIVEN iii. WHEN ii. THEN iv. d) GIVEN ii. WHEN v. AND vi. THEN i.
a) Is correct: this test represents a situation in which the elevator cannot operate, since the total weight of the passengers exceeds the allowed limits. ii) represents a situation, i) represents an action (event), and vi) the expected result. b) Is not correct: this test does not cover a reasonable operation/scenario - it just describes that some combination of events iv) and v) may occur, but does not contain any reasonable, expected result in the THEN section c) Is not correct: this test is not complete, since it does not take into account the restriction on the total weight of the passengers, given in the requirements. d) Is not correct: this test would represent a correct reasoning (if the weight message is shown then the total weight exceeds 200 kg), but this does not test a useful scenario. In fact, i) is not the expected result, but an action on the system. We would like test the opposite: if the weight is too big, is the message shown?
18) Assume you would like to create a model describing a loan request process in a bank. The loan request process starts when the customer submits a loan application. The bank then reviews the application. Regardless of whether the loan request is approved or not, a letter is sent to inform the customer of the decision. If the request is approved, the loan contract is created. You have drawn the following business process model using BPMN 2.0. Which one of the following sentences is true with respect to this process model? Select ONE option, explain why others are incorrect. a) Verifying employment is not done when the loan status is rejected b) Creating the loan contract is defined as a sub-process c) Performing title search and requesting credit report are sequential tasks d) A review credit report is optional when reviewing the loan application
a) Is not correct: "Verify Employment" is systematically done after the "Record Loan Application" task and prior to "Review Loan Application" in which the decision regarding the loan application is taken. b) Is correct: "Create the Loan Contract" is defined as a subprocess c) Is not correct: a parallel gateway splits the flow between "Perform Title Search" and "Request Credit Report" tasks. d) Is not correct: the task "Review Credit Report" has to be done before "Review Loan Application" in the process flow.
7) As a tester you participate in the project of the decision support system for granting a loan. You are asked to review the acceptance criteria for the following requirement: REQ 3.28. The automated system records critical credit application data (CCAD) needed to support application screening. Assume that it is well known what kind of data CCAD are. Which of the following would be the BEST example of an acceptance criterion for this requirement? Select ONE option, explain why others are incorrect. a) The CCAD are stored in the MySQL relational database after each successful data entry procedure b) The CCAD is not recorded if it is incomplete and a message is displayed c) The CCAD record process is quick and reversible d) The process for collecting CCAD meets corporate usability guidelines
a) Is not correct: a well-written acceptance criterion does not include technical solution details. b) Is correct: this is the expected behavior that an acceptance user would like to verify. Notice that it is well known when the CCAD is incomplete, because we have the CCAD precisely defined. c) Is not correct: this acceptance criterion is not precise, nor measurable d) Is not correct: this acceptance criterion does not refer to the above requirement.
15) How are beta testing and acceptance testing related?Select ONE option, explain why others are incorrect. a) Beta testing is a synonym for acceptance testing used in specific application domains. b) Beta testing should include predefined acceptance test scenarios based on acceptance criteria. c) Beta testing allows the product to be tested in realistic business configurations and contexts. d) Beta testing is a systematic approach to acceptance testing and provides measurable coverage of the user stories.
a) Is not correct: beta testing is a form of acceptance testing for commercial off-the-shelf software. It is not the same as acceptance testing. b) Is not correct: beta testing is performed by potential or existing users at their location and neither follow predefined scenarios nor use a test charter and test activities are usually not documented at all. c) Is correct: during beta testing, the product is tested in various realistic configurations by actual users in their business process context. d) Is not correct: beta testing is not systematic or measurable.
23) Your company wants to establish a new human resources management application. As tester, you propose to use an ATDD approach and to use business process models for test case design. Which of the following statements is the LEAST meaningful argument for this approach? Select ONE option, explain why others are incorrect. a) The process models will help testers to understand the use cases to be tested b) Testers will be able to show test coverage directly within the graphical representation of business processes c) Business process models will make it easier to detect defects in the application code d) As business process models will be updated to maintain the tests, they will be a living documentation of the product Select ONE option.
a) Is not correct: business analysts and testers collaborate to model workflows when using process modeling for ATDD. This helps the testers to understand the use cases to be tested. b) Is not correct: as testers derive tests from these business process models, they can show test coverage directly within the graphical representation c) Is correct: the graphical representation of business process model does not specifically allow to locate defects in the code. d) Is not correct: business process models created and maintained for ATDD can be viewed as living documentation used by business analysts to present the actual behavior of the test object.
38) Which of the following techniques is most likely applied to ensure the quality of acceptance testing activities?Select ONE option, explain why others are incorrect. a) Review of the source code to ensure traceability of user stories to system components b) Verification of the traceability between user stories and test cases to make sure it is up to date c) Checklist-based verification of requirements to ensure their completeness and quality d) Eye tracking to verify the feasibility of previously defined user acceptance tests Select ONE option.
a) Is not correct: code reviews are used to ensure the quality of software implementations. b) Is correct: traceability between requirements / user stories, acceptance criteria, test cases, and defects clarify dependencies and provide simple access to related information. c) Is not correct: even if acceptance testers should participate in requirements reviews, the verification of the test basis is not a QA technique for acceptance testing activities. d) Is not correct: eye tracking is a technique applied during usability testing. It is used to e
31) Which one of the following combinations of given perspective and statement matches BEST? Select ONE option, explain why others are incorrect. a) From a business perspective, computing power and architecture are major parameters for fine-tuning the system b) From a user perspective, missing feedback from the system when processing a request it is a problem c) From a technical perspective, the number of concurrent user and the types of transactions performed are major elements d) From a business perspective, the choice of performance test tools strongly depends on the applied test techniques Select ONE option.
a) Is not correct: computing power and architecture belong to the technical perspective. b) Is correct: from a user perspective, the perceived response time is crucial as it reflects his real experience with the system. c) Is not correct: the number of concurrent user and the types of scenarios or transactions are about business perspective. d) Is not correct: this is not a subject of interest for a business perspective.
27) Which of the following statements corresponds BEST to a UX requirement analysis activity? Select ONE option, explain why others are incorrect. a) Personas are used to analyze products or solutions from competitors b) User profiles are used to determine different levels of business knowledge c) Security requirements are derived from usage scenarios d) Environmental conditions such as light conditions are obtained from a task analysis Select ONE option.
a) Is not correct: creating personas may be part of the user profile analysis when analyzing UX requirements, but they are not used to analyze products or solutions from competitors. b) Is correct: measuring the level of business knowledge may be part of the user profile analysis when analyzing UX requirements . c) Is not correct: security requirements analysis is not usually part of UX requirements analysis. d) Is not correct: context analysis may include analysis of external conditions such as light condition, but these conditions result from context analysis not from task analysis.
21) Which one of the following statements regarding the graphical representation of business processes is true? Select ONE option, explain why others are incorrect. a) Using decision tables in BPMN allows defining test conditions corresponding to the business rules under test b) Graphical representations of business processes must describe the complete workflow in detail, including alternative and error scenarios c) For acceptance testing, graphical business process models should focus on the user workflows to be tested d) Business processes should be described graphically using the DMN standard and completed with decision tables Select ONE option.
a) Is not correct: diagrams should be as simple as possible and be structured in sub-processes b) Is correct: additional information such as links to user stories, requirements, risks, priorities and any other information useful for acceptance testing should be added to the diagrams using annotations c) Is not correct: links to user stories, requirements, risks, priorities and any other information useful for acceptance testing should be added to the diagrams using annotations. d) Is not correct: it should be a collaborative work between business analysts and testers, and produced artifacts shared between both groups.
22) What is considered as good practice regarding business process modeling? Select ONE option, explain why others are incorrect. a) Keeping all model element in one diagram considerably improves the readability of BMPN models b) BPMN diagrams and DMN tables should include information such as traceability to user stories c) Links to requirements or risks should be well separated from the workflow description d) Business analysts should finalize their process models before showing them to acceptance testers Select ONE option.
a) Is not correct: diagrams should be as simple as possible and be structured in sub-processes b) Is correct: additional information such as links to user stories, requirements, risks, priorities and any other information useful for acceptance testing should be added to the diagrams using annotations c) Is not correct: links to user stories, requirements, risks, priorities and any other information useful for acceptance testing should be added to the diagrams using annotations. d) Is not correct: it should be a collaborative work between business analysts and testers, and produced artifacts shared between both groups.
29) Which one of the following usability testing techniques matches the test objective BEST? Select ONE option, explain why others are incorrect. a) Expert reviews help to understand how users interact with a system and what is more or less visible b) Biometrics-based evaluation help to understand retrospectively, how users interacted with the system and to improve it. c) Log file analysis performed by usability experts identifies strong points of an interface that attract the user's attention d) Walkthrough and thinking aloud methods can indicate difficulties users experience with certain tasks Select ONE option.
a) Is not correct: in expert reviews usability experts evaluate the usability of the system or product according to pre-defined criteria or checklists based upon usability heuristics to identify strong and weak points of an interface b) Is not correct: in biometrics-based evaluations user behavior is monitored with specific biometric devices to understand how the user interacts with a page or a system c) Is not correct: log files analysis allows to analyze retrospectively how the users interacted with the system to improve it. d) Is correct: in walkthrough and thinking aloud methods, users explore the product and may perform given specific tasks. This helps to see how they interact with the product and to learn about expectations or difficulties.
24) Which of the following sentences explains BEST how business process and business rule modeling can be used for ATDD? Select ONE option, explain why others are incorrect. a) In an ATDD approach, business process/rule models must be created before the project starts b) In an ATDD approach, business process models replace acceptance criteria c) In an ATDD approach, testers use business process and business rule models to generate acceptance tests d) In an ATDD approach, process models are created for initial test design but are not maintained afterwards. Select ONE option.
a) Is not correct: in visual ATDD, business analysts and testers collaborate to model workflows and business rules using graphical notations. b) Is not correct: business process/rule models are reviewed with relevant stakeholders and contribute to the validation of the requirements and acceptance criteria, and not to replace them. c) Is correct: testers derive tests from these business process/rule models to ensure and demonstrate the required coverage through the different paths and business rules. d) Is not correct: Acceptance tests are derived from process models, which are updated to maintain test cases when there is a change in requirements or user stories.
16) Which one of the following statements defines beta testing BEST?Select ONE option, explain why others are incorrect. a) Beta testing is performed by developers at the customer's location b) Beta testing takes place early in the development process to acquire feedback from the market c) During beta testing, genuine users define the acceptance criteria for various realistic configurations d) Beta testers discover defects in the product that escaped during the development process
a) Is not correct: it is performed by potential or existing users at their location. b) Is not correct: it is performed after the product is completed to allow users evaluation of the product in real environment and provide feedback to development organization. c) Is not correct: in beta tests, user test the product in various realistic configurations and they neither follow predefined scenarios nor use a test charter. d) Is correct: beta testers may discover defects in the product that escaped during the development process.
32) Which one of the following acceptance criteria relates to security requirements? Select ONE option, explain why others are incorrect. a) The system's response time shall not exceed 3 seconds b) The system shall be web-based c) The graphical user interface shall comply with corporate style guides d) Normal users shall have restricted access to private data Select ONE option.
a) Is not correct: response time requirements relate to performance quality characteristics. b) Is not correct: this is a technical restriction of the solution space. c) Is not correct: corporate style guides are crucial for branding and may include aspects that relate to usability, but they usually do not cover security requirements which are rather part of programming guidelines. d) Is correct: confidentiality of private data is a security requirement.
40) Which tool fits the mentioned acceptance test activities BEST?Select ONE option, explain why others are incorrect. a) Requirements management tools for managing acceptance test execution campaigns b) Test management and automation tools for business process model-based acceptance test generation c) Business process management tools for modeling business processes and rules d) Model-based testing tools for managing incidents Select ONE option.
a) Is not correct: test management tools and test automation tools are used to manage test execution campaigns, but not requirements management tools. b) Is not correct: business process-based test case generators are used for generating tests from business process models. c) Is correct: business process management tools are used for modeling business processes and rules. d) Is not correct: defect / incident management tools are used for managing incidents.
35) Which of the following statements regarding defects is MOST correct? Select ONE option, explain why others are incorrect. a) Regular meetings between business analysts and testers are necessary to report discrepancies between actual and expected outcome b) Testers should provide accurate information regarding the difference between the expected test result and the actual result c) If the defect turns out to be a bug, the tester writes a defect report and sends it to the business analyst for further investigation d) The tester should analyze the potential impact of a defect on system usage, before communicating it to the business analyst Select ONE option.
a) Is not correct: testers first report discrepancies through defect reports which are discussed afterwards. b) Is correct: a defect report contains all relevant information the tester can provide to help the business analyst understand what happened and to assess the deviation should be provided. c) Is not correct: all defects should be documented and assessed by the business analyst, who may then decide. whether it is a defect or not. d) Is not correct: testers are testing experts, not business experts. It is the business analyst who is capable to judge the impact of a defect on system usage best.
33) The project team is currently facing a difficult situation originating from their difficulty in envisioning the future and the necessary steps to reach it together with a certain loss of motivation due to a strong feeling of stagnation. You try to unlock the situation by proposing a workshop. Which one would fit the best? Select ONE option, explain why others are incorrect. a) You ask two volunteers to play a part in front of the team. One will try to defend the project and propose positive arguments and ways forward. The other will do the opposite. You then recapitulate the major arguments of both sides and debate them openly with the team b) You draw a staircase with 11 steps, each of them representing a major milestone of the project. The bottom of the stairs corresponds to the first day of the project and the upper step means that the project is released. You locate the present situation in the middle of the stairs. The team is asked to identify and discuss the major steps down and up c) You organize a day out with challenging physical exercises practiced in teams followed by an after work dinner and drink. After all, nothing is best for motivation than hard times together, strong common objectives and a promise of good time d) You visualize all remaining major milestones of the project, starting with today and ending with project release. Then, you ask the team to identify and discuss the necessary actions to move forward from the present situation and to reach the milestones Select ONE option
a) Is not correct: this approach might come to help in identifying some of the problems but it will not help envisioning the future neither will it re-motivate the team b) Is correct: by identifying what has already been achieved (back) and what is left to be done and how, the team will be able to get a better understanding on where they are and how they will go forward. c) Is not correct: it might work on motivation and team spirit but it will not help envision the future neither will it help in getting a clue on what has already been achieved d) Is not correct: by starting the analysis with the present situation, the team will only work on the future steps. They will not envision what has been achieved and might even get more demotivated by what is left to be done and how unreachable it might seem to be.
30) Which one of the following statements regarding performance testing is MOST correct? Select ONE option, explain why others are incorrect. a) Depending on the model used to simulate the workload, performance tests are called load, stress or endurance / stability tests b) Performance testing aims to determine a system's robustness against malicious attacks c) The performance of the system is measured in a context that reflects, as far as possible, representative operating conditions d) The performance test results serve to determine hardware and software performance requirements Select ONE option. Select ONE option.
a) Is not correct: this classification refers to types of testing to be performed, depending on what needs to be measured. b) Is not correct: Performance testing aims to determine a system's responsiveness and stability under certain conditions. c) Is correct: in a typical performance test, concurrent users or transactions are simulated with specific tools to generate a given workload which mimics, as close as possible, actual conditions with real users and realistic interactions. d) Is not correct: results of a performance test are measured, and compared to pre-defined performance requirements.
13) In Agile an exploratory test session is conducted. Which one of the following concepts applies BEST?Select ONE option, explain why others are incorrect. a) Pair programming b) Refactoring c) Planning poker d) Time boxing Select ONE option.
a) Is not correct: this is not a concept related to exploratory testing (ET), this term refers to one of agile development approaches. b) Is not correct: this is not a concept related to ET, this term refers to one of agile development practices to be followed by development team. c) Is not correct: this is a planning technique, not related to ET itself. d) Is correct: Timeboxing is a concept supporting managing ET sessions, as time-boxed sessions help to control the time and effort dedicated to exploratory session.
28) Which one of the following scenarios characterizes UX task analysis BEST?Select ONE option, explain why others are incorrect. a) Users are qualified depending on their physical and intellectual characteristics b) Use cases are analyzed and represented through business process models c) External conditions are considered as input for subsequent design steps d) Inspirations from similar sectors are sought to identify successful solutions Select ONE option.
a) Is not correct: this relates to user analysis. b) Is correct: during task analysis, functionality is identified and formalized, for example through use cases that can be therefore represented as business process models. c) Is not correct: this relates to context analysis. d) Is not correct: this relates to competition analysis.
10) Which one of the following test design techniques fits accepting testing purposes BEST? Select ONE option, explain why others are incorrect. a) Static code analysis b) Input validation c) Equivalence partitioning d) Defect-based test design Select ONE option.
c) Is correct: as stated in [AcT Syllabus], this technique can be used as part of acceptance testing. a) Is not correct: this is a technique done on the source code level, while acceptance should focus on higher business levels. b) Is not correct: this can be used as an element of other black box technique but is a not a single test technique by itself.
4) How does ISTQB CT FL test activities relate to the IQBBA FL business analysis and requirements engineering activities? Select ONE option, explain why others are incorrect. a) Business analysts who follow the IQBBA requirements engineering process will not be involved in designing test cases b) Business analysts and tester have to decide, whether they follow the IQBBA or ISTQB lifecycle processes, because they exclude each other. c) The IQBBA solution evaluation phase precedes the ISTQB test implementation and test execution activities. d) Test analysis and test design activities may result in changes of acceptance criteria.
d) Is correct: as stated in Syllabus, testers can contribute to the definition and verification of acceptance criteria as part of test analysis and test design activities. a) Is not correct: IQBBA process assumes business analyst involvement in testing - reviewing test cases, providing input information etc. b) Is not correct: IQBBA and ISTQB processes are not in conflict, in fact many activities defined in these processes are related and together support similar goals. c) Is not correct: IQBBA solution evaluation and ISTQB test implementation, test execution may be done in parallel.
Its not economic impact mitigation it is
economic impact mitigation.
