Ch 7 System Integration Testing
Pairwise testing
only two interconnected systems in an overall system are tested at a time
Inter-system testing
- It is a high-level testing phase which requires interfacing independently tested systems
system integration testing (SIT)
- Putting modules together in an incremental manner - Ensuring that the additional modules work as expected without disturbing the functionalities of the modules already put togethe
Integration testing is said to be complete when...?
- The system is fully integrated togethr - All the test cases have been executed - All the severe and moderated defects found have been fixed
Intra-system testing
- This form of testing constitutes low-level integration testing with the objective of combining the modules together to build a cohesive system
Glue
A glue component provides the functionality to combine different components
how is a COTS component defined as?
A unit of composition with contractually specified interfaces and explicit context dependencies only. A software component can be deployed independently and is subject to composition by third parties
Tailoring
Components tailoring refers to the ability to enhance the functionality of a component
what is Interface integrity?
Internal and external interfaces are tested as each module is integrated
Wrapper
It is a piece of code that one builds to isolate the underlying components from other components of the system
unit testing
Modules are individually tested
what is End-to-end validity?
Tests are designed to ensure that a completely integrated system works together from end-to-end
Pairwise validity
Tests are designed to ensure that any two systems work properly when connected by a network
System endurance
Tests are designed to ensure that the integrated system stay up for weeks
Interface stress
Tests are designed to ensure that the interfaces can sustain the load
what is Functional validity?
Tests to uncover functional errors in each module after it is integrate
System-level fault injection testing
This is used to determine how well a system will tolerate a failing component
Black-box component testing
This is used to determine the quality of the component
Operational system testing
This kind of tests are used to determine the tolerance of a software system when the COTS component is functioning correctly
what is Engineering Change Order (ECO)?
is a formal document that describes a change to the hardware and software
Design Verification Test (DVT) plan
is prepared and executed by the hardware group before the integration with software system
The major advantages of conducting SIT
• Defects are detected early • It is easier to fix defects detected earlier • We get earlier feedback on the health and acceptability of the individual modules and on the overall system • Scheduling of defect fixes is flexible, and it can overlap with development
what are the common approaches to perform system integration testing?
• Incremental • Top-down • Bottom-up • Sandwich • Big-bang
A hardware engineering process consists of four phases
• Planning and specification • Design, prototype implementation, and testing • Integration with the software system • Manufacturing, distribution and field service
Three common paradigms for interfacing modules...?
• Procedure call interface • Shared memory interface • Message passing interfac
what is Normal mode?
• The built-in test capabilities are transparent to the component user • The component does not differ from other non-built-in testing enabled components
what is Maintenance mode?
• The component user can test the component with the help of its built-in testing features • The component user can invoke the respective methods of the component, which execute the test, evaluate autonomously its results, and output the test summary