Ch 7 System Integration Testing

Pairwise testing

only two interconnected systems in an overall system are tested at a time

Inter-system testing

- It is a high-level testing phase which requires interfacing independently tested systems

system integration testing (SIT)

- Putting modules together in an incremental manner - Ensuring that the additional modules work as expected without disturbing the functionalities of the modules already put togethe

Integration testing is said to be complete when...?

- The system is fully integrated togethr - All the test cases have been executed - All the severe and moderated defects found have been fixed

Intra-system testing

- This form of testing constitutes low-level integration testing with the objective of combining the modules together to build a cohesive system

Glue

A glue component provides the functionality to combine different components

how is a COTS component defined as?

A unit of composition with contractually specified interfaces and explicit context dependencies only. A software component can be deployed independently and is subject to composition by third parties

Tailoring

Components tailoring refers to the ability to enhance the functionality of a component

what is Interface integrity?

Internal and external interfaces are tested as each module is integrated

Wrapper

It is a piece of code that one builds to isolate the underlying components from other components of the system

unit testing

Modules are individually tested

what is End-to-end validity?

Tests are designed to ensure that a completely integrated system works together from end-to-end

Pairwise validity

Tests are designed to ensure that any two systems work properly when connected by a network

System endurance

Tests are designed to ensure that the integrated system stay up for weeks

Interface stress

Tests are designed to ensure that the interfaces can sustain the load

what is Functional validity?

Tests to uncover functional errors in each module after it is integrate

System-level fault injection testing

This is used to determine how well a system will tolerate a failing component

Black-box component testing

This is used to determine the quality of the component

Operational system testing

This kind of tests are used to determine the tolerance of a software system when the COTS component is functioning correctly

what is Engineering Change Order (ECO)?

is a formal document that describes a change to the hardware and software

Design Verification Test (DVT) plan

is prepared and executed by the hardware group before the integration with software system

The major advantages of conducting SIT

• Defects are detected early • It is easier to fix defects detected earlier • We get earlier feedback on the health and acceptability of the individual modules and on the overall system • Scheduling of defect fixes is flexible, and it can overlap with development

what are the common approaches to perform system integration testing?

• Incremental • Top-down • Bottom-up • Sandwich • Big-bang

A hardware engineering process consists of four phases

• Planning and specification • Design, prototype implementation, and testing • Integration with the software system • Manufacturing, distribution and field service

Three common paradigms for interfacing modules...?

• Procedure call interface • Shared memory interface • Message passing interfac

what is Normal mode?

• The built-in test capabilities are transparent to the component user • The component does not differ from other non-built-in testing enabled components

what is Maintenance mode?

• The component user can test the component with the help of its built-in testing features • The component user can invoke the respective methods of the component, which execute the test, evaluate autonomously its results, and output the test summary