Tutorials
The role of the tutorials is to provide a platform for a more intensive scientific exchange amongst researchers interested in a particular topic and as a meeting point for the community. Tutorials complement the depth-oriented technical sessions by providing participants with broad overviews of emerging fields. A tutorial can be scheduled for 1.5 or 3 hours.
Theory and Practice in Testing using Statistical Usage Models
Instructor
|
Winfried Dulz
TestUS Inc.
Germany
|
|
|
|
Brief Bio
Dr. Winfried Dulz was an assistant professor and research group leader at the Chair of Computer Science 7 (Department of Computer Science at the Friedrich-Alexander University Erlangen-Nuremberg) until 2016.
Since then he has been CTO at TestUS Consulting and responsible for research and development of the model-based testing tool TestPlayer©.
The main interest of his research and teaching activities is in the field of communication systems and computer networks, specification, simulation and testing of communication protocols, as well as their application in the domains automation technology, medical technology and automotive.
|
Abstract
This tutorial gives an overview of model-based testing with statistical usage models. It is oriented towards the generally accepted approach for model-based testing, as presented in the new ISTQB syllabus "Model-based Tester" (https://www.istqb.org/certification-path-root/model-based-tester-extension/model-tester-extension-in-a-nutshell.html). The aim is to provide a theoretical basis and to demonstrate the practical applicability of model-based statistical testing by means of simple and realistic scenarios.
Keywords
Model-based testing, statistical testing, Markov chain usage model, automatic test suite generation, website testing, Java GUI testing, ATM case study, testing tools, Eclipse, Selenium, TestPlayer©.
Aims and Learning Objectives
Participants first get a general overview of test procedures. This includes questions about the scope of individual test procedures and the distinction to verification. What is the difference between test procedures, functional and non-functional testing? What is model-based testing and why do we need statistical testing? What is the advantage and the state of the art in statistical testing? Participants learn which tool environments can be used to perform effective statistical testing.
The tutorial starts with a simple Hello World example to illustrate the main concepts. In addition, concrete case studies from the area of Java GUI programming and website testing will be presented. A larger application example of a simulated ATM illustrates how real software applications can efficiently be validated with model-based statistical acceptance tests for different usage profiles.
Target Audience
Researcher, Test engineer, Software and system developer, Group leader, CTO or generally people who want to get into the topic in order to work with Model-based Statistical Testing techniques.
Prerequisite Knowledge of Audience
Participants should be familiar with the development, programming and testing of software systems and should have a basic knowledge of modern object-oriented programming approaches (UML, Java, HTML/JavaScript...).
Detailed Outline
Overview Testing Procedures
• Quality assurance in the V-model
• Verification vs. Validation
• Classification of Testing procedures
• White-box vs. Grey-box vs. Black-box Testing
• Functional vs. Non-functional Testing
Model-based Testing
Statistical Usage Testing
• Basic Theory
• History and Tools
First Example - Hello MBT World
• Usage Model
• Test Suite Generation
• TestPlayer
Test Suite Execution
• Eclipse
Finding Bugs
• Model-based bug insertion
Second Example – Website testing
• Usage Model
• Test Suite Generation
• Selenium
Case Study – ATM Simulation (http://www.math-cs.gordon.edu/courses/cs211/ATMExample/)
• Requirements Statement
• Use Cases
• State Charts
• Statistical Usage Model
• Initial Functional Test Cases
• Automatic Test Suite Generation
• Adopted Profiles
• Automatic Test Suite Execution
Lessons learned and main findings