Inhaltsverzeichnis

Alle Kapitel aufklappen
Alle Kapitel zuklappen
Preface to the Second Edition
15
Foreword to the Revised and Extended Second English Edition
19
Foreword to the Second Edition
21
Foreword to the First Edition
27
1 Introduction
31
PART I Methodology
41
2 Theory of Software Testing
43
2.1 System Changes Necessitate Testing
43
2.2 Test Types
47
2.3 Test Stages
49
2.3.1 Test Stages in the General V-Model
49
2.3.2 Test Stages in SAP Projects
53
2.4 Black-Box Testing and White-Box Testing
56
2.5 Test Case Design for Black-Box Testing
57
2.5.1 Equivalence Class Partitioning
58
2.5.2 Boundary Value Analysis
60
2.5.3 Error Guessing
61
2.6 Test Data
62
2.7 Basic Procedures for Planning and Execution
62
2.7.1 Test Preparation
63
2.7.2 Test Case Creation
65
2.7.3 Test Planning and Execution
65
2.7.4 Test Evaluation
66
2.8 Selecting Test Tools
66
2.8.1 Types of Test Tools
66
2.8.2 Tool Selection and Implementation
72
2.9 Conclusion
75
3 Test Methodology
77
3.1 Roadmaps in SAP Solution Manager
78
3.1.1 Project Phases
80
3.1.2 Roadmaps
85
3.2 Project Preparation
90
3.3 Business Blueprint
95
3.3.1 Mapping Business Process Structure
95
3.3.2 Test Standards
98
3.4 Realization
101
3.5 Final Preparation
109
3.6 Go-Live & Support and Run
119
3.7 Conclusion
121
PART II Functional Testing
123
4 Test Management with SAP Solution Manager
125
4.1 Testing in the Context of SAP Enterprise Support, Run SAP, and SAP Standards for Solution Operations
127
4.2 SAP Solution Manager Enterprise Edition
131
4.2.1 Application Management Lifecycle
131
4.2.2 Work Center
137
4.2.3 Adapter and Functional Enhancements
141
4.2.4 Projects and Solutions
143
4.3 SAP Solution Manager—Basic Settings
146
4.4 Project-Related Testing with SAP Solution Manager
152
4.4.1 Creating a Project
152
4.4.2 Creating the Process Structure
161
4.4.3 Integrating Test Cases
164
4.4.4 Creating Test Plans and Test Packages
167
4.4.5 Extended Functionality for Creating Test Plans and Packages
171
4.4.6 Test Execution
182
4.4.7 Status Analysis
186
4.5 Integration Scenarios
193
4.5.1 Test and Service Desk
194
4.5.2 Test and Change Request Management
198
4.5.3 Test and Quality Gate Management
201
4.5.4 Test and Diagnostics
203
4.5.5 Test and IT Reporting
206
4.6 Solution-Related Testing
209
4.7 Summary
212
4.8 Customer Report by SOKA-BAU
215
4.9 Customer Report by SEWAG
229
4.10 Customer Report by BSH Bosch und Siemens Hausgeräte GmbH
241
4.11 Update of the Customer Report by BSH Bosch und Siemens Hausgeräte GmbH
251
4.12 Customer Report by Reno Fashion & Shoes GmbH
260
4.13 Update of the Customer Report by Hamm-Reno-Group GmbH & Co. KG
268
5 Project-Related Testing with SAP Solution Manager and SAP Quality Center by HP
275
5.1 SAP Quality Center by HP
276
5.2 SAP Solution Manager Adapter for SAP Quality Center by HP
279
5.3 Test Management in the SAP Quality Center by HP
282
5.3.1 Creating a Project and Process Structure in SAP Solution Manager
282
5.3.2 Managing Requirements
285
5.3.3 Creating Test Cases
289
5.3.4 Test Planning and Execution
290
5.3.5 Creating and Managing Error Messages
292
5.3.6 Versioning and Traceability
294
5.3.7 Status Analysis
302
5.3.8 Transferring the Test Results to SAP Solution Manager
308
5.4 Summary
309
5.5 Customer Report by Endress+Hauser Group
309
5.6 Customer Report by DB Systel GmbH
323
6 Supporting Test Automation with SAP TAO
337
6.1 Basic Principle: Automation Through Composition
338
6.2 Components of and Prerequisites for SAP TAO Technology
340
6.3 Using SAP TAO to Create Test Cases
343
6.3.1 Using the Process Flow Analyzer to Create Test Components and Test-Case Designs
345
6.3.2 Using the Inspection Procedure to Create Test Components
348
6.3.3 Composing Test Cases
351
6.3.4 Defining Test Data
353
6.3.5 Consolidating Test Scripts
354
6.3.6 Planning and Executing the Tests
356
6.4 Using SAP TAO to Maintain Test Cases
356
6.5 Summary
360
7 Economic Aspects of Test Automation
361
7.1 Cost Model for Software Testing
363
7.1.1 Cost of Designing Test Cases
363
7.1.2 Cost of Test Tools
364
7.1.3 Costs of Implementing Test Automation
369
7.1.4 Costs of Maintaining Test Cases
370
7.1.5 Costs of Implementing a Test Cycle
372
7.1.6 Testing Costs When Creating Component-Based Test Cases
372
7.1.7 Individual Test Cost Model
377
7.2 Cost Model for Software Errors
378
7.2.1 Errors Not Detected During Software Testing
379
7.2.2 Errors Detected During Software Testing
381
7.3 Overall View
382
7.4 Summary
383
7.5 Customer Report by INVISTA Resins & Fibers GmbH
383
7.6 Update to Customer Report by INVISTA Resins & Fibers GmbH
397
8 Test Automation with eCATT
411
8.1 Implementation and Prerequisites
412
8.1.1 Architecture of the Test Landscape and eCATT Fundamentals
412
8.1.2 Structure of the eCATT Test Scripts
418
8.1.3 Technical Requirements
422
8.1.4 Summary
425
8.2 Creating and Running UI-Driven Tests
426
8.2.1 Testing Transactions without Controls (TCD)
426
8.2.2 Testing Transactions with Controls (SAP GUI)
434
8.2.3 Testing Web Dynpro Applications
449
8.2.4 Summary
457
8.3 Creating Tests Via Direct Program Control
457
8.3.1 Testing Global ABAP Object Classes
457
8.3.2 Function Modules and BAPIs
458
8.3.3 Inline ABAP
459
8.3.4 Database Accesses
460
8.3.5 Summary
461
8.4 Creating Tests for Web Services
461
8.5 Integration with External Test Tools
465
8.6 Implementing Checks
470
8.6.1 Testing Parameters
471
8.6.2 Direct Testing of Values
473
8.6.3 Message Handling
474
8.6.4 Parameterization of Message Handling
480
8.6.5 Checking Tables
482
8.6.6 Summary
483
8.7 Managing Test Data
483
8.7.1 Test Configuration
483
8.7.2 Variants
485
8.7.3 Test Data Container
485
8.7.4 Runtime Data Container (RDC)
491
8.7.5 Test Data Container Programming Interface (TDC-API)
492
8.7.6 Summary
493
8.8 Modularizing Test Scripts
493
8.9 Additional eCATT Commands
497
8.10 Starting, Logging, and Analyzing Test Executions
503
8.10.1 Running eCATT Scripts
503
8.10.2 Logging eCATT Tests
507
8.10.3 Log Archiving
510
8.10.4 Automated Performance Analysis
511
8.10.5 Error Analysis for eCATT Scripts
515
8.10.6 Summary
518
8.11 Overview of the eCATT Versions
519
8.12 Further Steps
521
8.13 Summary: Advantages of the Integration of eCATT in the SAP System
521
8.14 Customer Report by Zürcher Kantonalbank
524
9 SAP Test Data Migration Server
531
9.1 Data Privacy for Test Data Collection
533
9.2 Process Types
535
9.3 Architecture and System Landscape
543
9.4 Data Transfer and Extraction
545
9.5 Creation and Refresh of Test Systems
547
9.6 Summary
550
9.7 Customer Report by Behr GmbH & Co. KG
551
9.8 Customer Report by Infineon Technologies AG
559
PART III Performance Tests
567
10 Project Outline of a Performance Test
569
10.1 Load Test—Stress Test—Volume Test
571
10.2 Roles in the Performance Test Project
572
10.3 Phase Model of a Performance Test
574
10.4 Planning
575
10.4.1 Process Analysis
576
10.4.2 Data Analysis
581
10.4.3 Selecting the Load Test Tool
583
10.4.4 The Load Profile
583
10.5 Performing the Load Test
584
10.5.1 Data and System Preparation
585
10.5.2 Single-User Test
586
10.5.3 Multi-User Tests
587
10.5.4 Result Analysis
588
10.5.5 Optimization
588
10.6 Performing the Stress Test
589
10.7 Completing
590
10.7.1 Executive Summary
590
10.7.2 Action Plan
591
10.7.3 Description of the Test Structure
591
10.7.4 Description of the Test Goals
592
10.7.5 Documentation of the Test Execution
592
10.7.6 Lessons Learned
592
10.8 Summary
593
11 SAP LoadRunner by HP
595
11.1 LoadRunner Virtual User Generator
597
11.2 LoadRunner Controller and LoadRunner Agent
600
11.3 LoadRunner Analysis
602
11.4 SAP Performance Center by HP
603
11.5 Summary
607
11.6 Customer Report by HeidelbergCement AG
608
11.7 Customer Report by Sanofi-Aventis
616
12 Monitoring a Performance Test
627
12.1 Sample Process In Case Performance Problems Occur
628
12.2 Localization of Performance Bottlenecks
630
12.3 Transactions for Technical Monitoring
634
12.3.1 AL08: List of all Users Logged On
634
12.3.2 SM04: User List
635
12.3.3 SM12: Lock Entry List
636
12.3.4 SM21: System Log
637
12.3.5 SM66: Global Work Process Overview
638
12.3.6 STAD: Transaction Analysis
639
12.3.7 ST02: Overview of SAP Buffers
640
12.3.8 ST04: Database Overview
642
12.3.9 ST05: SQL Trace Analysis
643
12.3.10 ST06: OS Monitor
645
12.3.11 ST22: ABAP Runtime Error
647
12.4 Summary
648
PART IV Test Center
649
13 Test Center
651
13.1 Setting Up a Test Center
653
13.2 Test Center Services
656
13.3 Summary
660
13.4 Customer Report by Deutsche Telekom AG
660
Appendices
691
A SAP Solution Manager Test Workbench vs. SAP Test Organizer
693
B SAP NetWeaver Knowledge Warehouse—Functionality in SAP Solution Manager
697
C Recommended Reading
701
D The Authors
703
Index
705