GSM Association Official Document IR.

81

Non Confidential

IR.81 GRQ Measurement Implementation 3.0 27 May 2011

This is a non-binding permanent reference document of the GSM Association.

Security Classification NON-CONFIDENTIAL GSMA Material

Copyright Notice
Copyright 2011 GSM Association

Antitrust Notice
The information contain herein is in full compliance with the GSM Associations antitrust compliance policy.

V3.0

Page 1 of 46

GSM Association Official Document IR.81

Non Confidential

Table of Contents
1 2 Overview ........................................................................................................... 3 About this document .................................................................................... 3 Overview of roaming QoS monitoring methods ............................................ 5 2.1 End-to-end Active Testing and Monitoring ................................................... 6 2.2 Drive Testing and Monitoring ....................................................................... 6 2.3 Passive Monitoring ...................................................................................... 6 2.4 CAMEL Monitoring ...................................................................................... 7 OVERVIEW OF Roaming QoS PARAMETERS ............................................... 8 3.1 Voice QoS Parameters ................................................................................ 9 3.2 SMS QoS Parameters ................................................................................. 9 3.3 Data QoS Parameters ............................................................................... 10 3.4 IPX QoS Monitoring ................................................................................... 11 QoS Parameter-Method Grid ......................................................................... 12 4.1 Circuit Switched......................................................................................... 12 4.2 SMS .......................................................................................................... 14 4.3 Packet Switched ........................................................................................ 15 Test Methodology .......................................................................................... 18 5.1 End-To-End Active Testing and Monitoring ............................................... 18 5.2 Passive Monitoring .................................................................................... 26 5.3 CAMEL Monitoring .................................................................................... 31 5.4 Call Flow ................................................................................................... 32 5.5 Trigger Table ............................................................................................. 40 5.6 Monitoring Values ...................................................................................... 44 Document Management................................................................................. 46 1.1

V3.0

Page 2 of 46

GSM Association Official Document IR.81

Non Confidential

1 OVERVIEW
Global Roaming Quality (GRQ) provides a neutral, objective and proportionate framework for pro-active and reactive monitoring and assuring end-to-end roaming services quality, thus enabling GSMA members to get a global perspective on roaming quality. By reducing roaming quality issues, reasonable quality levels can be assured and customer satisfaction improved. The costs associated with customer complaints and fault resolution will also reduce.

1.1

About this document

This document describes the implementation procedures for measuring the quality of SMS, voice, and data roaming services end-to-end both in the bilateral and in the roaming hubbing scenario. The document consists of four main sections. The first section details common Quality of Service (QoS) monitoring methods for use with the GRQ monitoring framework The second section provides an overview of the quality parameters used with the GRQ monitoring framework. These parameters are defined with details of calculations in PRD IR.42. The third section contains three tables indicating which monitoring methods are appropriate for each monitoring parameter, and the necessary conditions for consistent monitoring results. The fourth section provides detailed testing conditions for each parameter, method, and Visited Public Mobile Network/ Home Public Mobile Network (VPMN/HPMN) perspective. As each section builds on the previous one, it is recommended to read all the sections in the given order.

V3.0

Page 3 of 46

GSM Association Official Document IR.81

Non Confidential

IR.42 Computation including trigger point Dictionary

IR.81 GRQ Measurement implementation

BA.51 Roaming SLA Handbook

AA.13 Roaming SLA Annex C12

IR.78 Roaming Trouble Report

1.1.1

Scope

This permanent reference document (PRD) provides the parameters, methods, and conditions necessary to perform end-to-end monitoring of roaming services according to the GRQ framework. Other parameters may complement GRQ monitoring and other methods may be added in the future. 1.1.2 Purpose

This document is intended for mobile operators, roaming Hubbing Providers and vendors. Operators will find information about the most important QoS parameters and common monitoring methods for end-to-end roaming QoS monitoring. Roaming Hubbing Providers will find information about the most important QoS parameters and common monitoring methods that can be natively measured/performed by roaming Hubbing Providers themselves. Vendors will find information about the most important QoS parameters and the necessary testing conditions providing for comparable monitoring results irrespective of the methods, vendors, and mobile operators involved.

V3.0

Page 4 of 46

GSM Association Official Document IR.81

Non Confidential

1.1.3

Definition of Terms

Term HPMN SS7 VPMN ASR ACD PDD CAMEL IMSI MSC QoS STP MAP ISUP ISDN GTP

Description Home Public Mobile Network Signalling System 7 Visited Public Mobile Network Answer-Seize Ratio Average Call Duration Post-Dial Delay Customized Applications for Mobile networks Enhanced Logic International Mobile Subscriber Identity Mobile Switching Centre Quality of Service Signaling Transfer Point Mobile Application Part ISDN User Part Integrated Services Digital Network GPRS Tunneling Protocol

2 OVERVIEW OF ROAMING QOS MONITORING METHODS

Monitoring is a continuous method to measure the QoS on an on-going basis. It provides a statistical representation of end-user experience based on a sample of the roaming services provided. This in contrast to ad-hoc tests, which are only giving a snap-shot of the QoS. Adhoc tests are typically more complicated, and are not standardized. These are used for troubleshooting. There are two general approaches to monitoring roaming QoS end-to-end. The first approach generates test calls in the visited network using test subscriber identity module (SIM) cards from stationery or a moving test rig. This is referred to as active monitoring. The second approach monitors live roaming traffic signaling and IP traffic resulting from roaming subscriber activities in the visited network. This is referred to as passive monitoring, because this approach is non-intrusive. Roaming Hubbing Providers can natively perform some of these methods. This document includes both approaches and contains details of the following common methods: 1. 2. 3. 4. End-to-end Active Testing and Monitoring Drive Testing and Monitoring Passive Monitoring CAMEL Monitoring

One or more methods can be combined to perform end-to-end GRQ monitoring. Other methods may be added in the future.

V3.0

Page 5 of 46

GSM Association Official Document IR.81

Non Confidential

2.1

End-to-end Active Testing and Monitoring

The End-to-end Active Testing and Monitoring method deploys one or more stationary test rigs in the roaming destination. Each test rig contains one or more active Radio Frequency (RF) probes programmed to emulate subscriber behavior. Test calls are generated on the visited or on the home network using test SIM cards. The active test probes typically support automated scheduled testing for on-going roaming service quality monitoring, as well as real-time testing for troubleshooting. An IP network is used to remotely control the probes and receive test results from the test rig. The test rigs often incorporate SIM multiplexing to centrally manage SIM resources and dynamically assign them to the active test probes.

2.2

Drive Testing and Monitoring

The Drive Testing and Monitoring method is similar to the End-to-end Active Testing and Monitoring method with the exception that the active probes are installed in vehicles (for example taxis or buses). Given that monitoring is performed in different locations and potentially from a moving location, this method will give different results than stationary test rigs. As Drive Testing and Monitoring was not included in the GRQ trial, no test conditions nor comparison factors could be included in this document. Once we have the framework ready and working for End-to-end active testing, we will further look into this mobile variant.

2.3

Passive Monitoring

Passive Monitoring method uses non-intrusive high-impedance Signaling System number 7 (SS7) signaling probes to record selected protocol messages for further analysis for example with an SS7 data analysis and reporting tool. It is noted that some Signal Transfer Points (STP)s enable the replication of signaling messages. They can send the replicates towards a network monitoring application. Such approach is also considered as a passive monitoring method. The SS7 data analysis provides a real-time view of the network and service performance experienced by the roamers. It is important to note that only monitoring of basic and mandatory protocols for GSM/GPRS roaming services have been considered, that is Mobile Application Part (MAP), Integrated Services Digital Network User Part (ISUP). Similarly, Passive Monitoring may be applied on the IP traffic for monitoring the GPRS Tunneling Protocol (GTP) flows, as required for evaluating the QoS of the PS-domain. The approach taken may consist of implementing high-impedance probes or to apply a port mirroring on a network switch. In the later case, it forces the switch to send a copy of all network packets seen on one switch port (or an entire Virtual LAN (VLAN)) to a network monitoring connection on another switch port. This is commonly used for network appliances that require monitoring of network traffic. CAMEL is the embodiment of the Intelligent Networks (IN) concept for mobile networks. CAMEL is bilaterally and specifically enabled across networks by roaming partners. It is supported by the CAP protocol.

V3.0

Page 6 of 46

GSM Association Official Document IR.81

Non Confidential

In this document, CAMEL Monitoring refers to passive probes monitoring CAP signaling. This monitoring brings additional visibility on the activity of the roamer, so it is described separately from passive Monitoring, in a specific section see below.

2.4

CAMEL Monitoring

The Customized Applications for Mobile networks Enhanced Logic (CAMEL) Monitoring method uses a similar set up to SS7 Monitoring, whereby non-intrusive CAMEL signaling probes record selected protocol messages for further analysis and reporting. Once a CAMEL relationship is established between a HPMN and a VPMN, an exchange of CAMEL Application Part (CAP) protocol messages takes places. This enables both the HPMN and the VPMN to monitor roaming QoS using passive signaling probes (subject to appropriate protocol stack library for decoding messages). The CAMEL Phase enabled between the roaming partners will determine the scope of parameters available for GRQ monitoring: Phase 1: Applies to Mobile Originated (MO) and Mobile Terminated (MT) (at Gateway mobile switching center (GMSC)) calls related activities. Phase 2: Phase 1 plus Unstructured Supplementary Service Data (USSD) control, call duration, and so on. Phase 3: Phase 1 and Phase 2 plus control of dialed services (actual number dialed), mobility events, GPRS session and SMS-MO. Phase 4: All of the above plus IMS control and SMS-MT.

Most operators with CAMEL-enabled limit its support to CAMEL Phase 2. The CAMEL Monitoring was not tested in the trial due to lack of CAMEL agreements between the participating operators and the CAMEL/CAP monitoring modules being inactive at the trial participants. However, due to widespread use of CAMEL for critical services (prepaid roaming, VPN, and so on.), it was decided to include CAMEL Monitoring in this document. It is recommended that operators check the results from the calibration process if the CAMEL Monitoring method is to be used with GRQ.

V3.0

Page 7 of 46

GSM Association Official Document IR.81

Non Confidential

3 OVERVIEW OF ROAMING QOS PARAMETERS

This section gives an overview of the basic parameters that enable monitoring of roaming quality of services end-to-end under the GRQ framework. These parameters were selected on the basis that they cover the five QoS aspects defined in PRD IR42, and represents the customer experience. The five QoS aspects are: 1. Network Accessibility: Probability that the user performs a successful registration on the PLMN. The customer is registering to the network (either the circuit switched network for voice or the packet switched network for data). (For Global Roaming QoS monitoring, it is assumed that the network is available where the customer is located.). Some of these parameters can be natively monitored by a roaming Hubbing Provider 2. Service Accessibility: If a customer wants to use a service, the network operator will provide access to the service as quickly as possible. (The end-to-end bearer connection is provided to the customer. For voice services, the customer hears the ring tone; for data services, the end-to-end packet data protocol (PDP) context is activated; for SMS, the connection is established between the end-user terminal and the Short Message Service Centre (SMSC).) 3. Connection Establishment: For voice services, this describes the call setup endto-end (even in case of call forward to voicemail). For data services, this describes the connection establishment for MultiMedia Service (MMS) or accesses to a Wireless Application Protocol (WAP) portal or web server and so on. 4. Service Retain-ability: Service Retain-ability describes the termination of services (in accordance with or against the will of the user), for example the customer terminates his voice call or data connection without cut-off. 5. Connection Quality: This describes the Quality of Service during service use. The connection is not impaired by quality problems, such as speech quality for voice or data rate for data services. For Packet Switched services, only bearer level measures are included as most data services (for example MMS, HTTP) are delivered using the HPMNs infrastructure and the VPMNs data bearer (that is bit pipe). The GRQ framework may consider service or classbased QoS monitoring (cf. IP Exchange (IPX) QoS) in the future to reflect end-user applications more closely.

V3.0

Page 8 of 46

GSM Association Official Document IR.81

Non Confidential

Unless explicitly specified, the following parameters are for Mobile Originated (MO) activities from the VPMN.

3.1

Voice QoS Parameters

QoS Aspects QoS Parameters 1. Circuit Switched LU success rate (*) 2. Circuit Switched LU delay (*) 3. NER-MO or SAT-MO (success ratio)

1. Network Accessibility (customer being able to register on the network)

2. Service accessibility (from customer hitting the send bottom until hearing a ring tone)

4. NER-MT or SAT-MT (success ratio) 5. PDD-MO or STT-MO (duration) 6. PDD-MT or STT-MT (duration) 7. CSSR-MO (success ratio)

3. Connection establishment (from customer hitting the send bottom until a successful establishment of the call)

8. CSSR-MT (success ratio) 9. REL (ISUPv2) 10. OCN and RDN (ISUPv2)

4. Connection retain-ability (from a successful establishment of the call until service is terminated) 5. Connection quality

11. CCR (success ratio) 12. ALOC (duration)1 13.CLI transparency 14.SpQ (Speech Quality)

(*) Natively supported by roaming Hubbing Providers; other parameters may be supported through CAMEL.

3.2

SMS QoS Parameters

QoS Aspects

QoS Parameters No QoS Parameter (as not SMS specific)

1. Network Accessibility (customer being able to register on the network)

21. Service Accessibility for SMS-MO (*) 2. Service accessibility (MO) 22. Service Accessibility for SMS-MT (*) 23. Access Delay for SMS-MO (*)
1

Not relevant for a roaming QoS SLA.

V3.0

Page 9 of 46

GSM Association Official Document IR.81

Non Confidential

24. Access Delay for SMS-MT (*) 25. End-to-End Delivery Time for SMS-MO(*)1 26. End-to-End Delivery Time for SMS-MT(*)1 No QoS Parameter (Store and Forward Mechanism) No QoS Parameter (Store and Forward Mechanism)

3. Connection establishment (from customer hitting the send bottom until a successful delivery of the SMS) 4. Connection retain-ability (from a successful establishment of the service until service is terminated) 5. Connection quality

(*) Natively supported by a roaming Hubbing Provider only in the case where the SMS traffic is controlled by the roaming HUB.

3.3

Data QoS Parameters

GRQ monitoring involves testing of MMS, WAP and internet, all with their specific Access Point Name (APN)s. QoS Aspects QoS Parameters 31. Packet Switched Location Update success rate (*) 32. Packet Switched Location Update Delay (*) 2. Service accessibility (from customer hitting the send / connection bottom until accessing the data bearer) 3. Connection establishment (from customer hitting the send bottom until a successful establishment of the service) 4. Connection retain ability (from a successful establishment of the service until service is terminated) 5. Connection quality 33. PDP Context Activation success rate 34. PDP Context Activation time

1. Network Accessibility (customer being able to register on the network)

No QoS Parameter defined (service specific parameters may be defined in the future).

35. PDP Context Cut-Off Ratio 36. PDP Context Average Session Time1.

37. Throughput (Kbit/sec) 2 38. Goodput (Kbit/sec) 39. Roundtrip time (expressed in milliseconds) 3 40. Packet loss4 (*) Natively supported by a roaming Hubbing Provider; other parameters may be supported through CAMEL.
2

Because a bearer level approach adopted for the data services QoS monitoring, these parameters have to be measured at the bit pipe level and not at the User Application level ( for example HTTP). 3 See Delay in section 8 of PRD IR.34 Inter-Service Provider IP Backbone Guidelines. 4 See Packet Loss Rate in section 8 of PRD IR.34 Inter-Service Provider IP Backbone Guidelines

V3.0

Page 10 of 46

GSM Association Official Document IR.81

Non Confidential

Various opinions exist5 on how to measure throughput/goodput. It is acknowledged that the application used for measuring these parameters may even influence the measure itself. Therefore it is recommended that the calibration process at the initial stage of the implementation of a GRQ framework between two operators scrutinizes these measures. For the sake of clarity, it is noted that active probes may measure roundtrip and packet loss in different ways for example based on the PING application or based on analysis of TCP packet processing. It is also acknowledged that PING is not always trusted by IP experts for achieving accurate measure for the real customer experience. Indeed, PING is part of Internet Control Message Protocol (ICMP) while the data transfer is done in User Datagram Protocol (UDP) or Transmission Control Protocol (TCP). Therefore, it is recommended that both operators involved in the GRQ measurements agree on the chosen method and perform calibration tests. A high-level definition of throughput is the ratio between the global data volume by unit of time; goodput is the ratio between the useful data volume by unit of time.

3.4

IPX QoS Monitoring

Roaming interconnection is an integral part of roaming services. A new interconnection framework for IP (PRD IR.34) also provides for network level QoS monitoring of IP traffic between mobile operators and interconnection providers. Where IPX interconnections replace GRX interconnections, it may be possible to utilise packet switched QoS parameters from the IPX QoS Monitoring scheme with the GRQ Framework in the future.

See RFC 5166 Metrics for the Evaluation of Congestion Control Mechanisms (http://tools.ietf.org/html/rfc5166)

V3.0

Page 11 of 46

GSM Association Official Document IR.81

Non Confidential

4 QOS PARAMETER-METHOD GRID

The following tables summarize the feasibility of each test method against each QoS parameter when measured by the HPMN or the VPMN. The objective of the table is to identify whether a network acting as HPMN or as VPMN is able to measure a parameter. Parameters are measured independently (that is there is no coordination needed between the 2 roaming partners) and results are aggregated over the agreed monitoring period. Drive Testing and Monitoring was not evaluated for this version. Each GRQ test is referenced by a GRQ Test Code. For example, 21BH refers to test parameter 21 (Service Accessibility SMS MO) measured by the HPMN using the SS7 Monitoring method.

4.1

Circuit Switched
Monitoring by Roaming Hubbing Provider (R) Methods: End-to-end Active Testing and Monitoring A N Not applicable N Not applicable N Not applicable N Not applicable N Not applicable N Not applicable N SS7 Monitoring B CAMEL Monitoring (CS11) C N Not applicable N Not applicable Y (CS10) Monitoring by HPMN (H) End-to-end Active Testing and Monitoring A SS7 Monitoring B CAMEL Monitoring C N Not applicable N Not applicable Y (CS10) Monitoring by VPMN (V) End-to-end Active Testing and Monitoring A SS7 Monitoring B

CA Moni

Qos Parameter Circuit Switched LU Success Rate (CS LU SR) Circuit Switched Location Update Delay Service Accessibility Telephony MO (SAT-MO) Service Accessibility Telephony MT (SA-T-MT) Setup Time Telephony MO (ST-T-MO) Setup Time Telephony MO (ST-T-MT) Call Setup Success

GRQ Test Code 1

Y (CS2)

Y (CS2)

Y (CS3) N Not applicable N Not applicable N Not applicable N Not applicable N

Y (CS1)

Y (CS3)

Y (CS1)

N. Not applic N Not applic

N (CS4)

Y (CS

4 5 6 7

N Y (CS10) N Y (CS10)

Y Y Y Y

Y N (CS5) Y N (CS5)

Y Y (CS10) Y (CS11) Y

Y Y Y Y

Y Y Y Y (CS6)

Y (CS

Y (CS

Y (CS

Y (CS

V3.0

Page 12 of 46

GSM Association Official Document IR.81

Non Confidential

Ratio (CSSR MO) Call Setup Success Ratio (CSSR MT) ISUP signalling transparency (REL) ISUPv2 signalling transparency (OCN and RDN) Call Completion Rate Circuit Switched Telephony (CCR-CST) Average Length of a Call (ALOC) CLI Transparency Speech Quality (SpQ)

Not applicable N Not applicable N Not applicable

Not applicable N Not applicable N Not applicable N Y N Y (CS20) N N Y (CS12) Y Y (CS12, CS19) N Not applicable N Not applicable N (CS5) Y Y Y N (CS7) Y (CS12) Y (CS20) N (CS15) Y (CS6) Y (CS11) Y Y Y

N (CS18 0)

10

N Not applicable N Not applicable

N Not applicable N Not applicable

N (CS8)

Y.(CS10),(CS1 3)

N (CS16)

N (CS CS20

11

Y (CS

12 13 14

N Not applicable N Not applicable N Not applicable

N Not applicable N Not applicable N Not applicable

N Y Y

N (CS4) N (CS4) N (CS9)

Y Y (CS10, CS13) N (CS14)

N Y Y

Y N (CS17) N (CS11)

Y (CS

N (CS

N (CS

Remarks: (CS1) The measurement might vary depending on the handset integrated in the active probe. (CS2) It is assumed that the Location Update (LU) success rate is visible in the MAP signalling and can be monitored. In other words, it is assumed that the data-fill of the VLR is correct. The failures only happen at the HLR level and Steering of Roaming (SoR)-induced errors are filtered out. (CS3) Only for successful LUs and the measured duration is not the same as in VPMN (CS4) HPMN does not know when a call fails. (CS5) HPMN does not know when a call starts. (CS6) It is assumed that there is no cross talk. (CS7) HPMN cannot know which kind of release has been used. (CS8) HPMN cannot know which network was used for the call forwarding. (CS9) The method is non-intrusive. (CS10) It is assumed CAMEL works properly and the appropriate CAMEL capabilities are implemented/available.

V3.0

Page 13 of 46

GSM Association Official Document IR.81

Non Confidential

(CS11) Always in combination with a SS7 monitoring system (CS12) It is assumed the correct CAMEL parameters have been loaded for this call (that is BCSM Event Reports are in use). (CS13) Only in case of Home Routing. (CS14) CAMEL cannot measure voice quality. (CS15) The VPMN cannot know which release the B-party receives (CS16) The VPMN cannot know the OCN and RDN at the end of the call. (CS17) The VPMN cannot know the CLI of the B-Party (CS18) The SCP is at the HPMN side (CS19) Need to take into account the customer profile. Best to use only if HPMN customers are all CAMEL enabled. (CS20) The measurements are done on an interface (Um/Uu) or a protocol field (CAMEL), which is directly linked to what is observed on the ISUP interface.

4.2

SMS
Monitoring by Roaming Hubbing Provider (R) Methods: End-toend Active Testing and Monitorin g A N Not applicabl e N Not applicabl e N Not applicabl e Monitoring by HPMN (H) Monitoring by VPMN (V)

SS7 Monitorin g

CAMEL Monitorin g

End-to-end Active Testing and Monitoring

SS7 Monitoring

CAMEL Monitoring

End-to-end Active Testing and Monitoring

SS7 Monitoring

Qos Parameter Service Accessibility SMS MO (SA SMS MO) Service Accessibility SMS MT (SA SMS MT)

GRQ Test Code 21

N(SM1) N (SM1)

N (SM1) N (SM1)

N (SM1)

Y (S

22

Y (SM3)

N (SM1)

N (S

Access Delay SMS MO (AD SMS-MO)

23

N (SM2)

N (SM2)

Y (S

V3.0

Page 14 of 46

GSM Association Official Document IR.81

Non Confidential

Access Delay SMS MT (AD SMS-MT)

24

End-to-End Delivery Time for SMS-MO

25

End-to-End Delivery Time for SMS-MT

26

N Not applicabl e N Not applicabl e N Not applicabl e

N (SM1)

N (SM1)

Y (SM3)

N (SM1)

N (S

N (SM4)

Y (SM5)

Y (SM5)

Y (SM3)

N (SM4)

N (S

N (SM7)

Y (SM6)

Y (SM6)

Y (SM3)

N (SM7)

N (S

Remarks: (SM1) Failed attempts will be missing (SM2) Actual Start time will be missing (SM3) Measurement may be based on standard SS7 procedure (MAP) (SM4) There is no knowledge beforehand to identify where the receiving side stands. (SM5) SM-MO from a roamer in a VPMN to a subscriber in the HPMN. Note a delivery time can only measure for complete and successful transactions. (SM6) SM-MT from a subscriber in the HPMN to the a roamer in the VPMN (SM7) There is no knowledge to identify when the message is sent from the HPMN.

4.3

Packet Switched

The HPMN decides which APNs are used for monitoring. For example, if there are 3 APNs for WEB, WAP and MMS, and they are specified in the IR.21, these may be used for measuring QoS for data. They may be specified in the GPRS information - List of APNs available for testing and troubleshooting section.

Monitoring by Roaming Hubbing Provider (R) Methods: End-toend SS7 Monitorin CAMEL Monitorin

Monitoring by HPMN (H) End-to-end Active Testing and CAMEL Monitoring End-to-end Active Testing and Monitoring

Monitoring by VPMN (V)

SS7 Monitoring

SS7 Monitoring

V3.0

Page 15 of 46

GSM Association Official Document IR.81

Non Confidential

Active Testing and Monitorin g GRQ Test Code 31 A

g (PS13)

Monitoring

Qos Parameter Packet Switched LU Success Rate (PS LU SR) Packet Switched Location Update Delay (PS LU D) Service accessibility for PSD (PDP-context activation success rate) Set-up Delay (ST PSD) PDP Context Cut-Off Ratio Average PDP Context Session Time (per APN) Throughput (Kbits/sec) Goodput (Kbits/sec) Roundtrip time Packet loss

N/A

Y (PS2)

N/A

Y (PS2) Y

N/A

Y (PS2)

32

N/A

N/A

Y (PS1)

N/A

Y (PS1)

33

N/A

N/A

Y (PS8)

Y (PS3)

Y (PS8)

34 35 36 37 38 39 40

N/A N/A N/A N/A N/A N/A N/A

N/A N/A N/A N/A N/A N/A N/A

Y Y Y Y (PS9, PS15) N (PS10) N (PS11) N (PS12)

Y Y N Y (PS6, PS14) Y (PS6, PS14) Y (PS6, PS14) Y (PS6, PS14)

Y (PS4) N (PS5) Y Y (PS15) Y (PS15) Y (PS7, PS15) Y (PS7, PS15))

Y Y Y Y (PS9, PS15) N (PS10) N (PS11) N (PS12)

Y Y N Y (PS14) Y (PS14) Y (PS14) Y (PS14)

Y N (PS5) Y Y (PS15) Y (PS15) Y (PS7, PS15) Y (PS7, PS15)

Y Y Y Y

N N N

Remarks: (PS1) The measurement might vary depending on the handset integrated in the active probe. (PS2) It is assumed that the LU success rate is visible in the MAP signalling and can be monitored. In other words, it is assumed that the datafill of the VLR is correct. The failures only happen at the HLR level and SoR-induced errors are filtered out.

V3.0

Page 16 of 46

GSM Association Official Document IR.81

Non Confidential

(PS3) If successful activation or failed in the Gateway GPRS Support Node (GGSN) level (PS4) The time measurements will not be the same as in the VPMN. (PS5) No release cause provided in the MAP_DELETE_PDP_CONTEXT. (PS6) In order to limit the influence of the "internet" - not in control of the roaming partners - on the bearer-level measurements, it is recommended files/webpages accessed to measure the parameters are stored in a HPMN equipment. (PS7) Can be estimated at IP level (Gp interface). (PS8) Requires CAMEL ph3 GPRS-CSI. (PS9) Requires the CAMEL request (Charging Information). (PS10) Only the number of bytes sent and received are available no distinction for retransmission. (PS11) Only the number of bytes sent and received are available and some timestamps. Not the roundtrip time. (PS12) The packets loss information is not transmitted in the CAMEL information. The CAMEL application may receive information about the volume transferred, but it does not know what the expected size of the transfer is. Therefore it cannot estimate the lost packets. (PS13) In combination with SS7 methods. (PS14) To make it relevant and cost effective, the default value proposed for exchanged files in the case of active is 100KB. (PS15) Similarly, it proposed to track session for which minimum size is greater or equal to 100KB.

V3.0

Page 17 of 46

GSM Association Official Document IR.81

Non Confidential

5 TEST METHODOLOGY
This section details the methodology for each of the monitoring methods included in the GRQ Framework, and describes the general and specific conditions for all tests methods. Each GRQ test is referenced by a GRQ Test Code. For example, 21BH refers to test parameter 21 (Service Accessibility SMS MO) measured by the HPMN using the SS7 Monitoring method.

5.1
5.1.1

End-To-End Active Testing and Monitoring

General Information

When to measure: Minimum six (6) tests per day. Recommended: one (1) test every two (2) hours from 8am to 8pm, one (1) test every four (4) hours from 8pm to 8am. Where to measure: If Roaming Partner decides to publish its network topology, it is preferred that a limited number of test probes are spread across various representative VPMN MSC areas. Radio level recommended: RX Level > -80dbm. However for some test cases, a RX Level > -70dbm is recommended in order to avoid any roaming issue reporting, while the service is only affected by only transient conditions (meteorological circumstances and so on) Known Limitations The testing is only performed at a limited number of locations. The measurement is limited in terms of number of geographic locations in the network that can be tested. This limitation has less influence when there are limited International Gateways used. In case the PMN uses different core network vendors (MSC, Serving GPRS Support Node (SGSN),and so on) and decides to publish it, it would be ideal to test the QoS delivery for each network elements. It results it is recommended the active probe vendor to install one (1) probe per MSC, SGSN vendor region. However, this requirement might be difficult to achieve as the use of different vendors and the associated coverage is not public information to active probe vendors. Furthermore it may lead to inefficient allocation of cost for installing probes. Example: in a country with three (3) operators, each having two (2) vendors, it might lead to the deployment up to four (4) probes in the worst case scenario. GRQ Monitoring Pre-requisites Steering of Roaming could influence some results: the cards used for testing will not be subject to steering (Blacklisting at the HPMN) The receiving party is ready to receive SMS (no user errors like memory full, bad coverage, and so on) For GPRS data transfer performance, the operator has to provide a file located in its GPRS network which can be transferred for the test. This file will be preferably on the GGSN in order to reduce the risk of packet loss independent of the roaming between the operators.

Page 18 of 46

GSM Association Official Document IR.81

Non Confidential

5.1.2
GRQ Test Code 1AH

Test Procedures
Parameter How to Measure CIRCUIT-SWITCHED Force a location update via the modem, if there is steering the end result has to be the last location update of maximum five (5) attempts. Force a location update via the modem, if there is steering the end result has to be the last location update of maximum 5 attempts. Force a location update via the modem, if there is steering the delay of the last location update has to be taken onto account. It is important that before starting the simcards is registered on a different LAC in order to have a full location update. Force a location update via the modem, if there is steering the delay of the last location update has to be taken onto account. It is important that before starting the simcards is registered on a different LAC in order to have a full location update. Generate a call with from the probe located in the VPMN to a simcard from the probe located in the HPMN. The test is successful if the probe on the VPMN detects a ringing signal for the call he has generated. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. The test is successful if the probe on the VPMN detects a ringing signal for the call he has generated. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. The test is successful if the probe on the HPMN detects a ringing signal for the call he has generated. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. The test is successful if the probe on the HPMN detects a ringing signal for the call he has generated. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. The delay is the time between the point where the call has been confirmed and the ringing has been detected on the VPMN. Generate a call with a simcard from Test Specifics

LU update success rate

1AV

LU update success rate

2AH

LU delay

2AV

LU delay

3AH

NER-MO (Network Effectiveness Ratio on Mobile Originated calls in the visited network)

3AV

NER-MO (Network Effectiveness Ratio on Mobile Originated calls in the visited network)

4AH

NER-MT (Network Effectiveness Ratio on Mobile Terminated calls in the visited network)

4AV

NER-MT (Network Effectiveness Ratio on Mobile Terminated calls in the visited network)

5AH

PDD-MO (Post Dialling Delay)

5AV

PDD-MO (Post Dialling

Page 19 of 46

GSM Association Official Document IR.81 GRQ Test Code Delay)

Non Confidential

Parameter

How to Measure the probe located in the VPMN to a simcard from the probe located in the HPMN. The delay is the time between the point where the call has been confirmed and the ringing has been detected on the VPMN. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. The delay is the time between the point where the call has been confirmed and the ringing has been detected on the HPMN. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. The delay is the time between the point where the call has been confirmed and the ringing has been detected on the HPMN. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. The test is successful if the probe on the HPMN detects the ringing and picked up the call. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. The test is successful if the probe on the HPMN detects the ringing and picked up the call. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. The test is successful if the probe on the VPMN detects the ringing and picked up the call. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. The test is successful if the probe on the VPMN detects the ringing and picked up the call. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. At the end of the call, check if the release code is the same on both sides. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. At the end of the call, check if the release code is the same on both sides.

Test Specifics

6AH

PDD-MT (Post Dialling Delay)

6AV

PDD-MT (Post Dialling Delay)

7AH

CSSR-MO (Call Setup Success Ratio on Mobile Originated calls in the visited network)

7AV

CSSR-MO (Call Setup Success Ratio on Mobile Originated calls in the visited network)

8AH

CSSR-MT (Call Setup Success Ratio on Mobile Terminated calls in the visited network)

8AV

CSSR-MT (Call Setup Success Ratio on Mobile Terminated calls in the visited network)

9AH

REL (ISUPv2 signalling transparency)

9AV

REL (ISUPv2 signalling transparency)

Page 20 of 46

GSM Association Official Document IR.81 GRQ Test Code 10AH

Non Confidential

Parameter OCN and RDN (ISUPv2 signalling transparency)

How to Measure Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. Forward this call to the HPMN and check if the OCN and RDN is correct. Generate a call with a simcard from the probe located in the HPMN to a simcard from the probe located in the VPMN. Forward this call to the HPMN and check if the OCN and RDN is correct. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. Answer the calls and after a time hang up the call again. If the call has not been interrupted, the call is successful. Recommended duration: 2 minutes. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. Answer the calls and after a time hang up the call again. If the call has not been interrupted, the call is successful. Recommended duration: 2 minutes. N/A N/A Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. Check at the HPMN if the CLI is in a dialable format to call back the A-party Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN. Check at the HPMN if the CLI is in a dialable format to call back the A-party Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN and answer the call. Uplink voice quality:play a standard file in the VPMN and record this file in the HPMN and calculate the voice quality. Downlink voice quality: play a standard file in the HPMN and record this file in the VPMN and calculate the voice quality. Recommended duration: 2 minutes. If the sample is played/analyzed multiple times, the end-result of the test is the average of

Test Specifics

10AV

OCN and RDN (ISUPv2 signalling transparency)

11AH

CCR (Call Completion Rate Circuit )

Reasonable radio level required: RxLev > -70dbm.

11AV

CCR (Call Completion Rate Circuit )

Reasonable radio level required: RxLev > -70dbm.

12AH 12AV 13AH

ALOC ALOC CLI transparency

13AV

CLI transparency

14AH

SpQ (Speech Quality)

Reasonable radio level required: RxLev > -70dbm.

Page 21 of 46

GSM Association Official Document IR.81 GRQ Test Code

Non Confidential

Parameter

How to Measure the individual voice quality assessments. If the sample is played/analyzed multiple times, the end-result of the test is the average of the individual voice quality assessments. Generate a call with a simcard from the probe located in the VPMN to a simcard from the probe located in the HPMN and answer the call. Uplink voice quality:play a standard file in the VPMN and record this file in the HPMN and calculate the voice quality. Downlink voice quality: play a standard file in the HPMN and record this file in the VPMN and calculate the voice quality.Recommended duration: 2 minutes. If the sample is played/analyzed multiple times, the end-result of the test is the average of the individual voice quality assessments. SMS Send and SMS from a subscriber from the HPMN located on the VPLMN to a subscriber from the HPMN located in the HPMN using the HPMN SMSC, if the positive acknowledgement of the SMSC is received the tests is OK. Send and SMS from a subscriber from the HPMN located on the VPLMN to a subscriber from the HPMN located in the HPMN using the HPMN SMSC, if the positive acknowledgement of the SMSC is received the tests is OK. Send and SMS from a subscriber from the HPMN located on the HPMN to a subscriber from the HPMN located in the VPLMN using the HPMN SMSC, if the SMS is received the test is OK. Send and SMS from a subscriber from the HPMN located on the HPMN to a subscriber from the HPMN located in the VPLMN using the HPMN SMSC, if the SMS is received the test is OK. Send and SMS from a subscriber from the HPMN located on the VPLMN to a subscriber from the HPMN located in the HPMN using the HPMN SMSC. Measure the time between sending the SMS and receiving the notification from the SMSC that the message has been sent. Send and SMS from a subscriber from the HPMN located on the VPLMN to a subscriber from the HPMN located in

Test Specifics

14AV

SpQ (Speech Quality)

Reasonable radio level required: RxLev > -70dbm.

21AH

Service Accessibility SMS MO (SA SMS MO)

21AV

Service Accessibility SMS MO (SA SMS MO)

22AH

Service Accessibility SMS MT (SA SMS MT)

Reasonable radio level required: RxLev > -70dbm.

22AV

Service Accessibility SMS MT (SA SMS MT)

Reasonable radio level required: RxLev > -70dbm.

23AH

Access Delay SMS MO (AD SMS-MO)

23AV

Access Delay SMS MO (AD SMS-MO)

Page 22 of 46

GSM Association Official Document IR.81 GRQ Test Code

Non Confidential

Parameter

How to Measure the HPMN using the HPMN SMSC. Measure the time between sending the SMS and receiving the notification from the SMSC that the message has been sent. Send and SMS from a subscriber from the HPMN located on the HPMN to a subscriber from the HPMN located in the VPLMN using the HPMN SMSC. Measure the time between the notification from the SMSC that the message has been sent and the notification on the B-party that the message has arrived. Send and SMS from a subscriber from the HPMN located on the HPMN to a subscriber from the HPMN located in the VPLMN using the HPMN SMSC. Measure the time between the notification from the SMSC that the message has been sent and the notification on the B-party that the message has arrived. Send and SMS from a subscriber from the HPMN located on the VPLMN to a subscriber from the HPMN located in the HPMN using the HPMN SMSC. Measure the time between sending the SMS and receiving the notification on the B-party that the message has arrived. Send and SMS from a subscriber from the HPMN located on the VPLMN to a subscriber from the HPMN located in the HPMN using the HPMN SMSC. Measure the time between sending the SMS and receiving the notification on the B-party that the message has arrived. Send and SMS from a subscriber from the HPMN located on the HPMN to a subscriber from the HPMN located in the VPLMN using the HPMN SMSC. Measure the time between sending the SMS and receiving the notification on the B-party that the message has arrived. Send and SMS from a subscriber from the HPMN located on the HPMN to a subscriber from the HPMN located in the VPLMN using the HPMN SMSC. Measure the time between sending the SMS and receiving the notification on the B-party that the message has arrived. PACKET-SWITCHED

Test Specifics

24AH

Access Delay SMS MT (AD SMS-MT)

Reasonable radio level required: RxLev > -70dbm.

24AV

Access Delay SMS MT (AD SMS-MT)

Reasonable radio level required: RxLev > -70dbm.

25AH

End-to-End Delivery Time for SMS-MO

Reasonable radio level required: RxLev > -70dbm.

25AV

End-to-End Delivery Time for SMS-MO

Reasonable radio level required: RxLev > -70dbm.

26AH

End-to-End Delivery Time for SMS-MT

Reasonable radio level required: RxLev > -70dbm.

26AV

End-to-End Delivery Time for SMS-MT

Reasonable radio level required: RxLev > -70dbm.

Page 23 of 46

GSM Association Official Document IR.81 GRQ Test Code 31AH

Non Confidential

Parameter Packet Switched LU Success Rate (PS LU SR) Packet Switched LU Success Rate (PS LU SR) Packet Switched Location Update Delay (PS LU D)

How to Measure Start manually a GPRS attach on the VPLMN, after the GSM location has been performed. If the GPRS attached is confirmed, the test is OK. Start manually a GPRS attach on the VPLMN, after the GSM location has been performed. If the GPRS attached is confirmed, the test is OK. Start manually a GPRS attach on the VPLMN, after the GSM location has been performed. Measure the time between start and end of the GPRS attach. Start manually a GPRS attach on the VPLMN, after the GSM location has been performed. Measure the time between start and end of the GPRS attach. Start the PDP context activation after the GPRS attach on the VPLMN. If the PDP context has been confirmed, the test is successful Start the PDP context activation after the GPRS attach on the VPLMN. If the PDP context has been confirmed, the test is successful Start the PDP context activation after the GPRS attach on the VPLMN. Measure the time between the start and the acknowledgement of the PDP context activation. Start the PDP context activation after the GPRS attach on the VPLMN. Measure the time between the start and the acknowledgement of the PDP context activation. Start a PDP context, keep it open during a certain time and close it again. If the session is still open the test is OK. Start a PDP context, keep it open during a certain time and close it again. If the session is still open the test is OK. N/A N/A Start downloading a reference file and measure the time from the start of the download till the end of file detection. Start downloading a reference file and measure the time from the start of the download till the end of file detection.

Test Specifics

31AV

32AH

32AV

Packet Switched Location Update Delay (PS LU D)

33AH

Service accessibility for PSD (PDP-context activation success rate) Service accessibility for PSD (PDP-context activation success rate) Set-up Delay (ST PSD)

33AV

34AH

34AV

Set-up Delay (ST PSD)

35AH

35AV

36AH 36AV 37AH

PDP Context Cut-Off Ratio (session Stability measured at PDP context or PS level) PDP Context Cut-Off Ratio (session Stability measured at PDP context or PS level) Average PDP Context Session Time (per APN) Average PDP Context Session Time (per APN) Throughput (Kbits/sec)

Reasonable radio level required: RxLev > -70dbm.

Reasonable radio level required: RxLev > -70dbm.

Reasonable radio level required: RxLev > -70dbm. Reasonable radio level required: RxLev > -70dbm.

37AV

Throughput (Kbits/sec)

Page 24 of 46

GSM Association Official Document IR.81 GRQ Test Code 38AH

Non Confidential

Parameter Goodput (Kbits/sec)

How to Measure Start downloading a reference file and measure the time from the start of the download till the end of file detection and count the used bytes Start downloading a reference file and measure the time from the start of the download till the end of file detection and count the used bytes Measure the time between sending and a TCP packet and receiving the acknowledgement of the pack. Measure the time between sending and a TCP packet and receiving the acknowledgement of the pack. Count the TCP packets sent and count the TCP packets received for a file transfer. Count the TCP packets sent and count the TCP packets received for a file transfer.

Test Specifics Reasonable radio level required: RxLev > -70dbm.

38AV

Goodput (Kbits/sec)

Reasonable radio level required: RxLev > -70dbm.

39AH

Roundtrip time

39AV

Roundtrip time

40AH

Packet loss

Reasonable radio level required: RxLev > -70dbm. Reasonable radio level required: RxLev > -70dbm.

40AV

Packet loss

Page 25 of 46

GSM Association Official Document IR.81

Non Confidential

5.2
5.2.1

Passive Monitoring
General Information

When to measure:
The measurement is made continuously that is as soon as live traffic generates relevant data. The KPI calculated over a daily time window and is aggregated for the Month. Example Day 1 KPI = 90%, Day 2 KPI = 95% and so on Day 3 KPI = 88% GRQ KPI is the average of the daily KPI. A daily measurement is considered as valid if there is at least one (1) measure every four (4) hours (6/day or 180/Month) or according to a mutual agreement between the HPMN and VPMN.

Where to measure: The passive monitoring occurs on the international links (SS7 links, voice interconnect links and IP/Gp links). It is recommended operators to agree on the I International Mobile Subscriber Identity/ Mobile Subscriber ISDN Number (MSI/MSISDN) being used by the active probes in order that the same IMSI/MSISDN is being used between roaming partner using passive probes. If one operator uses active probes and the other Operating Company (OpCo) uses passive probes, the MSISDN needs to be agreed in order to be able to compare the results. Between passive probes address ranges they have to monitor: Country Code/ national destination code (CC/NDC) ranges, Mobile Station Roaming Number (MSRN) Ranges, IP Ranges of GPRS Nodes. Known Limitations: The measurements are done on live traffic. Therefore it can only bring information on node where the roaming service is correctly configured. Typically, Radio failure or Network configuration failure cannot be monitored by SS7 Monitoring alone. Additionally, as it is linked to the actual usage on the network, the values observed may be vary from one operator under observation to another due to various normal conditions: the prepaid/postpaid market share may have an impact on the Qos linked to chargeable events as credit exhaustion will prevent or stop the service abruptly. It may also influence the behaviour of the roamers (calls without answer (old-fashioned 2 rings and call me back), SMS oriented, and so on) the country may have an influence - numbering plan may be "closed" (known finite numbers of digits) or open. In the case of open numbering plans, the switch has to go through a wait period before deciding to connect the call the service provided to users (for example do the subscriber have a Voice Mail? The absence/presence of such service may the observed ASR (a Voice Mail system is supposed to always answer a call that is forwarded to it). GRQ Monitoring Pre-requisites Steering of Roaming could influence some results. Actually, the error messages generated by SoR system will be filtered out: the HPMN operator must provide information about its SoR configuration for enabling the parties to exclude the effect of the SoR on the measurements.

Page 26 of 46

GSM Association Official Document IR.81

Non Confidential

Filter out error that are non roaming related or do not affect the roaming service: MAP version fallback, User Error (Roaming Not Allowed),and so on In the case the operators want to compare throughput/goodput across technologies (that is GPRS, EDGE, UMTS, HSDPA,and so on) the operators have, for the time being to identify the technology based on the involved core network element (SGSN). While the technology is not explicitly identified in the protocol, the node origin address may help operator distinguish 2G / 3G elements, if the VPMN use non-hybrid core network elements (2G-3G nodes). It is noted that 3GPP TS 29.060 V6.18.0 (2007-09) specifies a new information element called RAT Type (radio access technology) that the SGSN may include in the signalling (it is an optional parameter) for facilitating the future measurements and their comparison. However, such release version is not implemented by SGSN vendors at the time of writing this document. 5.2.2
GRQ Test Code 1BH

Test Information
Parameter How to Measure VOICE Measure MAP Update Location procedure. Can be measured on SCCP and TCAP level. Measure MAP Update Location procedure. Can be measured on SCCP and TCAP level. Measure MAP Update Location procedure. Can be measured on SCCP and TCAP level. Measure the time between the MAP UL request until the MAP UL ACK Measure the time between the MAP UL request until the MAP UL ACK Measure the time between the MAP UL request until the MAP UL ACK Test Specifics

LU update success rate

1BV

LU update success rate

1BR

LU update success rate

2BH 2BV 2BR 3BH

LU delay LU delay LU delay NER-MO (Network Effectiveness Ratio on Mobile Originated calls in the visited network) NER-MO (Network Effectiveness Ratio on Mobile Originated calls in the visited network) NER-MT (Network Effectiveness Ratio on Mobile Terminated calls in the visited network) NER-MT (Network Effectiveness Ratio on Mobile Terminated calls in the visited network) PDD-MO (Post Dialling Delay) PDD-MO (Post Dialling Delay)

Only applicable for successful transaction Only applicable for successful transaction Only applicable for successful transaction

N/A

3BV

4BH

4BV

Measure ratio between successful calls (reception of ISUP ACM) and attempts (ISUP IAM) Measure ratio between successful calls (reception of ISUP ACM for calls towards MSRN) and attempts (MAP PRN with MSRN) Measure ratio between successful calls (reception of ISUP ACM for call towards MSRN) and attempts MAP PRN with MSRN) N/A

5BH 5BV

6BH

PDD-MT (Post Dialling

Measure Time between reception of ISUP ACM and attempts (ISUP IAM) Measure time between successful calls

Home network has no visibility on Voice Call without CAMEL For RP applying MNP, additional info to be extracted (IMSI/MSISDN in the loc.up) for assuring measurement on the roaming partner The success of an MT depends on the combined success of MAP PRN operation and ISUP towards MSRN The success of an MT depends on the combined success of MAP PRN operation and ISUP towards MSRN Home network has no visibility on Voice Call without CAMEL For RP applying MNP, additional info to be extracted (IMSI/MSISDN in the loc.up) for assuring measurement on the roaming partner

Page 27 of 46

GSM Association Official Document IR.81

GRQ Test Code Delay) 6BV PDD-MT (Post Dialling Delay) CSSR-MO (Call Setup Succes Ratio on Mobile Originated calls in the visited network) CSSR-MO (Call Setup Succes Ratio on Mobile Originated calls in the visited network)

Non Confidential

Parameter

How to Measure (reception of ISUP ACM) and MT procedure start (MAP PRN with MSRN) Measure time between successful calls (reception of ISUP ACM) and MT procedure start (MAP PRN with MSRN)

Test Specifics

7BH

N/A

7BV

8BH

8BV

9BH 9BV 10BH 10BV

CSSR-MT (Call Setup Success Ratio on Mobile Terminated calls in the visited network) CSSR-MT (Call Setup Success Ratio on Mobile Terminated calls in the visited network) REL (ISUPv2 signalling transparency) REL (ISUPv2 signalling transparency) OCN and RDN (ISUPv2 signalling transparency) OCN and RDN (ISUPv2 signalling transparency) CCR (Call Completion Rate Circuit ) CCR (Call Completion Rate Circuit )

Measure ratio between successful calls (reception of ISUP ANM) and attempts (ISUP IAM) Measure ratio between successful calls (reception of ISUP ANM for call towards MSRN and attempts (MAP PRN with MSRN) Measure ratio between successful calls (reception of ISUP ANM for call towards MSRN) and attempts (MAP PRN with MSRN) N/A N/A N/A

N/A 11BH 11BV N/A Measure ratio between successfully released calls (reception of ISUP RLC) of dropped calls and answered (ISUP ANM). A drop call definition based on the release call that is if call is released because of network specific errors, then it will be counted as call dropped. For example if REL cause code is one of (NO_ROUTE_TO_SPECIFIED_TRANSIT _NETWORK = 2, NO_ROUTE_TO_DESTINATION = 3, CHANNEL_UNACCEPTABLE = 6, EXCHANGE_ROUTING_ERROR = 25, DESTINATION OUT OF ORDER = 27, NETWORK_OUT_OF_ORDER = 38, TEMPORARY_FAILURE = 41, RECOVERY_ON_TIMER_EXPIRY = 102), then count the call as Call Dropped. 12BH 12BV ALOC ALOC N/A Measure Time between reception of call answer ISUP ANM and call release (ISUP

Home network has no visibility on Voice Call without CAMEL For RP applying MNP, additional info to be extracted (IMSI/MSISDN in the loc.up) for assuring measurement on the roaming partner. Takes into account destination behaviour (user busy, presence of VM, and so on) risk of result bias The success of an MT depends on the combined success of MAP PRN operation and ISUP towards MSRN The success of an MT depends on the combined success of MAP PRN operation and ISUP towards MSRN Home network has no visibility on Voice Call without CAMEL Visited network has no visibility on the actual release cause Home network has no visibility on Voice Call without CAMEL Home network has no visibility on RDN/OCN transparency at destination side Home network has no visibility on Voice Call without CAMEL

For RP applying MNP, additional info to be extracted (IMSI/MSISDN in the loc.up) for assuring measurement on the roaming partner Home network has no visibility on Voice Call without CAMEL For RP applying MNP, additional info to be extracted

Page 28 of 46

GSM Association Official Document IR.81

GRQ Test Code

Non Confidential

Parameter REL)

How to Measure

Test Specifics (IMSI/MSISDN in the loc.up) for assuring measurement on the roaming partner Home network has no visibility on Voice Call without CAMEL Home network has no visibility on CLI transparency at destination side SS7 monitoring is non intrusive. It only monitors signalling message. SS7 monitoring is non intrusive. It only monitors signalling message.

13BH 13BV

CLI transparency N/A CLI transparency N/A

14BH

SpQ (Speech Quality) N/A

14BV

SpQ (Speech Quality) N/A SMS

21BH 21BV 21BR 22BH 22BV 23BH 23BV 23BR 24BH 24BV 25BH

Service Accessibility SMS MO (SA SMS MO) Service Accessibility SMS MO (SA SMS MO) Service Accessibility SMS MO (SA SMS MO) Service Accessibility SMS MT (SA SMS MT) Service Accessibility SMS MT (SA SMS MT) Access Delay SMS MO (AD SMS-MO) Access Delay SMS MO (AD SMS-MO) Access Delay SMS MO (AD SMS-MO) Access Delay SMS MT (AD SMS-MT) Access Delay SMS MT (AD SMS-MT) End-to-End Delivery Time for SMS-MO

N/A Measure ratio between successful SMSSUBMIT and attempts Measure ratio between successful SMSSUBMIT and attempts Measure ratio between successful SMSDELIVER and attempts N/A N/A Measure time between SMS-SUBMIT and acknowledgement Measure time between SMS-SUBMIT and acknowledgement Measure time between successful SMSDELIVER and acknowledgement N/A Measure time stamp between MAP-FWDSM (SMS-Submit) operation and MAPFWD-SM (SMS-Deliver) operation acknowledgement N/A Measure time stamp between MAP-FWDSM (SMS-Submit) operation and MAPFWD-SM (SMS-Deliver) operation acknowledgement N/A PACKET-SWITCHED Measure MAP GPRS Update Location procedure. Can be measure on SCCP and TCAP level. Measure MAP GPRS Update Location procedure. Can be measure on SCCP and TCAP level. Measure MAP GPRS Update Location procedure. Can be measure on SCCP and TCAP level. Measure the time between the MAP UL request until the MAP UL ACK Measure the time between the MAP UL request until the MAP UL ACK Measure the time between the MAP UL

25BV 26BH

End-to-End Delivery Time for SMS-MO End-to-End Delivery Time for SMS-MT

26BV

End-to-End Delivery Time for SMS-MT Packet Switched LU Success Rate (PS LU SR) Packet Switched LU Success Rate (PS LU SR) Packet Switched LU Success Rate (PS LU SR) Packet Switched Location Update Delay (PS LU D) Packet Switched Location Update Delay (PS LU D) Packet Switched Location

31BH

31BV

31BR

32BH 32BV 32BR

Page 29 of 46

GSM Association Official Document IR.81

GRQ Test Code 33BH

Non Confidential

Parameter Update Delay (PS LU D) Service accessibility for PSD (PDP-context activation success rate) Service accessibility for PSD (PDP-context activation success rate) Set-up Delay (ST PSD)

How to Measure request until the MAP UL ACK Measure ratio between successful MAP_PDP_Context Activation and attempts Measure ratio between successful MAP_PDP_Context Activation and attempts Measure timing between successful MAP_PDP_Context Activation Request and Response Measure timing between successful MAP_PDP_Context Activation Request and Response

Test Specifics

33BV

34BH

34BV

Set-up Delay (ST PSD)

35BH

35BV

36BH

PDP Context Cut-Off Ratio (session Stability measured at PDP context or PS level) PDP Context Cut-Off Ratio (session Stability measured at PDP context or PS level) Average PDP Context Session Time (per APN) Average PDP Context Session Time (per APN) Throughput (Kbits/sec) Throughput (Kbits/sec) Goodput (Kbits/sec)

N/A

36BV

37BH 37BV 38BH

38BV

Goodput (Kbits/sec)

39BH

Roundtrip time

39BV

Roundtrip time

40BH 40BV

Packet loss Packet loss

N/A Measure time between the MAP_PDP Activation and the MAP_PDP_Delete message Measure time between the MAP_PDP Activation and the MAP_PDP_Delete message Measure UDP Packet volume exchanged Measure UDP Packet volume exchanged Measure UDP Packet volume exchanged, corrected by filtering UDP containing TCP retransmission Measure UDP Packet volume exchanged, corrected by filtering UDP containing TCP retransmission Measure UDP roundtrip based on encapsulated TCP acknowledgement mechanisms Measure UDP roundtrip based on encapsulated TCP acknowledgement mechanisms Measure UDP Packet Loss based on TCP retransmission mechanisms Measure UDP Packet Loss based on TCP retransmission mechanisms

only application based on TCP

only application based on TCP

only application based on TCP

only application based on TCP only application based on TCP only application based on TCP

Page 30 of 46

GSM Association Official Document IR.81

Non Confidential

5.3
5.3.1

CAMEL Monitoring
General Information Although CAMEL Monitoring was not trialled by GRQ project Jan-Apr 2008, this method is similar to SS7 Monitoring. The general information below is for information only.

When to measure:
The measurement is made continuously that is as soon as live traffic generates relevant data. The KPI calculated over a daily time window and is aggregated for the Month. Example Day 1 KPI = 90%, Day 2 KPI = 95% and so on Day 3 KPI = 88% GRQ KPI is the average of the daily KPI. A daily measurement is considered as valid if there is at least 1 measure every 4 hours (6/day or 180/Month) or according to a mutual agreement between the HPMN and VPMN.

Where to measure: The passive monitoring occurs on the operators and Hubbing Providers international links (SS7 links, voice interconnect links and IP/Gp links). All parties have to agree on the address ranges they have to monitor CC/NDC ranges, MSRN Ranges, IP Ranges of GPRS Nodes. Known Limitations: The measurements are done on the live traffic. Therefore it brings information on node where the roaming service is correctly configured. Typically, Radio failure or Network configuration failure is not unambiguously detectable. CAMEL is activated per subscriber. Therefore the kind of subscriber having a CAMEL mark may influence results (Prepaid, VPN, Postpaid,and so on) GRQ Monitoring Pre-requisites Requires SS7 monitoring capabilities for most of the tests. Requires CAMEL support from the Operators and the Hubbing Providers 5.3.2 Test Information Test information will be appended at a later stage when this method has been tested against the GRQ Framework.

Page 31 of 46

GSM Association Official Document IR.81

Non Confidential

5.4
5.4.1

Call Flow
Location update

Bilateral case

MS

MSC/ VLR Update Location Req

(IMSI)

HLR

Old VLR LU01

Authentication Info Authentication Info ack Authentication Req Authentication ack Update Location Req
(IMSI)

LU02 LU03 LU04 LU05 LU06 Cancel Location Cancel Location ack LU07 LU08 LU09 LU10 LU11 LU12

Insert Sub Data Insert Sub Data ack Update Location ack Update Location ack

Roaming Hubbing Provider case (only GRQ monitoring relevant procedures)

MSC/VLR

Hub 1
Update Location Req

HL R

LU06

Update Location Req

LU06Hub
Update Location Ack

LU11Hub

Update Location Ack

LU11

LU06 and LU11 are for reference only

Page 32 of 46

GSM Association Official Document IR.81

Non Confidential

5.4.2
MS1

Voice call MO
MSC/VLR Carriers GMSC HLR MSC/VLR MS2

CC Setup CC Call proceeding ISUP IAM ISUP IAM MAP SRI req MAP PRN req MAP PRN ack MAP SRI ack ISUP IAM (MSRN) CC Setup CC Confirm CC Alerting ISUP ACM CC Alerting CC Connect ISUP ANM CC Connect

MOC01 MOC02 MOC03 MOC04 MOC05 MOC06 MOC07 MOC08 MOC09 MOC10 MOC11 MOC12 MOC13 MOC14 MOC15 MOC16 MOC17 MOC18

Voice call
CC Disconnect ISUP REL CC Release CC Release Complete ISUP RELC CC Release CC Release Complete

MOC19 MOC20 MOC21 MOC22 MOC23 MOC24

VPLMN

HPLMN

Note: Although some signalling may pass through the roaming Hubbing Provider the diagram only refers to the bilateral case.

Page 33 of 46

GSM Association Official Document IR.81

Non Confidential

5.4.3
MS1

Voice call MT
MSC/VLR HLR Carrier GMSC MSC/VLR MS2

CC Setup CC Call proceeding MAP SRI req MAP PRN req MAP PRN ack MAP SRI ack ISUP IAM (MSRN) ISUP IAM (MSRN) ISUP IAM (MSRN) CC Setup CC Confirm CC Alerting ISUP ACM CC Alerting CC Connect ISUP ANM CC Connect

MTC01 MTC02 MTC03 MTC04 MTC05 MTC06 MTC07 MTC08 MTC09 MTC10 MTC11 MTC12 MTC13 MTC14 MTC15 MTC16 MTC17 MTC18

Voice call
CC Disconnect ISUP REL CC Release CC Release Complete ISUP RELC CC Release CC Release Complete

MTC19 MTC20 MTC21 MTC22 MTC23 MTC24

HPLMN

VPLMN

Note: Although some signalling may pass trough the roaming Hubbing Provider the diagram only refers to the bilateral case

Page 34 of 46

GSM Association Official Document IR.81

Non Confidential

5.4.4

SMS

MS1

MSC/VLR Sender

SMSC

HLR

MSC/VLR Receiver

MS2

SM Submit MAP FSM (MO) MAP FSM (Ack) SM Ack MAP SRI for SM MAP SRI for SM ack MAP FSM SM Delivery SM Delivery Ack MAP FSM ack

SMS1 SMS2 SMS3 SMS4 SMS5 SMS6 SMS7 SMS8 SMS9

Page 35 of 46

GSM Association Official Document IR.81

Non Confidential

5.4.5

Packet Switched/GPRS

Bilateral case

MS1

SGSN

MSC/VLR

HLR

Old SGSN

GGSN

Radius

DHCP

GMM Attach request MAP Update location MAP Cancel Loc. MAP Cancel Loc. ack MAP Insert Subscriber Data
(APN)

GPRS01 GPRS02 GPRS03 GPRS04 GPRS05 GPRS06 GPRS07 GPRS08 GPRS09 GPRS10 GRPS11 GPRS12 Create PDP context request
(PAP, CHAP, PDP Request)

MAP Insert Subscriber Data ack MAP Update location ack Location update req. Location update Accept GMM Attach accept GMM Attach complete Activate PDP Context

GPRS13 Radius authentication request Radius authentication response DHCP Address Request DHCP Address Response GPRS14 GPRS15 GPRS16 GPRS17 GPRS18 GPRS19 GPRS20

Create PDP context response Activate PDP Context Accept

PPP session
Deactivate PDP Context Delete PDP context request Delete PDP context response Deactivate PDP Context Accept

GPRS21 GPRS22 GPRS23 GPRS24 GPRS25

Roaming Hubbing Provider Case (only relevant procedures)

SGSN

MSC/VLR

Hub

HLR
GPRS02

Update Location Req

Update Location Req

GPRS02Hub
Update Location Ack

GPRS07Hub

Update Location Ack

GPRS07

Page 36 of 46

GSM Association Official Document IR.81

Non Confidential

Page 37 of 46

GSM Association Official Document IR.81

Non Confidential

5.4.6

FTP

User

FTP Client

FTP Server

FTP Get command PORT (IP + portnumber) TCP Ack PORT (IP + portnumber) RETR (filename) TCP Ack FTP 150 (Opening Ascii mode)

FTP01 FTP02 FTP03 FTP04 FTP05 FTP06 FTP07 FTP08

FTP Data transfer

TCP Ack FTP 226 (Transfer complete) Transfer completed message TCP Ack

FTP09 FTP10 FTP11 FTP12 FTP13

Page 38 of 46

GSM Association Official Document IR.81

Non Confidential

5.4.7

Ping

User

Client

Server

Ping ICMP_Echo ICMP_Echo_Reply Statistics

Ping01 Ping02 Ping03 Ping04

Page 39 of 46

GSM Association Official Document IR.81

Non Confidential

5.5
Test 1BH

Trigger Table
Parameter LU update success rate Reference flow CIRCUIT-SWITCHED Location update Location update Location update Location update Location update Location update Voice call MO Start point LU1 (Active) LU6 (Passive) LU1 (Active) LU6 (Passive) LU6HUB LU1 (Active) LU6 (Passive) LU1 (Active) LU6 (Passive) LU6Hub End Point LU12 (Active) LU11(Passive) LU12 (Active) LU11(Passive) LU11Hub LU12 (Active) LU11(Passive) LU12 (Active) LU11(Passive) LU11Hub

1BV

LU update success rate

1BR 2BH

LU update success rate LU delay

2BV

LU delay

2BR

LU delay

3BH

NER-MO (Network Effectiveness Ratio on Mobile Originated calls in the visited network)

3BV

NER-MO (Network Effectiveness Ratio on Mobile Originated calls in the visited network)

Voice call MO

4BH

NER-MT (Network Effectiveness Ratio on Mobile Terminated calls in the visited network)

Voice call MT

4BV

NER-MT (Network Effectiveness Ratio on Mobile Terminated calls in the visited network)

Voice call MT

5BH

PDD-MO (Post Dialling Delay)

Voice call MO

5BV

PDD-MO (Post Dialling Delay)

Voice call MO

6BH

PDD-MT (Post Dialling Delay)

Voice call MT

6BV

PDD-MT (Post Dialling Delay)

Voice call MT

MOC01 (Active) MOC03 (Passive) MOC01 (Active) MOC03 (Passive) MTC01 (Active) MTC07 (Passive) MTC01 (Active) MTC07 (Passive) MOC01 (Active) MOC03 (Passive) MOC01 (Active) MOC03 (Passive) MTC01 (Active) MTC07 (Passive) MTC01 (Active) MTC07 (Passive)

MOC14 (Active) MOC13 (Passive) MOC14 (Active) MOC13 (Passive) MTC14 (Active) MTC13 (Passive) MTC14 (Active) MTC13 (Passive) MOC14 (Active) MOC13 (Passive) MOC14 (Active) MOC13 (Passive) MTC14 (Active) MTC13 (Passive) MTC14 (Active) MTC13 (Passive)

V3.0

Page 40 of 46

GSM Association Official Document IR.81

Non Confidential

Test 7BH

Parameter CSSR-MO (Call Setup Succes Ratio on Mobile Originated calls in the visited network)

Reference flow Voice call MO

Start point MOC01 (Active) MOC03 (Passive) MOC01 (Active) MOC03 (Passive) MTC01 (Active) MTC07 (Passive) MTC01 (Active) MTC07 (Passive) MOC20 MOC20

End Point MOC17 (Active) MOC16 (Passive) MOC17 (Active) MOC16 (Passive) MOC17 (Active) MOC16 (Passive) MTC17 (Active) MTC16 (Passive) MOC22 MOC22

7BV

CSSR-MO (Call Setup Succes Ratio on Mobile Originated calls in the visited network)

Voice call MO

8BH

CSSR-MT (Call Setup Succes Ratio on Mobile Terminated calls in the visited network)

Voice call MT

8BV

CSSR-MT (Call Setup Succes Ratio on Mobile Terminated calls in the visited network)

Voice call MT

9BH 9BV 10BH 10BV 11BH

REL (ISUPv2 signalling transparency) REL (ISUPv2 signalling transparency) OCN and RDN (ISUPv2 signalling transparency) OCN and RDN (ISUPv2 signalling transparency) CCR (Call Completion Rate Circuit )

Voice call MO Voice call MO No flow available No flow available Voice call MO

11BV

CCR (Call Completion Rate Circuit )

Voice call MO

12BH 12BV 13BH 13BV 14BH 14BV

ALOC ALOC CLI transparency CLI transparency SpQ (Speech Quality) SpQ (Speech Quality) SMS Service Accessibility SMS MO (SA SMS MO)

Voice call MO Voice call MO Voice call MO Voice call MO Voice call MO Voice call MO SMS

MOC14 (Active) MOC13 (Passive) MOC14 (Active) MOC13 (Passive) MOC03 MOC03 MOC02 MOC02 MOC18 MOC18

MOC20 (Active) MOC21 (Passive) MOC20 (Active) MOC21 (Passive) MOC21 MOC21 MOC10 MOC10 MOC19 MOC19

21BH

21BV

Service Accessibility SMS MO (SA SMS MO)

SMS

SMS01 (Active) SMS02 (Passive) SMS01 (Active) SMS02

SMS04 (Active) SMS03(Passive)

SMS04 (Active) SMS03(Passive)

V3.0

Page 41 of 46

GSM Association Official Document IR.81

Non Confidential

Test

Parameter

Reference flow

Start point (Passive)

End Point

22BH

Service Accessibility SMS MT (SA SMS MT)

SMS

22BV

Service Accessibility SMS MT (SA SMS MT)

SMS

23BH

Access Delay SMS MO (AD SMS-MO)

SMS

23BV

Access Delay SMS MO (AD SMS-MO)

SMS

24BH

Access Delay SMS MT (AD SMS-MT)

SMS

24BV

Access Delay SMS MT (AD SMS-MT)

SMS

25BH

End-to-End Delivery Time for SMS-MO

SMS

25BV

End-to-End Delivery Time for SMS-MO

SMS

26BH

End-to-End Delivery Time for SMS-MT

SMS

26BV

End-to-End Delivery Time for SMS-MT

SMS

SMS04 (Active) SMS06 (Passive) SMS04 (Active) SMS06 (Passive) SMS01 (Active) SMS02 (Passive) SMS01 (Active) SMS02 (Passive) SMS04 (Active) SMS06 (Passive) SMS04 (Active) SMS06 (Passive) SMS01 (Active) SMS02 (Passive) SMS01 (Active) SMS02 (Passive) SMS01 (Active) SMS02 (Passive) SMS01 (Active) SMS02 (Passive) GPRS01 (Active) GPRS02 (Passive) GPRS01 (Active) GPRS02 (Passive) GPRS02Hub GPRS01 (Active)

SMS08 (Active) SMS09 (Passive) SMS08 (Active) SMS09 (Passive) SMS04 (Active) SMS03(Passive)

SMS04 (Active) SMS03(Passive)

SMS08 (Active) SMS09 (Passive) SMS08 (Active) SMS09 (Passive) SMS08 (Active) SMS09 (Passive) SMS08 (Active) SMS09 (Passive) SMS08 (Active) SMS09 (Passive) SMS08 (Active) SMS09 (Passive)

31BH

PACKET-SWITCHED Packet Switched LU Success Rate (PS LU - SR) GPRS

31BV

Packet Switched LU Success Rate (PS LU - SR)

GPRS

31BR 32BH

Packet Switched LU Success Rate (PS LU - SR) Packet Switched Location Update Delay (PS LU D)

GPRS GPRS

GPRS10 (Active) GPRS09 (Passive) GPRS10 (Active) GPRS09 (Passive) GPRS07Hub GPRS10 (Active)

V3.0

Page 42 of 46

GSM Association Official Document IR.81

Non Confidential

Test

Parameter

Reference flow

Start point GPRS02 (Passive)

End Point GPRS09 (Passive) GPRS10 (Active) GPRS09 (Passive) GPRS07Hub GPRS19 (Active) GPRS18 (Passive) GPRS19 (Active) GPRS18 (Passive) GPRS19 (Active) GPRS18 (Passive) GPRS19 (Active) GPRS18 (Passive) GPRS25 (Active) GPRS24 (Passive) GPRS25 (Active) GPRS24 (Passive) GPRS21 GPRS21 FTP12 (Active) GPRS21 (Passive) FTP12 (Active) GPRS21 (Passive) FTP12 (Active) GPRS21 (Passive) FTP12 (Active) GPRS21 (Passive) Ping04 (Active) During TCP

32BV

Packet Switched Location Update Delay (PS LU D)

GPRS

32BR 33BH

Packet Switched Location Update Delay (PS LU D) Service accessibility for PSD (PDP-context activation success rate)

GPRS GPRS

GPRS01 (Active) GPRS02 (Passive) GPRS02Hub GPRS12 (Active) GPRS13 (Passive) GPRS12 (Active) GPRS13 (Passive) GPRS12 (Active) GPRS13 (Passive) GPRS12 (Active) GPRS13 (Passive) GPRS19 (Active) GPRS18 (Passive) GPRS19 (Active) GPRS18 (Passive) GPRS20 GPRS20 FTP01 (Active) GPRS21 (Passive) FTP01 (Active) GPRS21 (Passive) FTP01 (Active) GPRS21 (Passive) FTP01 (Active) GPRS21 (Passive) Ping 01 (Active)

33BV

Service accessibility for PSD (PDP-context activation success rate)

GPRS

34BH

Set-up Delay (ST PSD)

GPRS

34BV

Set-up Delay (ST PSD)

GPRS

35BH

PDP Context Cut-Off Ratio (session Stability measured at PDP context or PS level) PDP Context Cut-Off Ratio (session Stability measured at PDP context or PS level) Average PDP Context Session Time (per APN) Average PDP Context Session Time (per APN) Throughput (Kbits/sec)

GPRS

35BV

GPRS

36BH 36BV 37BH

GPRS GPRS FTP / GPRS

37BV

Throughput (Kbits/sec)

FTP / GPRS

38BH

Goodput (Kbits/sec)

FTP / GPRS

38BV

Goodput (Kbits/sec)

FTP / GPRS

39BH

Roundtrip time

Ping / GPRS

V3.0

Page 43 of 46

GSM Association Official Document IR.81

Non Confidential

Test

Parameter

Reference flow

Start point During TCP session (Passive) Ping 01 (Active) During TCP session (Passive) Ping 01 (Active) During TCP session (Passive) Ping 01 (Active) During TCP session (Passive)

End Point session (Passive) Ping04 (Active) During TCP session (Passive) Ping04 (Active) During TCP session (Passive) Ping04 (Active) During TCP session (Passive)

39BV

Roundtrip time

Ping / GPRS

40BH

Packet loss

Ping / GPRS

40BV

Packet loss

Ping / GPRS

5.6

Monitoring Values
The monitoring results and their median values were recorded during the GRQ trial Jan-Apr 2008. They are presented in the GRQ Handbook (BA.51) and are for guidance only. Please refer to the GRQ Handbook (BA.51) for information on the GRQ trial observed measurements and how to define Service Level, trigger values

V3.0

Page 44 of 46

GSM Association Official Document IR.81

Non Confidential

V3.0

Page 45 of 46

GSM Association Official Document IR.81

Non Confidential

6 DOCUMENT MANAGEMENT
Document History Version 0.5 0.51 Date 26 Aug 2008 23 Sep 2008 10 Oct 2008 12 Dec 2008 22 Dec 2008 20 Feb 2009 Nov 2009 May 2011 Brief Description of Change Clean version for SIGNAL and PACKET comments. Editorial corrections to trigger table as noted by Inge Menschaert, Vodafone. Editorial corrections as noted by Magnus Zimmerman, Polystar. Further revisions and editorial changes Editorial and formatting corrections New PRD - GRQ Measurement Implementation Adding of roaming Hubbing Providing references Submitted to DAG and EMC for approval Approval Authority Editor / Company

0.52

David Gillot, Roamware N/A draft only

0.6 0.7

1.0 2.0 3.0

IREG-EMC IREG-EMC EMC

David Maxwell, GSMA David Gillot, Roamware David Gillot, Roamware David Gillot, Roamware

Other Information Type Document Owner Editor / Company Description IREG David Gillot, Roamware

V3.0

Page 46 of 46