Security Level: Internal
Speech Quality and MOS
Alex
www.huawei.com
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential
Agenda
• Introduction
• Measurement
• Evaluation
• Optimization
MOS- Subjective Evaluation Way
MOS test is normally performed on a group of listeners.
The listeners listen to the speech material in the same
channel environment and give a score. The scores are
then averaged to obtain the MOS score. The scores vary
largely from listener to listener.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 3
MOS- Objective Evaluation Way
Objective way compares an original signal with a degraded signal and
then outputs a MOS score. The MOS score is like the result of a subjective
listening test.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 4
PESQ(P.862)
• PESQ value is from
-0.5 to 4.5
• PESQ algorithm is
powerful enough to
test end-to-end
speech quality.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 5
MOS-LQO(P.862.1)
• MOS-LQO (Listening
Quality Objective)
value is from 1.02 to
4.56
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 6
PESQ-LQ Mapping
• This mapping is not
adopted by ITU-T
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 7
Agenda
• Introduction
• Measurement
• Evaluation
• Optimization
Measurement –Nemo (MS to MS)
Nemo Audio Module:
Sending Reference
Sample
MOS
Score
Nemo Audio Module :
Receiving Impaired
Sample
HUAWEI TECHNOLOGIES Co., Ltd. HUAWEI Confidential Page 9
Measurement –QVoice (MS to PSTN)
QVM-MOS
Measurement
QVP-Data Analysis
HUAWEI TECHNOLOGIES Co., Ltd. HUAWEI Confidential Page 10
MS to PSTN Way
Reference Sample Uplink MOS Impaired Sample
MS BTS BSC MSC PSTN
Impaired Sample Downlink MOS Reference Sample
UL MOS score and DL MOS score is available.
The configuration of Testing System is more complicated
Required less MS when performing Benchmark
HUAWEI TECHNOLOGIES Co., Ltd. HUAWEI Confidential Page 11
MS to MS Way
Reference
Sample Uplink
MS1 BTS BSC
MSC
MS2 BTS BSC
Impaired
Sample Downlink
UL MOS score and DL MOS score is not available 。
MOS test by MS to MS way is more sensitive for Um interface
Using Local switch or TFO can improve MOS (MS to MS way)。
HUAWEI TECHNOLOGIES Co., Ltd. HUAWEI Confidential Page 12
Agenda
• Introduction
• Measurement
• Evaluation
• Optimization
Common Report
MOS
=Average[MOS(all samples)]
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 14
QVoice Report
DL MOS = MOS_FR × FR% + MOS_HR × HR% + MOS_EFR ×
EFR% + MOS_AFR × AFR% + MOS_AHR × AHR%
UL MOS = MOS_FR × FR% + MOS_HR × HR% + MOS_EFR ×
EFR% + MOS_AFR × AFR% + MOS_AHR × AHR%
MOS = (DL_MOS + UL_MOS) / 2 Basic Report:
Advanced
Report:
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 15
Agenda
• Introduction
• Measurement
• Evaluation
• Optimization
Factors of MOS
Test Method (Equipment, Testing mode,Speech Sample)
RF performance（RxLev, RxQual, C/I, HO,…)
BSS Features (Codec，DTX, TFO, PC…)
Transmission (Speech route，Tran. quality…)
Factors of
MOS Hardware（BTS/FTC version，Fault…）
Others（FR/HR percentage…）
Consider comprehensively when analyzing MOS
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 17
Test Method
Equipment
Different equipment has different standard (PESQ is preferred)
Do not compare MOS value from different type of equipment.
Testing Mode
MS to MS
MS to PSTN
Speech Sample
Speech Sample should be the same for any compare.
English Speech Sample is preferred
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 18
Um interface(1)
SQI (Downlink Um)
Note： SQI is not equal to MOS. SQI is just a factor that can affect MOS
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 19
Um Interface(2)
Improve SQI
Uplink Um Quality
Can be evaluated by single user tracing or STS, normally Uplink Um interface should
be a bit better than downlink Um interface. If not, be aware of Uplink interference,
Uplink DTX, link balance.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 20
Features(1)
Feature Recommend Effect on MOS
The descending speech quality of 5 types of Speech
Active AMR, Version in GSM is as following:
Speech Version
EFR AMR FR >= EFR > AMR HR >= FR > HR。
Active AMR and EFR will improve MOS remarkably.
DTX will introduce clipping which is bad for MOS.
UL or DL DTX ？ However, DTX can decrease interference which is good
for Um interface.
UL and DL PC Open Power Control will decrease network interference.
Caused by frequency diversity and interference
Hopping Open
equalization, FH is helpful for enhancing speech quality.
TFO can cut one encoding and decoding off a
TFO Open conversation , which is helpful for enhancing MOS in MS
to MS way.
Allowing speech signal to bypass MSC and BSC, which
also can cut one encoding and decoding time.
Local Switch Open
However, if TFO is activated, local switch can only save
transmission resources.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 21
Feature(2)-Codec
AMR FR >= EFR > AMR HR >= FR > HR
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 22
Transmission(1)
Speech Signal Route
Evaluate how many times for encoding and decoding. There will be 0.2 MOS loss for one
more encoding and decoding.
MS to PSTN
Speech Signal Route：MS- BTS-BSC-MSC-GMSC-PSTN
Be aware of transmission between MSC and GMSC:
If using IP transmission, NSS part will introduce one time encoding and decoding.
If using TDM transmission, no MOS loss
While performing MOS benchmark, if MS to PSTN test way is adopted, you
should consider the transmission differences between MSC and GMSC.
For example：If networks all use AMR codec, the maximum MOS value in
network with IP backbone is 3.8 to 3.9, and maximum MOS value in network with
TDM can be 4.0-4.2.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 23
Transmission(2)
Speech Signal Route
MS to MS
Speech route ：MS-BTS-BSC-MSC-BSC-BTS-MSC
The speech will experience 2 times encoding and decoding.
But if TFO is adopted in the network, only one time encoding and decoding, which can
provide 0.2 MOS increase.
No TFO, 2 times
encoding and decoding
TFO, 1time encoding
and decoding
Transmission Quality
Speech quality is also strongly related to transmission quality, especially for microwave
or satellite transmission type, which are more easily affected by weather (raining,
snowing…) and cause MOS degrading.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 24
Hardware
For BSS part, BTS and TC can affect the speech quality.
Select the recommended software version.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 25
Others…
FR/HR traffic distribution
Suppose score for AMR FR and AMR HR will not change, if the percentage of AFR raise
from 65% to 80%.....
MOS (3.3) = 3.5(AMR FR)* 65% + 3.0(AMR HR) * 35%
MOS (3.4) = 3.5(AMR FR)* 80% + 3.0(AMR HR) * 20%
Vehicle Speed
…
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential Page 26
Thank you
www.huawei.com
