PSS10 Chinese 2017 Lu
PSS10 Chinese 2017 Lu
1 Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, P.R. China,
2 Academic Affairs Office, Shanghai Jiao Tong University, Shanghai, P.R. China
2) the items are easily understandable; 3) it is not limited to a specific situation and can be
used for past or ongoing events; 4) it can be used to examine changes over time in response to
stress-inducing events; and 5) the PSS can be used as an outcome variable [9–11]. The PSS has
been translated into many languages including Portuguese, Japanese, Arabic, Thai, and Chi-
nese, as well as across several populations including pregnant and postpartum women, cardiac
patients, and medical students [12–17]. The PSS was translated in Traditional Chinese, tested
in Taiwan and Hong Kong, and found to be reliable [14, 18]. Nevertheless, there has only been
one study on the validity of 10-item PSS in simplified Chinese (SCPSS-10), the primary lan-
guage used in mainland China; this study was conducted in Chinese policewomen [17]. Thus,
we analyzed the generalizability of the SCPSS-10 to other Chinese speaking populations.
Therefore, we assessed the perceived stress levels to evaluate the mental health status of Chi-
nese university students. Perceived stress has not been measured and validated in this popula-
tion. Thus, this study is the first to evaluate the reliability and validity of the SCPSS-10 in
Chinese university students.
Methods
Subjects
Undergraduate students were recruited from Shanghai Jiao Tong University between January
1, 2011 and December 31, 2011. A total of 10 departments were selected from 22 faculties
based on convenience sampling; 2191 students from the 10 departments were invited to partic-
ipate in the study, of whom 1096 (50.0%) agreed to participate and completed the scales. Out
of those students, 129 students (11.8%) were randomly selected for reassessment 2 weeks later
using the SCPSS-10.
All the procedures were reviewed and approved by the Institutional Review Board of Shang-
hai Mental Health Center. Written informed consent was obtained from every subject before
participation.
Instruments
All the participants were asked to complete the following self-administered questionnaires in a
classroom within 30 minutes. No more than 50 students completed the test simultaneously in
the same classroom.
Statistical analysis
Continuous variables were presented as mean and standard deviation. The internal consis-
tency reliability of the SCPSS-10 was evaluated using the Cronbach’s α coefficient. A Cron-
bach’s α coefficient value of 0.7–0.8 indicated sufficient reliability, whereas a value of 0.8–0.9
indicated very good reliability. Pearson correlation analysis was applied to assess the test-retest
reliability and evaluate the concurrent validity of SCPSS-10 on the depressive and anxious
symptoms measured by the PHQ-9 and GAD-7.
The samples were randomly split into two halves for the construct structure analysis. The
sample data were screened to confirm that no assumptions were violated prior to the EFA
using the Kaiser-Meyer-Olkin test and Bartlett’s test of sphericity. Exploratory factor analysis
(EFA) was conducted with the first half using the principle component analysis with varimax
rotation. The Kaiser-Meyer-Olkin measure of sampling adequacy was applied to assess sample
adequacy. Confirmatory factor analysis (CFA) was applied to determine the fitness of the pre-
viously identified two-factor and one-factor models [19]. The covariance matrix was tested by
the maximum-likelihood estimation method to determine how well the model fitted the sam-
ple data. Goodness-of-fit index (GFI), normalized fit index (NFI), comparative fit index (CFI),
root mean square residual (RMSR), and root mean square error of approximation (RMSEA)
were used to evaluate the models.
SPSS version 20.0 (IBM, Armonk, NY, USA) was used for analysis. The CFA analysis was
conducted using AMOS 7.0 (SPSS Inc., Chicago, IL, USA). p < 0.05 was considered statisti-
cally significant.
Results
Participant characteristics
The mean age of the 1096 participants (395 women, 701 men) was 18.3 ± 0.7 years. The mean
SCPSS-10 score was 13.7 ± 5.6 for the whole student sample, and there were no significant dif-
ferences between females (13.9 ± 5.5) and males (13.5 ± 5.5).
For the whole study sample, the SCPSS-10, PHQ, and GAD scores were 13.7±5.6, 4.3±3.1,
and 2.8±2.9, respectively. For the retest sample, the SCPSS-10, PHQ, and GAD scores were
18.6±4.7, 4.9±3.2, and 3.6±3.3, respectively.
EFA
Sampling adequacy was good (Kaiser-Meyer-Olkin = 0.86) and Bartlett’s test of sphericity was
statistically significant (p < 0.001). The principal component analysis with the varimax rotation
of the SCPSS-10 scores obtained two factors with Eigen values > 1.0 accounting for 62.49% of
the variance (Table 1). Factor loading ranged from 0.67 to 0.80 for SCPSS items, which entered
into factor 1, and from 0.73 to 0.87 for SCPSS items, which entered into factor 2.
CFA
In this sample, the two-factor solution was demonstrated to be adequate: GFI = 0.940,
NFI = 0.925, CFI = 0.939, RMSR = 0.039, and RMSEA = 0.049. In contrast, the one-factor
Table 1. Exploratory factor analysis and reliability coefficients of the SCPSS-10 (n = 548).
SCPSS-10 Item Factor loading
Factor 1 Factor 2
1. In the last month, how often have you been upset because of something that 0.777 0.040
happened unexpectedly?
2. In the last month, how often have you been unable to control the important things in 0.755 0.188
your life?
3. In the last month, how often have you felt nervous and “stressed”? 0.793 0.070
4. In the last month, how often have you felt confident about your ability to handle your 0.146 0.844
personal problems?
5. In the last month, how often have you felt that things were going your way? 0.349 0.732
6. In the last month, how often have you found that you could not cope with all of the 0.723 0.211
things that you had to do?
7. In the last month, how often have you been able to control irritations in your life? 0.014 0.738
8. In the last month, how often have you felt that you were in control of things? 0.214 0.869
9. In the last month, how often have you been angered because of things that were 0.667 0.165
outside of your control?
10. In the last month, how often have you felt difficulties were piling up so high that you 0.756 0.237
could not overcome them?
Eigen value 4.43 1.81
% variance 44.34 18.14
Cronbach’s α coefficient 0.86 0.83
https://doi.org/10.1371/journal.pone.0189543.t001
model showed a poor data fit: GFI = 0.676, NFI = 0.596, CFI = 0.628, RMR = 0.093, and
RMSEA = 0.122. None of the fit indices matched the cut-off criterion (Table 2). The CFA indi-
cated that the SCPSS-10 two-factor model was a reasonable approximation to the population.
Concurrent validity
We analyzed the association between the SCPSS-10, GAD-7, and PHQ-9 (Table 3). GAD-7
and PHQ-9 were positively correlated with SCPSS-10. The factors associated with the SCPSS-
10 total score and the other two scales had correlation coefficients of 0.37–0.87 (Table 3).
Discussion
Our study assessed for the first time perceived stress in Chinese university students. The psy-
chometric data yielded good validity and reliability for SCPSS-10. Overall, the Cronbach’s α of
the SCPSS-10 was 0.85, which is better than the standard of psychological measurement
(Cronbach’s α > 0.7) [34]. In addition, the 2-week test-retest reliability of the SCPSS-10 was
0.70, which is acceptable and demonstrated good cross-temporal constancy, similar to our pre-
viously published studies on policewomen (r = 0.68). These results are consistent with previous
studies of the PSS in other languages [2, 13–16, 19] as well as previous study from our group
conducted in Chinese policewomen, in which we obtained a Cronbach’s α value of 0.86 [17].
SCPSS-10 revealed high levels of perceived stress in Chinese university students, which also
correlated with anxiety and depression.
Regarding the SCPSS-10 structure, the construct validity analysis showed that the two com-
mon factors extracted from the principal component analysis with varimax rotation repre-
sented positive (Factor 1) and negative (Factor 2) feelings. This was consistent with other
language versions [8, 12, 13]. In this study, the Eigen values of the SCPSS-10 were 4.43 and
1.81, accounting for 44.34% and 18.14% of the variance. The loadings were 0.667–0.793 for
Factor 1 and 0.732–0.869 for Factor 2. The CFA demonstrated a relatively better goodness-of-
fit for the two-factor model for SCPSS-10 compared with the previous studies [17]. This may
be due to higher homogeneity of the sample, as undergraduate students tend to have similar
economic, social, and cultural backgrounds compared to policewomen. Although some
researchers have suggested one-factor model solution for the PSS-10, CFA revealed a poor fit
using this model. These results were consistent with a previous report based on Chinese
Table 3. Correlations between SCPSS-10, depression (PHQ-9), and anxiety (GAD-7) screening tools.
SCPSS-10 Factor 1 Factor 2 GAD-7
Factor 1 0.87
Factor 2 0.77 0.37
GAD-7 0.59 0.56 0.39
PHQ-9 0.57 0.53 0.40 0.72
SCPSS-10, Simplified Chinese version of the 10-item Perceived Stress Scale; PHQ-9, Patient Health Questionnaire; GAD-7, Generalized Anxiety Disorder
7-item scale.
https://doi.org/10.1371/journal.pone.0189543.t003
speaking population [35]. Furthermore, the correlation coefficients between the two extracted
common factors and the total SCPSS-10 scores were 0.87 and 0.77, and the correlation coeffi-
cient between Factors 1 and 2 was 0.37, indicating good internal homogeneity. Nevertheless,
“positive feelings” and “negative feelings” both reflect perceived stress, and it has been sug-
gested that any distinction between these factors is irrelevant and reflects the sentence struc-
ture of the scale [8]. Thus, although the two-factor model solution of PSS-10 is better, we
suggest not using two separate subscales in the clinical setting.
Wang et al. demonstrated that the SCPSS-10 was significantly and moderately positively
correlated with anxiety and depression in policewomen [17]. Other studies have showed that
the PSS-10 has concurrent validity with other measures, including the State Trait Anxiety
Inventory and the Beck Depression Inventory [13, 36]. We found that SCPSS-10 is moderately
positively correlated with PHQ-9 (rs = 0.59, p < 0.001) and GAD-7 (rs = 0.57, p < 0.001).
For the satisfactory psychometric results in Chinese university students, we propose that
SCPSS-10 should be widely applied in Chinese speaking university students, even outside
China mainland. Nevertheless, because of differences in university levels, and of social, eco-
nomic, and cultural differences among Chinese-speaking regions, additional studies should be
performed in those regions in order to confirm the generalizability of our results. Although
the participants recruited in our study were all freshmen university students, those in higher
grades may have different levels and kinds of stress, which may require different evaluation.
For example, junior, senior, or graduate-level students may encounter higher psychological
stress because of the accumulated study burden and job-hunting pressures. University students
may also have different perceived psychological pressures depending on their educational lev-
els, although both groups in the present study received similar education at similar ages after
high school. Second, construct validity was limited to self-reported measure comparisons.
Third, we did not evaluate discriminant validity of the SCPSS-10 in this present study. Thus,
further studies should address these questions in diverse populations, and more objective mea-
sures should be applied to improve the psychometric quality of the SCPSS-10.
Conclusion
In conclusion, we find that SCPSS-10 is a reliable and valid instrument for estimating the stress
levels in university students within a Chinese cultural context. We also found high perceived
stress levels in university students, which was also correlated with anxiety and depression.
Supporting information
S1 Table. Stress scale retest list and results.
(XLSX)
S2 Table. Stress test list and results.
(XLSX)
Acknowledgments
This study was supported by the Ministry of Science and Technology Project (2009BAI77B08),
Shanghai One Hundred Talent Project in health division (XBR2011015), and the National
Natural Science Foundation of China (81371486).
Author Contributions
Conceptualization: Wei Lu, Qian Bian, Zhen Wang, Min Zhao.
References
1. Bomhof-Roordink H, Seldenrijk A, van Hout HP, van Marwijk HW, Diamant M, Penninx BW. Associa-
tions between life stress and subclinical cardiovascular disease are partly mediated by depressive and
anxiety symptoms. J Psychosom Res. 2015; 78(4): 332–339. https://doi.org/10.1016/j.jpsychores.
2015.02.009 PMID: 25736692
2. Payne JK. State of the science: stress, inflammation, and cancer. Oncol Nurs Forum. 2014; 41(5):
533–540. https://doi.org/10.1188/14.ONF.533-540 PMID: 25158658
3. Salleh MR. Life event, stress and illness. Malays J Med Sci. 2008; 15(4): 9–18. PMID: 22589633
4. Schneiderman N, Ironson G, Siegel SD. Stress and health: psychological, behavioral, and biological
determinants. Annu Rev Clin Psychol. 2005; 1 607–628. https://doi.org/10.1146/annurev.clinpsy.1.
102803.144141 PMID: 17716101
5. Folkman S (2013) Stress: Appraisal and Coping. Encyclopedia of Behavioral Medicineedn. Springer
New York, New York, pp 1913–1915
6. Chen HL, Wong YC, Ran MS, Gilson C. Stress among Shanghai University Students. J Soc Work.
2009; 9 323–344.
7. Chen L, Wang L, Qiu XH, Yang XX, Qiao ZX, Yang YJ, et al. Depression among Chinese university stu-
dents: prevalence and socio-demographic correlates. PLoS One. 2013; 8(3): e58379. https://doi.org/
10.1371/journal.pone.0058379 PMID: 23516468
8. Cohen S. Perceived stress in a probability sample of the United States. Thousand Oaks: Sage Publica-
tions, Inc.; 1988.
9. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;
24(4): 385–396. PMID: 6668417
10. Cohen S, Williamson G. The Social Psychology of Health. London: Sage Publications; 1988.
11. Lee EH. Review of the psychometric evidence of the perceived stress scale. Asian Nurs Res (Korean
Soc Nurs Sci). 2012; 6(4): 121–127.
12. Reis RS, Hino AA, Anez CR. Perceived stress scale: reliability and validity study in Brazil. J Health Psy-
chol. 2010; 15(1): 107–114. https://doi.org/10.1177/1359105309346343 PMID: 20064889
13. Wongpakaran N, Wongpakaran T. The Thai version of the PSS-10: An Investigation of its psychometric
properties. Biopsychosoc Med. 2010; 46.
14. Leung DY, Lam TH, Chan SS. Three versions of Perceived Stress Scale: validation in a sample of Chi-
nese cardiac patients who smoke. BMC Public Health. 2010; 10 513. https://doi.org/10.1186/1471-
2458-10-513 PMID: 20735860
15. Mimura C, Griffiths P. A Japanese version of the Perceived Stress Scale: cross-cultural translation and
equivalence assessment. BMC Psychiatry. 2008; 8 85. https://doi.org/10.1186/1471-244X-8-85 PMID:
18826581
16. Remor E. Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS).
Span J Psychol. 2006; 9(1): 86–93. PMID: 16673626
17. Wang Z, Chen J, Boyd JE, Zhang H, Jia X, Qiu J, et al. Psychometric properties of the Chinese version
of the Perceived Stress Scale in policewomen. PLoS One. 2011; 6(12): e28610. https://doi.org/10.
1371/journal.pone.0028610 PMID: 22164311
18. Chen CH, Tseng YF, Chou FH, Wang SY. Effects of support group intervention in postnatally distressed
women. A controlled study in Taiwan. J Psychosom Res. 2000; 49(6): 395–399. PMID: 11182431
19. Mitchell AM, Crane PA, Kim Y. Perceived stress in survivors of suicide: psychometric properties of the
Perceived Stress Scale. Res Nurs Health. 2008; 31(6): 576–585. https://doi.org/10.1002/nur.20284
PMID: 18449942
20. Pedro Ruiz VAS, Sadock BJ. Kaplan and Sadock0 s Comprehensive Textbook of Psychiatry. [Online].
https://shop.lww.com/Kaplan-and-Sadock-s-Comprehensive-Textbook-of-Psychiatry/p/
9781451100471. [Accessed: 26-Jun-2017]. 2017;
21. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the
PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire.
Jama. 1999; 282(18): 1737–1744. PMID: 10568646
22. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen
Intern Med. 2001; 16(9): 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x PMID:
11556941
23. Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient
Health Questionnaire (PHQ-9): a meta-analysis. Cmaj. 2012; 184(3): E191–196. https://doi.org/10.
1503/cmaj.110829 PMID: 22184363
24. Lotrakul M, Sumrithe S, Saipanish R. Reliability and validity of the Thai version of the PHQ-9. BMC Psy-
chiatry. 2008; 8 46. https://doi.org/10.1186/1471-244X-8-46 PMID: 18570645
25. Liu SI, Yeh ZT, Huang HC, Sun FJ, Tjung JJ, Hwang LC, et al. Validation of Patient Health Question-
naire for depression screening among primary care patients in Taiwan. Compr Psychiatry. 2011; 52(1):
96–101. https://doi.org/10.1016/j.comppsych.2010.04.013 PMID: 21111406
26. Rogers KD, Young A, Lovell K, Campbell M, Scott PR, Kendal S. The British Sign Language versions of
the Patient Health Questionnaire, the Generalized Anxiety Disorder 7-item Scale, and the Work and
Social Adjustment Scale. J Deaf Stud Deaf Educ. 2013; 18(1): 110–122. https://doi.org/10.1093/
deafed/ens040 PMID: 23197315
27. Hansson M, Chotai J, Nordstom A, Bodlund O. Comparison of two self-rating scales to detect depres-
sion: HADS and PHQ-9. Br J Gen Pract. 2009; 59(566): e283–288. https://doi.org/10.3399/
bjgp09X454070 PMID: 19761655
28. Hyphantis T, Kotsis K, Voulgari PV, Tsifetaki N, Creed F, Drosos AA. Diagnostic accuracy, internal con-
sistency, and convergent validity of the Greek version of the patient health questionnaire 9 in diagnosing
depression in rheumatologic disorders. Arthritis Care Res (Hoboken). 2011; 63(9): 1313–1321.
29. Donker T, van Straten A, Marks I, Cuijpers P. Quick and easy self-rating of Generalized Anxiety Disor-
der: validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Res. 2011; 188(1): 58–
64. https://doi.org/10.1016/j.psychres.2011.01.016 PMID: 21339006
30. Lowe B, Decker O, Muller S, Brahler E, Schellberg D, Herzog W, et al. Validation and standardization of
the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med Care. 2008; 46(3):
266–274. https://doi.org/10.1097/MLR.0b013e318160d093 PMID: 18388841
31. Ruiz MA, Zamorano E, Garcia-Campayo J, Pardo A, Freire O, Rejas J. Validity of the GAD-7 scale as
an outcome measure of disability in patients with generalized anxiety disorders in primary care. J Affect
Disord. 2011; 128(3): 277–286. https://doi.org/10.1016/j.jad.2010.07.010 PMID: 20692043
32. Lee KH, Ho Chae C, Ouk Kim Y, Seok Son J, Kim JH, Woo Kim C, et al. Anxiety symptoms and occupa-
tional stress among young Korean female manufacturing workers. Ann Occup Environ Med. 2015; 2
724.
33. Reliability and validity of a generalized anxiety scale in general hospital outpatients. [Online]. https://
www.researchgate.net/publication/281360109_Reliability_and_validity_of_a_generalized_anxiety_
scale_in_general_hospital_outpatients. [Accessed: 26-Jun-2017]. In 2017.
34. George D. SPSS for Windows Step by Step. [Online]. http://dl.acm.org/citation.cfm?id=1803802.
[Accessed: 26-Jun-2017]. 2017;
35. Ng SM. Validation of the 10-item Chinese perceived stress scale in elderly service workers: one-factor
versus two-factor structure. BMC Psychol. 2013; 1(1): 9. https://doi.org/10.1186/2050-7283-1-9 PMID:
25566361
36. Summary on the Validity Study of the Hungarian Version of the Perceived Stress Scale—Semantic
Scholar. [Online]. https://www.semanticscholar.org/paper/Summary-on-the-Validity-Study-of-the-
Hungarian-Ver-Stauder-Thege/b316d45262a869d9825746196e4d3e093de0d6bf. [Accessed: 26-Jun-
2017]. In 2017.