Abstract
This study describes the use of a smartphone application based on the Korean version of the Mood Disorder Questionnaire in screening for bipolar spectrum disorders in a large general population. All data were collected between May 2011 and July 2011. A total of 27,159 individuals participated in the survey, using a smartphone application. The prevalence of positive screening results for bipolar spectrum disorders among 27,159 participants using the smartphone Korean Mood Disorder Questionnaire application was 8.2 percent. These results are similar to traditional paper-based results. The Korean Mood Disorder Questionnaire positive group exhibited more frequent occurrences of previous psychiatric treatment than the group with negative results. In a logistic regression analysis involving subjects with past psychiatric history, age group significantly predicted Korean Mood Disorder Questionnaire results. The smartphone application may be a useful screening tool for bipolar spectrum disorders. This study included only individuals who actively participated, and thus, the possibility of a selection bias should be considered.
Introduction
Bipolar disorder is a serious and relatively common psychiatric illness that is clinically associated with significant morbidity and mortality rates. The prevalence of typical bipolar I disorder is approximately 1 percent of the general population. However, recent research has suggested that bipolar spectrum disorders (BSD), including bipolar I disorder, bipolar II disorder, cyclothymic disorder, and bipolar disorder, not otherwise specified, are considerably more prevalent (3.0%–6.5%).1,2
The problems of misdiagnosis and underdiagnosis of BSD have been highlighted previously.1,3 Studies of depressed patients have found evidence that BSD patients are often misdiagnosed with other psychiatric disorders, particularly major depressive disorder; in addition, patients may be misdiagnosed with personality disorders, psychotic disorders, and anxiety disorders.4,5 Even among patients who are accurately diagnosed with BSD, the latency between the first experiences of symptoms and the correct diagnosis is often greater than 10 years,6,7 and the long duration of the untreated BSD may result in subsequent morbidity. 8 Hence, there is substantial need for screening tools for BSD that have a high degree of sensitivity and specificity and that can be easily implemented.
Several self-report screening questionnaires have been developed to detect BSD.9–12 The Mood Disorder Questionnaire (MDQ) is the most widely studied because it can be quickly and easily used to recognize BSD in a clinical setting with relatively good sensitivity and very good specificity.13,14 Comparison of the three most widely used self-report screening instruments—the MDQ, the bipolar spectrum diagnostic scale (BSDS), 15 and the hypomanic checklist for BSD (HCL-32) 11 —within a primary care or general population has shown that the highest degree of sensitivity was obtained with the BSDS, with the MDQ exhibiting the highest degree of specificity.16,17 A recent systematic review revealed that screening tests for bipolar disorder may include a high number of false positives; 18 therefore, applying the MDQ, which exhibits the highest degree of specificity, may be desirable in screening for BSD.
Several studies have used the MDQ to estimate the prevalence of BSD.2,19–21 However, previous studies within the general population or in a primary care setting have used traditional paper-based collection through mail or face-to-face communication. Using mail may be logistically easier than face-to-face evaluation; however, neither method is anonymous, leading to the possibility that subjects respond differently because they are aware that their identities are not concealed. 22 Indeed, an anonymous survey resulted in a much higher prevalence of BSD in mental health screening. 23
The rapid diffusion and accessibility of smartphones provides opportunities to enhance the screening of psychiatric illness within the general population with a greater degree of anonymity. According to a survey by the Korean Communications Commission, 24 approximately 27 percent of adults in South Korea own and use a smartphone. Moreover, in one recent study, 50 percent of psychiatric patients indicated an interest in using an app on a daily basis to monitor their mental health, 25 and another study has explored the role of mobile phone apps in screening for depression. 26 Given the accessibility of smartphones, further investigation of the role of smartphone apps in screening and monitoring psychiatric illness is likely to be useful.
In this study, therefore, our purpose was to enhance the detection of BSD by developing and distributing a free Korean MDQ (K-MDQ) smartphone application that can be completed anonymously. We relied on a Korean translation of the MDQ whose validity has been established. 27 The purpose of our study was to evaluate the feasibility of the MDQ application and to determine correlates for positive results on the MDQ with the aim of demonstrating that mental health screening can be done easily and reliably on a smartphone in a smartphone-using population.
Methods
The K-MDQ includes three criteria. In Criterion 1, the K-MDQ screens for a lifetime history of manic or hypomanic symptoms, using 13 yes/no items. Criterion 2 queries whether several manic or hypomanic symptoms or behaviors have been experienced during the same period, and Criterion 3 assesses the functional impairment resulting from the illness on a 4-point scale (from “no” to “severe” problems). 27 In this study, respondents were considered as testing positive for BSD when they provided “yes” responses to at least seven of the symptoms in Criterion 1, in addition to confirming that multiple symptoms clustered in the same time period (Criterion 2) and indicating that the symptoms caused “moderate” or “serious” problems (Criterion 3). We used the K-MDQ as the basis for a smartphone application that was developed in both Android and iOS versions. The iOS version was registered with the iPhone App Store on 12 May 2011, and the Android version was registered on the Android market on 5 May 2011. Data collection was performed on 11 July 2011. On the first page of the application, participants were informed that the information they submitted could be used for the purpose of academic or scientific research. Each item of the K-MDQ was presented sequentially one item at a time on the smartphone screen such that the next item did not appear if a score was not entered for the displayed item. Demographic data including age, sex, and past psychiatric treatment history were collected. The result of the screening test was made available to respondents.
The internal consistency of the K-MDQ was determined, using Cronbach’s α. We performed a factor analysis to determine construct validity, extracting principal components using varimax rotation. To define the factors that were associated with a positive K-MDQ result, we compared the frequency of the K-MDQ positive rate between age groups and gender groups using a chi-squared test. In addition, we performed a logistic regression using gender, age group, and past psychiatric history as predictors and K-MDQ positive results as the dependent variable. All statistical tests were two-tailed with a significance level set at 0.05. Our Institutional Review Board reviewed and approved the protocol, and the study was conducted in accordance with sound clinical practices and the Helsinki Declaration. Our Institutional Review Board waived patient-specific informed consent for this confidential survey and the anonymous reporting of aggregate data.
Results
Demographics characteristics
Data from 27,159 participants were collected during the 2 months from 5 May 2011 to 11 July 2011. There were 17,985 downloads of the iPhone application and 3816 of the Android application. The majority of the subjects were female (74.6%) and between the ages of 10 and 29 years (75.0%). The demographic characteristics are presented in Table 1.
Demographic characteristics of respondents.
Clinical characteristics
The clinical characteristics of participants are presented in Table 2. There were 2864 (10.5%) participants with a previous history of psychiatric treatment. The proportion of patients with a past psychiatric history differed significantly across age groups: 9.7 percent in the 10–29 group, 11.1 percent in the 30–49 group, and 34.6 percent in the 50 or older group (χ2 = 387.395, df = 2, p < 0.001).
Clinical characteristics of respondents.
Reliability and factor analysis of the K-MDQ application
The internal consistency of the K-MDQ was good, as indicated by a Cronbach’s α of 0.80. Correlation coefficients between the individual items on the questionnaire and the total K-MDQ score ranged from 0.43 (“spending money”) to 0.62 (“more active,” more social, or outgoing) and all were statistically significant (p < 0.01). Two factors with eigenvalues greater than 1 were extracted from the factor analysis; these accounted for 40.1 percent of the total variance (Table 3). Factor 1, with an eigenvalue of 3.9, corresponded to a group of five items (Items 3, 5, 8, 9, and 10) and accounted for 30.1 percent of the total variance. Factor 2 with an eigenvalue of 1.29 contributed 9.9 percent toward the variance and corresponded to a group of eight items (Items 1, 2, 4, 6, 7, 11, 12, and 13). The frequency of endorsement of individual K-MDQ items ranged from 31.2 to 75.8 percent. The most frequently endorsed items were “racing thoughts” (74.7%) and “easily distracted” (75.8%); the least frequently endorsed items were “excessive, foolish, or risky” (48.4%) and “spending money” (31.2%). The K-MDQ positive group exhibited significantly higher levels of endorsement for all of the items relative to the K-MDQ negative group, with the magnitude of the difference between the groups being the highest for the item “sending money” (Figure 1).
Factor loadings of K-MDQ application from principal-component analysis with varimax rotation in all participants.
K-MDQ: Korean version of Mood Disorder Questionnaire.

Comparison of K-MDQ application item frequencies between groups.
Correlates for K-MDQ positive results
The number of participants who were scored as K-MDQ positive (i.e. who met all three criteria as described in the “Methods” section) was 2224 (8.2%). The correlates for MDQ positive results as revealed by a univariate analysis (chi-square test) are presented in Table 4. The proportion of K-MDQ positive results was higher among participants with a past psychiatric history (12.3%) than among participants without a past psychiatric history (7.7%, χ2 = 70.429, df = 1, p < 0.001). In the logistic regression analysis (Table 4), gender and age group were not predictors of K-MDQ positive results; the presence of a past psychiatric history (odds ratio = 1.690, 95% confidence interval (CI) = 1.495–1.909, p < 0.001) was found to be the only predictor of K-MDQ positive results.
Correlates for K-MDQ positive.
K-MDQ: Korean version of Mood Disorder Questionnaire, K-MDQ positive: Meet all the three criteria of Mood Disorder Questionnaire, OR: odds ratio, CI: confidence interval.
Among participants without a past psychiatric history, the K-MDQ positive rate for males (7.6%) did not differ significantly from that of females (8.0%; χ2 = 0.703, df = 1, p = 0.402), nor were there any significant differences in the K-MDQ positive rate across age groups: 7.8 percent in the 10–29 years group, 7.2 percent in 30–49 years group, and 8.7 percent in the 50 years or older group (χ2 = 2.890, df = 2, p = 0.236). The multivariate analysis revealed that there were no significant predictors of the K-MDQ positive rate among subjects without a past psychiatric history (data not shown).
Among participants with a past psychiatric history, the K-MDQ positive rate did not differ by gender (12.0% in males, 12.3% in females; χ2 = 0.038, df = 1, p = 0.845), or by age group (12.4% in the 10–29 years group, 13.4% in the 30–49 years group, and 7.2% in the 50 years or older group; χ2 = 5.780, df = 2, p = 0.056). However, the logistic regression analysis indicated that age group significantly predicted K-MDQ positive results among subjects with a past psychiatric history. The odds ratio of the 10–29 years group compared with the 50 years or older group was 1.8 (95% CI = 1.1–3.1, p = 0.032); and that of the 30–49 years group compared with the 50 years or older group was 2.0 (95% CI = 1.1–3.5, p = 0.018).
Discussion
Efficiency of the smartphone application as a mental-health-screening tool
We conducted screening for BSD in the general community population using smartphone applications that incorporated the K-MDQ. Only 2 months were required to collect K-MDQ data from 27,159 participants. The number of participants in this study is considerably larger than in previous community-based studies using the MDQ.19,28–30 Moreover, in comparison with a study that involved a similar sample size, 31 in which 16,803 participants were tested over a period of 6 months using the 27-item Mood Swing Survey Questionnaire, this study was conducted over a relatively short period of time.
There are some benefits to screening for psychiatric illness over the Internet or on a mobile device. 22 First, the response is easily accessible and relatively anonymous—although it is possible to link survey results with the respondent’s Internet protocol (IP) address, a court order is required to identify the person; therefore, anonymity is fairly well preserved. 22 Second, the data can be automatically stored in a database for later data mining and analysis, significantly reducing costs relative to a printed survey. It is clear that there is tremendous potential for mobile communication to transform healthcare and clinical intervention in the community. 32 Several previous studies have evaluated the use of mobile phones in supporting healthcare and public health interventions, particularly with regard to the collection and collation of data for healthcare research, 33 in medical and healthcare education, and in clinical practice within the community. 34 Moreover, there may be substantial benefits to the user due to possible improvements in the early detection of BSD and subsequent evaluation and intervention involving psychiatric services. It has been suggested that individuals with mental health difficulties often hesitate to contact psychiatric services even when they wish to be evaluated for their symptoms, because they do not want to be labeled as “mental patients” and prefer to avoid the negative associations and stigma that accompany such a label. 35 These subjects could benefit from easily administrable self-screening instruments such as the application used in this study.
Feasibility of the smartphone application as a mental-health-screening tool
Screening of 27,159 participants using the K-MDQ smartphone application in this study indicated that 8.2 percent were scored as positive for BSD. This value is similar to that reported by Rouillon et al. 36 among patients consulting general practitioners in France (8.3%), but higher than those previously reported for the general population in the United States (3.7%) 2 and Australia (2.5%). 37 Moreover, the mean K-MDQ score for all subjects in our sample was 7.7 ± 3.4. This score is quite high, given that the cutoff score for Criterion 1 alone is 7. 27
Our findings may be due to several factors. First, the age and culture of the participants should be considered. In a previous study investigating the prevalence of BSD among Korean college students using a paper version of the K-MDQ, 38 the prevalence of BSD was 18.6 percent, a value that is considerably higher than is generally reported in international studies. The high K-MDQ positive rate and the high mean scores obtained in this study could be due to the age of the participants; 75 percent of our participants were between 10 and 29 years of age. In previous studies, positive screening results for BSD have been associated with younger age.10,36 Second, this study included only active participants due to the fact that it was conducted using K-MDQ smartphone applications, which needed to be downloaded by the participants. Subjects in this study may have been motivated to participate because of their diagnosed/undiagnosed psychiatric problems. This may have contributed to the high K-MDQ positive rate in our study. Indeed, in the logistic regression analysis, the presence of a past psychiatric history was found to be the only predictor of K-MDQ positive results. Third, the difference may be due to differences in evaluation methods across studies. Several instruments used in psychiatric research related to depression39,40 and anxiety disorder 41 have been validated for administration via the Internet. However, Internet-based administration of these instruments yields different results compared with paper-and-pencil assessments. 40 Therefore, it is questionable whether offline cutoff scores can be readily applied to scores obtained from participants over the Internet.42,43
Limitations of this study
A limitation of this study is that our sample was not a random sample and was not selected as being representative of the general population. Because this study included only active participants who voluntarily downloaded the K-MDQ smartphone applications, we were unable to obtain any data from people who chose not to participate. Hence, we were unable to calculate a refusal rate or to present the number/characteristics of those who were included in the study and those who were excluded. As a result, we cannot exclude the possibility that the findings may be biased in favor of positive results. The possibility of a single person submitting more than one set of responses is another limitation of this study. Although the total number of application downloads was 21,801, our total number of response sets was 27,159, which indicates that the application executed an average of 1.25 times on each device; this suggests that individual participants may have responded more than once, or that more than one participant may have submitted responses using a single device. With regard to the age distribution evident in this study, the youngest age group represented the largest proportion of participants. According to a survey by the Korean Communications Commission, 24 the probability of owning and using a smartphone in South Korea decreases steadily with age: 46 percent between 10 and 29 years, 34 percent between 30 and 49 years, and 4 percent among those 50 years or older. In light of these results, it is clear that the higher proportion of participants between 10 and 29 years (75.0%) and the lower proportion of participants between 30 and 49 years (22.8%) of age reflects the statistics for ownership and use of smartphones and cannot be taken as representative of the general population. Hence, self-selection and age group may have resulted in a biased population. Of relevance to this study are findings from a previous study investigating correlates of non-response in a web-based survey of alcohol involvement among college students. 44 Non-response was found to be related to lower levels of experience with the web and lower rates of heavy episodic drinking. The results from this study, which included younger subjects and reported high K-MDQ scores, may have been affected by similar selection biases. However, because screening in the community is especially successful with high-risk samples, 45 the use of smartphone applications by younger members of the population may in fact prove to be clinically effective in screening for bipolar disorder.
Our results suggest that BSD screening tools can be delivered via smartphone applications and that their use can make the screening process faster and easier. It is possible that their convenience and anonymity contributed to the large number of individuals who voluntarily used our applications. The findings and limitations of this study suggest that age and diverse levels of smartphone experience should be considered in using smartphone applications for mental health screening.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
