Culturally adapting internet- and mobile-based health promotion interventions might not be worth the effort: a systematic review and meta-analysis
Liu, J. J. et al. Adapting health promotion interventions to meet the needs of ethnic minority groups: Mixed-methods evidence synthesis. Health Technology Assessment https://doi.org/10.3310/hta16440 (2012).
Cerf, M. E. Healthy lifestyles and noncommunicable diseases: nutrition, the life‐course, and health promotion. Lifestyle Med. 2, 1–12 (2021).
Preston, S. H., Stokes, A., Mehta, N. K. & Cao, B. Projecting the effect of changes in smoking and obesity on future life expectancy in the United States. Demography 51, 27–49 (2014).
World Health Organization. Sexual Health and its Linkages to Reproductive Health: an Operational Approach 1–12 (World Health Organization, 2017).
Di Cesare, M. et al. Inequalities in non-communicable diseases and effective responses. Lancet 381, 585–597 (2013).
World Health Organization. Global Status Report On Noncommunicable Diseases 2014 (World Health Organization, 2014).
World Health Organization. 2008-2013 Action Plan for the Global Strategy for the Prevention and Control of Noncommunicable Diseases (World Health Organization, 2013).
Friel, S. & Marmot, M. G. Action on the Social determinants of health and health inequities goes global. Annu. Rev. Public Health. https://doi.org/10.1146/annurev-publhealth-031210-101220 (2011).
Muñoz, R. F. Using evidence-based Internet interventions to reduce health disparities worldwide. J. Med. Internet Res. 12, 1–10 (2010).
Head, K. J., Noar, S. M., Iannarino, N. T. & Grant Harrington, N. Efficacy of text messaging-based interventions for health promotion: a meta-analysis. Soc. Sci. Med. 97, 41–48 (2013).
Fiedler, J., Eckert, T., Wunsch, K. & Woll, A. Key facets to build up eHealth and mHealth interventions to enhance physical activity, sedentary behavior and nutrition in healthy subjects—an umbrella review. BMC Public Health 20, 1–21 (2020).
Müller, A. M. et al. Physical activity, sedentary behavior, and diet-related ehealth and mhealth research: Bibliometric analysis. J. Med. Internet Res. 20, e122 (2018).
Do, H. P. et al. Which eHealth interventions are most effective for smoking cessation? A systematic review. Patient Prefer. Adherence 12, 2065–2084 (2018).
Webb, T. L., Joseph, J., Yardley, L. & Michie, S. Using the Internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J. Med. Internet Res. 12, 1–18 (2010).
Muñoz, R. F. et al. Massive open online interventions: a novel model for delivering behavioral- health services worldwide. Clin. Psychol. Sci. 4, 194–205 (2016).
Vandelanotte, C. et al. Past, present, and future of ehealth and mhealth research to improve physical activity and dietary behaviors. J. Nutr. Educ. Behav. 48, 219–228.e1 (2016).
Jiang, X., Ming, W. K. & You, J. H. S. The cost-effectiveness of digital health interventions on the management of cardiovascular diseases: systematic review. J. Med. Internet Res. 21, 1–11 (2019).
Elbert, N. J. et al. Effectiveness and cost-effectiveness of ehealth interventions in somatic diseases: a systematic review of systematic reviews and meta-analyses. J. Med. Internet Res. 16, 1–23 (2014).
Henrich, J., Heine, S. J. & Norenzayan, A. Beyond WEIRD: towards a broad-based behavioral science. Behav. Brain Sci. 33, 111–135 (2010).
Lin, J., Faust, B., Ebert, D. D., Krämer, L. & Baumeister, H. A web-based acceptance-facilitating intervention for identifying patients’ acceptance, uptake, and adherence of internet- and mobile-based pain interventions: randomized controlled trial. J. Med. Internet Res. 20, e244 (2018).
Baumeister, H. et al. Impact of an acceptance facilitating intervention on diabetes patients’ acceptance of Internet-based interventions for depression: a randomized controlled trial. Diabetes Res. Clin. Pract. 105, 30–39 (2014).
Armaou, M., Araviaki, E. & Musikanski, L. eHealth and mHealth interventions for ethnic minority and historically underserved populations in developed countries: an umbrella review. Int. J. Community Well-Being 3, 193–221 (2020).
Clauss-Ehlers, C. S., Chiriboga, D. A., Hunter, S. J., Roysircar, G. & Tummala-Narra, P. APA multicultural guidelines executive summary: ecological approach to context, identity, and intersectionality. Am. Psychol. 74, 232–244 (2019).
Lewis, J. A., Williams, M. G., Peppers, E. J. & Gadson, C. A. Applying intersectionality to explore the relations between gendered racism and health among black women. J. Couns. Psychol. 64, 475–486 (2017).
World Health Organization. Promoting health in the SDGs. Report on 9th Global Conference on Health Promotion 1–37 (World Health Organization, 2016).
Barrera, M., Castro, F. G. & Steiker, L. K. H. A critical analysis of approaches to the development of preventive interventions for subcultural groups. Am. J. Community Psychol. 48, 439–454 (2011).
Bernal, G., Jiménez-Chafey, M. I., & Domenech Rodríguez, M. M. & Domenech Rodríguez Cultural adaptation of treatments: a resource for considering culture in evidence-based practice. Prof. Psychol. Res. Pract. 40, 361–368 (2009).
Resnicow, K., Soler, R., Braithwaite, R. L., Ahluwalia, J. S. & Butler, J. Cultural sensitivity in substance use prevention. J. Community Psychol. 28, 271–290 (2000).
Cardemil, E. Cultural adaptations to empirically supported treatments: a research agenda. Sci. Rev. Ment. Heal. Pract. 7, 8–21 (2010).
Liu, J. J. et al. Smoking cessation interventions for ethnic minority groups—a systematic review of adapted interventions. Prev. Med. (Balt.). 57, 765–775 (2013).
Nierkens, V. et al. Effectiveness of cultural adaptations of interventions aimed at smoking cessation, diet, and/or physical activity in ethnic minorities. a systematic review. PLoS ONE https://doi.org/10.1371/journal.pone.0073373 (2013).
Lambert, S. et al. The effect of culturally-adapted health education interventions among culturally and linguistically diverse (CALD) patients with a chronic illness: a meta-analysis and descriptive systematic review. Patient Educ. Couns. https://doi.org/10.1016/j.pec.2021.01.023 (2021).
Staffileno, B. A. B. A., Tangney, C. C. C. C. & Fogg, L. Favorable outcomes using an eHealth approach to promote physical activity and nutrition among young African American women. J. Cardiovasc. Nurs. 33, 62–71 (2018).
Anderson-Lewis, C., Darville, G., Mercado, R. E., Howell, S. & Di Maggio, S. mHealth technology use and implications in historically underserved and minority populations in the united states: Systematic literature review. JMIR mHealth uHealth 6, e128 (2018).
Montague, E. & Perchonok, J. Health and wellness technology use by historically underserved health consumers: Systematic review. J. Med. Internet Res. 14, e78 (2012).
Bennett, G. G. et al. Electronic health (eHealth) interventions for weight management among racial/ethnic minority adults: a systematic review. Obes. Rev. 15, 146–158 (2014).
Augustson, E. et al. Text to quit China: an mHealth smoking cessation. Trial Am. J. Health Promot. 31, 217–225 (2017).
Bender, M. S., Cooper, B. A., Park, L. G., Padash, S. & Arai, S. A feasible and efficacious mobile-phone based lifestyle intervention for Filipino Americans with type 2 diabetes: randomized controlled trial. JMIR Diabetes 2, e30 (2017).
Bowen, D. J., Henderson, P. N., Harvill, J. & Buchwald, D. Short-term effects of a smoking prevention website in American Indian youth. J. Med. Internet Res. 14, e81 (2012).
Brito Beck Da Silva, K. et al. Evaluation of the computer-based intervention program stayingfit Brazil to promote healthy eating habits: The results from a school cluster-randomized controlled trial. Int. J. Environ. Res. Public Health 16, 1–18 (2019).
Cruvinel, E., Richter, K. P., Colugnati, F. & Ronzani, T. M. An experimental feasibility study of a hybrid telephone counseling/text messaging intervention for post-discharge cessation support among hospitalized smokers in Brazil. Nicotine Tob. Res. 21, 1700–1705 (2019).
Duan, Y. P., Wienert, J., Hu, C., Si, G. Y. & Lippke, S. Web-based intervention for physical activity and fruit and vegetable intake among Chinese university students: a randomized controlled trial. J. Med. Internet Res. 19, 1–15 (2017).
Fortmann, A. L. et al. Dulce digital: An mHealth SMS based intervention improves glycemic control in hispanics with type 2 diabetes. Diabetes Care 40, 1349–1355 (2017).
Kurth, A. E. et al. Linguistic and cultural adaptation of a computer-based counseling program (CARE+ Spanish) to support HIV treatment adherence and risk reduction for people living with HIV/AIDS: a randomized controlled trial. J. Med. Internet Res. 18, e195 (2016).
Larsen, B. A. et al. Randomized trial of a physical activity intervention for Latino Men: Activo. Am. J. Prev. Med. 59, 219–227 (2020).
Lau, P. W. C., Pitkethly, A. J., Leung, B. W. C., Lau, E. Y. & Wang, J. J. The intervention effect of SMS delivery on chinese adolescent’s physical activity. Int. J. Environ. Res. Public Health 16, 1–12 (2019).
Marcus, B. H. et al. Pasos Hacia La Salud: a randomized controlled trial of an internet-delivered physical activity intervention for Latinas. Int. J. Behav. Nutr. Phys. Act. 13, 62 (2016).
Montag, A. C. et al. Preventing alcohol-exposed pregnancy among an american indian/alaska native population: effect of a screening, brief intervention, and referral to treatment intervention. Alcohol. Clin. Exp. Res. 39, 126–135 (2015).
Peiris, D. et al. A smartphone app to assist smoking cessation among aboriginal australians: findings from a pilot randomized controlled trial. JMIR mHealth uHealth 7, e12745 (2019).
Rothstein, H. R., Sutton, A. J. & Borenstein, M. Publication Bias in Meta-Analyses: Prevention, Assessment and Adjustments (John Wiley & Sons, 2005).
Rathod, S. et al. The current status of culturally adapted mental health interventions: a practice-focused review of meta-analyses. Neuropsychiatr. Dis. Treat. 14, 165–178 (2018).
Harper Shehadeh, M., Maercker, A., Heim, E., Chowdhary, N. & Albanese, E. Cultural adaptation of minimally guided interventions for common mental disorders: a systematic review and meta-analysis. JMIR Ment. Heal 3, e44 (2016).
Lustria, M. L. A. et al. A meta-analysis of web-delivered tailored health behavior change interventions. J. Health Commun. https://doi.org/10.1080/10810730.2013.768727 (2013).
Van Loon, A., Van Schaik, A., Dekker, J. & Beekman, A. Bridging the gap for ethnic minority adult outpatients with depression and anxiety disorders by culturally adapted treatments. J. Affect. Disord. 147, 9–16 (2013).
Whittaker, R. et al. Mobile phone text messaging and app‐based interventions for smoking cessation. Cochrane Database Syst. Rev. https://doi.org/10.1002/14651858.CD006611.pub5 (2019).
Myung, S.-K., McDonnell, D. D., Kazinets, G., Seo, H. G. & Moskowitz, J. M. Effects of web- and computer-based smoking cessation programs. Arch. Intern. Med. https://doi.org/10.1001/archinternmed.2009.109 (2009).
Joiner, K. L., Nam, S. & Whittemore, R. Lifestyle interventions based on the diabetes prevention program delivered via eHealth: a systematic review and meta-analysis. Prev. Med. (Balt.). 100, 194–207 (2017).
Rodriguez Rocha, N. P. & Kim, H. eHealth interventions for fruit and vegetable intake: a meta-analysis of effectiveness. Heal. Educ. Behav. 46, 947–959 (2019).
Kelly, J. T., Reidlinger, D. P., Hoffmann, T. C. & Campbell, K. L. Telehealth methods to deliver dietary interventions in adults with chronic disease: a systematic review and meta-analysis1,2. Am. J. Clin. Nutr. 104, 1693–1702 (2016).
Hutchesson, M. J. et al. eHealth interventions for the prevention and treatment of overweight and obesity in adults: A systematic review with meta-analysis. Obes. Rev. 16, 376–392 (2015).
Bailey, J. V. et al. Interactive computer-based interventions for sexual health promotion. Cochrane Database Syst. Rev. https://doi.org/10.1002/14651858.cd006483.pub2 (2010).
Noar, S. M., Black, H. G. & Pierce, L. B. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis. Aids 23, 107–115 (2009).
Cunningham, J. A., Kypri, K. & McCambridge, J. Exploratory randomized controlled trial evaluating the impact of a waiting list control design. BMC Med. Res. Methodol. 13, 150 (2013).
Graham, A. et al. Systematic review and meta-analysis of Internet interventions for smoking cessation among adults. Subst. Abuse Rehabil. 55. https://doi.org/10.2147/sar.s101660 (2016).
Bernal, G. & Sáez-Santiago, E. Culturally centered psychosocial interventions. J. Community Psychol. 34, 121–132 (2006).
Salamanca-Sanabria, A., Richards, D. & Timulak, L. Adapting an internet-delivered intervention for depression for a Colombian college student population: an illustration of an integrative empirical approach. Internet Inter. 15, 76–86 (2019).
Spanhel, K. et al. Cultural adaptation of internet- and mobile-based interventions for mental disorders: a systematic review. npj Digit. Med. https://doi.org/10.1038/s41746-021-00498-1 (2021).
Domhardt, M. et al. Therapeutic processes in digital interventions for anxiety: a systematic review and meta-analytic structural equation modeling of randomized controlled trials. Clin. Psychol. Rev. 90, 102084 (2021).
Domhardt, M., Cuijpers, P., Ebert, D. D. & Baumeister, H. More light? opportunities and pitfalls in digitalized psychotherapy process research. Front. Psychol. 12, 1–5 (2021).
Kazdin, A. E. Mediators and mechanisms of change in psychotherapy research. Annu. Rev. Clin. Psychol. 3, 1–27 (2007).
Domhardt, M. et al. Mediators and mechanisms of change in internet- and mobile-based interventions for depression: a systematic review. Clin. Psychol. Rev. 83, 101953 (2021).
Rad, M. S., Martingano, A. J. & Ginges, J. Toward a psychology of Homo sapiens: Making psychological science more representative of the human population. Proc. Natl Acad. Sci. USA 115, 11401–11405 (2018).
Gone, J. P. A community-based treatment for Native American historical trauma: prospects for evidence-based practice. J. Consult. Clin. Psychol. 77, 751–762 (2009).
Nagayama Hall, G. C., Yip, T. & Zárate, M. A. On becoming multicultural in a monocultural research world: a conceptual approach to studying ethnocultural diversity. Am. Psychol. 71, 40–51 (2016).
Bernal, G. & Adames, C. Cultural adaptations: conceptual, ethical, contextual, and methodological issues for working with ethnocultural and majority-world populations. Prev. Sci. 18, 681–688 (2017).
Castro, F. G., Barrera, M. & Holleran Steiker, L. K. Issues and challenges in the design of culturally adapted evidence-based interventions. Ssrn https://doi.org/10.1146/annurev-clinpsy-033109-132032 (2010).
Warne, D. & Wescott, S. Social determinants of American Indian Nutritional Health. Curr. Dev. Nutr. https://doi.org/10.1093/cdn/nzz054 (2019).
Abaza, H. & Marschollek, M. mHealth application areas and technology combinations. Methods Inf. Med. 56, e105–e122 (2017).
Hall, C. S., Fottrell, E., Wilkinson, S. & Byass, P. Assessing the impact of mHealth interventions in low- and middle-income countries—what has been shown to work? Glob. Health Action 7, 25606 (2014).
Kruse, C. et al. Barriers to the use of mobile health in improving health outcomes in developing countries: Systematic review. J. Med. Internet Res. 21, 1–13 (2019).
Weisel, K. K. et al. Standalone smartphone apps for mental health—a systematic review and meta-analysis. npj Digit. Med. 2, 1–10 (2019).
Bendig, E. et al. Internet-based interventions in chronic somatic disease. Dtsch. Arztebl. Int. 115, 659–665 (2018).
Ebert, D. D. et al. Internet- and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health. Eur. Psychol. 23, 167–187 (2018).
Tsetsi, E. & Rains, S. A. Smartphone Internet access and use: extending the digital divide and usage gap. Mob. Media Commun. 5, 239–255 (2017).
Baumeister, H., Reichler, L., Munzinger, M. & Lin, J. The impact of guidance on Internet-based mental health interventions – A systematic review. Internet Inter. 1, 205–215 (2014).
Arsenijevic, J., Tummers, L. & Bosma, N. Adherence to electronic health tools among vulnerable groups: Systematic literature review and meta-analysis. J. Med. Internet Res. 22, e11613 (2020).
Aranda-Jan, C. B., Mohutsiwa-Dibe, N. & Loukanova, S. Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa. BMC Public Health 14, 1–15 (2014).
James, D. C., Harville, C., Sears, C., Efunbumi, O. & Bondoc, I. Participation of African Americans in e-Health and m-Health studies: a systematic review. Telemed. e-Health 23, 351–364 (2017).
Hwang, D. S. A., Lee, A., Song, J. M. & Han, H. R. Recruitment and retention strategies among racial and ethnic minorities in web-based intervention trials: retrospective qualitative analysis. J. Med. Internet Res. 23, e23959 (2021).
Callier, S. & Fullerton, S. M. Diversity and inclusion in unregulated mHealth research: addressing the risks. J. Law Med. Ethics 48, 115–121 (2020).
Druce, K. L., Dixon, W. G. & McBeth, J. Maximizing engagement in mobile health studies: lessons learned and future directions. Rheum. Dis. Clin. North Am. 45, 159–172 (2019).
Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ 339, 332–336 (2009).
Balci, S., Spanhel, K., Sander, L. & Baumeister, H. Protocol for a systematic review and meta-analysis of culturally adapted internet- And mobile-based health promotion interventions. BMJ Open https://doi.org/10.1136/bmjopen-2020-037698 (2020).
Spanhel, K., Balci, S., Baumeister, H., Bengel, J. & Sander, L. B. Cultural adaptation of Internet- and mobile-based interventions for mental disorders: a systematic review protocol. Syst. Rev. 9, 207 (2020).
Babineau, J. Product Review: Covidence (Systematic Review Software). J. Can. Heal. Libr. Assoc./J. l’Association bibliothèques la St.é du Can. 35, 68 (2014).
Sterne, J. A. C. et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ https://doi.org/10.1136/bmj.l4898 (2019).
Higgins JPT et al. (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. (The Cochrane Collaboration, 2011). Available at: www.handbook.cochrane.org.
Fritz, C. O., Morris, P. E. & Richler, J. J. Effect size estimates: current use, calculations, and interpretation. J. Exp. Psychol. Gen. 141, 2–18 (2012).
Tufanaru, C., Munn, Z., Stephenson, M. & Aromataris, E. Fixed or random effects meta-analysis? Common methodological issues in systematic reviews of effectiveness. Int. J. Evid. Based Health. 13, 196–207 (2015).
Balduzzi, S., Rücker, G. & Schwarzer, G. How to perform a meta-analysis with R: a practical tutorial. Evid. Based Ment. Health 22, 153–160 (2019).
Harrer, M., Cuijpers, P. & Ebert, D. Doing meta-analysis in R. https://doi.org/10.5281/ZENODO.2551803 (2019).
The Nordic Cochrane Centre. Review Manager (RevMan) (The Cochrane Collaboration, 2014).
Viechtbauer, W. Conducting meta-analyses in R with the metafor. J. Stat. Softw. 36, 1–48 (2010).
Cohen, J. Statistical Power Analysis for the Behavioural Science 2nd edn. (Erlbaum Associate, 1988).
Higgins, J. P. T. & Thompson, S. G. Quantifying heterogeneity in a meta-analysis. Stat. Med. https://doi.org/10.1002/sim.1186 (2002).
Card, N. A. Applied Meta-Analysis for Social Science Research. (Guilford, 2011).
Bender, M. S. & Clark, M. J. Cultural adaptation for ethnic diversity: a review of obesity interventions for preschool children. Calif. J. Health Promot 9, 40 (2011).
Barrera, M., Castro, F. G., Strycker, L. & Toobert, D. Cultural adaptations of behavioral health interventions: a progress report. J. Consult. Clin. Psychol. 81, 196–205 (2013).
Castro, Y. et al. Adaptation of a counseling intervention to address multiple cancer risk factors among overweight/obese latino smokers. Heal. Educ. Behav. 42, 65–72 (2015).
Philis-Tsimikas, A. et al. Improvement in diabetes care of underinsured patients enrolled in Project Dulce: A community-based, culturally appropriate, nurse case management and peer education diabetes care model. Diabetes Care 27, 110–115 (2004).
