USABILITY TESTING OF GUIDED INTERNET-BASED PARENT TRAINING FOR CHALLENGING BEHAVIOR IN CHILDREN WITH FETAL ALCOHOL SPECTRUM DISORDER (STRONGEST FAMILIES FASD)

Main Article Content

Amos S. Hundert
Centre for Research in Family Health, I WK Health Centr e, Halifax, NS, Canada

Anna Huguet
Centre for Research in Family Health, I WK Health Centr e, Halifax, NS, Canada; Department of Community Health and Epidemiology, Dalhousie University, Halifax, NS, Canada

Courtney R. Green
Department of Biomedical and Molecular Sciences, Queens University, Kingston, ON, Canada

Amy J. Hewitt
Department of Biomedical and Molecular Sciences, Queens University, Kingston, ON, Canada

Christopher J. Mushquash
Department of Psychology, Lakehead University and Northern Ontario School of Medicine, Thunder Bay, ON, Canada

Nazeem Muhajarine
Department of Community Health and Epidemiology, College of Medicine, University of Saskatchewan, Saskatoon, SK, Canada

Andre Sourander
Department of Child Psychiatry, Clinical Sciences, Medic al Faculty, Turku University and Turku University Hospital, Turku, Finland

Heather Caughey
Public Health Agency of Canada, Ottawa, ON, Canada

Patricia Lingley-Pottie
Centre for Research in Family Health, I WK Health Centre, Halifax, NS, Canada; Strongest Families Institute, Halifax, NS, Canada; Department of Psychiatry, Dalhousie University, Halifax, NS, Canada

Patrick J. McGrath
Centre for Research in Family Health, I WK Health Centr e, Halifax, NS, Canada; Department of Community Health and Epidemiology, Dalhousie University, Halifax, NS, Canada ; Department of Psychiatry, Dalhousie University, Halifax, NS, Canada ; Dep artment of Pediatrics, Dalhousie University, Halifax, NS, Canada

James N. Reynolds
Department of Biomedical and Molecular Sciences, Queens University, Kingston, ON, Canada

Keywords

Fetal alcohol spectrum disorders, distance treatment, psychoeducation, usability, Internet, ehealth

Abstract

Background


In order to meet the need for accessible interventions and support for families affected by fetal alcohol spectrum disorder ( FASD ), we have developed an Internet -based, distance intervention for caregivers of children with FASD between the ages of four and twelve, called Strongest Familiesâ„¢ FASD. Objectives To evaluate the usability of the Strongest Families FASD program content and website in terms of learnability, efficiency and acceptability.


Objectives
To evaluate the usability of the Strongest Families FASD program content and website in terms of learnability, efficiency and acceptability.

Methods


A remote usability testing approach was conducted in two iterat ive cycles of participants. Synchronous online usability testing session s were conducted, followed by asynchronous testing. A total of 18 partic ipants were included, comprised of both health care professionals with expertise in FASD and caregivers of children with FASD. The data collected in each cycle was examined for commonalities and results were used to inform changes to the website and content after each cycle.


Results


Participants rated the website as appealing and relatively easy and fast to use. Nevertheless, several usability problems were identified such as difficulty navigating between sections of content on the website, displaying too much content per page, and the relevance and appropriateness of the content as it related to FASD.


Conclusions


The identification of usability problems was an important step in refining the Strongest Families FASD program before its effectiveness is evaluated in a randomized controlled trial.

Abstract 456 | PDF Downloads 256

References

1. Sokol R, Delaney Black V, Nordstrom B. Fetal alcohol spectrum disorder. JAMA 2003;290(22):2996- 9.
2. Chudley A, Conry J, Cook J, Loock C, Rosales T, LeBlanc N. Fetal alcohol spectrum disorder: Canadian guidelines for diagnosis. CMAJ 2005;172(5 Suppl):S1 -S21.
3. Mattson S, Roesch S, Glass L, et al. Further development of a neurobehavioral profile of fetal alcohol spectrum disorders. Alcohol Clin Exp Res 2013;37(3):517- 28.
4. Pei J, Job J, Kully Martens K, Rasmussen C. Executive function and memory in children with fetal alcohol spectrum disorder. Child Neuropsychol 2011;17(3):290- 309.
5. Rasmussen C. Executive functioning and working memory in feta l alcohol spectrum disorder. Alcohol Clin Exp Res 2005;29(8):1359- 67.
6. Streissguth AP, Aase JM, Clarren SK, Randels SP, LaDue RA, Smith DF. Fetal alcohol syndrome in adolescents and adults. JAMA 1991;265(15):1961-7.
7. Streissguth A, Bookstein F, Barr H, Samps on P, O'Malley K, Young J. Risk factors for adverse life outcomes in fetal alcohol syndrome and fetal alcohol effects. J Dev Behav Pediatr 2004;25(4):228- 38.
8. May P, Baete A, Russo J, et al. Prevalence and characteristics of fetal alcohol spectrum disorders . Pediatrics 2014;134(5):855- 66.
9. Public Health Agency of Canada. Fetal alcohol spectrum disor der (FASD): a framework for action. PHAC 2005.
10. Thanh N, Jonsson E, Salmon A, Sebastianski M. Incidence and prevalence of fetal alcohol spectrum disorder by sex and age group in Alberta, Canada. J Popul Ther Clin Pharmacol 2014;21(3):e395- 404.
11. Popova S, Lange S, Burd L, Rehm J. The burden and economic impact of fetal alcohol spectrum disorder i n Canada. Centre for A ddiction and Mental Health 2015.
12. Stade B, Ali A, Bennett D, et al. The burden of prenatal exposure to alcohol: r evised measurement of cost. J Popul Ther Clin Pharmacol 2009;16(1):e91 -102.
13. Petrenko CLM, Tahir N, Mahoney E, Chin N. Prev ention of secondary conditions in fetal alcohol spectrum disorders: i dentification of systems -level barriers. Ma tern Child Health J 2014;18(6): 1496- 505.
14. Caley L, Winkelman T, Mariano K. Problems expressed by caregivers of children with fetal alcohol spectr um disorder. Int J Nu rs Terminol Classif 2009;20(4): 181- 8.
15. Kodituwakku P, Kodituwakku EL. From research to practice: An integrative framework for the development of interventions for children with fetal alcohol spectrum disorder s. Neuropsychol Rev 2011;21( 2): 204- 23.
16. Peadon E, Rhys Jones B, Bower C, Elliott E. Systematic review of interventions for children with fetal alcohol spectrum d isorders. BMC Pediatr 2009;9(35).
17. Jones D, Forehand R, Cuellar J, et al. Harnessing innovative technologies to advance child ren's mental health: behavioral parent training as an exampl e. Clin Psychol Rev 2013;33(2): 241- 52.
18. Barak A, Hen L, Boniel -Nissim M, Shapira N. A comprehensive review and a meta -analysis of the effectiveness of internet -based psychotherapeutic interventions . J Technol Hum Serv 2008;26(2- 4): 109- 160.
19. Jones D, Forehand R, Cuellar J, et al. Technology- enhanced program for child disruptive behavior disorders: d evelopment and pilot randomized control trial. J Clin Child Adolesc Psychol 2014;43(1):88- 101.
20. Statistic s Canada. Canadian internet use survey 2012. The Daily 2013.
21. Green C, Roane J, Hewitt A, et al. Frequent behavioural challenges in children with fetal alcohol spectrum disorder: a needs -based assessment reported by caregivers and clinicians. J Popul Ther C lin Pharmacol 2014;21(3):e405- 20.
22. McGrath PJ, Lingley -Pottie P, Thurston C, et al. Telephone -based mental health interventions for child disruptive behavior or anxiety disorders: randomized trials and overall analysis. J Am Acad Child Adolesc Psychiatry 2011;50(11):1162- 1172.
23. Kooistra L, Crawford S, Gibbard B, Ramage B, Kaplan B. Differentiating attention deficits in children with fetal alcohol spectrum disorder or attention -deficit -hyperactivity disorder. Dev Med Child Neurol 2010;52(2):205- 11.
24. Gustafson D, Wyatt J. Evaluation of ehealth systems and services. BMJ 2004;328(7449):1150.
25. Wichansky AM. Usability testing in 2000 and beyond. Ergonomics 2000;43(7):998- 1006.
26. Brock D, Kim S, Palmer O, Gallagher T, Holmboe E. Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application. Teach Learn Med 2013;25(1):89- 96.
27. Nielsen J. Heuristic evaluation. In: Nielsen J, Mack RP, edi tors. Usability Inspection Methods. New York: John Wiley & Sons, 1994.
28. Wozney L, McGrath PJ, Newton A, et al. Usability, learnability and performance evaluation of intelligent research and intervention software: a delivery platform for eHealth interventions. Health Informatics J 2015. Jun 23. pii: 1460458215586803. [Epub ahead of print].
29. Hartson HR, Castillo JC, Kelso J, Neale WC. Remote evaluation: The network as an extension of the usability laboratory. Proceedings of CHI'96 Human Factors in Computing Sys tems 1996;228- 235.
30. Wozney LM, Baxter P, Fast H, Cleghorn L, Hundert AS, Newton AS. Sociotechnical human factors involved in remote online usability testing of two eHealth interventions. JMIR Human Factors 2016;3(1):e6.
31. Blackboard Inc. Blackboard collaborat e: Release 12.5. Washington, DC: Blackboard Inc. 2013.
32. Lewis C. Using the" thinking -aloud" method in cognitive interface design. IBM 1982;RC -9265.
33. Ericsson KA, Simon HA. Verbal reports as data. Psychol Rev 1980;87(3):215- 251.
34. Brooke J. SUS: A quick and dir ty usability scale. Usability Evaluation in Industry 1996;189- 194.
35. Sauro J. SUPR -Q: A comprehensive measure of the quality of the website user experience. Journal of Usability Studies 2015;10(2) :e68 -96.
36. Virzi RA. Refining the test phase of usability evalua tion: How many subjects is enough? Human Factors: The Journal of the Human Factors and Ergonomics Society 1992;34(4):457- 468.
37. Nielsen J. Estimating the number of subjects needed for a thinking aloud test. Int J Hum Comput Stud 1994;41(3):385- 397.
38. Turner K, Reynolds JN, McGrath P, et al. Guided internet -based parent training for challenging behavior in children with fetal alcohol spectrum disorder (strongest families FASD): Study protocol for a randomized controlled trial. JMIR Res Protoc 2015;4(4):e112.

Article Sidebar

PDF
Published
Nov 6, 2018

Article Details

How to Cite
Hundert, A. S., Huguet, A., Green, C. R., Hewitt, A. J., Mushquash, C. J., Muhajarine, N., Sourander, A., Caughey, H., Lingley-Pottie, P., McGrath, P. J., & Reynolds, J. N. (2018). USABILITY TESTING OF GUIDED INTERNET-BASED PARENT TRAINING FOR CHALLENGING BEHAVIOR IN CHILDREN WITH FETAL ALCOHOL SPECTRUM DISORDER (STRONGEST FAMILIES FASD). Journal of Population Therapeutics and Clinical Pharmacology, 23(1). https://mail.jptcp.com/index.php/jptcp/article/view/241
Issue
Vol. 23 No. 1 (2016)
Section
Articles

All articles published in JPTCP  are licensed under Copyright Creative Commons Attribution-NonCommercial 4.0 International License.

How to Cite

Hundert, A. S., Huguet, A., Green, C. R., Hewitt, A. J., Mushquash, C. J., Muhajarine, N., Sourander, A., Caughey, H., Lingley-Pottie, P., McGrath, P. J., & Reynolds, J. N. (2018). USABILITY TESTING OF GUIDED INTERNET-BASED PARENT TRAINING FOR CHALLENGING BEHAVIOR IN CHILDREN WITH FETAL ALCOHOL SPECTRUM DISORDER (STRONGEST FAMILIES FASD). Journal of Population Therapeutics and Clinical Pharmacology, 23(1). https://mail.jptcp.com/index.php/jptcp/article/view/241

Most read articles by the same author(s)