Evaluation of usability, perception of usefulness, and validation of a restorative dentistry study app
DOI:
https://doi.org/10.30979/BrazJDentEduc.v25.2448Keywords:
Telemedicine, Education Dental Continuing, Dentistry OperativeAbstract
The objective was to develop an application, evaluate its usability and perceived usefulness, in addition to validating it in different groups to identify which group is most targeted at. The “Restorative Procedures Clinical Study Guide” was developed by experts on Restorative Dentistry. The content is accessed through two tabs: “Materials Guide”, which presents the materials and protocols, and “Dental Assessment”, which directs the user to the degree of tooth involvement, pulp condition and directs them to a treatment protocol specific. The evaluation was carried out by 15 specialists in restorative dentistry using the System Utility Score (SUS) usability scale and the Technology Acceptance Model (TAM). It was validated by third, fifth and tenth semester undergraduate students, lato sensu postgraduate students in dentistry and primary care dentists in Fortaleza, Ceará, Brazil (n=15). Participants used and evaluated the application using the SUS and TAM questionnaires. The values obtained were compared using the Wilcoxon test and Spearman correlation. In the evaluation by a specialist, scores of 90.6 were obtained in the SUS and 68.0 in the TAM. In validation, overall scores of 87.7 and 91.2 were obtained for SUS and TAM, respectively. When comparing groups, scores were higher for undergraduate students compared to professionals, SUS (p=0.037) and TAM (p=0.031). The application provides clinical information support for the dental community, proving to be a potential study guide for professionals and students, being more targeted at undergraduate students.
References
Chahande DJ, Deshmukh DS. Perception of undergraduate dental students about use of smartphones in dentistry: an efficient teaching-learning tool during covid - 19 pandemic. AJMRR [Internet]. 2022:19;3(2):138-52. [cited 2024 Oct 07]. doi: https://doi.org/10.55662/ajmrr.2022.3205
Pilcher L, Pahlke S, Urquhart O, O’Brien KK, Dhar V, Fontana M, et al. Direct materials for restoring caries lesions: systematic review and meta-analysis-a report of the American Dental Association Council on Scientific Affairs. JADA [Internet]. 2023;154(2):e1-98. doi: https://doi.org/10.1016/j.adaj.2022.09.012
Martins MT, Sardenberg F, Vale MP, Paiva SM, Pordeus IA. Dental caries and social factors: impact on quality of life in Brazilian children. Braz Oral Res [Internet]. 2015;29(1):0133. doi: https://doi.org/10.1590/1807-3107BOR-2015.vol29.0133
Lee M, Lee H, Kim Y, Kim J, Cho M, Jang J, et al. Mobile app-based health promotion programs: a systematic review of the literature. IJERPH [Internet]. 2018;15(12):2838. doi: https://doi.org/10.3390/ijerph15122838
Land-Zandstra AM, Devilee JLA, Snik F, Buurmeijer F, Van Den Broek JM. Citizen science on a smartphone: participants’ motivations and learning. Public Underst Sci [Internet]. 2016;25(1):45-60. https://doi.org/10.1177/0963662515602406
Namakian M, Subar P, Glassman P, Quade R, Harrington M. In-Person Versus “Virtual” Dental Examination: Congruence Between Decision-Making Modalities. CDA [Internet]. 2012;40(7):587–95. doi: https://doi.org/10.1080/19424396.2012.12220931
Ozdalga E, Ozdalga A, Ahuja N. The Smartphone in Medicine: A Review of Current and Potential Use Among Physicians and Students. J Med Internet Res [Internet]. 2012;14(5):e1994. doi: https://doi.org/10.2196/jmir.1994
Visser BJ, Bouman J. There’s a medical app for that. BMJ. 2012;344:e2162.
Adams NE. Bloom’s taxonomy of cognitive learning objectives. J Med Libr Assoc [Internet]. 2015;103(3):152-3. doi: https://doi.org/10.1136/sbmj.e2162
Zessis NR, Dube AR, Sadanand A, Cole JJ, Hrach CM, Daud YN. Teaching scripts via smartphone app facilitate resident-led teaching of medical students. BMC Med Educ [Internet]. 2021;21(1):33. doi: https://doi.org/10.1186/s12909-021-02782-w
Goob J, Possert P, Klören M, Erdelt K, Güth JF, Edelhoff D, et al. First evaluation of an app to optimize and organize the processes and assessments in dental clinical courses. BMC Med Educ [Internet]. 2022;22(1):872. doi: https://doi.org/10.1186/s12909-022-03945-z
Wang W. Influences of education app-assisted teaching technology on learning efficacy of learners. Int J Emerg Technol Learn [Internet]. 2022;17(21):4-16. doi: https://doi.org/10.3991/ijet.v17i21.35369
Zhang J, Zhang P. Influence of APP-assisted teaching on teaching quality in mobile learning. Int J Emerg Technol Learn [Internet]. 2023;18(9):4-16. doi: https://doi.org/10.3991/ijet.v18i09.37827
Teixeira D, Maritan B, Gonçalves B. Um modelo de fluxo para design de livro digital infantil. 2016. In XX Congreso de la Sociedad Iberoamericana de Gráfica Digital. São Paulo: Blucher; 2016. doi: https://doi.org/10.5151/despro-sigradi2016-571
Sousa VEC, Lopez KD. Towards usable E-health. Appl Clin Inform [Internet]. 2017;08(2):470-90. doi: https://doi.org/10.4338/ACI-2016-10-R-0170
Nielsen J. 10 Usability heuristics for user interface design. 1994 [cited 2024 Oct 07]. Available from: https://www.nngroup.com/articles/ten-usability-heuristics/
Sauro J, Lewis JR. Quantifying the user experience: practical statistics for user research. Estados Unidos: Morgan Kaufmann; 2016 [cited 2024 Oct 07]. 374 p. doi: https://doi.org/10.1016/b978-0-12-384968-7.00002-3
Borsci S, Federici S, Lauriola M. On the dimensionality of the System Usability Scale: a test of alternative measurement models. Cogn Process [Internet]. 2009;10(3):193–7. doi: https://doi.org/10.1007/s10339-009-0268-9
Macedo FS, Silva PGB, Marçal EBF, Rolim JPML. Evaluation of usability, perception of usefulness, and efficiency of an application in interpreting imaging examinations and supporting decision-making in orthopedics. Telemed J E Health [Internet]. 2021;27(5):561–7. doi: https://doi.org/10.1089/tmj.2020.0108
Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly [Internet]. 1989;13(3):319-40. doi: https://doi.org/10.2307/249008
Seixas CA, Godoy S, Martins JCA, Mazzo A, Baptista RCN, Mendes IAC. Usability assessment of moodle by Brazilian and Portuguese nursing students. Comput Inform Nurs [Internet]. 2016;34(6):266. doi: https://doi.org/10.1097/CIN.0000000000000237
Silveira DV, Marcolino MS, Machado EL, Ferreira CG, Alkmim MBM, Resende ES, et al. Development and evaluation of a mobile decision support system for hypertension management in the Primary Care setting in Brazil: mixed-methods field study on usability, feasibility, and utility. JMIR Health and Health [Internet]. 2019:25;7(3):e9869. doi: https://doi.org/10.2196/mhealth.9869
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum-Comput Int [Internet]. 2008;24(6):574–94. doi: https://doi.org/10.1080/10447310802205776
Lee Y, Kozar KA, Larsen KRT. The Technology Acceptance Model: past, present, and future. CAIS [Internet]. 2003 [cited 2024 Jan 22];12:752-780. doi: https://doi.org/10.17705/1cais.01250
Mitov G, Dillschneider T, Abed MR, Hohenberg G, Pospiech P. Introducing and evaluating MorphoDent, a web-based learning program in dental morphology. JDE [Internet]. 2010;74(10):1133–9. doi: https://doi.org/10.1002/j.0022-0337.2010.74.10.tb04968.x
Sharma S, Mohanty V, Balappanavar AY, Chahar P, Rijhwani K. Role of digital media in promoting oral health: a systematic review. Cureus [Internet]. 2022;14(9):e28893. doi: https://doi.org/10.7759/cureus.28893.ecollection
Braz MA, Rivaldo EG, Moura FRR, Cruz RA, Brew MC, Haddad AE, et al. Aplicativos móveis para ensino e assistência odontológica: uma revisão integrativa. Rev ABENO [Internet]. 2018;18(3):118-90. doi: https://doi.org/10.30979/rev.abeno.v18i3.574
Kalman L. Development of a novel dental shade determination application. J Dent Res Dent Clin Dent Prospects [Internet]. 2020;14(1):73–6. doi: https://doi.org/10.34172/joddd.2020.011
Buijink AWG, Visser BJ, Marshall L. Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med [Internet]. 2013;18(3):90–2. doi: https://doi.org/10.1136/eb-2012-100885
Figueiredo M, Barone D, Jardim LE. New challenges for informatics: design and implementation of a mobile system dedicated to improve oral health conditions. In Actas del Congreso Internacional de Informática Educativa. p. 707-710. 2013 [cited 2024 Oct 07]. Available from: https://www.tise.cl/volumen9/TISE2013/707-710.pdf
Ribeiro YJS, Ferreira LG, Nelson-Filho P, Arnez MFM, Paula-Silva FWG. Influence of digital media in the oral health education of mother-child pairs: study protocol of a parallel double-blind randomized clinical trial. Trials [Internet]. 2022;23(1):639. doi: https://doi.org/10.1186/s13063-022-06602-4
University knowledge in an age of supercomplexity. High Educ [Internet]. 2000;40:409-422. doi: https://doi.org/10.1023/A:1004159513741
Leadbeatter D, Peck C. Are dental students ready for supercomplex dental practice? Eur J Dent Educ [Internet]. 2018;22(1):e116-21. doi: https://doi.org/10.1111/eje.12268
Payne KFB, Wharrad H, Watts K. Smartphone and medical related App use among medical students and junior doctors in the United Kingdom (UK): a regional survey. BMC Med Inform Decis Mak [Internet]. 2012:12(1):121. doi: https://doi.org/10.1186/1472-6947-12-121
Zhang C, Fan L, Chai Z, Yu C, Song J. Smartphone and medical application use among dentists in China. BMC Med Inform Decis Mak [Internet]. 2020;20(1):213. doi: https://doi.org/10.1186/s12911-020-01238-3
