Usability and utility evaluation of an application for dentists and dental students to manage dental injuries
DOI:
https://doi.org/10.30979/revabeno.v24i1.2203Keywords:
Education Dental Continuing, Tooth Injuries, Diagnosis, Mobile Applications, Dental InformaticsAbstract
This study aimed to apply usability and utility tests to the Dental Trauma application (app), available for free in Portuguese on the App Store and Play Store. Students and dentists participated in the study (n = 20). The System Usability Scale (SUS) test was used for usability analysis, and the Technology Acceptance Model (TAM) test, adapted to the dental trauma context, was used for utility analysis. The Mann-Whitney test was applied to compare SUS scores between students and dentists, and the Spearman test was used to correlate utility questions. The SUS score at the 50th percentile was 83.75. Scores above 68 are classified as acceptable. The Mann-Whitney test did not show a significant difference in the SUS score when analyzing dentists and dental students separately (p = 0.442). The app was widely evaluated as useful (95% to 100%), with robust, positive, and significant correlations observed between responses to each question. However, it does not cover traumas in deciduous teeth, presenting an opportunity for updating or developing other apps. The Dental Trauma app fulfilled both usability and usefulness criteria, garnering an "excellent" rating in its outcomes. Users acknowledged its utility as a valuable technological tool aiding professionals in diagnosis, management, and comprehension of dental trauma-related concepts.
Downloads
References
Instituto Brasileiro de Geografia e Estatística, portal. De 2010 a 2022, população brasileira cresce 6,5% e chega a 203,1 milhões. Brasília: Ministério do Planejamento e Orçamento; 2023 [citado em 29 de novembro de 2023]. Disponível em: https://agenciadenoticias.ibge.gov.br/agencia-noticias/2012-agencia-de-noticias/noticias/37237-de-2010-a-2022-populacao-brasileira-cresce-6-5-e-chega-a-203-1-milhoes
Santana FS, Costa MB, Matos Neto JD, Silva AB, Silva GJF, Takeshita WM. Development and evaluation of a mobile application for teaching Dental Radiology. Rev ABENO [Internet]. 2020;20(2):102-110. doi: https://doi.org/10.30979/rev.abeno.v20i2.1135
Abuabara A, Castro JP, Locks ME, Pezzin AP, Mattos NH, Araújo CM, et al. Evaluation of Endo 10 mobile application as diagnostic tool in endodontics. J Clin Exp Dent [Internet]. 2023;15(8):e612-e620. doi: https://doi.org/10.4317/jced.60342
Brasil. Projeto Saúde Bucal - SB Brasil. 2020 [citado em 29 de novembro de 2023]. Disponível em: http://189.28.128.100/dab/docs/portaldab/documentos/projetosbbrasil2020CONSULTAPUBLICA.pdf
Vieira WA, Pecorari VGA, Figueiredo-de-Almeida R, Carvas Junior N, Vargas-Neto J, Santos ECA, et al. Prevalence of dental trauma in Brazilian children and adolescents: a systematic review and meta-analysis. Cad Saude Publica [Internet]. 2021;37(12):e00015920. doi: https://doi.org/10.1590/0102-311X00015920
Petti S, Glendor U, Andersson L. World traumatic dental injury prevalence and incidence, a meta-analysis-One billion living people have had traumatic dental injuries. Dent Traumatol [Internet]. 2018;34(2):71-86. doi: https://doi.org/10.1111/edt.12389
Loureiro JM, Jural LA, Soares TRC, Risso PA, Fonseca-Gonçalves A, Magno MB, et al. Critical appraisal of the information available on traumatic dental injuries found in applications. Dent Traumatol [Internet]. 2022;38(1):77-87. doi: https://doi.org/10.1111/edt.12715
Levin L, Day PF, Hicks L, O'Connell A, Fouad AF, Bourguignon C, et al. International Association of Dental Traumatology guidelines for the management of traumatic dental injuries: General introduction. Dent Traumatol [Internet]. 2020;36(4):309-313. doi: https://doi.org/10.1111/edt.12574
Brasil. Ministério da Saúde. Conselho Nacional de Saúde. Resolução nº 466, de 12 dezembro de 2012. Aprova as diretrizes e normas regulamentadoras de pesquisas envolvendo seres humanos. Diário Oficial da União: 2012 [citado em 8 de janeiro de 2024]. Disponível em: https://bvsms.saude.gov.br/bvs/saudelegis/cns/2013/res0466_12_12_2012.html
Brasil. Ministério da Saúde. Conselho Nacional de Saúde. Resolução nº 510, de 7 de abril de 2016. Dispõe sobre as normas aplicáveis a pesquisas em Ciências Humanas e Sociais cujos procedimentos metodológicos envolvam a utilização de dados diretamente obtidos com os participantes ou de informações identificáveis ou que possam acarretar riscos maiores do que os existentes na vida cotidiana, na forma definida nesta Resolução. Diário Oficial da União: 2016 [citado em 8 de janeiro de 2024]. Disponível em: https://www.in.gov.br/web/dou/-/resolucao-n-510-de-7-de-abril-de-2016-22917558
Nogueira JBS, Carvalho ACGS, Barros Filho EM, Araújo LHDC, Bezerra MJC, Demange MK. Evaluation of benefits and accuracy of a mobile application in planning total knee arthroplasties. Rev Bras Ortop [Internet]. 2018;53(2):142-150. doi: https://doi.org/10.1016/j.rboe.2018.02.011
Tullis TS, Stetson JN. A comparison of questionnaires for assessing website usability. Proceedings of UPA 2004 Conference [Internet]. Minnesota; 2004 [citado em 30 de novembro de 2023]. Disponível em: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.396.3677&rep=rep1&type=pdf
Müller J, Weinert L, Svensson L, Rivinius R, Kreusser MM, Heinze O. Mobile Access to Medical Records in Heart Transplantation Aftercare: Mixed-Methods Study Assessing Usability, Feasibility and Effects of a Mobile Application. Life [Internet]. 2022;12:1204. doi: https://doi.org/10.3390/life12081204
Broke J. SUS: A Retrospective. J usability Stud [Internet]. 2013;8(2):29-40. [citado em 30 de novembro de 2023]. Disponível em: https://uxpajournal.org/sus-a-retrospective/
Davis FD. Perceived usefulness, perceived ease of use, and user acceptance. MIS Q. 1989;13(3):19-39.
Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability stud [Internet]. 2009;3:114-123. [citado em 30 de novembro de 2023]. Disponível em: https://uxpajournal.org/determining-what-individual-sus-scores-mean-adding-an-adjective-rating-scale/
Lewis JR, Sauro J. Item Benchmarks for the System Usability Scale. J Usability Stud [Internet]. 2018;3:158-167. [citado em 29 de novembro de 2023]. Disponível em: https://uxpajournal.org/item-benchmarks-system-usability-scale-sus/
Gomes ML, Rodrigues IR, Moura NS, Bezerra KC, Lopes BB, Teixeira JJ, et al. Avaliação de aplicativos móveis para promoção da saúde de gestantes com pré-eclâmpsia. Acta Paul Enferm [Internet]. 2019;32(3):275-281. doi: http://dx.doi.org/10.1590/1982-0194201900038
Muro-Culebras A, Escriche-Escuder A, Martin-Martin J, Roldán-Jiménez C, De-Torres I, Ruiz-Muñoz M, et al. Tools for evaluating the content, efficacy, and usability of mobile health apps according to the consensus-based standards for the selection of health measurement instruments: systematic review. JMIR Mhealth Uhealth [Internet]. 2021;9(12):e15433. doi: https://doi.org/10.2196/15433
Ferreira SBL, Leita JCS. Avaliação da usabilidade em sistemas de informação: o caso do Sistema Submarino. Rev Adm Contemp [Internet]. 2003;7(2):115-136. doi: https://doi.org/10.1590/S1415-65552003000200007
Padrini-Andrade L, Balda RCX, Areco KCN, Bandiera-Paiva P, Nunes MDV, Marba STM, et al. Evaluation of usability of a neonatal health information system according to the user's perception. Rev Paul Pediatr [Internet]. 2019;37(1):90-96. doi: https://doi.org/10.1590/1984-0462/;2019;37;1;00019
Kortum P, Sorber M. Measuring the usability of mobile applications for phones and tablets. Int J Hum-Comput Interact [Internet]. 2015;31(8):518–529. doi https://doi.org/10.1080/10447318.2015.1064658
Kaya A, Ozturk R, Gumussoy CA. Usability measurement of mobile applications with system usability scale (sus). industrial engineering in the big data era: selected papers from the Global Joint Conference on Industrial Engineering and Its Application Areas, GJCIE 2018, June 21–22, 2018, Nevsehir, Turkey. Springer International Publishing; 2019. p. 389-400 [citado em 9 de janeiro de 2024]. Disponível em: https://www.researchgate.net/publication/330603223_Usability_Measurement_of_Mobile_Applications_with_System_Usability_Scale_SUS_Selected_Papers_from_the_Global_Joint_Conference_on_Industrial_Engineering_and_Its_Application_Areas_GJCIE_2018_June_21-22_
Kumar PM, Gottumukkala SNVS, Ramesh KSV, Bharath TS, Penmetsa GS, Kumar CN. Effect of e-learning methods on Dental education: An observational study. J Educ Health Promot [Internet]. 2020;9:235. doi: https://doi.org/10.4103%2Fjehp.jehp_209_20
Garza MC, Olivan S, Monleón E, Cisneros AI, García-Barrios A, Ochoa I, et al. Performance in Kahoot! activities as predictive of exam performance. BMC Med Educ [Internet]. 2023;23(1):413. doi: https://doi.org/10.1186/s12909-023-04379-x
Donkin R, Rasmussen R. Student Perception and the Effectiveness of Kahoot!: A Scoping Review in Histology, Anatomy, and Medical Education. Anat Sci Educ [Internet]. 2021;14(5):572-585. doi: https://doi.org/10.1002/ase.2094
Suner A, Yilmaz Y, Pişkin B. Mobile learning in dentistry: usage habits, attitudes and perceptions of undergraduate students. PeerJ [Internet]. 2019;7:e7391. doi: https://doi.org/10.7717/peerj.7391
Rung A, Warnke F, Mattheos N. Investigating the use of smartphones for learning purposes by Australian dental students. JMIR Mhealth Uhealth [Internet]. 2014;2(2):e20. doi: https://doi.org/10.2196/mhealth.3120
Djemal S, Singh P. Smartphones and dental trauma: the current availability of apps for managing traumatic dental injuries. Dent Traumatol [Internet]. 2016;32(1):52-7. doi: https://doi.org/10.1111/edt.12217
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Autores que publicam nesta revista concordam com os seguintes termos:
a) Autores mantém os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista.
b) Autores têm autorização para assumir contratos adicionais separadamente, para distribuição não-exclusiva da versão do trabalho publicada nesta revista (ex.: publicar em repositório institucional ou como capítulo de livro), com reconhecimento de autoria e publicação inicial nesta revista.
c) Autores têm permissão e são estimulados a publicar e distribuir seu trabalho online (ex.: em repositórios institucionais ou na sua página pessoal) a qualquer ponto antes ou durante o processo editorial, já que isso pode gerar alterações produtivas, bem como aumentar o impacto e a citação do trabalho publicado (Veja O Efeito do Acesso Livre).
