A dental pre-screening system: usability and user perception

Tamires Santos de Melo; Giselle Albuquerque Pacheco; Maria Isabel de C. de Souza; Karla Figueiredo

doi:10.29086/JISfTeH.11.e2

Tamires Santos de Melo State University of Rio de Janeiro (UERJ) https://orcid.org/0000-0003-3928-885X
Giselle Albuquerque Pacheco State University of Rio de Janeiro (UERJ) https://orcid.org/0000-0003-0336-0565
Maria Isabel de C. de Souza State University of Rio de Janeiro (UERJ) https://orcid.org/0000-0002-0355-9673
Karla Figueiredo State University of Rio de Janeiro (UERJ) https://orcid.org/0000-0001-8420-3937

DOI: https://doi.org/10.29086/JISfTeH.11.e2

Keywords: Dentistry, Teledentistry, Usability test, User-Centered Design, Brazil, System Usability Scale

Abstract

Background: Accessing dental treatment is still a challenge in several countries. In Brazil, there is a deficit in the provision of dental services by the public health system, with an emphasis on specialised treatments. The poorest are most affected and usually have to travel long distances for treatment in other regions, with the associated costs of travel, food, and often the loss of a day's work. Aiming to improve care for this public, the Dental Pre-Screening System (in Portuguese, Sistema de Pré-Triagem Odontológica - STO) was developed, which is responsive (mobile) and aims at remotely pre-screening these patients by an oral health professional. Objective: This pilot study was developed to analyse the system's usability by developers and patients and the subjects' perceptions during the use of the STO through semi-structured interviews. Methods: A convenience sample (35 patients and 10 developers) with a mixed methodology was used to evaluate usability (System Usability Scale) and to measure the user's perception (semi-structured interview) of the components of the Dental Pre-Screening System. Results: The system's overall System Usability Scale (SUS) score was 76.9. Among the patients, Twenty-four patients found the system easy to use, 83% agreed or completely agreed that they would like to use this system frequently" and 83% agreed or strongly agreed that people would learn to use it quickly. Qualitative data suggest that all of the patients would recommend using the system, and the patients' perception of the system was positive and optimistic. However, it is also possible to identify points to be improved, such as changing the calendar format. Conclusions: The results of the SUS and semi-structured interview showed that the Dental Pre-Screening System was well accepted and that it can optimise the face-to-face screening process, reducing unnecessary trips and saving money.

Downloads

Download data is not yet available.

Author Biographies

Tamires Santos de Melo, State University of Rio de Janeiro (UERJ)

Master Student in Telehealth, Medicine School, State University of Rio de Janeiro (UERJ)

Giselle Albuquerque Pacheco, State University of Rio de Janeiro (UERJ)

Master Student in Telehealth, Medicine School, State University of Rio de Janeiro (UERJ)

Maria Isabel de C. de Souza, State University of Rio de Janeiro (UERJ)

Professor of Community and Preventive Dentistry Department, Dentistry School, State University of Rio de Janeiro (UERJ)

Karla Figueiredo, State University of Rio de Janeiro (UERJ)

Assistant Professor of Department of Informatics and Computer Science Institute of Mathematics and Statistics, State University of Rio de Janeiro (UERJ)

References

Piotrowska DE, Jankowska D, Huzarska D, Szpak AS, Pędziński B. Socioeconomic inequalities in use and non-use of dental services in Poland. Int J Public Health 2020;65:637-647. DOI: https://doi.org/10.1007/s00038-020-01379-2

Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. SB Brasil 2010: Pesquisa Nacional de Saúde Bucal: resultados principais. [Internet]. [Brasília, DF]: Editora MS. Ministério da Saúde (BR). 2012. Available at: https://bvsms.saude.gov.br/bvs/publicacoes/pesquisa_nacional_saude_bucal.pdf accessed 3 January 2023.

Nalliah RP. Could dental school teaching clinics provide better care than regular private practices? J Investig Clin Dent 2019;10(2):e12329. DOI: https://doi.org/10.1111/jicd.12329

Jokela T, Abrahamsson P. Modelling usability capability–introducing the dimensions. In: International Conference on Product Focused Software Process Improvement. Springer, Berlin, Heidelberg, 2000:73-87. DOI: https://doi.org/10.1007/978-3-540-45051-1_10

International Organization for Standardization. (1991). ISO 9126 (1991). Software product quality.

Brooke J. SUS: a “quick and dirty” usability scale. Usability evaluation in industry. 1996;189(194):4-7

Minayo MCS. O desafio do conhecimento: pesquisa qualitativa em saúde. 14ª ed. São Paulo: Hucitec; 2014.

Greenhalgh, T. Como ler artigos científicos: fundamentos da medicina baseada em evidências. 5 ed. Porto Alegre: Artmed; 2015. Artigos que vão além dos números (pesquisa qualitativa). Artmed Editora, 2015.

Reichold M, Heß M, Kolominsky-Rabas P, Gräßel E, Prokosch H. Usability evaluation of an offline electronic data capture app in a prospective multicenter dementia registry (digidem bayern): mixed method study. JMIR Form Res 2021;5(11):e31649. DOI: https://doi.org/10.2196/31649

Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. J Usability Stud 2009;4(3):114-123.

Xiao J, Meyerowitz C, Ragusa P et al. Assessment of an Innovative Mobile Dentistry eHygiene Model amid the COVID-19 Pandemic in the National Dental Practice-Based Research Network: Protocol for design, implementation, and usability testing. JMIR Res Protoc 2021;Oct 26;10(10):e32345. DOI: https://doi.org/10.2196/32345

Allied Market Research. (2021). E-health Market by Type and End User: Global Opportunity Analysis and Industry Forecast. (2021). Available at: https://www.alliedmarketresearch.com/ehealth-market-A10166 accessed: 3 January 2023.

van Limburg M, van Gemert-Pijnen JE, Nijland N, et al. Why business modeling is crucial in the development of eHealth technologies. J Med Internet Res 2011;13(4):e124. DOI: https://doi.org/10.2196/jmir.1674

Jones RBJ, Ashurst EJ, Trappes-Lomax T. Searching for a sustainable process of service user and health professional online discussions to facilitate the implementation of e-health. Health Inf J 2016;22(4):948–961; DOI: https://doi.org/10.1177/1460458215599024

Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: a systematic literature review. J Med Syst. 2015;39:1-19. DOI: https://doi.org/10.1007/s10916-014-0182-2.

World Health Assembly, 71. (‎2018)‎. Seventy-first World Health Assembly: Geneva, 21-26 May 2018: summary records of committees, reports of committees. World Health Organization. Available at: https://apps.who.int/iris/handle/10665/325993 accessed: 11 January 2022.

Broderick J, Devine T, Langhans E, et al. Designing health literate mobile apps. NAM Perspectives. Discussion Paper, National Academy of Medicine, Washington, DC. 2014; DOI: https://doi.org/ 10.31478/201401a

Brown III W, Yen PY, Rojas M, Schnall R. Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology. J Biomed Inform 2013;46(6):1080–1087. DOI: https://doi.org/10.1016/j.jbi.2013.08.001

Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: A scoping review. Int J Med Inform 2019;126:95-104; DOI: https://doi.org/10.1016/j.ijmedinf.2019.03.018

Stetson JN, Tullis TS. A comparison of questionnaires for assessing website usability. UPA Presentation. 2004. Available at: https://www.researchgate.net/publication/228609327_A_Comparison_of_Questionnaires_for_Assessing_Website_Usability accessed 5 February 2023.

Nielsen J. Why you only need to test with 5 users. Nielsen Norman Group. Nielsen. 2000. Available at: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/ accessed 5 February 2023.