Application of Sentiment Analysis in the Reshot Method to Improve User Experience of the Hijra Bank Application

Ridwan Ahmad Ma'arif; Agung Triayudi

doi:10.58905/saga.v2i1.240

Authors

Ridwan Ahmad Ma'arif Fakultas Teknologi Komunikasi dan Informatika, Universitas Nasional, DKI Jakarta, Indonesia
Agung Triayudi Fakultas Teknologi Komunikasi dan Informatika, Universitas Nasional, DKI Jakarta, Indonesia https://orcid.org/0000-0002-1269-5888

DOI:

https://doi.org/10.58905/saga.v2i1.240

Keywords:

Analysis Sentiment, Naïve Bayes, RESHOT, User Experience, User Research

Abstract

The first stage in simplifying User Experience (UX) using the RESHOT method is Refine the Challenge. This stage is carried out so that design practitioners know the problems or needs of application users through product research. However, the product research methods that can be carried out at this stage are very diverse and require time. This research aims to explain a product research method that can be used by design practitioners easily and quickly, namely the sentiment analysis method with the Naïve Bayes algorithm. Naive Bayes is a classification method based on simple probability. The results of this analysis will be used as a reference for improving UX using the RESHOT method on the Hijra Bank application. The results of product research using sentiment analysis obtained 2711 opinions originating from tweets on Twitter and user reviews of the Hijra Bank application on Google Play. Of the 2711 opinions, 149 had negative sentiment, with the most frequently mentioned opinions being "Customer" and "Data" with an analysis accuracy of 92%. The results of this analysis are converted into a hypothesis, which will later become a reference in designing interfaces using the RESHOT method.

References

D. Norman, “The Definition of User Experience (UX),” Nelsen Norman Group. Accessed: Jan. 20, 2023. [Online]. Available: https://www.nngroup.com/articles/definition-user-experience/

A. Upadhyay, M. Shekhawat, and R. Manhas, “Data Driven UX/UI design for reproductive health tracker,” in 2023 IEEE International Students’ Conference on Electrical, Electronics and Computer Science (SCEECS), IEEE, Feb. 2023, pp. 1–5. doi: 10.1109/SCEECS57921.2023.10063134.

W. N. Wan Ahmad and N. Mohamad Ali, “THE IMPACT OF PERSUASIVE TECHNOLOGY ON USER EMOTIONAL EXPERIENCE AND USER EXPERIENCE OVER TIME,” Journal of Information and Communication Technology, Oct. 2018, doi: 10.32890/jict2018.17.4.8273.

J. Rodda, C. Ranscombe, and B. Kuys, “A method to explore strategies to communicate user experience through storyboards: an automotive design case study,” Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AIEDAM, vol. 36, Mar. 2022, doi: 10.1017/S0890060421000287.

ISO DIS 2019, “ISO 9241-210:2019 Ergonomics of human-system interaction Part 210: Human-centred design for interactive systems,” International Standardization Organization (ISO), 2019.

D. A. Norman, “Human-Centered Design Considered Harmful,” Interactions, vol. 12, no. 4, pp. 14–19, Jul. 2005, doi: 10.1145/1070960.1070976.

Tullis and Albert, Measuring the user experience: collecting, analyzing, and presenting usability metrics, vol. 2. Elsevier, 2013. doi: 10.1016/C2011-0-00016-9.

O. Vl. Bitkina, H. K. Kim, and J. Park, “Usability and user experience of medical devices: An overview of the current state, analysis methodologies, and future challenges,” Int J Ind Ergon, vol. 76, p. 102932, Mar. 2020, doi: 10.1016/j.ergon.2020.102932.

D. Quiñones, C. Rusu, and V. Rusu, “A methodology to develop usability/user experience heuristics,” Comput Stand Interfaces, vol. 59, pp. 109–129, Aug. 2018, doi: 10.1016/j.csi.2018.03.002.

Baymard, “48 Cart Abandonment Rate Statistics 2023 – Cart & Checkout – Baymard Institute,” Baymard Institute . Accessed: Jan. 21, 2023. [Online]. Available: https://baymard.com/lists/cart-abandonment-rate

M. Fairs, “Lack of design input is putting patients and doctors at risk, says physician,” dezeen. Accessed: May 20, 2023. [Online]. Available: https://www.dezeen.com/2020/04/21/design-input-healthcare-risk/

I. Pettersson, F. Lachner, A.-K. Frison, A. Riener, and A. Butz, “A Bermuda Triangle?,” in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, New York, NY, USA: ACM, Apr. 2018, pp. 1–16. doi: 10.1145/3173574.3174035.

Binus, “Macam-macam Metode pada UX Research,” Binus University. Accessed: Oct. 28, 2023. [Online]. Available: https://sis.binus.ac.id/2022/01/05/macam-macam-metode-pada-ux-research/

U. Ibekwe, “Usability Studies: How Many Participants Are Enough?,” UXtweak. Accessed: Jan. 15, 2024. [Online]. Available: https://blog.uxtweak.com/usability-studies-how-many-participants-are-enough/#:~:text=doesn’t%20exist-,The%205%2Duser%20rule%3A%20Cost%2Deffective%20and%20optimal%20usability,’

N. Loper, “User Interviews Review (2024): $100 an Hour for Your Opinion?,” sidehustlenation. Accessed: Mar. 04, 2024. [Online]. Available: https://www.sidehustlenation.com/user-interviews-review/

D. Ananda, T. A. Taqiyyuddin, Ii. Nugraha Faqih, R. Badrahadipura, and A. A. Pravitasari, “Application of Bidirectional Gated Recurrent Unit (BiGRU) in Sentiment Analysis of Tokopedia Application Users,” in 2021 International Conference on Artificial Intelligence and Big Data Analytics, IEEE, Oct. 2021, pp. 1–4. doi: 10.1109/ICAIBDA53487.2021.9689758.

A. G. Budianto, B. Wirjodirdjo, I. Maflahah, and D. Kurnianingtyas, “Sentiment Analysis Model for KlikIndomaret Android App During Pandemic Using Vader and Transformers NLTK Library,” in 2022 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), IEEE, Dec. 2022, pp. 0423–0427. doi: 10.1109/IEEM55944.2022.9989577.

R. A. Ma’arif and F. Fauziah, “Implementation of RESHOT Method to Create a Good User Experience in an Application,” JUITA : Jurnal Informatika, vol. 11, no. 2, p. 281, Nov. 2023, doi: 10.30595/juita.v11i2.17643.

B. Hasian, “Menyederhanakan UI (User Interface) dengan metode RESHOT,” Medium. Accessed: Jan. 22, 2023. [Online]. Available: https://medium.com/designchitchat/menyederhanakan-ui-user-interface-dengan-metode-reshot-69545384b0ee

Kusrini and M. Mashuri, “Sentiment Analysis In Twitter Using Lexicon Based and Polarity Multiplication,” in 2019 International Conference of Artificial Intelligence and Information Technology (ICAIIT), IEEE, Mar. 2019, pp. 365–368. doi: 10.1109/ICAIIT.2019.8834477.

S. AISYAH, S. WAHYUNINGSIH, and F. AMIJAYA, “PERAMALAN JUMLAH TITIK PANAS PROVINSI KALIMANTAN TIMUR MENGGUNAKAN METODE RADIAL BASIS FUNCTION NEURAL NETWORK,” Jambura Journal of Probability and Statistics, vol. 2, no. 2, pp. 64–74, Nov. 2021, doi: 10.34312/jjps.v2i2.10292.

K. Marchese, “Swiss Army Knife: a sharp tool and design icon.” Accessed: Jan. 23, 2023. [Online]. Available: https://designwanted.com/swiss-army-knife-design-icon/

J. Nielsen, “Why You Only Need to Test with 5 Users,” Nielsen Norman Group. Accessed: Jan. 15, 2024. [Online]. Available: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/

N. Veflen and A. Gonera, “Perceived usefulness of design thinking activities for transforming research to impact,” Food Control, vol. 143, p. 109264, Jan. 2023, doi: 10.1016/j.foodcont.2022.109264.

A. Lahiri, K. Cormican, and S. Sampaio, “Design thinking: From products to projects,” Procedia Comput Sci, vol. 181, pp. 141–148, 2021, doi: 10.1016/j.procs.2021.01.114.