Skip to main content

A real-time predicting online tool for detection of people’s emotions from Arabic tweets based on big data platforms

Research Authors
Naglaa Abdelhady, Ibrahim E. Elsemman and Taysir Hassan A. Soliman
Research Date
Research Department
Research Journal
Journal of Big Data
Research Rank
international
Research Publisher
Springer International Publishing
Research Vol
11 (1)
Research Year
2024
Research_Pages
171
Research Abstract

Emotion prediction is a subset of sentiment analysis that aims to extract emotions from text, speech, or images. The researchers posit that emotions determine human behavior, making the development of a method to recognize emotions automatically crucial for use during global crises, such as the COVID-19 pandemic. In this paper, a real-time system is developed that identifes and predicts emotions conveyed by users in Arabic tweets regarding COVID-19 into standard six emotions based on the big data platform, Apache Spark. The system consists of two main stages: (1) Developing an ofine model and (2) Online emotion prediction pipeline. For the frst stage, two diferent approaches: The deep Learning (DL) approach and the Transfer Learning-based (TL) approach to fnd the optimal classifer for identifying and predicting emotion. For DL, three classifers are applied: Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), and Bidirectional GRU (BiGRU). For TL, fve models are applied: AraBERT, ArabicBERT, ARBERT, MARBERT, and QARiB. For the second stage, create a Transmission Control Protocol (TCP) socket between Twitter’s API and Spark used to receive streaming tweets and Apache Spark to predict the label of tweets in real-time. The experimental results show that the QARiB model achieved the highest Jaccard accuracy (65.73%), multi-accuracy (78.71%), precision-micro (78.71%), recall-micro (78.71%), f-micro (78.71%), and f-macro (78.55%). The system is available as a web-based application that aims to provide a real-time visualization of people’s emotions during a crisis.