Analyzing Public Sentiment on Twitter During COVID-19
A look at how Twitter voiced reactions to COVID-19 through different waves.
― 6 min read
Table of Contents
- Importance of Topic Modeling
- Methodology: How We Analyzed Tweets
- Data Cleaning and Preparation
- Topic Modeling Techniques Used
- Analyzing the First Wave of COVID-19
- The Second Wave: A New Challenge
- The Third Wave: Emerging Variants and Adjustments
- Comparing the Waves: Overlapping Themes
- Insights from Media Coverage
- Limitations of the Study
- Conclusion: Understanding Public Sentiment through Social Media
- Future Research Directions
- Original Source
- Reference Links
The COVID-19 pandemic has changed the world in many ways. It has affected our health, the economy, and our daily lives. As the virus spread, social media platforms like Twitter became a key source of information and an outlet for people to share their thoughts and feelings. This article focuses on how deep learning can help us understand the topics discussed on Twitter regarding COVID-19, particularly during the emergence of different virus variants like Alpha, Delta, and Omicron.
Importance of Topic Modeling
Topic modeling is a way to analyze text data and discover the main themes or topics within a collection of documents. In the context of COVID-19, topic modeling can reveal how people reacted to the pandemic and what issues were most important at different times. By analyzing tweets, researchers can get insights into public sentiment, fears, and behaviors during the pandemic.
Methodology: How We Analyzed Tweets
For our analysis, we collected tweets related to COVID-19 from India using various deep learning methods. We focused on three major waves of COVID-19 in India. The first wave began in early 2020, followed by a significant rise in cases during the second wave in early 2021, marked notably by the Delta variant. The third wave, dominated by the Omicron variant, occurred later in 2021.
We gathered data from Twitter using tools that help us extract tweets based on specific keywords related to COVID-19. We ensured that our dataset included a wide range of tweets from different dates corresponding to each wave of the pandemic.
Data Cleaning and Preparation
Before starting our analysis, we cleaned the data. This involved removing unnecessary information like punctuation, links, and user mentions. We also converted emoji symbols to text to ensure that we captured the sentiment accurately. After cleaning, we applied natural language processing techniques to make the data ready for analysis.
Topic Modeling Techniques Used
We employed several topic modeling techniques to analyze the tweets. Among the most notable are Latent Dirichlet Allocation (LDA) and a newer approach using BERT and clustering methods.
Latent Dirichlet Allocation (LDA): This traditional method helps identify topics based on the words used in the tweets. It assumes that each document (tweet) is a mix of topics and that each topic consists of a set of words.
BERT and Clustering: BERT is a powerful language model that captures the context of words in a tweet. We combined BERT with clustering algorithms to get a deeper understanding of the topics discussed in the tweets. This method is particularly effective for short texts like tweets, allowing us to analyze Sentiments and topics more accurately.
Analyzing the First Wave of COVID-19
During the first wave, the primary topics discussed on Twitter included lockdown measures, the spread of the virus, and the introduction of safety protocols. Many tweets focused on people’s reactions to the lockdowns and how they adjusted to life under restrictions. Key phrases often included terms like "stay home," "social distancing," and "face masks."
As people shared their experiences and fears, trends began to emerge regarding mental health and the impact of isolation. The emotional tone of the tweets varied significantly, with many expressing anxiety and concern, while others shared positive messages of hope and resilience.
The Second Wave: A New Challenge
The second wave of COVID-19 brought a surge in cases and hospitalizations, primarily due to the Delta variant. During this period, the topics on Twitter shifted to Vaccination campaigns, government policies, and the Healthcare System's response. Tweets highlighted the urgency of vaccination and the public's frustrations with the slow rollout.
Many users shared updates about vaccine availability and offered their opinions on government actions. The sentiment was mixed, with a significant number of players expressing hope for a return to normalcy but also voicing concerns about the healthcare system's ability to cope with the rising number of cases.
The Third Wave: Emerging Variants and Adjustments
In the third wave, fueled by the Omicron variant, discussions on Twitter began to reflect a combination of hope and caution. The availability of vaccines and booster shots became prevalent topics, along with discussions around the effectiveness of existing vaccines against the new variant. People shared their experiences regarding vaccination and the importance of getting tested.
The atmosphere on Twitter was different from the previous waves, as many users seemed more informed and equipped to deal with the situation. However, there were still concerns about new restrictions and the potential impact on daily life.
Comparing the Waves: Overlapping Themes
An analysis of the three waves reveals several overlapping themes. Common topics included:
Government Response: In all three waves, users critiqued government policies, especially regarding lockdowns and vaccination efforts. Discussions often revolved around calls for better communication and support from authorities.
Healthcare System: The strain on the healthcare system was a recurring theme. Tweets often highlighted the challenges healthcare workers faced and the need for more resources and support.
Social Impact: The mental and social toll of the pandemic was a constant concern. Many tweets touched on issues of unemployment, isolation, and the emotional effects of living through a pandemic.
Insights from Media Coverage
Throughout the pandemic, media coverage played a significant role in shaping public perception. By comparing the topics found in tweets to news reports, we can see how media narratives influenced public sentiment. For instance, during the second wave, sensational news coverage about hospital shortages likely fueled public anxiety and led to an increase in discussions about healthcare access on social media.
Limitations of the Study
While our analysis provides valuable insights, it also has its limitations. The data collection process involved selecting tweets from specific dates, which may not fully represent the overall sentiment at all times. Additionally, the language used in tweets can be influenced by regional vernaculars and cultural context, making it challenging to create a comprehensive model that captures all nuances.
Conclusion: Understanding Public Sentiment through Social Media
Using deep learning techniques to analyze Twitter data during the COVID-19 pandemic has given us a clearer picture of how people reacted to major events. By examining tweets over the three waves, we have identified significant themes and trends that reflect public sentiment and concern.
As we move forward, understanding these sentiments will be essential for policymakers, healthcare providers, and community leaders. By engaging with communities and listening to their experiences, we can develop better responses to public health crises and foster resilience in the face of future challenges.
Future Research Directions
Our research demonstrates the potential of social media analysis for understanding public behavior during crises. Future studies could expand the dataset to include other social media platforms and compare responses between different countries. Additionally, further refining the methodologies used for data extraction and analysis could lead to even richer insights into public sentiment during the ongoing pandemic.
Title: Deep learning for COVID-19 topic modelling via Twitter: Alpha, Delta and Omicron
Abstract: Topic modelling with innovative deep learning methods has gained interest for a wide range of applications that includes COVID-19. Topic modelling can provide, psychological, social and cultural insights for understanding human behaviour in extreme events such as the COVID-19 pandemic. In this paper, we use prominent deep learning-based language models for COVID-19 topic modelling taking into account data from emergence (Alpha) to the Omicron variant. We apply topic modeling to review the public behaviour across the first, second and third waves based on Twitter dataset from India. Our results show that the topics extracted for the subsequent waves had certain overlapping themes such as covers governance, vaccination, and pandemic management while novel issues aroused in political, social and economic situation during COVID-19 pandemic. We also found a strong correlation of the major topics qualitatively to news media prevalent at the respective time period. Hence, our framework has the potential to capture major issues arising during different phases of the COVID-19 pandemic which can be extended to other countries and regions.
Authors: Janhavi Lande, Arti Pillay, Rohitash Chandra
Last Update: 2023-02-28 00:00:00
Language: English
Source URL: https://arxiv.org/abs/2303.00135
Source PDF: https://arxiv.org/pdf/2303.00135
Licence: https://creativecommons.org/licenses/by/4.0/
Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.
Thank you to arxiv for use of its open access interoperability.
Reference Links
- https://www.ctan.org/pkg/latexdiff?lang=en
- https://journals.plos.org/plosone/s/figures
- https://journals.plos.org/plosone/s/tables
- https://journals.plos.org/plosone/s/latex
- https://docs.google.com/spreadsheets/d/1SVKQdbUMLVsF7HWXdTXGZRnFCPQ7fWgcuIQU1PyjFz8/edit#gid=1992441989
- https://github.com/DocNow/hydrator
- https://pypi.org/project/emoji2text/
- https://www.nltk.org/
- https://radimrehurek.com/gensim/
- https://doi.org/10.48550/arxiv.2107.02173
- https://huggingface.co/sentence-transformers/distiluse-base-multilingual-cased
- https://www.bbc.com/news/world-asia-india-57237059
- https://journals.plos.org/plosone/article/authors?id=10.1371/journal.pone.0255615
- https://github.com/sydney-machine-learning/topicmodelling-COVID19-India
- https://economictimes.indiatimes.com/news/economy/finance/latest-stimulus-package-among-largest-in-the-world/articleshow/75701976.cms
- https://www.cdc.gov/coronavirus/2019-ncov/variants/variant-classifications.html
- https://dx.doi.org/10.21227/781w-ef42
- https://www.kaggle.com/ds/2397387
- https://doi
- https://arxiv.org/abs/2107.02173
- https://aclanthology.org/W13-0102.pdf
- https://www.thehindu.com/news/national/over-1-crore-migrant-labourers-return-to-home-states-on-foot-during-mar-jun-govt/article61702000.ece