Simple Science

Cutting edge science explained simply

# Computer Science # Social and Information Networks

The Hidden Truth Behind Facial Expressions in Politics

Examining how facial emotions reveal deeper feelings during the 2024 elections.

Chiyu Wei, Sean Noh, Ho-Chun Herbert Chang

― 5 min read


Facial Emotions in Facial Emotions in Politics political discourse. Facial cues reveal hidden feelings in
Table of Contents

In recent times, social media has become a primary platform for people to express their thoughts and feelings, especially during significant events like elections. With the rise of platforms like Instagram, images and videos have taken center stage, often speaking louder than words. This shift has made it necessary for researchers to look beyond just text to understand the emotions conveyed through visuals, particularly Facial Expressions.

The Importance of Facial Expressions

Facial expressions are very telling. They can reveal what someone is really feeling-more so than words sometimes. When you think of a politician giving a speech, the smile they plaster on might hide their true feelings. This study dives into the emotional world of facial expressions, focusing on posts related to the 2024 U.S. presidential election on Instagram.

What Was Analyzed?

Researchers collected a vast amount of data, including over 500,000 images and captions posted on Instagram between April and August 2024. They aimed to understand how face-based emotions relate to textual sentiments during this politically charged period. Basically, they wanted to know: when people say one thing, do their faces tell a different story?

How Was The Data Collected?

To gather this data, researchers first came up with a list of election-related keywords and hashtags. They used a tool to search Instagram for posts with these terms. The collected posts contained essential details, such as when they were posted, the number of likes, and comments, along with the images themselves. The dataset allowed for a thorough analysis of how sentiments shifted over time, particularly before and after major political events.

Text Sentiment Analysis

After gathering the data, researchers turned their attention to analyzing the text. They used various tools to measure the sentiment of the captions. Some tools, like TextBlob, assigned scores based on the words used, while others, such as VADER, were designed specifically for social media. They were smart enough to know that online conversations can be tricky; what sounds positive might just be sarcasm dressed in a smiley emoji.

Image Sentiment Analysis

Researchers didn’t stop at the text; they also examined the images associated with the posts. They used a tool called Py-Feat, which helped identify specific facial movements. Think of it as a facial expression detective that categorizes emotions like happiness, sadness, anger, and surprise. They measured how strong these emotions were to gain deeper insights into the overall sentiment of the images.

Comparing Text and Facial Sentiment

The real fun began when the researchers compared the results from text sentiment analysis with facial emotion recognition. They wanted to see if people’s written words matched the expressions on their faces. They found that, in many cases, facial expressions didn’t always align with the sentiment conveyed in the text. For instance, even when captions were positive, the facial expressions could still reflect worry or anger-definitely not a smiling face!

Emotional Reactions During Key Events

The study also looked at how emotions changed around significant political events, such as Donald Trump’s conviction for felonies and an assassination attempt. Researchers found that just after these incidents, posts featuring Trump showed an increase in negative emotions like anger and disgust. It’s like when your friend gets dumped and suddenly looks at life like a sad puppy; in the political world, these emotional shifts are significant.

Partisan Differences

One of the most interesting findings came from observing how different groups framed their narratives around Trump. Democrats tended to highlight emotions of fear and vulnerability when referencing him, while Republicans focused on anger and strength. It's kind of like watching two friends argue over who won at Monopoly; each one sees the situation differently based on their experiences.

The Takeaway

The study emphasizes that integrating facial expressions with text sentiment analysis provides richer insights into what people are really feeling, especially in our increasingly visual culture. It showcased the potential benefits of using technology not just to look at what people say, but also at how they feel.

Limitations

Like all studies, this one had its limitations. It focused specifically on political discussions, which means the findings might not apply to other topics like lifestyle or health that people often chat about on social media. Additionally, since the study was done on Instagram, it might not capture the complete picture of sentiment across different platforms, which have their own unique vibes.

Conclusion

In today’s fast-paced world, where emojis often replace words, understanding sentiment goes beyond the text. Emotions are complex, and they can be expressed in a multitude of ways-sometimes even contradictory ways. By combining text and facial analysis, researchers can gain a clearer picture of public sentiment, especially during pivotal moments like elections. Who knows? In the future, analyzing emojis might even become part of the mix too!

This research serves as a reminder that in the game of politics, it’s not just what you say, but how you say it-and how your face might give you away!

Original Source

Title: Faces speak louder than words: Emotions versus textual sentiment in the 2024 USA Presidential Election

Abstract: Sentiment analysis of textual content has become a well-established solution for analyzing social media data. However, with the rise of images and videos as primary modes of expression, more information on social media is conveyed visually. Among these, facial expressions serve as one of the most direct indicators of emotional content in images. This study analyzes a dataset of Instagram posts related to the 2024 U.S. presidential election, spanning April 5, 2024, to August 9, 2024, to compare the relationship between textual and facial sentiment. Our findings reveal that facial expressions generally align with text sentiment, although neutral and negative facial expressions provide critical information beyond valence. Furthermore, during politically significant events such as Donald Trump's conviction and assassination attempt, posts depicting Trump showed a 12% increase in negative sentiment. Crucially, Democrats use their opponent's fear to depict weakness whereas Republicans use their candidate's anger to depict resilience. Our research highlights the potential of integrating facial expression analysis with textual sentiment analysis to uncover deeper insights into social media dynamics.

Authors: Chiyu Wei, Sean Noh, Ho-Chun Herbert Chang

Last Update: Dec 23, 2024

Language: English

Source URL: https://arxiv.org/abs/2412.18031

Source PDF: https://arxiv.org/pdf/2412.18031

Licence: https://creativecommons.org/licenses/by/4.0/

Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.

Thank you to arxiv for use of its open access interoperability.

Similar Articles