Neuroscientists from HSE University Learn to Predict Human Behaviour by Their Facial Expressions
Willingness to donate to charity is written all over the face.
Researchers at the Institute for Cognitive Neuroscience at HSE University are using automatic emotion recognition technologies to study charitable behaviour. In an experiment, scientists presented 45 participants with photographs of dogs in need and invited them to make donations to support these animals. Emotional reactions to the images were determined through facial activity using the FaceReader program. It turned out that the stronger the participants felt sadness and anger, the more money they were willing to donate to charity funds, regardless of their personal financial well-being. The study was published in the journal Heliyon.
The research was supported by a mega-grant from the Russian government as part of the national project ‘Science and Universities.’
Charitable behaviour is a complex psychological process with motives that are not fully understood. Emotional state is one of the key factors influencing the willingness to give one's resources to another. However, the question of how specific emotions are related to donations remains a subject of debate, as previous studies on this topic have yielded conflicting results.
One of the main reasons is methodological limitations in data collection. Most studies on charitable behaviour use subjective methods: volunteers themselves report their emotions and how they affect donations. However, participants do not always understand their feelings or are not willing to speak about them openly. Moreover, depending on the direction of charitable activity (helping sick people, helping animals, supporting environmental initiatives, and others), the same emotions can differently influence the willingness to donate. Therefore, to develop effective charity advertising, it is important to have objective data on the influence of emotions on the willingness to donate, taking into account the goals of fundraising.
Researchers Anna Shepelenko, Vladimir Kosonogov, and Anna Shestakova from the HSE Institute for Cognitive Neuroscience were the first in the world to use an automatic emotion recognition program to evaluate the effectiveness of charity appeals. In the experiment, scientists used FaceReader to record the facial expressions of volunteers while viewing photos of dogs in various conditions, including homeless, domestic, sick, healthy, adult, and puppies. Participants were given 320 rubles, which they could fully or partially donate to the animal aid fund during the experiment. The remaining amount could be kept for themselves.
Dogs were specifically chosen for the study because society's attitude towards them is ambiguous: they can be perceived as both victims and threats. In these conditions, charity appeals can evoke contradictory or hidden emotions that are difficult to detect through surveys or focus groups but can be recognised by facial expressions.
Co-author of the study, Junior Research Fellow at the Centre for Cognition & Decision Making at the Institute for Cognitive Neuroscience, HSE University
Currently, affective computing is still in the early stages of its development and is not widely used in the industry. However, in the coming years, its widespread implementation in various business and scientific fields can be expected. Technologies like FaceReader are already being used for diagnosing mental disorders, improving the quality of online education, assessing customer satisfaction, and in some other areas. Our study clearly shows the prospects of using affective computing to predict the effectiveness of social advertising, creating a basis for further research and practical application.
The main results of the study showed that people are inclined to donate more when charity appeals provoke unpleasant emotions in them. In particular, participants gave larger amounts to animals whose images evoked sadness and anger. These results are confirmed by both self-reports of emotions and affective computing data.
At the same time, for some other emotions, researchers found differences between survey data and FaceReader data. According to self-reports, surprise, disgust, and fear also contributed to increased donations, but FaceReader data did not confirm this. According to the authors, these differences may have arisen due to the timing of emotion recording: the program analysed reactions during the first presentation of pictures and immediately before the donation decision, whereas self-reports were made after a second viewing of the images. This time gap could have changed participants' perception of their emotions.
Additionally, the formulation of questions about specific emotions could have caused cognitive biases and influenced respondents' answers so that they indicated not only the emotions they experienced but also those they considered appropriate depending on the context of the image. Based on this, researchers conclude that affective computing complements self-report data, allowing for a more accurate identification of emotions at the moment of decision-making and reducing the influence of experimental procedures or cognitive biases on research results.
It is noteworthy that donations were associated with the individual perception of the value of money: the higher the subjective significance of the reward for participating in the experiment (320 rubles), the less willing participants were to donate to charity, while their personal level of financial well-being did not affect the amount of donations. This data clarifies the results of earlier publications, which showed contradictions regarding the relationship between financial well-being and the willingness to make donations.
Co-author of the study, Junior Research Fellow at the Centre for Cognition & Decision Making at the Institute for Cognitive Neuroscience, HSE University
This study contributes to the understanding of charitable behaviour, and we hope that the obtained results will be useful for non-profit organisations. At the same time, it is important to note some limitations: our results do not take into account the long-term impact of charity advertising on the audience.
Indeed, unpleasant emotions can increase the amount of donations during initial contact, but regularly repeated negative charity appeals can provoke empathy fatigue or avoidance—people may simply exclude such messages from their information field. Thus, to further study the impact of emotions on charity, longitudinal studies should be conducted, in which changes in donors' behaviour can be registered over several months or even years.
See also:
Smartphones Not Used for Digital Learning among Russian School Students
Despite the widespread use of smartphones, teachers have not fully integrated them into the teaching and learning process, including for developing students' digital skills. Irina Dvoretskaya, Research Fellow at the HSE Institute of Education, has examined the patterns of mobile device use for learning among students in grades 9 to 11.
‘Scientists Work to Make This World a Better Place’
Federico Gallo is a Research Fellow at the Centre for Cognition and Decision Making of the HSE Institute for Cognitive Research. In 2023, he won the Award for Special Achievements in Career and Public Life Among Foreign Alumni of HSE University. In this interview, Federico discusses how he entered science and why he chose to stay, and shares a secret to effective protection against cognitive decline in old age.
Working while Studying Can Increase Salary and Chances of Success
Research shows that working while studying increases the likelihood of employment after graduation by 19% and boosts salary by 14%. One in two students has worked for at least a month while studying full time. The greatest benefits come from being employed during the final years of study, when students have the opportunity to begin working in their chosen field. These findings come from a team of authors at the HSE Faculty of Economic Sciences.
Beauty in Details: HSE University and AIRI Scientists Develop a Method for High-Quality Image Editing
Researchers from theHSE AI Research Centre, AIRI, and the University of Bremen have developed a new image editing method based on deep learning—StyleFeatureEditor. This tool allows for precise reproduction of even the smallest details in an image while preserving them during the editing process. With its help, users can easily change hair colour or facial expressions without sacrificing image quality. The results of this three-party collaboration were published at the highly-cited computer vision conference CVPR 2024.
HSE Scientists Have Examined Potential Impact of Nuclear Power on Sustainable Development
Researchers at HSE University have developed a set of mathematical models to predict the impact of nuclear power on the Sustainable Development Index. If the share of nuclear power in the global energy mix increases to between 20% and 25%, the global Sustainable Development Index (SDI) is projected to grow by one-third by 2050. In scenarios where the share of nuclear power grows more slowly, the increase in the SDI is found to be lower. The study has been published in Nuclear Energy and Technology.
HSE Scientists Have Developed a New Model of Electric Double Layer
This new model accounts for a wide range of ion-electrode interactions and predicts a device's ability to store electric charge. The model's theoretical predictions align with the experimental results. Data on the behaviour of the electric double layer (EDL) can aid in the development of more efficient supercapacitors for portable electronics and electric vehicles. The study has been published in ChemPhysChem.
Psychologists from HSE University Discovered How Love for Animals Affects Relationships with People
Researchers from HSE University have identified a connection between attachment to pets and attitudes toward nature and other people. The study found that the more joy people derive from interacting with their pets, the more they want to help others. However, love for animals is not always associated with concern for nature. The findings were published in the Social Psychology and Society journal.
HSE Scientists Propose Using Heart Rate Analysis to Diagnose Anxiety and Depression
A group of scientists at HSE University have discovered how anxiety and depression can be diagnosed by analysing heart rate. It turns out that under mental stress, the heart rate of individuals with a predisposition to mental health disorders differs from that of healthy individuals, especially when performing more complex tasks. These changes in cardiovascular parameters can even be detected using a pulse oximeter or a smartwatch. The study findings have been published in Frontiers in Psychiatry.
Researchers at HSE in St Petersburg Develop Superior Machine Learning Model for Determining Text Topics
Topic models are machine learning algorithms designed to analyse large text collections based on their topics. Scientists at HSE Campus in St Petersburg compared five topic models to determine which ones performed better. Two models, including GLDAW developed by the Laboratory for Social and Cognitive Informatics at HSE Campus in St Petersburg, made the lowest number of errors. The paper has been published in PeerJ Computer Science.
'Science Is Akin to Creativity, as It Requires Constantly Generating Ideas'
Olga Buivolova investigates post-stroke language impairments and aims to ensure that scientific breakthroughs reach those who need them. In this interview with the HSE Young Scientists project, she spoke about the unique Russian Aphasia Test and helping people with aphasia, and about her place of power in Skhodnensky district.