The Effect of Resolving Uncertainty on Facial Expression, Visual Path, and Affect

Author

Rosa Della-Corte-Romano

Background

Image Descriptions

All images were taken from OASIS: Open Affective Standardized Image Set

The OASIS dataset contains 900 images that are categorized by theme, valence, category description, and arousal.

Image Categories

Code
library(gt)
library(tidyverse)


os <- read.csv("OASIS.csv")

os %>% 
  count(Category, sort = TRUE) %>% 
  gt() %>% 
  tab_header(
    title = md("**Image Categorization in OASIS Image Set**")
  )
Image Categorization in OASIS Image Set
Category n
Person 346
Scene 220
Object 200
Animal 134

Image Selection Criteria

  • Negative Images were selected that were low in valence and high in arousal

  • Positive Images were selected that were both high in valence and high in arousal

  • Neutral Images were selected that were low in arousal

Code
os %>% 
  arrange(Valence_mean) %>% 
  select(Theme, Category, Valence_mean, Arousal_mean) %>% 
  gt() %>% 
  fmt_auto() %>% 
  opt_interactive(use_sorting = TRUE)

Image Description

Code
stim <- read.csv("Copy of stimList.xlsx - stimList.csv") 

stim %>% 
  select(neutral, negative, positive) %>% 
  gt() %>% 
  tab_header(
    title = md("**Image Descriptions from OASIS**"),
    subtitle = md("*Verbatim Visual Description*")
  )
Image Descriptions from OASIS
Verbatim Visual Description
neutral negative positive
An image of a stone wall made of rectangular bricks stacked in rows. An image of a carcass of a rotting headless deer with rib exposed. An image of a tropical beach with palm trees and lounge chairs overlooking clear turquoise water.
An image of an empty cardboard box viewed from above. An image of a line up of dead bodies with bloody clothes. An image of the sun setting over a rocky shoreline as warm colors reflect on the ocean.
An image of several white cotton swabs scattered on a flat surface. An image a young dead body laying next to another dead body in a field. An image of two tiny kittens asleep curled together in a soft purple blanket.
An image of a container filled with cotton swabs, some with colored stems. An image of a dead shirtless man with an empty look laying in a dirt field. An image of a cheerful beagle standing on a wooden surface.
An image of a patch of brown soil with a rough, natural texture. An image of a dry lifeless land with cracks across the surface. An image of a small puppy sitting inside a white cup with red polka dots.
An image of a red fire hydrant standing on a grassy area. An image of a malnourished stray dog with part of flesh exposed. An image of colorful fireworks bursting over a city skyline at night.
An image of two people sitting on a rooftop at night overlooking a lit city skyline. An image of bloody dummy missing its face laying lifeless. An image of a forest opening that reveals a lake surrounded by tall trees.
An image of a loose pile of tan rubber bands. An image of a house englufed in flames. An image of snowcapped mountains reflecting in a turquoise alpine lake.
A blue-and-white stapler placed on a plain background. An image of plastic waste littered across a coast line. An image of a golden sunset illuminating moutain peaks in a still blue lake.
An image of a small stack of white paper sheets slightly fanned out. An image of a shopping cart in a field surrounded by garbage. An image of a reflective lake at sunset with dramatic clouds and warm golden light.
An image of a scattered pile of silver metal paper clips. An image of someone with multiple lacerations on the lower body and bloody legs on an operating table. An image of a peaceful river bordered by lush green trees under a blue sky with scattered clouds.
An image of a close up view of small gray gravel stones. An image of the KKK having a meeting and giving a speech. An image of a wooden pier stretching into a calm lake beneath a bright full moon.
An image of a surface covered in small multicolored pebbles with mostly gray and teal tones. An image of the KKK burning a reglious symbol. An image of a mountain lake with red canoes resting on a wooden dock.
An image of beige textured surface resembling a neutral-toned wall. An image a severe case of a young man with malnutrition on the brink of starvation. An image of an emperor penguin sheltering its small chick on a snowy landscape.
An image of a brown textured material that looks like a wall. An image of a man missing his left eye due to a tumor. An image of a bright rainbow arching over a calm lake beside a vivid red leaved tree.
An image of three spools of gray thread arranged side by side. An image of a time of war where a soldier is pointing his gun at a child. An image of a rainbow stretching across a dramatic sky above the ocean at sunset.

Image Example

Rocks: V=4.21 | A = 1.85

Fire: V=1.47 | A=5.15

Penguins: V=6.21 | A=4.65
Figure 1: OASIS Examples

Instruments

Morbid Curiosity Scale

Developed by Scrivner @article{scrivner2021psychology, title={The psychology of morbid curiosity: Development and initial validation of the morbid curiosity scale}, author={Scrivner, Coltan}, journal={Personality and individual differences}, volume={183}, pages={111139}, year={2021}, publisher={Elsevier} }

Disgust Sensitivity Scale

@article{olatunji2007disgust,   title={The Disgust Propensity and Sensitivity Scale-Revised: Psychometric properties and specificity in relation to anxiety disorder symptoms},   author={Olatunji, Bunmi O and Cisler, Josh M and Deacon, Brett J and Connolly, Kevin and Lohr, Jeffrey M},   journal={Journal of Anxiety Disorders},   volume={21},   number={7},   pages={918--930},   year={2007},   publisher={Elsevier} }

Self Assessment Manikin (SAM)

@article{bradley1994measuring,   title={Measuring emotion: the self-assessment manikin and the semantic differential},   author={Bradley, Margaret M and Lang, Peter J},   journal={Journal of behavior therapy and experimental psychiatry},   volume={25},   number={1},   pages={49--59},   year={1994},   publisher={Elsevier} }

Digital Poster