Range and Differentiation of Emotional Experience Scale (RDEES)
Emotional granularity was measured using the 14-item Range and Differentiation of Emotional Experience Scale (RDEES) (Kang & Shaver, 2004). This scale is designed to assess the range of a person’s emotional experiences, including how attentive people are to their feelings, the amount they are open to experience, their ability to understand others’ feelings, and adjust socially. Participants respond to items such as “I usually experience a wide range of emotions” or “I am aware of the subtle differences between feelings I have” on a 5-point Likert scale, with 1 indicating “does not describe me very well” and 5 indicating “describes me very well” (see Appendix A). Four of these items are reverse-coded. Scores are averaged across all items. Higher scores indicate higher emotional differentiation (granularity), whereas lower scores indicate lower emotional differentiation. A factor analysis (Kang & Shaver, 2004) of all initial items showed 14 items were sufficient to produce two distinct factors: “range” and “differentiation”, with and alpha coefficient of .85 (.83 for 7-item range subscale and .79 for the remaining 7-item differentiation subscale). In those studies, study 1 used self-report ratings; study 2 used peer rating. The correlation between the two subscales ranged in study 1 between .30 and .47, and between .42 to .57 in study 2.
With respect to construct and convergent validity, the RDEES has been found to be significantly negatively correlated with the Toronto Alexithymia Scale (TAS), and significantly positively correlated with the Emotional Range Test, Levels of Emotional Awareness Test, and the Trait Meta-Mood Scale (TMMS) (Kang & Shaver, 2004). In study 1 (Kang & Shaver, 2004), the differentiation scale, but not the range scale, was significantly positively correlated with only two of the three subscales of the TMMS scales (clarity and repair subscales), but the range subscale was not. In study 2, the differentiation subscale showed greater correlation to an emotion card sorting task (i.e., generated more emotion categories) than the range subscale (r = .33 vs. .20). Thus, the differentiation subscale has good construct validity, such that emotional experience is related more to fine-grain categories than range of emotional experience. Additionally, the differentiation subscale (study 2) also was more strongly correlated with interpersonal relationship than the range subscale (r = 0. 40 vs. 0.14), showing that emotional differentiation is more important than emotional range for good relationship maintenance, even after controlling for social desirability. Emotional differentiation was also more strongly associated than emotional range with both self and peer ratings of interpersonal relationship quality. Although the two aspects of emotional complexity were correlated, the differentiation scale was more strongly related to knowing one's own feelings and understanding others’ feelings (compared with emotional intensity and mood variability). For these reasons, we only used participants’ scores from the differentiation subscale in our analyses.
Difficulties in Emotion Regulation Scale (DERS-18)
Difficulties in emotion regulation was measured using the 18-item version of the Difficulties in Emotion Regulation Scale-18 (Victor & Klonsky, 2016). The DERS is based on a clinically-useful conceptualization of emotion regulation “that was developed to be applicable to a wide variety of psychological difficulties and relevant to clinical applications and treatment development (Gratz, 2007; Gratz & Tull 2010)” (Bjureberg et al., 2016, p. 284). Specifically, the conceptual definition of emotion regulation on which the DERS is based emphasizes the functionality of emotions and focuses on adaptive ways of responding to emotional distress, including the: (a) awareness, understanding, and acceptance of emotions; (b) ability to control behaviors when experiencing negative emotions; (c) flexible use of situationally-appropriate strategies to modulate the intensity and/or duration of emotional responses, rather than to eliminate emotions entirely; and (d) willingness to experience negative emotions as part of pursuing meaningful activities in life. Participants respond to items such as “When I am upset, I have difficulty controlling my behaviors” or “When I am upset, I have difficulty focusing on other things” on a 5-point Likert scale, with 1 indicating “almost never” to 5 indicating “almost always” (see Appendix B). Three of the items are reverse-coded. The minimum overall score is 18, and the maximum score is 90. Higher scores indicate greater difficulties with emotion regulation. Internal consistency and reliability are reported for the 16 item version (Bjureberg et al., 2016). The internal consistency of the DERS-16 has an alpha of .92, and the test-retest reliability was good (ρ =.85, p < .001). In the original validation study (Bjureberg et al., 2016, study 2), the DERS-16 was significantly positively correlated with experiential avoidance, mindfulness, and negative emotionality, psychiatric symptoms, and most clinically- relevant behaviors. These were generally of the same magnitude and direction of the original DERS.
Emotion Words
An initial set of 40 emotion words was selected from the ANEW list (Bradley & Lang, 1999) to maximize coverage of the affective circumplex (Russell, 1980) in terms of valence, arousal, and emotion category, while also balancing for word length and difficulty (i.e. age of acquisition; see Baron-Cohen et al., 2010). Extensive piloting was performed on these 40 words which included 30 online student ratings of arousal and valence (1-5 scale), emotion category sorting (sad, calm, happy, fear, disgust, angry, happy, surprised, or none of the above), and frequency of use (1-5), among other variables not related to the current study. From these 40 words, 20 emotion words were selected based on at least two emotion words per each of the eight emotion categories. The remaining four were distributed across positive valence/low arousal, positive valence/high arousal, negative valence/low arousal, and negative valence/high arousal (see Appendix C). The specific words selected for each emotion category and the four remaining words were selected to have similar use by participants from the pilot ratings.
Participants and Specific Procedures by Study
Dataset 1
As part of a larger study on social media use and emotional health, nine undergraduate students from the University of Massachusetts-Dartmouth and 30 participants from the general population (advertised via social media) between the ages of 18-25 years (n = 32 females, n = 4 males, 2 = prefer not to say, 1= did not answer) completed an online Qualtrics survey which assessed their usage, understanding, (1 = I use this word/ I know what this word means; 4 =I do not use this word often/ I do not understand or am not confident that I know the meaning of this word/), and accuracy of 20 pre-normed highly granular emotion words. For each emotion word, participants were asked their usage, understanding, and then accuracy. The accuracy question was not asked if participants indicated a “4” on understanding for that word, as it did not seem to make sense to ask participants to choose a definition if they did not know what the word meant. For the accuracy questions, the incorrect answers were the correct answers from other words, randomly assigned and equally repeated throughout the list. Accuracy was calculated as the percentage correct over trials. We decided that total accuracy for non-answered/non-attempted questions should be counted as incorrect. Usage and understanding were averaged over the 20 emotion words. Participants also completed the RDEES and DERS surveys. This experiment was part of a larger study which also collected information on participants’ online social media usage and emotional health, and included the Mental Health Continuum (MHC). Participants were entered into a raffle for the chance to win one $50USD gift card at the end of the study for their participation. Data was collected in 2019 under IRB #18.084
Datasets 2 & 3
One hundred fourteen undergraduate students from the University of Massachusetts-Dartmouth completed a Qualtrics survey similar to that described for Dataset 1, in which they also rated each presented emotion word on valence, arousal, and embodiment. Participants were required to be between 18-25 years of age to participate; no further demographic data were collected. The study included the additional measures described above and the same measures and words as above. Participants received a $10USD gift card or one research credit for participation if they were enrolled in Psychology 101 as part of the course requirement. Participants subsequently completed an emotional face perceptual discrimination task in which they viewed individual morphed faces created from combining (using morphing software) sequences of five faces between each of two emotions. In different trials, each emotion was morphed with one of five other emotions. Four individual poser’s faces were used (Barrett face set)1[1]. Morphs were shown one per trial followed by a second face that was either the same exact face or a face that depicted slightly more of one of the emotions (slightly less of the other). Participants were asked to judge whether the second face matched the first face using a computer keyboard. Data was collected in 2019 under IRB #18.084.
Dataset 4
One hundred twenty three undergraduate students from the University of Massachusetts-Dartmouth completed a Qualtrics survey similar to that described for Dataset 1, except the MHC and gender question did not function and did not record data. Participants were entered into a raffle for the chance to win one $50USD gift card at the end of the study for their participation. Data was collected in 2020 under IRB #18.084.
Datasets 5 & 6
Thirty-six (Dataset 5) and 38 (Dataset 6) graduate students from the Kansas City University completed a Qualtrics survey similar to that described for Dataset 1, with the addition of six other surveys in Dataset 5 (n = 36) (Schutte Suite Emotional Intelligence Scale (SSEI), Emotion Regulation Questionnaire (ERQ), Satisfaction with Life Scale (SWL), MHC, TMMS, and the TAS), and these same scales minus the SSEI in Dataset 6 (n = 38). Instead of 20 emotion words, only 14 emotion words were used, and three new words were added to replace words which had a consistently high (>98%) emotion accuracy. As with other data sets, the accuracy question only appeared if participants did not report a “4” for usage (and now also for understanding). In addition, participants completed two emotion perception tasks (see Datasets 2 & 3) in the first PI’s current laboratory at Kansas City University (KCU) in 2022 and 2023. Participants received a $10 USD gift card to Amazon for completion. The study which contributed to Dataset 5 was approved through IRB KCU #1906743 and the study which contributed to Dataset 6 was approved through IRB KCU #1942774. Participants contributing to Dataset 5 included additional training and a long-term intervention of emotion word training and experiential momentary sampling for additional compensation (up to $100 USD over 3 weeks).