| Article Access Statistics|
| Viewed||1356 |
| Printed||4 |
| Emailed||0 |
| PDF Downloaded||134 |
| Comments ||[Add] |
Click on image for details.
BRIEF RESEARCH COMMUNICATION
|Year : 2021
: 63 | Issue : 1 | Page
|Validation of revised reading the mind in the eyes test in the Indian (Bengali) population: A preliminary study
Madhushree Chakrabarty1, Gargi Dasgupta2, Rudraprasad Acharya2, Seshadri Sekhar Chatterjee3, Prathama Guha4, Matthew K Belmonte5, Kaberi Bhattacharya6
1 Independent Researcher, Kolkata, West Bengal, India
2 Department of Psychiatry, Medical College, Kolkata, West Bengal, India
3 Department of Psychiatry, Diamond Harbour Government Medical College and Hospital, Diamond Harbour, West Bengal, India
4 Department of Psychiatry, Calcutta National Medical College, Kolkata, West Bengal, India
5 The Com DEALL Trust, Bengaluru, Karnataka, India; Division of Psychology, Nottingham Trent University, Nottingham, England, UK
6 Department of Psychiatry, Midnapore Medical College, Midnapore, West Bengal, India
Click here for correspondence address and
|Date of Submission||10-Aug-2020|
|Date of Decision||29-Sep-2020|
|Date of Acceptance||01-Oct-2020|
|Date of Web Publication||15-Feb-2021|
| Abstract|| |
Background: Social cognition deficits are common in clinical populations but there is a dearth of standardized social cognition assessment tools in India. Theory of mind (ToM) is an important aspect of social cognition which is often assessed with the revised reading the mind in eyes test (RMET-R). However, we do not have a statistically validated version of the test for the Indian population.
Aim: This study aims to assess the acceptability, reliability, and validity of the Bengali version of the RMET-R.
Materials and Methods: We administered the RMET-R to 23 patients with chronic schizophrenia (SCZ), 22 patients with bipolar disorder, and 104 healthy controls (HCs) to evaluate the reliability and validity of the instrument in the Indian (Bengali) population.
Results: We obtained moderate internal consistency (Cronbach's alpha = 0.6) and test-retest reliability (intraclass correlation coefficient = 0.64, P < 0.001). Positive correlations were found between RMET-R and Wechsler picture arrangement (r = 0.60, P < 0.001), picture completion (r = 0.54, P < 0.001), and comprehension subtests (r = 0.48, P < 0.001). Patients with SCZ (M = 49.7, standard deviation [SD] = 16.5) scored significantly lower than HCs (M = 68.9, SD = 13.8) (P = 0.008; Cohen's d = 1.3) on the RMET-R. Thus this tool could discriminate patients who are reported to have Theory of Mind deficits from healthy controls.
Conclusion: The Bengali version of the RMET-R is a reliable and valid tool for assessing first-order ToM insofar as the original RMET-R measures this construct.
Keywords: Bengali, revised reading the mind in the eyes test, validation
|How to cite this article:|
Chakrabarty M, Dasgupta G, Acharya R, Chatterjee SS, Guha P, Belmonte MK, Bhattacharya K. Validation of revised reading the mind in the eyes test in the Indian (Bengali) population: A preliminary study. Indian J Psychiatry 2021;63:74-9
|How to cite this URL:|
Chakrabarty M, Dasgupta G, Acharya R, Chatterjee SS, Guha P, Belmonte MK, Bhattacharya K. Validation of revised reading the mind in the eyes test in the Indian (Bengali) population: A preliminary study. Indian J Psychiatry [serial online] 2021 [cited 2021 Jul 28];63:74-9. Available from: https://www.indianjpsychiatry.org/text.asp?2021/63/1/74/309520
| Introduction|| |
Understanding others' perspectives is crucial for successful social interaction. Different cognitive processes work in tandem to enable the human brain to understand others' perspectives –how they think and feel. Theory of mind (ToM) is one of the most important aspects of social cognition. The American Psychological Association dictionary of psychology defines ToM as the ability to understand that “others have intentions, desires, beliefs, perceptions, and emotions different from one's own and that such intentions, desires, and so forth affect people's actions and behaviors.”
Advanced ToM is reported to influence peer relationships in children and has been strongly associated with greater social popularity. Conversely, a deficit in ToM has been associated with social cognition deficits in clinical populations. Cotter et al. reviewed meta-analyses of 30 clinical conditions and stated that there are “significant deficits among individuals with a wide range of clinical conditions in their ability to identify emotions from facial expressions and to successfully complete ToM tasks.” Therefore, a deeper insight into social cognition deficits in developmental, neurologic, and psychiatric populations can help clinicians design specific and transdiagnostic therapeutic measures.
However, assessing social cognition in a diverse population such as India's is quite a challenge especially in the absence of culturally appropriate tests. Consequently, the assessment of social cognition has received very little attention in Indian clinical studies, although global literature has been emphasizing its importance in recent times. The development of the Social Cognition Rating Tools in Indian Setting has initiated a new drive to delve deep into social cognition deficits in Indian clinical populations.,, However, ToM is a complex construct involving several cognitive processes, and conversely “ToM” tasks often tap more skills than just ToM. Consequently, we have a range of ToM tasks focusing on distinct processes. A recent two-systems hypothesis, holds that ToM involves social perceptual processes (e.g., face processing) as well as reflexive cognitive operations (e.g., language and reasoning). Bora et al. conducted a meta-analysis of 36 studies comprising 1181 patients with schizophrenia (SCZ). This study considered the task variability across the different types of ToM tests and “found that only the individual tasks 'Reading the Mind in the Eyes' and the 'Hinting Task' produced consistent effects.”
Thus, the RMET is not only widely used to assess ToM but is also reported to produce consistent results. Consequently, it has been translated into different languages as an effective tool for evaluating ToM. Although Western tests are considered to be inappropriate in other cultural contexts, some studies posit that basic human emotions are universal and their expressions are conventionalized for all members of the species regardless of culture. Recent studies, however, have documented cultural differences in facial expressions of emotions, especially for complex emotions. Moreover, morphologically similar expressions such as anger and disgust may generate multiple responses from different observers. Hence, care must be taken to assess the acceptability of these facial expressions in a particular culture before employing them in a testing tool.
In this study, we aim to investigate the acceptability, reliability, and validity of the revised RMET (RMET-R) in the Indian (Bengali) population. Validity will be assessed in patients with SCZ and bipolar disorder (BPD), who are reported to have ToM deficits.,
| Materials and Methods|| |
Twenty-three patients with chronic (SCZ; 12 males, 11 females; average age: 36.0, standard deviations [SD] = 11.5; average education: 11.8, SD = 3.4), 22 patients with (BPD; 18 males, 4 females; average age: 32.8, SD = 11.5; average education: 10.8, SD = 3.2), and 104 healthy controls (HCs; 55 male, 49 female; average age: 28.1, SD = 8.5; average education: 15.9, SD = 3.4) participated in the study. Two HCs who scored two SD below the mean in RMET-R were excluded from the study. Hence, the final HC group consisted of 102 participants (HC; 55 male, 47 female; average age: 28.2, SD = 8.6; average education: 16.0, SD = 3.3). The SCZ and BPD patients were selected based on Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria for SCZ and BPD respectively. HCs were selected on the basis of their scores in the 12-question General Health Questionnaire. There were significant differences between the SCZ and the HC groups in age (t (27.7) = −3.08, P = 0.005) and education (t (123) = 5.44, P < 0.001). A significant difference was also found between the BPD and the HC groups in their level of education (t (122) = 6.66, P < 0.001). However, SCZ and BPD groups did not differ significantly in either age or education. All the participants were native Bengali speakers with at least 5 years of formal education and had a reasonable command of the four language skills (reading, writing, speaking, and listening). They had normal or corrected to normal vision and were right-handed as determined by the Edinburgh Handedness Inventory. The participants signed an informed consent form approved by the Ethics committee, Calcutta Medical College and Hospital, Kolkata where the data were collected from June 2013 to December 2014. All the patients and their accompanying caregivers (biologically unrelated) who fulfilled the inclusion criteria were invited to participate in this study. Internees, postgraduate students and faculty members of the Department of Psychiatry, Calcutta Medical College and Hospital, Kolkata also volunteered to participate in the study.
The RMET-R consists of 36 photographs depicting “the eye-region of the face of different actors and actresses.” The subject taking the test has to choose the target word that best describes what the person in the photograph is thinking or feeling from an array of four different choices. This test is designed to assess first-order ToM (i.e., the ability to understand another person's thoughts).
The Indian adaptation of Wechsler Adult Performance Intelligence Scale (WAPIS)-Picture Arrangement subtest consists of a series of cards that need to be arranged in a correct order to weave a story that makes sense. This test aims to assess reasoning abilities. To weave a perfect story one needs to understand the intentions and the emotions of the human characters depicted on the cards. Consequently, it involves mentalizing and is intricately associated with social cognition.
The WAPIS-Picture Completion subtest is a visual cognition test assessing the ability to perceive visual details. The test consists of 26 pictures with a missing part (e.g., a face without ears). The subject taking the test has to identify the missing part in a very short span of time. It may be noted that visual cognition is intricately intertwined with social interaction.,
The comprehension subtest of the Verbal Intelligence subscale of the PGI-Brain Dysfunction Battery (PGIBBD) consists of 18 questions on social situations. The questions are of increasing difficulty. This test assesses social reasoning and the ability to deal with social rules and conventions.
Translation of 'Reading the Mind in the Eyes' Test - Revised
The original English version of the test was independently translated into Bengali by the second author (G.D.) and the seventh author (K.B.). These Bengali versions were independently back-translated into English by the third author (R.A.) and the fourth author (S.S.C.), respectively. The translations were reviewed by an expert team consisting of the fifth author (P.G.), the sixth author (M.K.B.) – a native English speaker, the translators, and a senior psychiatrist of the department not involved in the study. The senior psychiatrist was blind to the specific aims and objectives of the study and declared no conflicts of interest that could affect his judgment regarding this study. He was included in the expert team to control possible selection biases. The expert team resolved the discrepancies and made subtle changes to address the inadequacies in expressions. The members of the expert team were balanced bilinguals with almost equal proficiency in both languages. This version of the test was administered to ten postgraduate student interns of the Department of Psychiatry, Calcutta Medical College. They were asked to give their feedback on the test. After careful analyses of their performances and feedback on the test, a second round of moderations was made. Care was taken to avoid the use of unfamiliar words as far as possible. As the test involved (1) recognition of the emotions depicted in the eyes and (2) mapping mental state lexicon to those expressions, difficulty in comprehension of the words that were given as choices could affect performance. To address this issue a glossary of all the mental state terms used in the test was prepared along with their use in sentences and the participants were instructed to go through the glossary before taking the test.
The final Bengali version of the RMET-R comprising all the 36 items was administered to 104 healthy participants. The instructions and stimuli were presented on a Dell Inspiron 15.6” laptop with four answer choices arranged in four corners of the pictures as in the original version. The data from all the 104 participants were preprocessed in Microsoft Excel 2016. Two participants who scored two SDs below the mean were excluded from the study. The percentage of correct responses of the remaining 102 participants was analyzed. An item-wise analysis revealed that 7 items (2, 7, 19, 23, 31, 32, and 35) did not reach the 50% cut off level. These items were excluded [Table 1]. Hence, 29 items were considered for the final analyses. This new version of the Bengali RMET-R (29 items) was administered to 23 patients with SCZ and 22 patients with BPD. The Picture Completion subtest, the Picture Arrangement subtest of WAPIS, and the comprehension subtest of PGIBBD were administered to all the participants per the guidelines laid down in the respective test manuals. The final data were transferred to SPSS Statistics 21.0, IBM Corp., Armonk, NY, USA for statistical analyses.
|Table 1: Percentage of correct responses of the 36-item in descending order|
Click here to view
| Results|| |
The data conformed to the normality and homogeneity assumptions measured by the Shapiro–Wilk test and Levene's test, respectively. The mean percentages of correct responses in HC, BPD, and SCZ were 68.9 (SD = 13.8), 51.4 (SD = 13.2), and 49.7 (SD = 16.5), respectively [Figure 1]. There was no significant difference between RMET-R scores of healthy male (M = 69.4, SD = 14.6) and healthy female (M = 68.2, SD = 12.9) participants (t (100) = 0.425, P = 0.672). There were no significant differences between healthy male (age: M = 27.9, SD = 8.3; education: M = 16.3, SD = 3.7) and healthy female participants (age: M = 28.5, SD = 8.9; education: M = 15.5, SD = 2.8) in either age (t (100) = −0.372, P = 0.71) or education (t (100) = 1.251, P = 0.214). Age (r = −0.34, P = 0.001) correlated negatively and education (r = 0.49, P <.001) positively with RMET-R scores.
|Figure 1: Percentage of correct responses of the three groups in the Bengali version of the revised reading the mind in eyes test|
Click here to view
Internal consistency reliability
The internal consistency of the 29 items was measured with Cronbach's alpha. We obtained a moderate value (α = 0.6) which is below the traditional threshold (0.7). Usually, a high value of alpha indicates that every item measures something similar to other items in the test. As RMET-R assesses a wide range of emotional expressions, a very high value of Cronbach's alpha was not expected. Considering the broad range of emotions assessed, we accepted this α value.
Twenty-five persons from the HC group were randomly selected for the retest. Retests were done at least after a period of 6 months to control practice effects. The test-retest reliability was assessed using intraclass correlation coefficient (ICC). A moderate degree of reliability was found between the test-retest scores. The average measure ICC was 0.64 with a 95% confidence interval from 0.40 to 0.82, P < 0.001).
Picture Arrangement and Picture Completion are reported to be associated with the social cognition factor. Comprehension of social situation questions has been used in numerous studies as a measure of social cognition. Therefore, we used the Indian adaptations of these tests to assess concurrent validity. We found moderate positive correlations between RMET-R (29-item Bengali version) and the Indian adaptation of WAPIS-Picture Arrangement subtest (r = 0.60, P < 0.001), the Indian adaptation of WAPIS-Picture Completion (r = 0.54, P < 0.001), and the Comprehension subtest of the verbal intelligence subscale of PGIBBD (r = 0.48, P < 0.001).
Known group validity
One-way ANCOVA revealed a significant difference in RMET-R scores of the three groups (HC, SCZ, and BPD) after controlling for age and education (F (2, 147) = 5.52, P = 0.005), partial η2=0.07, observed power = 0.85. The covariate age (F (1,147) = 8.30, P =0.005, partial η2 = 0.06, observed power = 0.81) and education were significant (F (1, 147) = 23.4, P < 0.001, partial η2 = 0.14, observed power = 1.0).
Pairwise comparisons with adjustments for multiple comparisons (Bonferroni correction) revealed that scores of the patients with SCZ (M = 49.7, SD = 16.5) were significantly lower than their matched controls' (M = 68.9, SD = 13.8) (P =0.008; Cohen's d = 1.3). The difference between the scores of the patients with BPD (M = 51.4 SD = 13.2) and matched controls (M = 68.9, SD = 13.8) approached significance (P = 0.067; Cohen's d = 1.3).
| Discussion|| |
The Bengali version of the RMET-R was found to have acceptable psychometric properties. The average score of the healthy population was greater than that for the original English version which reported 18.8 (SD = 2.5) or 52.2% for men and 21.8 (SD = 1.8) or 58.3% for women. In contrast to the original version, the male and female participants in our study did not exhibit any significant difference in RMET-R scores. This gender equivalence is consistent with Olderbak et al. and some other studies on RMET-R. However, in contrast to Olderbak et al. in this Bengali population, we found a significant correlation between RMET-R and age and education. Age was negatively correlated and education positively correlated with the RMET-R scores. This seems intuitive as education helps to hone cognitive and especially language function and aging can result in cognitive decline.
The internal consistency of the Bengali version of the RMET-R was less than the traditional threshold. However, the RMET-R tests a broad domain of facial expressions and the items probably do not measure a single construct. Exploratory factor analysis by Olderbak et al. yielded a five-factor solution clearly indicating that the RMET-R measures more than one construct. Consequently, the value of Cronbach's alpha (α = 0. 6) was only moderately high. Consistent with our result, several published studies report that RMET-R has poor internal consistency. For example, Vellante et al. obtained a similar alpha value (α = 0. 605) for the Italian version of the test.
We obtained moderate test-retest reliability (ICC = 0.64) which is very close to the Spanish version of the test (ICC = 0.63).
The Bengali RMET-R was found to be correlated with other social cognition tests per our expectations. However, the correlations were not strong, probably as these tests assessed different aspects of social cognition. Social cognition involves different processes, and tests measuring different aspects might not exhibit strong correlations. For instance, the computerized test of primary emotions perception (PEP) and the Brazilian version of the RMET-R were also found to have only moderate correlations (r = 0.43), as the PEP measures cognitive aspects of emotional intelligence involving reasoning ability while the RMET-R assesses the ability to label mental states.
The Bengali version of the RMET-R can discriminate clinical populations from HCs and more importantly can make graded discriminations indicating the scale of the impairment. Patients with SCZ scored significantly less than the controls on RMET-R (P = 0.008) whereas patients with BPD only showed a deficient trend (P = 0.067). This result seems consistent with studies that report a more severe ToM impairment in patients with SCZ compared to patients with BPD.
In sum, the Bengali version of the RMET-R has acceptable psychometric measures. However, the small sample size of the SCZ and bipolar patients, the sampling from a particular region of West Bengal, and the higher average educational level of the participants may limit the scope of the generalizability of the results. Moreover, we deviated from the WHO guidelines laid down for translation and adaptation of English instruments. According to the WHO, the back translation should be done by a native English speaker who has no knowledge of the questionnaire. In this case, however, the instrument was back-translated independently by two bilingual persons who were involved in the study. Nevertheless, the translations were reviewed and approved by the sixth author who was a native English speaker. In addition, the agreement between the two independent translators was very high and this validated the aptness of the translations. Despite these limitations, the high average score of the Bengali RMET-R in a healthy population and large effect sizes observed in discriminating healthy and clinical populations look promising. It may prove to be a useful tool for assessing ToM in the Indian population.
| Conclusion|| |
The results suggest that the 29-item Bengali version of RMET-R is a reliable and valid tool for assessing emotion recognition in adult healthy and clinical populations. This new tool can be used to explore social cognition in different clinical populations and might enable researchers to explore sociodemographic and cross-cultural differences in emotion recognition.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Adolphs R. Social cognition and the human brain. Trends Cogn Sci 1999;3:469-79.
Slaughter V, Imuta K, Peterson CC, Henry JD. Meta-analysis of theory of mind and peer popularity in the preschool and early school years. Child Dev 2015;86:1159-74.
Cotter J, Granger K, Backx R, Hobbs M, Looi CY, Barnett JH. Social cognitive dysfunction as a clinical marker: A systematic review of meta-analyses across 30 clinical conditions. Neurosci Biobehav Rev 2018;84:92-9.
Mehta UM, Thirthalli J, Kumar CN, Mahadevaiah M, Rao K, Subbakrishan DK, et al.
Validation of social cognition rating tools in Indian setting (SOCRATIS): A new test-battery to assess social cognition. Asian J Psychiatr 2011;4:203-9.
Mehta UM, Thirthalli J, Naveen Kumar C, Keshav Kumar J, Keshavan MS, Gangadhar BN. Schizophrenia patients experience substantial social cognition deficits across multiple domains in remission. Asian J Psychiatr 2013;6:324-9.
Thamby A, Desai G, Mehta U, Chaturvedi S. Deficits in theory of mind and emotional awareness in somatoform disorders. Indian J Psychol Med 2019;41:368-74.
] [Full text]
Anupama V, Bhola P, Thirthalli J, Mehta UM. Pattern of social cognition deficits in individuals with borderline personality disorder. Asian J Psychiatr 2018;33:105-12.
Apperly IA, Butterfill SA. Do humans have two systems to track beliefs and belief-like states? Psychol Rev 2009;116:953-70.
Frith CD, Frith U. Implicit and explicit processes in social cognition. Neuron 2008;60:503-10.
Bora E, Yucel M, Pantelis C. Theory of mind impairment in schizophrenia: Meta-analysis. Schizophr Res 2009;109:1-9.
Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The “Reading the Mind in the Eyes” Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry 2001;42:241-51.
Ekman P. Basic emotions. In: Handbook of Cognition and Emotion. New York: Wiley; 2005.
Chen C, Jack RE. Discovering cultural differences (and similarities) in facial expressions of emotion. Curr Opin Psychol 2017;17:61-6.
Fang X, Sauter DA, Van Kleef GA. Seeing mixed emotions: The specificity of emotion perception from static and dynamic facial expressions across cultures. J Cross Cult Psychol 2018;49:130-48.
Brüne M. “Theory of mind” in schizophrenia: A review of the literature. Schizophr Bull 2005;31:21-42.
Bora E, Bartholomeusz C, Pantelis C. Meta-analysis of theory of mind (ToM) impairment in bipolar disorder. Psychol Med 2016;46:253-64.
Lundin A, Hallgren M, Theobald H, Hellgren C, Torgén M. Validity of the 12-item version of the general health questionnaire in detecting depression in the general population. Public Health 2016;136:66-74.
Oldfield RC. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971;9:97-113.
Ramalingaswamy P. Wechsler Adult Performance Intelligence Scale Indian Adaptation (WAPIS). New Delhi: Manasayan; 1974.
Allen DN, Strauss GP, Donohue B, van Kammen DP. Factor analytic support for social cognition as a separable cognitive domain in schizophrenia. Schizophr Res 2007;93:325-33.
Skarratt PA, Cole GG, Kuhn G. Visual cognition during real social interaction. Front Hum Neurosci 2012;6:196.
Pershad DV. Handbook of PGI Battery of Brain Dysfunction (PGI-BBD). Agra: National Psychological Corporation; 1990.
Taber KS. The use of Cronbach's alpha when developing and reporting research instruments in science education. Res Sci Educ 2017:1-24. [doi: 10.1007/s11165-016-9602-2].
Valmas MM, Mosher Ruiz S, Gansler DA, Sawyer KS, Oscar-Berman M. Social cognition deficits and associations with drinking history in alcoholic men and women. Alcohol Clin Exp Res 2014;38:2998-3007.
Olderbak S, Wilhelm O, Olaru G, Geiger M, Brenneman MW, Roberts RD. A psychometric analysis of the reading the mind in the eyes test: Toward a brief form for research and applied settings. Front Psychol 2015;6:1503.
Guerra-Carrillo B, Katovich K, Bunge SA. Does higher education hone cognitive functioning and learning efficacy? Findings from a large and diverse sample. PLoS One 2017;12:e0182276.
Harada CN, Love MC, Triebel K. Normal cognitive aging. Clin Geriatr Med 2013;29:737-52.
Vellante M, Baron-Cohen S, Melis M, Marrone M, Petretto DR, Masala C, et al
. The “Reading the Mind in the Eyes” test: Systematic review of psychometric properties and a validation study in Italy. Cogn Neuropsychiatry 2013;18:326-54.
Fernández-Abascal EG, Cabello R, Fernández-Berrocal P, Baron-Cohen S. Test-retest reliability of the “Reading the Mind in the Eyes” test: A one-year follow-up study. Mol Autism 2013;4:33. [doi: 10.1186/2040-2392-4-33].
Miguel FK, Zuanazzi AC, Caramanico RB, Huss EY. Validity of the reading the mind in the eyes test in a Brazilian sample1. Paideia 2017;27:16-23. [doi: 10.1590/1982-43272766201703].
Mitchell RL, Young AH. Theory of mind in bipolar disorder, with comparison to the impairments observed in schizophrenia. Front Psychiatry 2016;6:188.
611 MB Road, Birati, Kolkata - 700 051, West Bengal
Source of Support: None, Conflict of Interest: None