Edited by: Elizabeth Redcay, University of Maryland, United States
Reviewed by: Arjen Stolk, Dartmouth College, United States; Edda Bilek, University College London, United Kingdom
*Correspondence: Lauri Nummenmaa,
This article was submitted to Social Cognition, a section of the journal Frontiers in Psychiatry
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Studies of brain mechanisms supporting social interaction are demanding because real interaction only occurs when persons are in contact. Instead, most brain imaging studies scan subjects individually. Here we present a proof-of-concept demonstration of two-person blood oxygenation dependent (BOLD) imaging of brain activity from two individuals interacting inside the bore of a single MRI scanner. We developed a custom 16-channel (8 + 8 channels) two-helmet coil with two separate receiver-coil pairs providing whole-brain coverage, while bringing participants into a shared physical space and realistic face-to-face contact. Ten subject pairs were scanned with the setup. During the experiment, subjects took turns in tapping each other’s lip versus observing and feeling the taps timed by auditory instructions. Networks of sensorimotor brain areas were engaged alternatingly in the subjects during executing motor actions as well as observing and feeling them; these responses were clearly distinguishable from the auditory responses occurring similarly in both participants. Even though the signal-to-noise ratio of our coil system was compromised compared with standard 32-channel head coils, our results show that the two-person fMRI scanning is feasible for studying the brain basis of social interaction.
香京julia种子在线播放
Humans are embedded in complex social networks where individuals interact at different temporal scales. Most social interactions, such as verbal and nonverbal communication, occur in dyads or groups, where people constantly strive to predict, understand, and influence each other. During the interaction, sensory, cognitive, and emotional information is constantly remapped in the observers’ brain and used for motor actions as responses attuned to the received input (
Some aspects of human social behavior—in particular perceptual and decision-making processes—can be studied by measuring single brains in isolation. Conventional BOLD-fMRI experiments allow to locate brain processes related to different social functions, while intersubject correlation (ISC) analysis based on voxelwise temporal correlation of BOLD-fMRI time series (
Reciprocal social cognitive processes cannot thus be understood completely without studying the complete interaction unit consisting of two individuals (
Some aspects of human communication can be investigated using alternated scanning of the subjects sending and receiving information. In such an approach, the senders convey some social information
Such natural sense of presence of another individual might be critical for understanding the brain basis of social interaction. For example, resting-state brain activity in nonhuman primates is different when conspecifics are present versus absent (
One potentially powerful approach for studying brain basis of social interaction involves simultaneous blood oxygenation dependent (BOLD) imaging of two persons within one magnetic resonance imaging scanner. Such an approach would bring both subjects into the same physical space whilst allowing tomographic imaging of hemodynamic brain activation. Currently, one such solution has been published, based on decoupled circular-polarized volume coil for two heads (
Because this was the very first proof-of-concept human experiment done with our dual-coil design, we wanted to benchmark the feasibility of the setup with a robust and simple social interaction task, rather than setting up an overly complex design without knowing the potential limitations of the coil setup. Consequently, we used social touching as the model task, as touching is an intimate way of conveying affect and trust in social relationships (
We scanned 10 pairs of volunteers with a mean age of 23 ± 3 years (20 subjects; 7 female–male pairs and 3 female–female pairs). One further pair was scanned but excluded due to excessive head motions: one of the subjects moved so that the detector array’s sensitivity was compromised, and repositioning was not possible due to time constraints. All subjects were right-handed per self-report, and none of them reported any history of neurological illness. All pairs were friends or romantic partners. The study was approved by the Aalto University Institutional Review Board. All subjects gave written informed consent and were screened for MRI exclusion criteria prior to scanning.
Data were acquired with 3-T whole body MRI system (MAGNETOM Skyra 3.0 T, Siemens Healthcare, Erlangen, Germany) with both a vendor-provided 32-channel receive head coil (reference scans) and a custom-built 16-channel (8 + 8 channels) two-head, two-helmet receive coil (anatomical images, task-based fMRI, and resting state scan). With both receive coils, the integrated body coil was used for transmit.
Coil and subject setup.
Every scanning session consisted of two parts. First both subjects were scanned one-by-one using normal one-person setup (head-first supine, 32-channel coil). T1-weighted MP-RAGE images were acquired for anatomical reference, and gradient echo (GRE) echo-planar imaging (EPI) data were acquired for evaluating the temporal signal-to-noise ratio (tSNR), especially in comparison with the two-person data. Imaging parameters for the MP-RAGE scans were as follows: repetition time (TR) = 2.53 s, echo time (TE) = 28 ms, readout flip angle (
Next the subjects were positioned in the scanner together with the two-head coil; the subjects were lying on their sides, facing each other at a close distance. Localizer and GRE-EPI data were acquired after shimming the magnet, using the semi-automated workflow by iteratively acquiring
Experimental design. Subjects took 30-s turns in tapping the top of each other’s lip with their index finger, resulting in alternating tapping-feeling boxcar design with complete antiphase across the subjects. Turns were indicated with commands relayed
Resting state scans were obtained for inspecting signal quality. During the single-subject GRE-EPI data acquisition, the subjects were instructed to keep their eyes open and still. Eye-blinking was allowed. The two-person resting-state scans were always acquired prior to the task scans, asking the subjects to lie still with eyes open without actively looking at each other.
The fMRI data were preprocessed in Matlab utilizing custom code and FSL functions (
Individual heads were first separated and rotated to standard head-first supine orientation using a fixed coordinate transformation without resampling. Next both subjects’ data were preprocessed independently as described above. Preprocessing was concluded by recombining the data of each pair so that one subject’s data were in MNI space, and the other subject’s data were placed nose-to-nose with that to mimic the actual positioning during the scanning.
Coil performance was assessed with temporal signal-to-noise ratio (tSNR) of resting-state fMRI scans comprising of 126 time points. The FSL BET program was used to extract the brain voxels from the images, after which the data were motion-corrected using FSL MCFLIRT. Next, voxelwise tSNR values were calculated as the ratio of the mean signal over the measurement, divided by the standard deviation (std) at each voxel. For comparison, similar analysis was carried out for the one-person resting-state data.
Task-evoked BOLD responses were analyzed in FSL using the General Linear Model (GLM). The main blocks were modeled at the stimulus periodicity, and the voice instructions were modeled as 3-s events at the beginning and end of each block (see
Representative single-dyad T1
The voice cues modeled as 3-s events elicited reliable bilateral auditory-cortex activations similarly in both subjects regardless of their role as the actor or the receiver (
Main effects of auditory cue
We next evaluated the consistency of the auditory and somatosensory activations across individual subjects. To that end, we binarized the first-level activation maps for the verbal instructions and tactile tasks, and generated cumulative activation maps where voxels indicated in how many subjects task-dependent activations were detected at the a priori threshold (
Cumulative map of the binarized (active / inactive) single-pair level activation maps for the auditory cues and touching task. Color bar indicates the number of subjects where significant activations were observed in the first-level analyses. Note that this analysis does not differentiate which subject was active in the tapping task.
ICA (
Our results show that hemodynamic activity can be reliably measured from two interacting subjects’ brains within one scanner using a dual-helmet setup with two separate coil arrays, and that this technique can be used for studying elementary social cognitive functions, such as interpersonal communication
GLM revealed that specific task-dependent fluctuations in hemodynamic activity can be picked up with the setup. Despite relatively modest sample size, the contrasts of interest (tactile, motor, and auditory activations) were significant at the a priori FDR-corrected statistical threshold. However, SNR of the dual coil was clearly inferior to a conventional 32-channel head coil. An important source of discrepancy in the tSNR between the two- and the single-subject setups is the smaller number of coil elements in each of the helmets in the two-person coil in comparison to the one-person coil (8 vs. 32). The overall quality and geometry of the coil also matters: while the two-person coil is a working prototype, the 32-channel coil is the state-of-the-art product of the magnet vendor. The homogeneity of the main magnetic field (
Also, as the two heads are typically of somewhat different size, the flip angles differ between the heads. Moreover, as the heads after shimming remain in different magnetic fields (and often result in a two-peaked water spectrum; the phase maps of the individual brains are relatively even, but have different offsets), the magnetization transfer due to fat saturation tends to reduce the signal of one head more than of the other, with fat saturation performance varying correspondingly. The homogeneity of the tSNR in the brain is also compromised due to the absence of coil elements in the anterior parts of the brains (see
In contrast to conventional single-person MR imaging, the present two-person functional imaging approach provides novel means for understanding the neural basis of human social interaction. During social interaction, the interaction partners’ brains need to continuously anticipate as well as respond and adjust to incoming signals. A critical question is whether these sensorimotor loops function only recursively, as a cascade of third-person action-response processes? For example, a dialogue between two persons becomes fully incomprehensible if one persons’ speech fragments are removed from the recording. Brains are coupled with each other
Intuitively two-person neuroimaging sounds like an outstanding means for analyzing social interaction, because it allows quantifying the dynamic interaction between two brains similarly as such interaction occurs in real life. Yet after initial demonstrations of the feasibility of the two-person hyperscanning fMRI technique (
We had to position our subjects into close proximity with each other due to the limited size of the transmitting body coil but also to provide a shared interpersonal space, allowing, for example, joint manipulation of objects. However, this intimate setting likely led to breaching the subjects’ peripersonal spaces, potentially influencing social processes because close social proximity may feel uncomfortable (
In this study we resorted to conventional moderately accelerated fMRI acquisitions. However, recent advances in multi-band excitation, to improve temporal resolution, and parallel transmit, to even out the flip angles in the two potentially very different sized heads, could greatly benefit the two-person MRI setup. The SNR for the dual coil was significantly worse than that of the conventional 32-channel head coil, particularly in the frontal cortex due to multiple factors pertaining to coil geometry and the low number of channels. This lacking signal in frontal cortex is a limiting factor when it comes to investigating social interaction, for which the frontal cortex acts as a central hub region (
We conclude that two-person fMRI is a feasible and potentially powerful tool for studying brain dynamics of real-time social interaction. Even though the signal quality was compromised compared with state-of-the art head coils, our results show that our dual-head coil yields sufficient SNR for quantifying the dynamics of the real-time two-person interaction. This proof-of-concept study revealed that it is possible to measure good-quality hemodynamic signals simultaneously from two brains with one scanner. The two-person fMRI approach presented in this study complements the existing fMRI and MEG hyperscanning and face-to-face EEG and fNIRS techniques by allowing tomographic imaging of brain activations of two interacting subjects in face-to-face settings. Even though both subjects generated tactile stimuli to each other in the experiment, the task was still externally controlled. Our data however suggest that in the future this methodology can be used for quantifying brain activation in dyadic, unconstrained, and naturalistic social interaction.
The datasets generated for this study will not be made publicly available. The institutional review board did not give permission for sharing sensitive medical data (MR images); thus data sharing waiver could not be included in the informed consent. Requests to access these datasets should be directed to the corresponding author.
The studies involving human participants were reviewed and approved by Aalto University Institutional Review Board. The participants provided their written informed consent to participate in this study.
VR, JK, RH, and LN designed research. VR, SM, and RH developed instruments. VR and JK acquired data. VR and JK analyzed data. VR, JK, RH, and LN interpreted data. VR, JK, SM, RH, and LN wrote the paper.
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We thank Ms. Anna Anttalainen, Dr. Toni Auranen, Ms. Marita Kattelus, Mr. Veli-Matti Saarinen, and Mr. Tuomas Tolvanen for assistance, and Insight MRI for the development of the dual coil. The research was made possible by the Advanced Magnetic Imaging Centre, Aalto University School of Science, Espoo, Finland. VR is grateful to the funding provided by the Swedish Cultural Foundation in Finland, Instrumentarium Science Foundation, and Kalle and Dagmar Välimaa Fund of the Finnish Cultural Foundation. The funding support of the Academy of Finland (grant #218072 to RH, grant #265917 to LN) and European Research Council (“Brain2Brain” grant #232946 to RH and “SocialBrain” grant #313000 to LN) is thankfully acknowledged.
The Supplementary Material for this article can be found online at: