Slide
Centre Interdisciplinaire
de Recherche et d’Innovation
en Cybersécurité et Société
de Recherche et d’Innovation
en Cybersécurité et Société
1.
Jesus, B. De; Lopes, M.; Perreault, L.; Roberge, M. -C.; Oliveira, A. A. De; Falk, T. H.
In: Conf. Proc. IEEE Int. Conf. Syst. Man Cybern., pp. 6033–6038, Institute of Electrical and Electronics Engineers Inc., 2025, ISBN: 1062922X (ISSN); 979-833153358-8 (ISBN), (Journal Abbreviation: Conf. Proc. IEEE Int. Conf. Syst. Man Cybern.).
Abstract | Links | BibTeX | Tags: Biomedical signal processing, Diseases, Electroencephalography, electroencephalography (EEG), Electrophysiology, Haptics, Immersive, Immersive virtual reality, Multisensory, Nature immersion, Odors, Olfactory, Patient monitoring, Patient treatment, Post-traumatic stress disorder, Post-traumatic stress disorder (PTSD), posttraumatic stress disorder, virtual reality, virtual reality (VR)
@inproceedings{dejesusElectroencephalographyNeuromarkersPredict2025,
title = {Electroencephalography Neuromarkers to Predict the Response of a Multisensory Virtual Reality Nature Immersion Intervention for Patients Diagnosed with Post-Traumatic Stress Disorder},
author = {B. De Jesus and M. Lopes and L. Perreault and M. -C. Roberge and A. A. De Oliveira and T. H. Falk},
url = {https://www.scopus.com/pages/publications/105033154892?origin=resultslist},
doi = {10.1109/SMC58881.2025.11342787},
isbn = {1062922X (ISSN); 979-833153358-8 (ISBN)},
year = {2025},
date = {2025-01-01},
booktitle = {Conf. Proc. IEEE Int. Conf. Syst. Man Cybern.},
pages = {6033–6038},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {Immersive virtual reality (VR) applications rapidly expand across domains, including training, gaming, and healthcare. More recently, multisensory immersive experiences, including olfactory and haptic stimulation, have emerged and shown great promise, especially for interventions in well-being and mental health management. Multisensory experiences, however, are very subjective (e.g., one subject may like certain smells, while others do not), and recent results have suggested that some participants may not respond positively to the treatment. As multisensory VR interventions can be costly and time-consuming for both patients and clinicians, being able to find neuromarkers that predict intervention outcomes would be invaluable. Here, we aim to take the first steps in the development of a neuromarker to predict the response to a multisensory nature immersion VR intervention. A pilot experiment was performed with twenty patients diagnosed with post-traumatic stress disorder. Potential neuromarkers are extracted from electroencephalography (EEG) signals measured from an instrumented VR headset. We show that some EEG patterns start to differ between responders and non-responders as early as the fourth session, i.e., one-third of the way into the entire intervention. This suggests that neuromarkers to predict the outcomes of a multisensory VR immersion intervention may exist. These markers could be used not only to save time and resources for clinicians and patients but also to promote precision treatment where interventions are adjusted to each patient, maximizing success rates. © 2025 IEEE.},
note = {Journal Abbreviation: Conf. Proc. IEEE Int. Conf. Syst. Man Cybern.},
keywords = {Biomedical signal processing, Diseases, Electroencephalography, electroencephalography (EEG), Electrophysiology, Haptics, Immersive, Immersive virtual reality, Multisensory, Nature immersion, Odors, Olfactory, Patient monitoring, Patient treatment, Post-traumatic stress disorder, Post-traumatic stress disorder (PTSD), posttraumatic stress disorder, virtual reality, virtual reality (VR)},
pubstate = {published},
tppubtype = {inproceedings}
}
Immersive virtual reality (VR) applications rapidly expand across domains, including training, gaming, and healthcare. More recently, multisensory immersive experiences, including olfactory and haptic stimulation, have emerged and shown great promise, especially for interventions in well-being and mental health management. Multisensory experiences, however, are very subjective (e.g., one subject may like certain smells, while others do not), and recent results have suggested that some participants may not respond positively to the treatment. As multisensory VR interventions can be costly and time-consuming for both patients and clinicians, being able to find neuromarkers that predict intervention outcomes would be invaluable. Here, we aim to take the first steps in the development of a neuromarker to predict the response to a multisensory nature immersion VR intervention. A pilot experiment was performed with twenty patients diagnosed with post-traumatic stress disorder. Potential neuromarkers are extracted from electroencephalography (EEG) signals measured from an instrumented VR headset. We show that some EEG patterns start to differ between responders and non-responders as early as the fourth session, i.e., one-third of the way into the entire intervention. This suggests that neuromarkers to predict the outcomes of a multisensory VR immersion intervention may exist. These markers could be used not only to save time and resources for clinicians and patients but also to promote precision treatment where interventions are adjusted to each patient, maximizing success rates. © 2025 IEEE.
2.
Léveillé, E.; Desjardins, M.; Dumel, G.; Blais, C.; Saint-Amour, D.; Scherzer, P.; Beaumont, L. De
Effects of Emotion and Emotional Ambiguity on Early Visual Event-Related Potentials Journal Article
In: Emotion, vol. 23, no. 3, pp. 787–804, 2022, ISSN: 15283542 (ISSN), (Publisher: American Psychological Association).
Abstract | Links | BibTeX | Tags: adult, article, Brain, clinical article, controlled study, Electroencephalography, electroencephalography (EEG), emotion, emotional facial expression (EFE), event related potential, event-related potential (ERP), Facial Expression, female, human, human experiment, male, mass univariate statistics, photography, univariate analysis
@article{leveille_effects_2022,
title = {Effects of Emotion and Emotional Ambiguity on Early Visual Event-Related Potentials},
author = {E. Léveillé and M. Desjardins and G. Dumel and C. Blais and D. Saint-Amour and P. Scherzer and L. De Beaumont},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85135853427&doi=10.1037%2femo0001119&partnerID=40&md5=7e89d6dee0b96766b8a359a3a9be4d73},
doi = {10.1037/emo0001119},
issn = {15283542 (ISSN)},
year = {2022},
date = {2022-01-01},
journal = {Emotion},
volume = {23},
number = {3},
pages = {787–804},
publisher = {American Psychological Association},
abstract = {The modulation of early sensory event-related potentials such as the P1, N1, and N170 by emotion and emotional ambiguity is still controversial. Some studies have found a modulation of one or all of these components by one or both of these factors, whereas others have failed to show such results. The objective of this study was to investigate the effects of emotion and ambiguity on the behavioral and electrophysiological responses to a morphed emotion recognition task. Thirty-seven healthy participants (19 men) completed an emotion recognition task where photographs of a male face expressing the six basic emotions morphed with another emotion (in a proportion ranging from 26% to 74%) were randomly presented while electroencephalography was recorded. After each face presentation, participants were asked to identify the facial emotion. We found an emotional effect on the P1, N1, and N170, with greater amplitudes for some emotional facial expressions than for others. However, we found no significant emotional ambiguity effect or interaction between emotion and ambiguity for any of these components. These findings suggest that computation of emotional facial expressions (regardless of their ambiguity) occurs from the early stages of brain processing. © 2022 American Psychological Association},
note = {Publisher: American Psychological Association},
keywords = {adult, article, Brain, clinical article, controlled study, Electroencephalography, electroencephalography (EEG), emotion, emotional facial expression (EFE), event related potential, event-related potential (ERP), Facial Expression, female, human, human experiment, male, mass univariate statistics, photography, univariate analysis},
pubstate = {published},
tppubtype = {article}
}
The modulation of early sensory event-related potentials such as the P1, N1, and N170 by emotion and emotional ambiguity is still controversial. Some studies have found a modulation of one or all of these components by one or both of these factors, whereas others have failed to show such results. The objective of this study was to investigate the effects of emotion and ambiguity on the behavioral and electrophysiological responses to a morphed emotion recognition task. Thirty-seven healthy participants (19 men) completed an emotion recognition task where photographs of a male face expressing the six basic emotions morphed with another emotion (in a proportion ranging from 26% to 74%) were randomly presented while electroencephalography was recorded. After each face presentation, participants were asked to identify the facial emotion. We found an emotional effect on the P1, N1, and N170, with greater amplitudes for some emotional facial expressions than for others. However, we found no significant emotional ambiguity effect or interaction between emotion and ambiguity for any of these components. These findings suggest that computation of emotional facial expressions (regardless of their ambiguity) occurs from the early stages of brain processing. © 2022 American Psychological Association
3.
Léveillé, E.; Desjardins, M.; Dumel, G.; Blais, C.; Saint-Amour, D.; Scherzer, P.; Beaumont, L. De
Effects of Emotion and Emotional Ambiguity on Early Visual Event-Related Potentials Journal Article
In: Emotion, vol. 23, no. 3, pp. 787–804, 2022, ISSN: 15283542 (ISSN).
Abstract | Links | BibTeX | Tags: adult, article, Brain, clinical article, controlled study, Electroencephalography, electroencephalography (EEG), emotion, emotional facial expression (EFE), event related potential, event-related potential (ERP), Facial Expression, female, human, human experiment, male, mass univariate statistics, photography, univariate analysis
@article{leveilleEffectsEmotionEmotional2022,
title = {Effects of Emotion and Emotional Ambiguity on Early Visual Event-Related Potentials},
author = {E. Léveillé and M. Desjardins and G. Dumel and C. Blais and D. Saint-Amour and P. Scherzer and L. De Beaumont},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85135853427&doi=10.1037%2femo0001119&partnerID=40&md5=7e89d6dee0b96766b8a359a3a9be4d73},
doi = {10.1037/emo0001119},
issn = {15283542 (ISSN)},
year = {2022},
date = {2022-01-01},
journal = {Emotion},
volume = {23},
number = {3},
pages = {787–804},
publisher = {American Psychological Association},
abstract = {The modulation of early sensory event-related potentials such as the P1, N1, and N170 by emotion and emotional ambiguity is still controversial. Some studies have found a modulation of one or all of these components by one or both of these factors, whereas others have failed to show such results. The objective of this study was to investigate the effects of emotion and ambiguity on the behavioral and electrophysiological responses to a morphed emotion recognition task. Thirty-seven healthy participants (19 men) completed an emotion recognition task where photographs of a male face expressing the six basic emotions morphed with another emotion (in a proportion ranging from 26% to 74%) were randomly presented while electroencephalography was recorded. After each face presentation, participants were asked to identify the facial emotion. We found an emotional effect on the P1, N1, and N170, with greater amplitudes for some emotional facial expressions than for others. However, we found no significant emotional ambiguity effect or interaction between emotion and ambiguity for any of these components. These findings suggest that computation of emotional facial expressions (regardless of their ambiguity) occurs from the early stages of brain processing. © 2022 American Psychological Association},
keywords = {adult, article, Brain, clinical article, controlled study, Electroencephalography, electroencephalography (EEG), emotion, emotional facial expression (EFE), event related potential, event-related potential (ERP), Facial Expression, female, human, human experiment, male, mass univariate statistics, photography, univariate analysis},
pubstate = {published},
tppubtype = {article}
}
The modulation of early sensory event-related potentials such as the P1, N1, and N170 by emotion and emotional ambiguity is still controversial. Some studies have found a modulation of one or all of these components by one or both of these factors, whereas others have failed to show such results. The objective of this study was to investigate the effects of emotion and ambiguity on the behavioral and electrophysiological responses to a morphed emotion recognition task. Thirty-seven healthy participants (19 men) completed an emotion recognition task where photographs of a male face expressing the six basic emotions morphed with another emotion (in a proportion ranging from 26% to 74%) were randomly presented while electroencephalography was recorded. After each face presentation, participants were asked to identify the facial emotion. We found an emotional effect on the P1, N1, and N170, with greater amplitudes for some emotional facial expressions than for others. However, we found no significant emotional ambiguity effect or interaction between emotion and ambiguity for any of these components. These findings suggest that computation of emotional facial expressions (regardless of their ambiguity) occurs from the early stages of brain processing. © 2022 American Psychological Association