Slide
Centre Interdisciplinaire
de Recherche et d’Innovation
en Cybersécurité et Société
de Recherche et d’Innovation
en Cybersécurité et Société
1.
Jaberi, M.; Falk, T. H.
A Literature Survey on Potential Private User Information Leakage in Metaverse Applications Journal Article
In: Advanced Intelligent Systems, vol. 8, no. 1, 2026, ISSN: 26404567 (ISSN).
Abstract | Links | BibTeX | Tags: age, augmented reality, Brain, brain computer interface, Computer privacy, Data privacy, Electroencephalography, eye tracking, Gender, Haptic interfaces, Information leakage, Intelligent systems, Literature survey, metaverse, Metaverses, Neurophysiological signal, neurophysiological signals, Neurophysiology, Privacy, Private user information, Race, Signal analysis, User information, Virtual and augmented reality
@article{jaberiLiteratureSurveyPotential2026,
title = {A Literature Survey on Potential Private User Information Leakage in Metaverse Applications},
author = {M. Jaberi and T. H. Falk},
url = {https://www.scopus.com/pages/publications/105012929167?origin=resultslist},
doi = {10.1002/aisy.202500263},
issn = {26404567 (ISSN)},
year = {2026},
date = {2026-01-01},
journal = {Advanced Intelligent Systems},
volume = {8},
number = {1},
publisher = {John Wiley and Sons Inc},
abstract = {The Metaverse is revolutionizing various fields, including healthcare, education, social interaction, and the workplace. Commercial multisensory devices (e.g., smell diffusion and haptic technologies) are available, and virtual and augmented reality (VR/AR) headsets are increasingly integrated with brain–computer interfaces (BCI). These integrations enable adaptive, personalized virtual immersive experiences that are more engaging, interactive, and effective. As these applications become mainstream, concerns arise regarding the security and privacy of personal information. Recent studies demonstrate that users can be identified with high accuracy using the data monitored from sensors available in VR/AR headsets. This literature survey investigates the types of personal user information that can be inferred from BCI-instrumented headsets. In particular, it focuses on predicting age, gender, and ethnic/racial background from neurophysiological signals currently monitored by commercial devices. The survey highlights the predictive strength of electroencephalogram and electrocardiogram signal modalities, followed by eye tracking and iris scanning. It also considers future privacy risks posed by biometric and gesture-based monitoring using non-contact technologies such as computer vision and WiFi signal analysis. The survey concludes with recommendations for future research aimed at contributing to the development of robust frameworks that safeguard user privacy in the evolving Metaverse landscape. © 2025 The Author(s). Advanced Intelligent Systems published by Wiley-VCH GmbH.},
keywords = {age, augmented reality, Brain, brain computer interface, Computer privacy, Data privacy, Electroencephalography, eye tracking, Gender, Haptic interfaces, Information leakage, Intelligent systems, Literature survey, metaverse, Metaverses, Neurophysiological signal, neurophysiological signals, Neurophysiology, Privacy, Private user information, Race, Signal analysis, User information, Virtual and augmented reality},
pubstate = {published},
tppubtype = {article}
}
The Metaverse is revolutionizing various fields, including healthcare, education, social interaction, and the workplace. Commercial multisensory devices (e.g., smell diffusion and haptic technologies) are available, and virtual and augmented reality (VR/AR) headsets are increasingly integrated with brain–computer interfaces (BCI). These integrations enable adaptive, personalized virtual immersive experiences that are more engaging, interactive, and effective. As these applications become mainstream, concerns arise regarding the security and privacy of personal information. Recent studies demonstrate that users can be identified with high accuracy using the data monitored from sensors available in VR/AR headsets. This literature survey investigates the types of personal user information that can be inferred from BCI-instrumented headsets. In particular, it focuses on predicting age, gender, and ethnic/racial background from neurophysiological signals currently monitored by commercial devices. The survey highlights the predictive strength of electroencephalogram and electrocardiogram signal modalities, followed by eye tracking and iris scanning. It also considers future privacy risks posed by biometric and gesture-based monitoring using non-contact technologies such as computer vision and WiFi signal analysis. The survey concludes with recommendations for future research aimed at contributing to the development of robust frameworks that safeguard user privacy in the evolving Metaverse landscape. © 2025 The Author(s). Advanced Intelligent Systems published by Wiley-VCH GmbH.
2.
Dang, L. B.; Truong, V. Tuan; Le, L. B.; Falk, T. H.
EM-Auth: A Generalizable Eye-Movement Authentication Framework using Event Cameras Proceedings Article
In: IEEE Conf. Artif. Intell., CAI, pp. 2064–2069, Institute of Electrical and Electronics Engineers Inc., 2026, ISBN: 979-833156039-3 (ISBN), (Journal Abbreviation: IEEE Conf. Artif. Intell., CAI).
Abstract | Links | BibTeX | Tags: augmented reality, Authentication, Cameras, Convolutional neural networks, Data privacy, Eye movement patterns, Eye movements, eye tracking, Eye-tracking, Frame-based, High power consumption, Neuromorphic vision sensors, Power potential, Privacy concerns, Temporal resolution, Transfer learning, User authentication, Virtual and augmented reality, virtual reality
@inproceedings{dangEMAuthGeneralizableEyeMovement2026,
title = {EM-Auth: A Generalizable Eye-Movement Authentication Framework using Event Cameras},
author = {L. B. Dang and V. Tuan Truong and L. B. Le and T. H. Falk},
url = {https://www.scopus.com/pages/publications/105042114237?origin=resultslist},
doi = {10.1109/CAI68641.2026.11536355},
isbn = {979-833156039-3 (ISBN)},
year = {2026},
date = {2026-01-01},
booktitle = {IEEE Conf. Artif. Intell., CAI},
pages = {2064–2069},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {With the rapid emergence of virtual and augmented reality (VR/AR) head-mounted devices that closely interact with users' eyes, eye-tracking-based applications are becoming increasingly promising. Among them, eye movement patterns have emerged as a reliable biometric modality for user authentication. However, existing solutions based on conventional frame-based cameras face significant limitations, including low temporal resolution, high latency, high power consumption, and potential privacy concerns due to the detailed appearance captured around the eyes. To address these challenges, we propose EM-Auth, a novel framework for eye-tracking-based user authentication that leverages event cameras, a type of neuromorphic vision sensor providing asynchronous, high-temporal-resolution data, while preserving user privacy. Our method introduces a two-stage spatiotemporal feature extraction pipeline: first, a lightweight convolutional neural network (CNN) extracts spatial features from event streams; second, a transformer-based module models the temporal dependencies to generate robust eye representations. Extensive experiments show that our framework significantly outperforms existing state-of-the-art (SOTA) methods, achieving 0.008 and 0.015 equal error rates (EERs) on two representative datasets. Notably, EM-Auth demonstrates a strong generalization capability. In a zero-shot setting where the model is trained on a specific dataset and evaluated on previously unseen users, our approach achieves authentication accuracies of 98.4% and 95.9% on the EV-Eye and EBV-Eye datasets, respectively. Under cross-dataset evaluation, our framework achieves an authentication accuracy of nearly 85% without additional fine-tuning, and consistently improves performance through transfer learning. © 2026 IEEE.},
note = {Journal Abbreviation: IEEE Conf. Artif. Intell., CAI},
keywords = {augmented reality, Authentication, Cameras, Convolutional neural networks, Data privacy, Eye movement patterns, Eye movements, eye tracking, Eye-tracking, Frame-based, High power consumption, Neuromorphic vision sensors, Power potential, Privacy concerns, Temporal resolution, Transfer learning, User authentication, Virtual and augmented reality, virtual reality},
pubstate = {published},
tppubtype = {inproceedings}
}
With the rapid emergence of virtual and augmented reality (VR/AR) head-mounted devices that closely interact with users' eyes, eye-tracking-based applications are becoming increasingly promising. Among them, eye movement patterns have emerged as a reliable biometric modality for user authentication. However, existing solutions based on conventional frame-based cameras face significant limitations, including low temporal resolution, high latency, high power consumption, and potential privacy concerns due to the detailed appearance captured around the eyes. To address these challenges, we propose EM-Auth, a novel framework for eye-tracking-based user authentication that leverages event cameras, a type of neuromorphic vision sensor providing asynchronous, high-temporal-resolution data, while preserving user privacy. Our method introduces a two-stage spatiotemporal feature extraction pipeline: first, a lightweight convolutional neural network (CNN) extracts spatial features from event streams; second, a transformer-based module models the temporal dependencies to generate robust eye representations. Extensive experiments show that our framework significantly outperforms existing state-of-the-art (SOTA) methods, achieving 0.008 and 0.015 equal error rates (EERs) on two representative datasets. Notably, EM-Auth demonstrates a strong generalization capability. In a zero-shot setting where the model is trained on a specific dataset and evaluated on previously unseen users, our approach achieves authentication accuracies of 98.4% and 95.9% on the EV-Eye and EBV-Eye datasets, respectively. Under cross-dataset evaluation, our framework achieves an authentication accuracy of nearly 85% without additional fine-tuning, and consistently improves performance through transfer learning. © 2026 IEEE.
3.
Brideau-Duquette, M.; Côté, S. S. -P.; Pfaus, J. G.; Renaud, P.
First Cross-Entropy Associated With Virtual Sexual Content Journal Article
In: Applied Human Factors and Ergonomics International, vol. 119, pp. 110–119, 2024, ISSN: 27710718 (ISSN).
Abstract | Links | BibTeX | Tags: Brain entropy, Electroencephalography, eye tracking, immersion, Sexual Presence, virtual reality
@article{brideau-duquette_first_2024,
title = {First Cross-Entropy Associated With Virtual Sexual Content},
author = {M. Brideau-Duquette and S. S. -P. Côté and J. G. Pfaus and P. Renaud},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105031273879&doi=10.54941%2Fahfe1004474&partnerID=40&md5=3a1b6f10201659be05b3feebea9c6dfd},
doi = {10.54941/ahfe1004474},
issn = {27710718 (ISSN)},
year = {2024},
date = {2024-01-01},
journal = {Applied Human Factors and Ergonomics International},
volume = {119},
pages = {110–119},
abstract = {This study investigates the brain’s response to virtual sexual content using EEG dynamic cross-entropy and physiological measures of arousal. It aims to elucidate the neural underpinnings of “sexual presence”—a state of arousal influenced by personal predispositions and technological affordances. The research integrates concepts of sexual affordances within embodied cognitive processes, suggesting that the brain optimizes responses to minimize free energy when processing sexual cues. The findings show that sexual avatars trigger specific arousal and attention, evidenced by physiological arousal responses. Notably, frontal cross-entropy in the low alpha band decreased during exposure to sexual content, suggesting a more streamlined frontal information transfer during arousal. The results contribute to understanding how virtual environments can induce sexual presence, indicating that sexual affordances in virtual settings significantly influence cognitive engagement and neural efficiency. The study’s outcomes have implications in the understanding of human-machine interactions with virtual content mobilizing sexual cognition. © 2024. Published by AHFE.},
keywords = {Brain entropy, Electroencephalography, eye tracking, immersion, Sexual Presence, virtual reality},
pubstate = {published},
tppubtype = {article}
}
This study investigates the brain’s response to virtual sexual content using EEG dynamic cross-entropy and physiological measures of arousal. It aims to elucidate the neural underpinnings of “sexual presence”—a state of arousal influenced by personal predispositions and technological affordances. The research integrates concepts of sexual affordances within embodied cognitive processes, suggesting that the brain optimizes responses to minimize free energy when processing sexual cues. The findings show that sexual avatars trigger specific arousal and attention, evidenced by physiological arousal responses. Notably, frontal cross-entropy in the low alpha band decreased during exposure to sexual content, suggesting a more streamlined frontal information transfer during arousal. The results contribute to understanding how virtual environments can induce sexual presence, indicating that sexual affordances in virtual settings significantly influence cognitive engagement and neural efficiency. The study’s outcomes have implications in the understanding of human-machine interactions with virtual content mobilizing sexual cognition. © 2024. Published by AHFE.
4.
Brideau-Duquette, M.; Côté, S. S. -P.; Pfaus, J. G.; Renaud, P.
First Cross-Entropy Associated With Virtual Sexual Content Journal Article
In: Applied Human Factors and Ergonomics International, vol. 119, pp. 110–119, 2024, ISSN: 27710718 (ISSN).
Abstract | Links | BibTeX | Tags: Brain entropy, Electroencephalography, eye tracking, immersion, Sexual Presence, virtual reality
@article{brideau-duquetteFirstCrossEntropyAssociated2024,
title = {First Cross-Entropy Associated With Virtual Sexual Content},
author = {M. Brideau-Duquette and S. S. -P. Côté and J. G. Pfaus and P. Renaud},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105031273879&doi=10.54941%2Fahfe1004474&partnerID=40&md5=3a1b6f10201659be05b3feebea9c6dfd},
doi = {10.54941/ahfe1004474},
issn = {27710718 (ISSN)},
year = {2024},
date = {2024-01-01},
journal = {Applied Human Factors and Ergonomics International},
volume = {119},
pages = {110–119},
abstract = {This study investigates the brain’s response to virtual sexual content using EEG dynamic cross-entropy and physiological measures of arousal. It aims to elucidate the neural underpinnings of “sexual presence”—a state of arousal influenced by personal predispositions and technological affordances. The research integrates concepts of sexual affordances within embodied cognitive processes, suggesting that the brain optimizes responses to minimize free energy when processing sexual cues. The findings show that sexual avatars trigger specific arousal and attention, evidenced by physiological arousal responses. Notably, frontal cross-entropy in the low alpha band decreased during exposure to sexual content, suggesting a more streamlined frontal information transfer during arousal. The results contribute to understanding how virtual environments can induce sexual presence, indicating that sexual affordances in virtual settings significantly influence cognitive engagement and neural efficiency. The study’s outcomes have implications in the understanding of human-machine interactions with virtual content mobilizing sexual cognition. © 2024. Published by AHFE.},
keywords = {Brain entropy, Electroencephalography, eye tracking, immersion, Sexual Presence, virtual reality},
pubstate = {published},
tppubtype = {article}
}
This study investigates the brain’s response to virtual sexual content using EEG dynamic cross-entropy and physiological measures of arousal. It aims to elucidate the neural underpinnings of “sexual presence”—a state of arousal influenced by personal predispositions and technological affordances. The research integrates concepts of sexual affordances within embodied cognitive processes, suggesting that the brain optimizes responses to minimize free energy when processing sexual cues. The findings show that sexual avatars trigger specific arousal and attention, evidenced by physiological arousal responses. Notably, frontal cross-entropy in the low alpha band decreased during exposure to sexual content, suggesting a more streamlined frontal information transfer during arousal. The results contribute to understanding how virtual environments can induce sexual presence, indicating that sexual affordances in virtual settings significantly influence cognitive engagement and neural efficiency. The study’s outcomes have implications in the understanding of human-machine interactions with virtual content mobilizing sexual cognition. © 2024. Published by AHFE.
5.
Simon, J.; Grogna, D.; Rivard, M. -C.; Heck, M.; Bouchard, S.; Quertemont, E.
Assessing attentional bias for alcohol-related cues using eye tracking in a virtual reality environment Journal Article
In: Frontiers in Virtual Reality, vol. 3, 2022, ISSN: 26734192 (ISSN), (Publisher: Frontiers Media S.A.).
Abstract | Links | BibTeX | Tags: craving, cue exposure, eye tracking, immersion, virtual reality
@article{simon_assessing_2022,
title = {Assessing attentional bias for alcohol-related cues using eye tracking in a virtual reality environment},
author = {J. Simon and D. Grogna and M. -C. Rivard and M. Heck and S. Bouchard and E. Quertemont},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85139027341&doi=10.3389%2ffrvir.2022.849840&partnerID=40&md5=22d08446b9b6bf184867d77efa11932a},
doi = {10.3389/frvir.2022.849840},
issn = {26734192 (ISSN)},
year = {2022},
date = {2022-01-01},
journal = {Frontiers in Virtual Reality},
volume = {3},
publisher = {Frontiers Media S.A.},
abstract = {Several experimental paradigms were developed to measure attentional biases towards alcohol-related cues. However, most of them are based on reaction times to two-dimensional stimuli displayed on a computer screen, such that their ecological validity has been questioned. To address this, we integrated an eye tracking system into a virtual reality headset (ET-VR) and measured attentional biases in a subclinical population of alcohol users. In this exploratory study, forty social drinkers were recruited and immersed in a virtual bar including alcohol-related stimuli. Attentional focus was assessed using dwell time and number of fixations for these alcohol-related stimuli as well as for neutral stimuli unrelated to alcohol consumption. The results show that the number of fixations and, to a lesser extent, the dwell time for alcohol-related cues were positively correlated with the drinking motivation of the participants. In contrast, no significant correlation was found for neutral stimuli. In conclusion, the present study shows that alcohol-induced attentional biases can be studied using an ET-VR device in a subclinical population of alcohol users. Copyright © 2022 Simon, Grogna, Rivard, Heck, Bouchard and Quertemont.},
note = {Publisher: Frontiers Media S.A.},
keywords = {craving, cue exposure, eye tracking, immersion, virtual reality},
pubstate = {published},
tppubtype = {article}
}
Several experimental paradigms were developed to measure attentional biases towards alcohol-related cues. However, most of them are based on reaction times to two-dimensional stimuli displayed on a computer screen, such that their ecological validity has been questioned. To address this, we integrated an eye tracking system into a virtual reality headset (ET-VR) and measured attentional biases in a subclinical population of alcohol users. In this exploratory study, forty social drinkers were recruited and immersed in a virtual bar including alcohol-related stimuli. Attentional focus was assessed using dwell time and number of fixations for these alcohol-related stimuli as well as for neutral stimuli unrelated to alcohol consumption. The results show that the number of fixations and, to a lesser extent, the dwell time for alcohol-related cues were positively correlated with the drinking motivation of the participants. In contrast, no significant correlation was found for neutral stimuli. In conclusion, the present study shows that alcohol-induced attentional biases can be studied using an ET-VR device in a subclinical population of alcohol users. Copyright © 2022 Simon, Grogna, Rivard, Heck, Bouchard and Quertemont.
6.
Simon, J.; Grogna, D.; Rivard, M. -C.; Heck, M.; Bouchard, S.; Quertemont, E.
Assessing attentional bias for alcohol-related cues using eye tracking in a virtual reality environment Journal Article
In: Frontiers in Virtual Reality, vol. 3, 2022, ISSN: 26734192 (ISSN).
Abstract | Links | BibTeX | Tags: craving, cue exposure, eye tracking, immersion, virtual reality
@article{simonAssessingAttentionalBias2022,
title = {Assessing attentional bias for alcohol-related cues using eye tracking in a virtual reality environment},
author = {J. Simon and D. Grogna and M. -C. Rivard and M. Heck and S. Bouchard and E. Quertemont},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85139027341&doi=10.3389%2ffrvir.2022.849840&partnerID=40&md5=22d08446b9b6bf184867d77efa11932a},
doi = {10.3389/frvir.2022.849840},
issn = {26734192 (ISSN)},
year = {2022},
date = {2022-01-01},
journal = {Frontiers in Virtual Reality},
volume = {3},
publisher = {Frontiers Media S.A.},
abstract = {Several experimental paradigms were developed to measure attentional biases towards alcohol-related cues. However, most of them are based on reaction times to two-dimensional stimuli displayed on a computer screen, such that their ecological validity has been questioned. To address this, we integrated an eye tracking system into a virtual reality headset (ET-VR) and measured attentional biases in a subclinical population of alcohol users. In this exploratory study, forty social drinkers were recruited and immersed in a virtual bar including alcohol-related stimuli. Attentional focus was assessed using dwell time and number of fixations for these alcohol-related stimuli as well as for neutral stimuli unrelated to alcohol consumption. The results show that the number of fixations and, to a lesser extent, the dwell time for alcohol-related cues were positively correlated with the drinking motivation of the participants. In contrast, no significant correlation was found for neutral stimuli. In conclusion, the present study shows that alcohol-induced attentional biases can be studied using an ET-VR device in a subclinical population of alcohol users. Copyright © 2022 Simon, Grogna, Rivard, Heck, Bouchard and Quertemont.},
keywords = {craving, cue exposure, eye tracking, immersion, virtual reality},
pubstate = {published},
tppubtype = {article}
}
Several experimental paradigms were developed to measure attentional biases towards alcohol-related cues. However, most of them are based on reaction times to two-dimensional stimuli displayed on a computer screen, such that their ecological validity has been questioned. To address this, we integrated an eye tracking system into a virtual reality headset (ET-VR) and measured attentional biases in a subclinical population of alcohol users. In this exploratory study, forty social drinkers were recruited and immersed in a virtual bar including alcohol-related stimuli. Attentional focus was assessed using dwell time and number of fixations for these alcohol-related stimuli as well as for neutral stimuli unrelated to alcohol consumption. The results show that the number of fixations and, to a lesser extent, the dwell time for alcohol-related cues were positively correlated with the drinking motivation of the participants. In contrast, no significant correlation was found for neutral stimuli. In conclusion, the present study shows that alcohol-induced attentional biases can be studied using an ET-VR device in a subclinical population of alcohol users. Copyright © 2022 Simon, Grogna, Rivard, Heck, Bouchard and Quertemont.
7.
Blais, C.; Fiset, D.; Roy, C.; Régimbald, C. S.; Gosselin, F.
Eye fixation patterns for categorizing static and dynamic facial Expressions Journal Article
In: Emotion, vol. 17, no. 7, pp. 1107–1119, 2017, ISSN: 15283542 (ISSN), (Publisher: American Psychological Association Inc.).
Abstract | Links | BibTeX | Tags: adult, anatomy and histology, Bubbles, Dynamic, emotion, Emotions, Eye, eye fixation, Eye movements, eye tracking, Facial Expression, facial expressions, female, Fixation, human, Humans, male, Mouth, Ocular, Photic Stimulation, photostimulation, physiology, PsycINFO, stimulus, Visual strategies, Young Adult
@article{blais_eye_2017,
title = {Eye fixation patterns for categorizing static and dynamic facial Expressions},
author = {C. Blais and D. Fiset and C. Roy and C. S. Régimbald and F. Gosselin},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85016754655&doi=10.1037%2femo0000283&partnerID=40&md5=baecd8d6500d1447d48a399497611ccd},
doi = {10.1037/emo0000283},
issn = {15283542 (ISSN)},
year = {2017},
date = {2017-01-01},
journal = {Emotion},
volume = {17},
number = {7},
pages = {1107–1119},
publisher = {American Psychological Association Inc.},
abstract = {Facial expressions of emotion are dynamic in nature, but most studies on the visual strategies underlying the recognition of facial emotions have used static stimuli. The present study directly compared the visual strategies underlying the recognition of static and dynamic facial expressions using eye tracking and the Bubbles technique. The results revealed different eye fixation patterns with the 2 kinds of stimuli, with fewer fixations on the eye and mouth area during the recognition of dynamic than static expressions. However, these differences in eye fixations were not accompanied by any systematic differences in the facial information that was actually processed to recognize the expressions. © 2017 American Psychological Association.},
note = {Publisher: American Psychological Association Inc.},
keywords = {adult, anatomy and histology, Bubbles, Dynamic, emotion, Emotions, Eye, eye fixation, Eye movements, eye tracking, Facial Expression, facial expressions, female, Fixation, human, Humans, male, Mouth, Ocular, Photic Stimulation, photostimulation, physiology, PsycINFO, stimulus, Visual strategies, Young Adult},
pubstate = {published},
tppubtype = {article}
}
Facial expressions of emotion are dynamic in nature, but most studies on the visual strategies underlying the recognition of facial emotions have used static stimuli. The present study directly compared the visual strategies underlying the recognition of static and dynamic facial expressions using eye tracking and the Bubbles technique. The results revealed different eye fixation patterns with the 2 kinds of stimuli, with fewer fixations on the eye and mouth area during the recognition of dynamic than static expressions. However, these differences in eye fixations were not accompanied by any systematic differences in the facial information that was actually processed to recognize the expressions. © 2017 American Psychological Association.
8.
Conti, J.; Ozell, B.; Paquette, E.; Renaud, P.
Adjusting stereoscopic parameters by evaluating the point of regard in a virtual environment Journal Article
In: Computers and Graphics (Pergamon), vol. 69, pp. 24–35, 2017, ISSN: 00978493 (ISSN), (Publisher: Elsevier Ltd).
Abstract | Links | BibTeX | Tags: Cameras, Cave automatic virtual environments, Cell proliferation, Depth of field blur, Depth-of-field blur, eye tracking, Immersive virtual environments, Inter-camera distance, Point of regard tracking, Point of regards, Research and development, Stereo image processing, Stereoscopic parameters, Subjective evaluations, virtual reality
@article{conti_adjusting_2017,
title = {Adjusting stereoscopic parameters by evaluating the point of regard in a virtual environment},
author = {J. Conti and B. Ozell and E. Paquette and P. Renaud},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85032854314&doi=10.1016%2fj.cag.2017.08.017&partnerID=40&md5=529b21bdd959c209d79b5262fae53516},
doi = {10.1016/j.cag.2017.08.017},
issn = {00978493 (ISSN)},
year = {2017},
date = {2017-01-01},
journal = {Computers and Graphics (Pergamon)},
volume = {69},
pages = {24–35},
publisher = {Elsevier Ltd},
abstract = {Despite the growth in research and development in the area of virtual reality over the past few years, virtual worlds do not yet convey a feeling of presence that matches reality. This is particularly due to the difference in visual perception of flat images as compared to actual 3D. We studied the impact of two parameters of the stereoscopic configuration, namely, the inter-camera distance (ICD) and the presence of a depth of field blur (DOF blur). We conducted an experiment involving 18 participants in order to evaluate this impact, based on both subjective and objective criteria. We examined six configurations which differed in the presence or absence of DOF blur and the value of the ICD: fixed and equal to the anatomical interpupillary distance, fixed and chosen by the participant, or variable, depending on the depth of the viewer's point of regard (POR). The DOF blur and the variable ICD require the use of an eye tracking system in order to be adjusted with respect to the POR. To our knowledge, no previously published research has tested a gaze-contingent variable ICD along with dynamic DOF blur in a Cave Automatic Virtual Environment. Our results show that the anatomical and variable ICD performed similarly regarding each criterion of the experiment, both being more efficient than the fixed ICD. Besides, as with earlier similar attempts, the configurations with DOF blur obtained lower subjective evaluations. Although mainly not significant, the results obtained by the variable ICD and DOF blur are likely due to a noticeable delay in the parameters update. We also designed a new methodology to objectively compare the geometry and depth rendering, based on the reproduction of the same scene in the real and virtual setups, and then on the study of resulting ocular convergence and angular deviation from a target. This leads to a new comparative criterion for the perceptual realism of immersive virtual environments based on the visual behavior similarity between real and virtual setups. © 2017 Elsevier Ltd},
note = {Publisher: Elsevier Ltd},
keywords = {Cameras, Cave automatic virtual environments, Cell proliferation, Depth of field blur, Depth-of-field blur, eye tracking, Immersive virtual environments, Inter-camera distance, Point of regard tracking, Point of regards, Research and development, Stereo image processing, Stereoscopic parameters, Subjective evaluations, virtual reality},
pubstate = {published},
tppubtype = {article}
}
Despite the growth in research and development in the area of virtual reality over the past few years, virtual worlds do not yet convey a feeling of presence that matches reality. This is particularly due to the difference in visual perception of flat images as compared to actual 3D. We studied the impact of two parameters of the stereoscopic configuration, namely, the inter-camera distance (ICD) and the presence of a depth of field blur (DOF blur). We conducted an experiment involving 18 participants in order to evaluate this impact, based on both subjective and objective criteria. We examined six configurations which differed in the presence or absence of DOF blur and the value of the ICD: fixed and equal to the anatomical interpupillary distance, fixed and chosen by the participant, or variable, depending on the depth of the viewer's point of regard (POR). The DOF blur and the variable ICD require the use of an eye tracking system in order to be adjusted with respect to the POR. To our knowledge, no previously published research has tested a gaze-contingent variable ICD along with dynamic DOF blur in a Cave Automatic Virtual Environment. Our results show that the anatomical and variable ICD performed similarly regarding each criterion of the experiment, both being more efficient than the fixed ICD. Besides, as with earlier similar attempts, the configurations with DOF blur obtained lower subjective evaluations. Although mainly not significant, the results obtained by the variable ICD and DOF blur are likely due to a noticeable delay in the parameters update. We also designed a new methodology to objectively compare the geometry and depth rendering, based on the reproduction of the same scene in the real and virtual setups, and then on the study of resulting ocular convergence and angular deviation from a target. This leads to a new comparative criterion for the perceptual realism of immersive virtual environments based on the visual behavior similarity between real and virtual setups. © 2017 Elsevier Ltd
9.
Blais, C.; Fiset, D.; Roy, C.; Régimbald, C. S.; Gosselin, F.
Eye fixation patterns for categorizing static and dynamic facial Expressions Journal Article
In: Emotion, vol. 17, no. 7, pp. 1107–1119, 2017, ISSN: 15283542 (ISSN).
Abstract | Links | BibTeX | Tags: adult, anatomy and histology, Bubbles, Dynamic, emotion, Emotions, Eye, eye fixation, Eye movements, eye tracking, Facial Expression, facial expressions, female, Fixation, human, Humans, male, Mouth, Ocular, Photic Stimulation, photostimulation, physiology, PsycINFO, stimulus, Visual strategies, Young Adult
@article{blaisEyeFixationPatterns2017,
title = {Eye fixation patterns for categorizing static and dynamic facial Expressions},
author = {C. Blais and D. Fiset and C. Roy and C. S. Régimbald and F. Gosselin},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85016754655&doi=10.1037%2femo0000283&partnerID=40&md5=baecd8d6500d1447d48a399497611ccd},
doi = {10.1037/emo0000283},
issn = {15283542 (ISSN)},
year = {2017},
date = {2017-01-01},
journal = {Emotion},
volume = {17},
number = {7},
pages = {1107–1119},
publisher = {American Psychological Association Inc.},
abstract = {Facial expressions of emotion are dynamic in nature, but most studies on the visual strategies underlying the recognition of facial emotions have used static stimuli. The present study directly compared the visual strategies underlying the recognition of static and dynamic facial expressions using eye tracking and the Bubbles technique. The results revealed different eye fixation patterns with the 2 kinds of stimuli, with fewer fixations on the eye and mouth area during the recognition of dynamic than static expressions. However, these differences in eye fixations were not accompanied by any systematic differences in the facial information that was actually processed to recognize the expressions. © 2017 American Psychological Association.},
keywords = {adult, anatomy and histology, Bubbles, Dynamic, emotion, Emotions, Eye, eye fixation, Eye movements, eye tracking, Facial Expression, facial expressions, female, Fixation, human, Humans, male, Mouth, Ocular, Photic Stimulation, photostimulation, physiology, PsycINFO, stimulus, Visual strategies, Young Adult},
pubstate = {published},
tppubtype = {article}
}
Facial expressions of emotion are dynamic in nature, but most studies on the visual strategies underlying the recognition of facial emotions have used static stimuli. The present study directly compared the visual strategies underlying the recognition of static and dynamic facial expressions using eye tracking and the Bubbles technique. The results revealed different eye fixation patterns with the 2 kinds of stimuli, with fewer fixations on the eye and mouth area during the recognition of dynamic than static expressions. However, these differences in eye fixations were not accompanied by any systematic differences in the facial information that was actually processed to recognize the expressions. © 2017 American Psychological Association.
10.
Conti, J.; Ozell, B.; Paquette, E.; Renaud, P.
Adjusting stereoscopic parameters by evaluating the point of regard in a virtual environment Journal Article
In: Computers and Graphics (Pergamon), vol. 69, pp. 24–35, 2017, ISSN: 00978493 (ISSN).
Abstract | Links | BibTeX | Tags: Cameras, Cave automatic virtual environments, Cell proliferation, Depth of field blur, Depth-of-field blur, eye tracking, Immersive virtual environments, Inter-camera distance, Point of regard tracking, Point of regards, Research and development, Stereo image processing, Stereoscopic parameters, Subjective evaluations, virtual reality
@article{contiAdjustingStereoscopicParameters2017,
title = {Adjusting stereoscopic parameters by evaluating the point of regard in a virtual environment},
author = {J. Conti and B. Ozell and E. Paquette and P. Renaud},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85032854314&doi=10.1016%2fj.cag.2017.08.017&partnerID=40&md5=529b21bdd959c209d79b5262fae53516},
doi = {10.1016/j.cag.2017.08.017},
issn = {00978493 (ISSN)},
year = {2017},
date = {2017-01-01},
journal = {Computers and Graphics (Pergamon)},
volume = {69},
pages = {24–35},
publisher = {Elsevier Ltd},
abstract = {Despite the growth in research and development in the area of virtual reality over the past few years, virtual worlds do not yet convey a feeling of presence that matches reality. This is particularly due to the difference in visual perception of flat images as compared to actual 3D. We studied the impact of two parameters of the stereoscopic configuration, namely, the inter-camera distance (ICD) and the presence of a depth of field blur (DOF blur). We conducted an experiment involving 18 participants in order to evaluate this impact, based on both subjective and objective criteria. We examined six configurations which differed in the presence or absence of DOF blur and the value of the ICD: fixed and equal to the anatomical interpupillary distance, fixed and chosen by the participant, or variable, depending on the depth of the viewer's point of regard (POR). The DOF blur and the variable ICD require the use of an eye tracking system in order to be adjusted with respect to the POR. To our knowledge, no previously published research has tested a gaze-contingent variable ICD along with dynamic DOF blur in a Cave Automatic Virtual Environment. Our results show that the anatomical and variable ICD performed similarly regarding each criterion of the experiment, both being more efficient than the fixed ICD. Besides, as with earlier similar attempts, the configurations with DOF blur obtained lower subjective evaluations. Although mainly not significant, the results obtained by the variable ICD and DOF blur are likely due to a noticeable delay in the parameters update. We also designed a new methodology to objectively compare the geometry and depth rendering, based on the reproduction of the same scene in the real and virtual setups, and then on the study of resulting ocular convergence and angular deviation from a target. This leads to a new comparative criterion for the perceptual realism of immersive virtual environments based on the visual behavior similarity between real and virtual setups. © 2017 Elsevier Ltd},
keywords = {Cameras, Cave automatic virtual environments, Cell proliferation, Depth of field blur, Depth-of-field blur, eye tracking, Immersive virtual environments, Inter-camera distance, Point of regard tracking, Point of regards, Research and development, Stereo image processing, Stereoscopic parameters, Subjective evaluations, virtual reality},
pubstate = {published},
tppubtype = {article}
}
Despite the growth in research and development in the area of virtual reality over the past few years, virtual worlds do not yet convey a feeling of presence that matches reality. This is particularly due to the difference in visual perception of flat images as compared to actual 3D. We studied the impact of two parameters of the stereoscopic configuration, namely, the inter-camera distance (ICD) and the presence of a depth of field blur (DOF blur). We conducted an experiment involving 18 participants in order to evaluate this impact, based on both subjective and objective criteria. We examined six configurations which differed in the presence or absence of DOF blur and the value of the ICD: fixed and equal to the anatomical interpupillary distance, fixed and chosen by the participant, or variable, depending on the depth of the viewer's point of regard (POR). The DOF blur and the variable ICD require the use of an eye tracking system in order to be adjusted with respect to the POR. To our knowledge, no previously published research has tested a gaze-contingent variable ICD along with dynamic DOF blur in a Cave Automatic Virtual Environment. Our results show that the anatomical and variable ICD performed similarly regarding each criterion of the experiment, both being more efficient than the fixed ICD. Besides, as with earlier similar attempts, the configurations with DOF blur obtained lower subjective evaluations. Although mainly not significant, the results obtained by the variable ICD and DOF blur are likely due to a noticeable delay in the parameters update. We also designed a new methodology to objectively compare the geometry and depth rendering, based on the reproduction of the same scene in the real and virtual setups, and then on the study of resulting ocular convergence and angular deviation from a target. This leads to a new comparative criterion for the perceptual realism of immersive virtual environments based on the visual behavior similarity between real and virtual setups. © 2017 Elsevier Ltd