Slide
Centre Interdisciplinaire
de Recherche et d’Innovation
en Cybersécurité et Société
de Recherche et d’Innovation
en Cybersécurité et Société
1.
Saumure, C.; Plouffe-Demers, M. -P.; Estéphan, A.; Fiset, D.; Blais, C.
The use of visual information in the recognition of posed and spontaneous facial expressions Journal Article
In: Journal of Vision, vol. 18, no. 9, pp. 1–15, 2018, ISSN: 15347362, (Publisher: Association for Research in Vision and Ophthalmology Inc.).
Abstract | Links | BibTeX | Tags: association, Cues, emotion, Emotions, Facial Expression, Facial Recognition, female, happiness, human, Humans, male, Pattern Recognition, physiology, Visual, Young Adult
@article{saumure_use_2018,
title = {The use of visual information in the recognition of posed and spontaneous facial expressions},
author = {C. Saumure and M. -P. Plouffe-Demers and A. Estéphan and D. Fiset and C. Blais},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85054591286&doi=10.1167%2f18.9.21&partnerID=40&md5=9d2396b70438842c089a36f6a499f734},
doi = {10.1167/18.9.21},
issn = {15347362},
year = {2018},
date = {2018-01-01},
journal = {Journal of Vision},
volume = {18},
number = {9},
pages = {1–15},
abstract = {Recognizing facial expressions is crucial for the success of social interactions, and the visual processes underlying this ability have been the subject of many studies in the field of face perception. Nevertheless, the stimuli used in the majority of these studies consist of facial expressions that were produced on request rather than spontaneously induced. In the present study, we directly compared the visual strategies underlying the recognition of posed and spontaneous expressions of happiness, disgust, surprise, and sadness. We used the Bubbles method with pictures of the same individuals spontaneously expressing an emotion or posing with an expression on request. Two key findings were obtained: Visual strategies were less systematic with spontaneous than with posed expressions, suggesting a higher heterogeneity in the useful facial cues across identities; and with spontaneous expressions, the relative reliance on the mouth and eyes areas was more evenly distributed, contrasting with the higher reliance on the mouth compared to the eyes area observed with posed expressions. © 2018 The Authors.},
note = {Publisher: Association for Research in Vision and Ophthalmology Inc.},
keywords = {association, Cues, emotion, Emotions, Facial Expression, Facial Recognition, female, happiness, human, Humans, male, Pattern Recognition, physiology, Visual, Young Adult},
pubstate = {published},
tppubtype = {article}
}
Recognizing facial expressions is crucial for the success of social interactions, and the visual processes underlying this ability have been the subject of many studies in the field of face perception. Nevertheless, the stimuli used in the majority of these studies consist of facial expressions that were produced on request rather than spontaneously induced. In the present study, we directly compared the visual strategies underlying the recognition of posed and spontaneous expressions of happiness, disgust, surprise, and sadness. We used the Bubbles method with pictures of the same individuals spontaneously expressing an emotion or posing with an expression on request. Two key findings were obtained: Visual strategies were less systematic with spontaneous than with posed expressions, suggesting a higher heterogeneity in the useful facial cues across identities; and with spontaneous expressions, the relative reliance on the mouth and eyes areas was more evenly distributed, contrasting with the higher reliance on the mouth compared to the eyes area observed with posed expressions. © 2018 The Authors.
2.
Roy, C.; Blais, C.; Fiset, D.; Rainville, P.; Gosselin, F.
Efficient information for recognizing pain in facial expressions Journal Article
In: European Journal of Pain (United Kingdom), vol. 19, no. 6, pp. 852–860, 2015, ISSN: 10903801 (ISSN).
Abstract | Links | BibTeX | Tags: anger, article, association, Classification, Cues, disgust, emotion, Emotions, Facial Expression, Fear, female, happiness, human, human experiment, Humans, male, nociception, normal human, Pain, pain assessment, Pattern Recognition, Photic Stimulation, photostimulation, physiology, priority journal, procedures, random sample, reproducibility, Reproducibility of Results, sadness, statistical significance, Visual, visual information, visual stimulation
@article{roy_efficient_2015,
title = {Efficient information for recognizing pain in facial expressions},
author = {C. Roy and C. Blais and D. Fiset and P. Rainville and F. Gosselin},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-84929122739&doi=10.1002%2fejp.676&partnerID=40&md5=027f6da7b6d5c98c86de6a07766fb83d},
doi = {10.1002/ejp.676},
issn = {10903801 (ISSN)},
year = {2015},
date = {2015-01-01},
journal = {European Journal of Pain (United Kingdom)},
volume = {19},
number = {6},
pages = {852–860},
abstract = {Background The face as a visual stimulus is a reliable source of information for judging the pain experienced by others. Until now, most studies investigating the facial expression of pain have used a descriptive method (i.e. Facial Action Coding System). However, the facial features that are relevant for the observer in the identification of the expression of pain remain largely unknown despite the strong medical impact that misjudging pain can have on patients' well-being. Methods Here, we investigated this question by applying the Bubbles method. Fifty healthy volunteers were asked to categorize facial expressions (the six basic emotions, pain and neutrality) displayed in stimuli obtained from a previously validated set and presented for 500 ms each. To determine the critical areas of the face used in this categorization task, the faces were partly masked based on random sampling of regions of the stimuli at different spatial frequency ranges. Results Results show that accurate pain discrimination relies mostly on the frown lines and the mouth. Finally, an ideal observer analysis indicated that the use of the frown lines in human observers could not be attributed to the objective 'informativeness' of this area. Conclusions Based on a recent study suggesting that this area codes for the affective dimension of pain, we propose that the visual system has evolved to focus primarily on the facial cues that signal the aversiveness of pain, consistent with the social role of facial expressions in the communication of potential threats. © 2015 European Pain Federation-EFIC®.},
keywords = {anger, article, association, Classification, Cues, disgust, emotion, Emotions, Facial Expression, Fear, female, happiness, human, human experiment, Humans, male, nociception, normal human, Pain, pain assessment, Pattern Recognition, Photic Stimulation, photostimulation, physiology, priority journal, procedures, random sample, reproducibility, Reproducibility of Results, sadness, statistical significance, Visual, visual information, visual stimulation},
pubstate = {published},
tppubtype = {article}
}
Background The face as a visual stimulus is a reliable source of information for judging the pain experienced by others. Until now, most studies investigating the facial expression of pain have used a descriptive method (i.e. Facial Action Coding System). However, the facial features that are relevant for the observer in the identification of the expression of pain remain largely unknown despite the strong medical impact that misjudging pain can have on patients' well-being. Methods Here, we investigated this question by applying the Bubbles method. Fifty healthy volunteers were asked to categorize facial expressions (the six basic emotions, pain and neutrality) displayed in stimuli obtained from a previously validated set and presented for 500 ms each. To determine the critical areas of the face used in this categorization task, the faces were partly masked based on random sampling of regions of the stimuli at different spatial frequency ranges. Results Results show that accurate pain discrimination relies mostly on the frown lines and the mouth. Finally, an ideal observer analysis indicated that the use of the frown lines in human observers could not be attributed to the objective 'informativeness' of this area. Conclusions Based on a recent study suggesting that this area codes for the affective dimension of pain, we propose that the visual system has evolved to focus primarily on the facial cues that signal the aversiveness of pain, consistent with the social role of facial expressions in the communication of potential threats. © 2015 European Pain Federation-EFIC®.
3.
Blais, C.; Roy, C.; Fiset, D.; Arguin, M.; Gosselin, F.
The eyes are not the window to basic emotions Journal Article
In: Neuropsychologia, vol. 50, no. 12, pp. 2830–2838, 2012, ISSN: 00283932.
Abstract | Links | BibTeX | Tags: adult, analytic method, article, association, association cortex, cognition, Cues, Discrimination (Psychology), discriminative stimulus, dynamic stimulus, emotion, Emotions, Eye, Facial Expression, female, Fixation, human, human experiment, Humans, male, Mouth, normal human, Ocular, Pattern Recognition, Photic Stimulation, static stimulus, task performance, Visual, visual discrimination, visual information, visual memory, visual system function, Young Adult
@article{blais_eyes_2012,
title = {The eyes are not the window to basic emotions},
author = {C. Blais and C. Roy and D. Fiset and M. Arguin and F. Gosselin},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-84865829171&doi=10.1016%2fj.neuropsychologia.2012.08.010&partnerID=40&md5=8a46d347f96ea9bd94bd161b6f1e8b92},
doi = {10.1016/j.neuropsychologia.2012.08.010},
issn = {00283932},
year = {2012},
date = {2012-01-01},
journal = {Neuropsychologia},
volume = {50},
number = {12},
pages = {2830–2838},
abstract = {Facial expressions are one of the most important ways to communicate our emotional state. In popular culture and in the scientific literature on face processing, the eye area is often conceived as a very important - if not the most important - cue for the recognition of facial expressions. In support of this, an underutilization of the eye area is often observed in clinical populations with a deficit in the recognition of facial expressions of emotions. Here, we used the Bubbles technique to verify which facial cue is the most important when it comes to discriminating between eight static and dynamic facial expressions (i.e., six basic emotions, pain and a neutral expression). We found that the mouth area is the most important cue for both static and dynamic facial expressions. We conducted an ideal observer analysis on the static expressions and determined that the mouth area is the most informative. However, we found an underutilization of the eye area by human participants in comparison to the ideal observer. We then demonstrated that the mouth area contains the most discriminative motions across expressions. We propose that the greater utilization of the mouth area by the human participants might come from remnants of the strategy the brain has developed with dynamic stimuli, and/or from a strategy whereby the most informative area is prioritized due to the limited capacity of the visuo-cognitive system. © 2012 Elsevier Ltd.},
keywords = {adult, analytic method, article, association, association cortex, cognition, Cues, Discrimination (Psychology), discriminative stimulus, dynamic stimulus, emotion, Emotions, Eye, Facial Expression, female, Fixation, human, human experiment, Humans, male, Mouth, normal human, Ocular, Pattern Recognition, Photic Stimulation, static stimulus, task performance, Visual, visual discrimination, visual information, visual memory, visual system function, Young Adult},
pubstate = {published},
tppubtype = {article}
}
Facial expressions are one of the most important ways to communicate our emotional state. In popular culture and in the scientific literature on face processing, the eye area is often conceived as a very important - if not the most important - cue for the recognition of facial expressions. In support of this, an underutilization of the eye area is often observed in clinical populations with a deficit in the recognition of facial expressions of emotions. Here, we used the Bubbles technique to verify which facial cue is the most important when it comes to discriminating between eight static and dynamic facial expressions (i.e., six basic emotions, pain and a neutral expression). We found that the mouth area is the most important cue for both static and dynamic facial expressions. We conducted an ideal observer analysis on the static expressions and determined that the mouth area is the most informative. However, we found an underutilization of the eye area by human participants in comparison to the ideal observer. We then demonstrated that the mouth area contains the most discriminative motions across expressions. We propose that the greater utilization of the mouth area by the human participants might come from remnants of the strategy the brain has developed with dynamic stimuli, and/or from a strategy whereby the most informative area is prioritized due to the limited capacity of the visuo-cognitive system. © 2012 Elsevier Ltd.
4.
Butler, S.; Blais, C.; Gosselin, F.; Bub, D.; Fiset, D.
Recognizing famous people Journal Article
In: Attention, Perception, and Psychophysics, vol. 72, no. 6, pp. 1444–1449, 2010, ISSN: 19433921.
Abstract | Links | BibTeX | Tags: adult, article, association, attention, Cues, Discrimination (Psychology), Face, Famous Persons, female, human, Humans, male, Mental Recall, Pattern Recognition, perception, perceptive discrimination, Perceptual Masking, public figure, recall, Visual, Young Adult
@article{butler_recognizing_2010,
title = {Recognizing famous people},
author = {S. Butler and C. Blais and F. Gosselin and D. Bub and D. Fiset},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-77957655513&doi=10.3758%2fAPP.72.6.1444&partnerID=40&md5=75eaa110c44eb14b6eea6120d7477798},
doi = {10.3758/APP.72.6.1444},
issn = {19433921},
year = {2010},
date = {2010-01-01},
journal = {Attention, Perception, and Psychophysics},
volume = {72},
number = {6},
pages = {1444–1449},
abstract = {In daily life, face identification requires that the observer select a single representation from hundreds if not thousands in memory. This breadth of choice is nearly impossible to replicate in the laboratory using newly learned faces, especially in the context of a Bubbles experiment (Gosselin & Schyns, 2001). In this study, we obviated this concern by studying the performance of observers in a face-naming task using 210 faces of celebrities. On each trial, we presented a face randomly sampled with Bubbles. We performed least-square multiple linear regressions on the location of the samples and on accuracy to pinpoint the facial features that were used effectively in this task. Correct face identification relied primarily on the eye areas in spatial frequency bands ranging from 4.37 to 70 cycles per face (cpf) and on the mouth and the nose in a spatial frequency band ranging from 8.75 to 17.5 cpf. A comparison with other studies (Caldara et al., 2005; Schyns, Bonnar, & Gosselin, 2002) in which Bubbles was used with a set of 10 newly learned faces revealed that although the eye areas were useful across studies, the mouth area and higher spatial frequencies gained in importance when few newly learned faces were used. © 2010 The Psychonomic Society, Inc.},
keywords = {adult, article, association, attention, Cues, Discrimination (Psychology), Face, Famous Persons, female, human, Humans, male, Mental Recall, Pattern Recognition, perception, perceptive discrimination, Perceptual Masking, public figure, recall, Visual, Young Adult},
pubstate = {published},
tppubtype = {article}
}
In daily life, face identification requires that the observer select a single representation from hundreds if not thousands in memory. This breadth of choice is nearly impossible to replicate in the laboratory using newly learned faces, especially in the context of a Bubbles experiment (Gosselin & Schyns, 2001). In this study, we obviated this concern by studying the performance of observers in a face-naming task using 210 faces of celebrities. On each trial, we presented a face randomly sampled with Bubbles. We performed least-square multiple linear regressions on the location of the samples and on accuracy to pinpoint the facial features that were used effectively in this task. Correct face identification relied primarily on the eye areas in spatial frequency bands ranging from 4.37 to 70 cycles per face (cpf) and on the mouth and the nose in a spatial frequency band ranging from 8.75 to 17.5 cpf. A comparison with other studies (Caldara et al., 2005; Schyns, Bonnar, & Gosselin, 2002) in which Bubbles was used with a set of 10 newly learned faces revealed that although the eye areas were useful across studies, the mouth area and higher spatial frequencies gained in importance when few newly learned faces were used. © 2010 The Psychonomic Society, Inc.
5.
Willenbockel, V.; Fiset, D.; Chauvin, A.; Blais, C.; Arguin, M.; Tanaka, J. W.; Bub, D. N.; Gosselin, F.
Does Face Inversion Change Spatial Frequency Tuning? Journal Article
In: Journal of Experimental Psychology: Human Perception and Performance, vol. 36, no. 1, pp. 122–135, 2010, ISSN: 00961523 (ISSN).
Abstract | Links | BibTeX | Tags: adult, article, association, attention, Cues, Depth Perception, Face, face perception, female, human, Humans, identification, inversion effect, male, perception, Perceptual Masking, reaction time, Space Perception, spatial frequency, vision, Visual Perception, Young Adult
@article{willenbockel_does_2010,
title = {Does Face Inversion Change Spatial Frequency Tuning?},
author = {V. Willenbockel and D. Fiset and A. Chauvin and C. Blais and M. Arguin and J. W. Tanaka and D. N. Bub and F. Gosselin},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-76049110562&doi=10.1037%2fa0016465&partnerID=40&md5=d855c4148d6a6f32d96ab71018569d7c},
doi = {10.1037/a0016465},
issn = {00961523 (ISSN)},
year = {2010},
date = {2010-01-01},
journal = {Journal of Experimental Psychology: Human Perception and Performance},
volume = {36},
number = {1},
pages = {122–135},
abstract = {The authors examined spatial frequency (SF) tuning of upright and inverted face identification using an SF variant of the Bubbles technique (F. Gosselin & P. G. Schyns, 2001). In Experiment 1, they validated the SF Bubbles technique in a plaid detection task. In Experiments 2a-c, the SFs used for identifying upright and inverted inner facial features were investigated. Although a clear inversion effect was present (mean accuracy was 24% higher and response times 455 ms shorter for upright faces), SF tunings were remarkably similar in both orientation conditions (mean r = .98; an SF band of 1.9 octaves centered at 9.8 cycles per face width for faces of about 6°). In Experiments 3a and b, the authors demonstrated that their technique is sensitive to both subtle bottom-up and top-down induced changes in SF tuning, suggesting that the null results of Experiments 2a-c are real. The most parsimonious explanation of the findings is provided by the quantitative account of the face inversion effect: The same information is used for identifying upright and inverted inner facial features, but processing has greater sensitivity with the former. © 2010 American Psychological Association.},
keywords = {adult, article, association, attention, Cues, Depth Perception, Face, face perception, female, human, Humans, identification, inversion effect, male, perception, Perceptual Masking, reaction time, Space Perception, spatial frequency, vision, Visual Perception, Young Adult},
pubstate = {published},
tppubtype = {article}
}
The authors examined spatial frequency (SF) tuning of upright and inverted face identification using an SF variant of the Bubbles technique (F. Gosselin & P. G. Schyns, 2001). In Experiment 1, they validated the SF Bubbles technique in a plaid detection task. In Experiments 2a-c, the SFs used for identifying upright and inverted inner facial features were investigated. Although a clear inversion effect was present (mean accuracy was 24% higher and response times 455 ms shorter for upright faces), SF tunings were remarkably similar in both orientation conditions (mean r = .98; an SF band of 1.9 octaves centered at 9.8 cycles per face width for faces of about 6°). In Experiments 3a and b, the authors demonstrated that their technique is sensitive to both subtle bottom-up and top-down induced changes in SF tuning, suggesting that the null results of Experiments 2a-c are real. The most parsimonious explanation of the findings is provided by the quantitative account of the face inversion effect: The same information is used for identifying upright and inverted inner facial features, but processing has greater sensitivity with the former. © 2010 American Psychological Association.
6.
Blais, C.; Arguin, M.; Marleau, I.
Orientation invariance in visual shape perception Journal Article
In: Journal of Vision, vol. 9, no. 2, 2009, ISSN: 15347362.
Abstract | Links | BibTeX | Tags: adult, article, association, attention, Cues, Depth Perception, Form Perception, human, Humans, methodology, Orientation, Pattern Recognition, Photic Stimulation, photostimulation, physiology, Rotation, vision, Visual Perception, Young Adult
@article{blais_orientation_2009,
title = {Orientation invariance in visual shape perception},
author = {C. Blais and M. Arguin and I. Marleau},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-60649103374&doi=10.1167%2f9.2.14&partnerID=40&md5=1fb771ae6c96e3a0ad4e92a307a12d1d},
doi = {10.1167/9.2.14},
issn = {15347362},
year = {2009},
date = {2009-01-01},
journal = {Journal of Vision},
volume = {9},
number = {2},
abstract = {To assess directly the orientation-invariance of specific shape representation stages in humans, we examined whether rotation (on the image plane or in depth) modulates the conjunction and linear non-separability effects in a shape visual search task (M. Arguin & D. Saumier, 2000; D. Saumier & M. Arguin, 2003). A series of visual search experiments involving simple 2D or 3D shapes show that these target type effects are entirely resistant to both planar and depth rotations. It was found however, that resistance to depth rotation only occurred when the 3D shapes had a richly textured surface but not when they had a uniform surface, with shading as the only reliable depth cue. The results also indicate that both planar and depth rotations affected performance indexes not concerned with the target type effects (i.e. overall RTs and magnitude of display size and target presence effects). Overall, the present findings suggest that the shape representations subtending the conjunction and linear non-separability effects are invariant across both planar and depth rotations whereas other shape representation stages involved in the task are orientation-specific. © ARVO.},
keywords = {adult, article, association, attention, Cues, Depth Perception, Form Perception, human, Humans, methodology, Orientation, Pattern Recognition, Photic Stimulation, photostimulation, physiology, Rotation, vision, Visual Perception, Young Adult},
pubstate = {published},
tppubtype = {article}
}
To assess directly the orientation-invariance of specific shape representation stages in humans, we examined whether rotation (on the image plane or in depth) modulates the conjunction and linear non-separability effects in a shape visual search task (M. Arguin & D. Saumier, 2000; D. Saumier & M. Arguin, 2003). A series of visual search experiments involving simple 2D or 3D shapes show that these target type effects are entirely resistant to both planar and depth rotations. It was found however, that resistance to depth rotation only occurred when the 3D shapes had a richly textured surface but not when they had a uniform surface, with shading as the only reliable depth cue. The results also indicate that both planar and depth rotations affected performance indexes not concerned with the target type effects (i.e. overall RTs and magnitude of display size and target presence effects). Overall, the present findings suggest that the shape representations subtending the conjunction and linear non-separability effects are invariant across both planar and depth rotations whereas other shape representation stages involved in the task are orientation-specific. © ARVO.