Christophe Maggia

Nathalie Guyader

Anne Guérin Dugué

Using natural vs. artificial stimuli to perform calibration For 3D gaze tracking

Keywords: vision, binocular disparity, eye tracking, calibration, natural scenes, artificial images

The presented study tests which type of stereoscopic image, natural or artificial, is more adapted to perform efficient and reliable calibration in order to track the gaze of observers in 3D space using classical 2D eye tracker. We measured the horizontal disparities, i.e. the difference between the x coordinates of the two eyes obtained using a 2D eye tracker. This disparity was recorded for each observer and for several target positions he had to fixate. Target positions were equally distributed in the 3D space, some on the screen (with a null disparity), some behind the screen (uncrossed disparity) and others in front of the screen (crossed disparity). We tested different regression models (linear and non linear) to explain either the true disparity or the depth with the measured disparity. Models were tested and compared on their prediction error for new targets at new positions. First of all, we found that we obtained more reliable disparities measures when using natural stereoscopic images rather than artificial. Second, we found that overall a non-linear model was more efficient. Finally, we discuss the fact that our results were observer dependent, with variability's between the observer's behavior when looking at 3D stimuli. Because of this variability, we proposed to compute observer specific model to accurately predict their gaze position when exploring 3D stimuli.

INTRODUCTION

3D perception arises from multiple depth cues. Monocular cues need only one eye to be perceived and include occlusion, perspective, relative size, texture. [START_REF] Cutting | Perception of Space and Motion[END_REF] , whereas binocular cues need the two eyes and include binocular disparity and vergence. In this research, we are interested in binocular cues. Binocular disparity is mainly due to the horizontal separation of the two eyes, getting two shifted versions of the same visual input in the two retinas [START_REF] Wheatstone | Contributions to the Physiology of Vision.--Part the First. On Some Remarkable, and Hitherto Unobserved, Phenomena of Binocular Vision[END_REF][START_REF] Gonzalez | Neural mechanisms underlying stereoscopic vision[END_REF] . The horizontal disparity between the two retina images is responsible for the depth perception in stereo vision.

A stereo image is composed of two versions of the same scene, a left image and a right image that corresponds to a shifted version of the left image. 3D devices use the same principle since Wheatstone [START_REF] Wheatstone | Contributions to the Physiology of Vision.--Part the First. On Some Remarkable, and Hitherto Unobserved, Phenomena of Binocular Vision[END_REF] . To ensure that one eye only sees one image of the stereo pair, glasses are usually used: either active or passive glasses. When studying binocular disparity, two types of disparity are distinguished: the crossed disparity to perceive objects that are in front of the reference plane and the uncrossed disparity to perceive objects behind the reference plane. Zero disparity occurs when fixating the reference plane. Vergence eye movements correctly align the fixation point on the centers of the retinas, which allows the brain to fuse the two images into a single percept [START_REF] Fincham | The reciprocal actions of accommodation and convergence[END_REF][START_REF] Duchowski | Measuring gaze depth with an eye tracker during stereoscopic display[END_REF] . Consequently, vergence eye movements are crucial to an accurate stereoscopic perception of depth and were showed to be proportional to the retinal disparity amplitude. Due to fusional vergence, the fixation point in the reference plan has zero disparity whereas all the other objects have specific retinal disparity according to their position in depth from the fixation point. There are two types of vergence eye movements, convergent and divergent movements that occur respectively when fixating objects nearer or further than the precedent fixation.

Since recent developments of easy-to-use 3D visualization devices such as 3D TVs or 3D compatible screens with 3D glasses, some research on visual perception use these displays to work with more natural stimuli. In parallel, eye tracking is often used in several research fields like computer science, psychology, neurosciences. By now, eye tracker predict eye positions on a 2D screen but are not able to accurately recover the point of gaze in a 3D space. Consequently, there is an attempt to develop methodology to predict, using 2D eye tracker, the gaze of observer looking at 3D visual stimuli. We called this methodology 3D calibration. Without a reliable 3D calibration, it is not possible to predict gaze position in the 3D space. However, some research did study gaze exploration during 3D stimuli viewing. But they did not retrieve the gaze of observers in the 3D space. They used a "depth map" associated to each visual stimulus and projected the 2D gaze monocular coordinates onto this "depth map" acquired with a laser camera to estimate the depth plane gazed at. This constitutes a technological constraint to study large natural image database. Moreover, the laser camera is quite expensive and we think that using only one eye data is not reliable to determine the 3D gaze location.

Hence, some studies were interested in recovering 3D gaze positions using artificial stereoscopic stimuli from vergence eye movements or from binocular disparity using 2D eyetrackers [START_REF] Duchowski | Measuring gaze depth with an eye tracker during stereoscopic display[END_REF][START_REF] Essig | A neural network for 3D gaze recording with binocular eye trackers[END_REF] . The goal of these authors was to compute a model specific to the observer's gaze characteristics and to compensate for camera-related image distortions. One study developed a geometrical model (fitting model [START_REF] Duchowski | Measuring gaze depth with an eye tracker during stereoscopic display[END_REF] ) that uses the same polynomial interpolation that the one used for 2D calibration. They tested their model using artificial visual stimuli with a rotating target. This rotation was to test the influence of motion parallax on stereopsis but they did not found any significant effect of motion parallax. In another study, they developed a neural network [START_REF] Essig | A neural network for 3D gaze recording with binocular eye trackers[END_REF] that showed good performances on artificial stimuli. Another way was also explored [START_REF] Kwon | 3D gaze estimation and interaction to stereo display[END_REF] by an algorithm using the concept of Pupil Center Distance to estimate 3D gaze position on artificial stimuli. This measure is dependent of vergence since these ocular movements tend to increase or decrease this distance according to the depth plan fixated. Their system was coupled to a game application where observer had to select with gaze a dart displayed at a given depth and gaze on a target at another depth to throw the dart. Their system seemed to have good accuracy but was purely geometric so it did not adapt to the observer 3D fixation pattern. Vergence eye movements were showed to be correlated with disparity changes displayed on a 3D device [START_REF] Duchowski | Measuring gaze depth with an eye tracker during stereoscopic display[END_REF] . Vergence eye movements might be measured to further retrieve disparity.

In our study, we propose a method to predict, using a 2D eye tracker, the observer's gaze in a 3D space when he is viewing 3D stimuli. Knowing that natural images are complex and richer in depth cues than artificial images, it is interesting to discuss the best type of stimuli to use in a 3D calibration. In fact for the moment, as far as we know, all the papers that worked on 3D calibration used artificial stereo stimuli. The method which we proposed was used with either natural or artificial stereoscopic stimuli. Observers were asked to gaze at nine positions at different depths for both kinds of stimuli. We think it is important to test each calibration point with all disparity conditions to take into account the alteration that eccentricity would have on 2D eye tracking and by extension on 3D gaze tracking. For each position, the binocular disparity recorded through a 2D eye tracker was measured, this constitutes the calibration part. This allowed us to compute and to test different types of models, linear and non-linear, to predict the true disparity from the recorded disparity (and hence, the depth of gaze). In order to test the performance of this 3D calibration for the two types of stimuli (natural and artificial)and the efficiency of the different models, the experiment involved a test part in which new positions and new depth planes were presented using both types of stimuli. Models, computed with the positions displayed during the calibration part, were tested to predict 3D gaze for the new positions displayed during the testing part. In the following, we present the design of the proposed experiment, the calibration and the test parts. We develop the data analysis and the comparison between the different models.

MATERIALS AND METHODS

The eye tracker is calibrated with both eyes on a 2D reference plane (the point P on the screen surface, Figure 1). During a fixation (P), the fusional vergence adjusts each eye's view on the same point resulting in a null disparity. When gazing at a point (F, C) in front or behind the 2D plan, a disparity between the gazes of the two eyes is detected on the screen, since each eye gaze at a different positions (C L , F L for the left eye and C R, F R for the right eye). By simply measuring the disparity between the right and the left horizontal gaze coordinates (δx = C L -C R , or F L -F R ) obtained through an eye tracker, we might deduct the horizontal disparity type (crossed or uncrossed) with the sign of the disparity and its amplitude. Finally, depth (Z coordinate) might be deducted from the real disparity Δx. Indeed, knowing the geometric configuration (D and L) and the real disparity Δx displayed for each point (F, or C), the theoretical Z (Figure 1) can be estimated such as :

= -. ∆ + ∆

Participants

All participants (n=7, 4 F, 3 M, ages 30.5 on average) had a normal or corrected to normal vision and were pre-screened for depth perception by binocular disparity thanks to the test for stereoscopic vision TNO (Lameris Ootech BV Nieuwegen). This test uses red/green anaglyphic stereogram to determinate each participant perceptive thresholds. Only the participants who had a stereo threshold of 60 arc sec or less in both crossed and uncrossed binocular disparity were accepted to participate in our experiment.

Visual impairments like strabismus and color blindness were also avoided although we did not test them. All participants had already seen stereoscopic movies and we made sure they understood the full task and got familiar with the material before the experiment. The interpupillary distance (L, Figure 1) was measured for each participant.

Apparatus

We used a remote binocular eye tracker EyeLink 1000 (SR Research) to track the gaze of each eye while the observer is looking at stereo stimuli. The EyeLink system was used in the Pupil-Corneal Reflection tracking mode sampling at 1000Hz. In order to combine eye tracking and 3DTV experience, 3D glasses must be compatible with the Infrared camera of the eye tracker. Only polarized glasses (passive system) should be used because most of the shutter glasses (active system) use infrared signal to synchronize with the TV, which results in interferences between the two devices.

The TV used is an LG 32LW4500 (70cm wide and 39.3cm high). According to the manufacturer, the 3d brightness is 150 cd/m² and the contrast ratio measured is 1240:1. The resolution of 1920*1080 pixels allows at a viewing distance (D) of 132cm a minimum disparity of 57.6 arc sec for a total angular size of 30.13°. This is much bigger than the finest disparity that the human eye can see (up to few arc sec [START_REF] Schor | Disparity range for local stereopsis as a function of luminance spatial frequency[END_REF][START_REF] Westheimer | Cooperative neural processes involved in stereoscopic acuity[END_REF] ). The experiment took place in a dark room to increase 3D immersion.

Stimuli

Two types of stimuli were tested in this study: artificial images and natural pictures. Two images were created for each eye (the left and the right image) with the same information and a horizontal shift between both images (the shift that corresponds to the true disparity is given in pixels). Natural pictures were taken with a stereoscopic photo camera (Fujifilm W3), whereas artificial images were created using Matlab software. All images were converted to grayscale then equalized to an average luminance of 127 (on a luminance scale [0,255]). Stimuli were resized to 12.8° of visual angle (800*450pixels). Images were centered and the rest of the screen was black. The black border enhances the 3D perception and immersion. Both types of stimuli were constructed according to the same principle as the eye tracker calibration stimuli. Each stereo image contained a target located on one of nine possible locations equally distributed on the 2D screen (similar to the well-known 9 points calibration used in classical 2D eye tracking 10 Figure 2). Then, each stereo image was modified to display the nine positions on five distinct depth planes. One depth corresponds to the null disparity, two planes to crossed disparity (disparities equal to 32 and 16 pixels) and two to uncrossed disparity (Δx equal to -32 and -16 pixels). 45 targets (9 positions x 5 depth planes) referred as "learned positions and learned disparities" were displayed during the calibration part and further used to compute the models. In the test part, we designed images with four new targets located at intermediate positions "New positions". In addition to the five learned disparities "New positions and learned disparities", we tested four new disparities "New positions and new disparities" (two crossed Δx= 40, 24pixels and two uncrossed Δx=-24, -40 pixels). This testing part was constituted of 36 new targets (4 positions * 9 depth planes). These positions allow us to test models efficiency to retrieve new positions (interpolation and extrapolation).

Artificial stimuli

Artificial stimuli can be easily adapted to both crossed and uncrossed disparities by reversing right and left images.

When testing these artificial stimuli with only the target that had a different plane, it was very difficult to perceive clearly the depth of the target. To make the task easier for the observer, other squares were added both in and out of the target depth plane to allow relative disparity judgment (Figure 3). In fact, it is known that human depth perception is more based on relative disparity than absolute disparity making it easier and more accurate [START_REF] Gonzalez | Neural mechanisms underlying stereoscopic vision[END_REF][START_REF] Westheimer | Cooperative neural processes involved in stereoscopic acuity[END_REF] . The target was a white square (21*21 pixels, 20,1 arc min of visual angle with a black dot on the center) included in a 5*5 grid of purple squares (Figure 3). The nine positions described earlier moved in the same depth plane as the target whereas the others stayed in 2D as a reference plan.

Natural stimuli

It is almost impossible to find natural scenes where both disparities would be present and localized at 9 different positions. Hence, we used two different scenes for crossed and uncrossed disparities. In the Figure 4 we only represented the scenes with the target in the central position. We tried to avoid monocular depth cues (perspective, occlusions, and relative size) as it has been shown that monocular cues can influence vergence eye movements even on 2D images [START_REF] Masson | Vergence eye movements in response to binocular disparity without depth perception[END_REF] .

Observer knew beforehand the target he had to gaze at in the scene. Moreover a small dot was added on the center of each target to help the observer to be more precise when fixating.

Experimental design

All participants underwent the experiment twice, one with natural and one with artificial images in a random order in separated days to avoid visual fatigue. The experiment was divided in two parts: a calibration and a test.

One trial was made up of three steps. In the first one, a 2D image displayed the target in one of the nine spatial positions for 1.5sec. Then, the image with the same target in one of the five depth planes was displayed for 6sec maximum.

Observers were told to gaze at the target as precisely as possible during this delay. This succession of two images permitted to clearly see the difference between 3D and 2D images and make the task easier. For the targets in the reference plane (null disparity), there was a succession of two 2D images. We made the images switched from one image to the other of the stereo pair. The image used for the target was selected according to the dominant eye of the observer. The target image was displayed for 6 sec which might be long, but vergence is a slow eye movement and this duration allowed the observer to explore the stimulus and the different depth planes before fixating the target. Finally, a mean gray screen remained for 1sec before the next trial. Target positions were randomized.

Visual fatigue is a crucial factor when observing vergence eye movements. Some authors [START_REF] Lambooij | Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review[END_REF][START_REF] Neveu | Vergence tracking: a tool to assess oculomotor performance in stereoscopic displays[END_REF] noticed a decrease in oculomotor performance even before observer did subjective complaints. To fixate on a 3D point can alter vergence eye movements if it is repeated during a long period. To make the task more pleasant and to shorten the experiment, we used a contingent gaze display to remove the target image before the 6 sec. If the gaze of both eyes were fixated within a restricted area around the target for at least 600ms, the image was removed and the next trial started. The size of the area varied according to the dominant eye of the observer. In fact, we noticed that the non-dominant eye gaze was less precise than the dominant one. We defined an area of 75 pixels centered on the target for the dominant eye and an area of 100 pixels centered on the target for the non dominant eye. If the two eyes did not gaze in this area, the stimulus was displayed for 6 sec and the recorded data were not further analyzed. When eyes were fixed in the defined area around the target, we kept all the eye positions recorded. We further need to select during this period which eye positions to analyze. Actually, during this period we recorded several events: a saccade toward the target, then several saccades still might be recorded on the target area but also around the target area. An offline selection was realized on the fixations detected by the Eyelink system for the dominant eye. We kept the fixations that were not farther than 50 pixels from the target. If multiple fixations fitted this criterion, the longest one was kept. We chose to repeat every 45 targets twice. This repetition decreases the risk to lack data for some positions. Every 9 images, a 2D calibration was done. A verification step was made to ensure that the mean error between the eye tracker estimation and observer's fixations was lower than 1° for each eye. This allowed to keep the maximum tracking accuracy all along the experiment, but also to allow breaks for observers.

Data extraction

As already noticed by authors [START_REF] Duchowski | Measuring gaze depth with an eye tracker during stereoscopic display[END_REF] , ocular data stability is an important issue when tracking gaze in depth (Figure 5). It has been shown that vergence eye movements in response to stepwise change in disparity need time before stabilization [START_REF] Pobuda | The relationship between absolute disparity and ocular vergence[END_REF] . However, during the 3D fixations, it happened that the stabilization did not last. We noticed some oscillations or drifts of the recorded eye positions around the target position without a conscious perception of this phenomenon by observers Figure 4 Stereoscopic view of the central position of natural stimuli for crossed (Right) and uncrossed (Left) disparity. Target angular size is 24 arc min for uncrossed disparities and 73 arc min for crossed disparities (Figure 5). The fixation detected by the EyeLink system is based on the mean of raw eye positions. As we can see in the example showed in Figure 5, the δx measured stabilize at a lower disparity than the Δx displayed (-32 pixels). The mean δx of such a fixation is influenced by data outside the stabilized period. So the fixation summary given by the Eyelink system do not represent accurately 3D fixation. On the contrary, by taking the most frequent δx (distribution mode) as the resulting fixation summary, we free ourselves from the vergence adjustments movements to only keep the real stabilized period even if it stray away from the Δx displayed . Each fixation corresponded to several raw eye positions, and in function of the fixation duration we might have more or less raw eye positions. For each fixation, we extracted 80 eye positions closest to the mode of the fixation. . Two third of them were used to compute the different models whereas the last third was kept to test the efficiency of models.

When no fixation occurred in the target area (defined 2.4) the corresponding trial was referred as "Missing data". Because we did two repetitions for each target there were in most of the cases two correct fixations for each target. If the two repetitions were consistent (a 30 pixel thresholds was empirically chosen after preliminary testing), the closest to the target position was kept. Sometimes, it happened that two fixations for the same target correspond to different disparity signs, crossed and uncrossed; these trials was referred as "Uncertain data". Finally, it sometimes happened that an observer for one spatial position showed disparities larger than the true disparities. Hence, we also considered for one spatial position the evolution of the measured disparities for the five depth planes. Due to our experimental design with true disparities linearly distributed, we should also recorded linearly distributed disparities. Hence a linear regression was computed from the selected data and all the possible combinations of the uncertain ones. The combination, for which the mean square error (MSE) between the linear regression and the data recorded was minimal, was kept. This way, we preserved the observer tendency even if his data were far from the theoretical ones but aligned. However despite this procedure, aberrant values could remain. We manually checked every model to remove outliers impairing a reliable regression (see 2.5.1). Some trials were considered as "outlier" if the MSE error of the regression significantly decreased after removal.

Models

We decided to divide the screen in nine parts to model the ocular behavior in front of 3D stimuli. The accuracy of the eye tracking tend to be poorer a high eccentricity [START_REF] Holmqvist | Eye tracking: A comprehensive guide to methods and measures[END_REF] , so to create a mapping that includes this loss of accuracy to retrieve the disparity displayed, we made models on each of the nine positions.

Theoretically, the measured δx has to match the displayed disparity Δx (Figure 1 D and L the physical parameters and D and L, the estimated parameters thanks to the nonlinear regression. And then for all the models, all the estimated parameters are noticed in bold. To compare them on the disparity values, we have to convert the Z estimation obtained with the non linear models in δx estimation by using the inverse of the theoretical equation:

� = - � ×L D+ �
The tree models are detailed hereafter (Figure 6b):

-Model ab : Linear regression applied on the δx data with two adjustable parameters: We noticed that the theoretical equation with the real values of D and L could not always fit the evolution of ̂ described by the data. That's why we realized a regression on D, L and O (model DLO) so we could consider potential noise in all dimensions and adjust the parameters to fit the data. For the two nonlinear models, the parameters are estimated thanks to the conjugate gradients method for the penalized least squared error optimization. The penalty term provides interpretable values for the estimated parameters (D and L close to D and L respectively and d and O close to zero) Figure 7 shows an example of regression on δx or Z by the different models. Here, experimental data drift clearly from Δx and Z towards the crossed disparities. The absolute disparity perception is biased, however relative disparity relationship between targets at different depth are for the most part respected. In this case the observer's fixation for the highest disparity stray away from the Δx the most. The three models differ mostly for high disparity estimation. We can therefore choose which model is best adapted to each observer. Such regression gave us one set of parameters per model and per position. Deleted positions were interpolated from the nearby positions. With these sets coupled to positions coordinates maps were built using cubic spline interpolation between the 9 calculated parameters values. Each model was then represented by the spatial maps of its parameters (Figure 8). Each observer had his own map of parameter for each model determined according to his own ocular behavior (Figure 8). We found large variability between observers and the variability of the parameters across the 2D space showed that to take into account the spatial position is determinant for 3D gaze tracking.

� = ×
We applied the parameters corresponding to the gaze coordinates of the last third of the calibration data(Learned positions and learned disparities) and we calculated its RMS error to check the models accuracy to predict the data. Then we used these same parameters maps on the new positions and learned disparities data from the test part and calculated the RMS error of the estimation. This result represents the efficiency of the spatial interpolation since disparities are the same for the two target positions. Afterwards, as for calibration, we built new models based on the test part (Learned new positions, learned disparities) and calculated the RMS error for the learned and the new disparities.

Positions being the same between learned and new disparities, we tested this time the 3D interpolation efficiency of our models. Finally, we used the models based on calibration on the new positions and new disparities data to check the spatial and depth crossed interpolation efficiency of our models (Figure 9).

RESULTS

The first aim of this research was to test which type of stimulus, artificial or natural, was more adapted to perform efficient 3D calibration using 2D eye tracking. We compared the reliability of the disparity recorded when viewing natural and artificial stimuli that displays target at several positions in the 3D space.

Natural vs. Artificial: Data extraction

First, it was important to note that most observers (5 out of 7) reported after the experiment that it was easier for them to fixate the target positions for the natural stimuli rather than the artificial stimuli. Moreover, some of them reported that although they perceived 3D artificial stimuli, it was in some cases difficult for them to perceive the depth plane of the target. Table 1 reports several errors reflecting the fixation instability (see §2.5 for the procedure explanation). "Missing data" represents the percentage of missing data if we take into account one or two iterations. As expected to repeat twice each target position reduces the probability of missing data. It is important to note that the proportion of missing data varies between observers despite the fact that observers were checked for similar stereo acuity thresholds. "Uncertain" data correspond to the percentage of trials for which we obtained different δx for the two iterations for the same target position (difference above 30 pixels). "Outliers" data represent the percentage of data that was removed after the calibration. the missing data (considering the first iteration), the missing data (considering the two iterations), uncertain data and outliers.

Stimuli

Figure 9. Schematic representation of the treatments realized on the different conditions. We compared the different conditions and models with the calculated RMS error.

We ran an ANOVA with two within -subject factors: the type of stimulus (Natural / Artificial) and the type of error (missing 1 iteration / missing 2 iterations / uncertain / outliers). We observed a significant effect of the type of stimulus (F (1, 18) =20.01; p<0.005): there were less data errors when using natural stimuli (10.8%) compared to artificial stimuli (15.7%). We also observe a significant effect of the type of error (F (3, 18) =13.45; p<0.001). As expected, there were less missing data when taking into account two iterations (F (1, 6) =13.53; p=0.01). Moreover, the proportion of uncertain data was higher than the proportion of missing data 2 (F (1, 6) =22.25; p<0.005) and the proportion of outliers (F (1, 6) =43.9; p<0.001). We did not observe any significant effect of the interaction (F (3, 18) =0.38; ns).

Hence, the conclusion of this first analysis was that using natural stimuli observers better manage to correctly fixate the different target positions. Moreover, it might be important to obtain more data by repeating twice (2 iterations) each target position. In fact, if we had used only one repetition, we would have lost 11.6% of data for natural stimuli whereas by using two repetitions, we only lost 2% of the data. For the further analyzes, the outliers were removed.

Natural vs. Artificial: Raw data analysis

We calculated, for all models, the RMS error between each recorded δx during correct fixations and their corresponding true disparity Δx for different testing target positions (Figure 9). Model performances were highly observer dependent. For some observers, the measured disparities were very close to the true disparity. Hence, for these observers, when plotting the measured disparity as a function of the theoretical disparity, we obtained a line (AL006, AL007 and NA004). For other observers, there was a global drift toward the crossed or uncrossed disparities that was stable for the different positions (AN001, FR005, RA003 and AN002). For 3 observers, this bias is toward the uncrossed disparities, observers tend to fixate the target farther than its real depth. This effect is accentuated by visual fatigue which causes a progressive release toward the relaxed state where the two lines of sight are parallel. Only one observer (RA003) exhibits the inverse bias towards the crossed disparities. Before analyzing model performance, we focused on the raw data for all observers according to the target positions. We ran an ANOVA on the RMS error measure with two within subject factors: the stimulus type (Natural / Artificial) and the target positions (Learned pos Learned disp / New pos Learned disp / New pos new disp). A significant effect of the target position was found on raw data (F (2, 12) =4.66; p<0.04). The RMS error was higher for the new positions and new disparities compared to the learned positions and learned disparities (F (1.6) =5.96; p=0.05). No significant effect of the stimulus type was observed (F (1, 12) = 1.72; ns), however on average natural stimuli always showed smaller RMS error than artificial stimuli. Data tended to be closer from theoretical values and more stable (standard error smaller) for natural stimuli than for artificial ones (Figure 10).

Although no significant difference was found between the stimulus types, the criterions of stability and consistency and the raw data analysis clearly favor the natural stimuli. The following analyses are presented only on the natural stimuli. We ran an ANOVA analysis with two within subject factors: the target position (Learned pos Learned disp / New pos Learned disp / New pos new disp) and the type of model (Raw / ab / dO / DLO) (Figure 11). We observed a significant effect of the target position (F (2, 36) = 20.8; p<0.001). As expected, models perform clearly better on learned positions and learned disparities. Moreover RMS error was higher for the new disparities than for the learned ones (F (1.6) =13.23; p<0.01). The type of model did not have any significant effect (F (3, 36) = 2.12; ns). Both factors interact (F (6, 36) = 2.5; p<0.05). The linear model ab was more efficient on the learned position and learned disparities. This might be explained by the fact that this model was computed using the same set of data and our data extraction used a linear regression (see 2.5). However we observed on the "Learned new positions and learned disparities" that this advantage of the linear model seemed to not be related to the selection process (see 2.4); in fact, the testing part had only one iteration and did not endured such a selection. We also noticed that the spatial interpolation was the best for the nonlinear DLO model (RMS=20.15). In fact if there was a god spatial interpolation, models should be efficient to predict target positions at new positions and learned disparities. Moreover, it produced the best results for the new disparities tested both with the calibration model and the model built on the testing part.

Actually, when we look at the individual results, the models efficiency compared with raw data is more observers dependent. Three subjects show an improvement of the error with model parameters in comparison with raw data.

For two of them (FR005 and AL007), the three models are equally efficient on new positions (Figure 12). They permit the decrease of the error on the new positions and learned disparities of 63% for the first and 48% for the second. The improvement is slightly smaller for the new disparities on the new positions (46% and 44% respectively). AN001 data were biased such as most of the models were not efficient to predict the new positions, however the non-linear model DLO was able to decrease the error of 75% and 73% for learned and new disparities of new positions compared to raw data.

On the other hand, there are cases where models do not manage to decrease the error from raw data. Figure 13 shows an example of this case.

DISCUSSION

In this paper, our main issue was to determine what type of stimuli might be the most appropriated to perform a 3D calibration using a 2D eye tracking. Our approach is similar to the concept used during 2D calibration and also it depends on the 2D tracking accuracy. While the 2D calibration assure the correspondence between the screen coordinates and the gaze coordinate, the 3D calibration attempt to follow the correspondence between the disparity displayed and the vergence pattern to track accurately the 3D gaze. We know that monocular depth cues can affect the vergence state REF.

Hence, vergence eye movements in an experiment using natural images are necessarily biased. Although we chose our natural images with limited monocular depth cues, the architecture still influence the vergence eye movements of the observer. The use of two different images to represent close and far object could better consider this bias. Although, no significant difference was observed on the model efficiency, both subjective evaluation of observers and quality criterions confirm that natural stimuli should be used to calibrate the depth of gaze when viewing 3D stimuli. Natural stimuli elicited more repeatable fixation as we obtained significantly lesser uncertain values than for the artificial stimuli.

Besides, we lost more data for the artificial stimuli reflecting a higher difficulty to gaze at 3D targets. The data consistency also favors the natural stimuli. The higher proportion of outliers makes the artificial stimuli condition data unreliable and increases the risks to have to discard data. And models need as much valid data as possible to follow the observer behavior. Consequently, natural stimuli might be used to efficiently perform 3D calibration. However because perception quality of stereoscopic stimuli through time varies from one observer to another, side effect such as headache, ocular dryness and visual fatigue 12 may appear during the viewing time and lead to a disturbed vergence state. So, in an experiment where the observer has to perform a 3D task after a 3D calibration, two iterations increase the risk of biases caused by these symptoms. Consequently, only one iteration of each target should be used during the calibration part.

For some observers, we did not expect that the absolute disparity extracted from vergence would be so far from the theoretical gaze position. So, in a 3D exploration context, we might wonder if the recent researches about 3D saliency based on monocular gaze position are valid. These studies [START_REF] Liu | Natural scene statistics at stereo fixations[END_REF][START_REF] Jansen | Influence of disparity on fixation and saccades in free viewing of natural scenes[END_REF] used only the guiding eye data coupled to a disparity map computed beforehand. To determine the depth gazed at, they looked at the gaze location on the disparity map. However, we saw in our experiment that even the guiding eye gaze location can be influenced by vergence. In some case where vergence state is shifted from the theoretical state, the gaze location extracted from only one eye might be wrong and the corresponding disparity on the map too. We think, that in a 3D experiment, in order to retrieve the depth and the object fixated, the two eyes should be considered since vergence eye movements influence the gaze location recorded.

According to Ogle [START_REF] Ogle | On the limits of stereoscopic vision[END_REF][START_REF] Ogle | Disparity limits of stereopsis[END_REF][START_REF] Ogle | Precision and Validity of Stereoscopic Depth Perception from Double Images[END_REF] , the stereoscopic depth perception can be divided into two categories based on the amplitude of the disparity and the perception of the observer : the quantitative and the qualitative stereopsis. While in the quantitative stereopsis, the observer's perception is directly proportional to the binocular disparity displayed, in the qualitative stereopsis range of disparity, perception reach a plateau where it does not follow the disparity anymore and where the observer cannot estimate reliably the disparity amplitude. Consequently, it is important that the disparity displayed in the calibration and the future 3D task remains in the quantitative range where vergence eye movement still manages to fusion the stereo images and for which its relation with binocular disparity is still linear. That is why we put the largest disparity recorded in the calibration at approximately half a degree. Visual comfort is equally a factor since observers complained at higher disparities especially for the crossed disparity at d=40. We can notice that the RMS error for new disparities is significantly higher than for learned disparities on new positions. Besides, when we made the models directly on new positions and learned disparities we noticed that the extrapolation of models to new disparities have some issues since the error is significantly higher for new disparities than for the learned ones on the same position. We could explain this higher error by the fact that stereo threshold increases with absolute disparity amplitude ( 20 for review). The vergence eye movements would be prone to more variation.

On average, the nonlinear model DLO is more efficient to retrieve the depth gazed at both the spatial and 3D interpolation level. Our mean error level is similar to other studies having used close paradigm (19.3arcmin of error for our model on learned disparities to be compared with 25.6arcmin for Duchowky's fitting model [START_REF] Duchowski | Measuring gaze depth with an eye tracker during stereoscopic display[END_REF] and 28.8arcmin of error for our model on new disparities), despite the fact that they did not tried to generalize their model to others disparities than the learned ones. With such an error level we cannot track accurately the absolute disparity level perceived during a free viewing experiment, however the 3D scan path will be available since we observed that relative disparity interaction were preserved in the vergence extraction. This will allow us to better understand how humans explore a 3D image and for example, confirm if features salient in 2D image stay as much salient in 3D [START_REF] Jansen | Influence of disparity on fixation and saccades in free viewing of natural scenes[END_REF] . However when we analyze each subject individually, we notice that model efficiency depends highly on the observer. Some people tend to be extremely precise and consistent within their 3D fixations whereas others have an ocular behavior more erratic, making estimation more difficult. By building several distinct models, we can choose the best adapted model to each observer's behavior. The perception ability seems to not be the source of this inter-subject variability since the observers' stereo acuity was similar. So this inconsistency necessarily comes from the vergence eye movements. The fact that some observers found quite difficult and tiring to look at 3D stimuli becomes an important issue to track accurately the gaze in 3D from the vergence eye movement. During an experiment using 3D images such a 3D calibration will permit to track the 3D gaze providing that models can be kept up to date with the vergence state of the observer. Hence, multiple calibration session have to be considered all along the experiment. So it's important to consider as a whole, the 3D calibration procedure and the 3D target experiment when designing this 3D target experiment. Having an efficient, flexible and fast 3D calibration procedure adapted for each subject is then essential for the reliability of the 3D target experiment.

Figure 1 :

 1 Figure 1: The point P represents the basis of the calibration. C and F elicit gaze positions which reflect each point disparity. C has a crossed disparity, while F has an uncrossed disparity. D represents the viewing distance. L is the inter-ocular distance.

Figure 2 .Figure 3

 23 Figure 2. Schematic representation of the 3D space used in the calibration. Nine positions are used at five different disparities. d is given in pixels

Figure 5

 5 Figure5Time course of a delta x measure during a 3D fixation. Ocular data are noisy. The observer does not always follow the theoretical value, in this case he stabilizes himself at farther depth than the presented one. The mean as a fixation resume is too influenced by drift and noise, whereas the mode only keep the best stablilized period.

+-

  Model dO: Non-linear model with two adjustable parameters, in which additional noise on δx (d) and a general offset O are adaptable to obtain ̂. The initial value for d and O are 0 for both. The model is described ̂= -× ( + ) + ( + ) + -Model DLO: Non-linear model with three adjustable parameters which are the initial parameters L and D as well as the offset O. The initial value for D, L and O are respectively D, L and 0. The model is described by: ̂= -× + +

Figure 6 (

 6 Figure 6 (Left) hyperbolic evolution of Z in function of Δx. There is an asymptote in -L and D. b. (Right) Schema of the application of the linear and non-linear model on δx and Z

Figure 8 .

 8 Figure 8. Representation of the different models on both δx and Z estimation in pixels for one position. The black line represents the theoretical evolution of δx and Z. The different gray scaled lines represent the different models following the raw data (black dots).

Figure 7 .

 7 Figure 7. (Left,center) Example of the two interpolated parameters maps of the ab model built from the calibration of one subject. (Right) The same parameters map for another observer.

Figure 10 .

 10 Figure 10. RMS error calculated on raw data according to the type of stimulus and the target positions. Error bars are standard errors

Figure 11 .

 11 Figure 11. Left: Representation of global RMS error according to target position and models in the natural condition. Pos = Positions. Disp= Disparities.Error bars show standard errors. Right : Global RMS error of two new target positions where models are built directly from the new positions and learned disparity.

Figure 13 RMS

 13 Figure 13 RMS error of one observer where models do not decrease the error compared to raw data.

Table 1

 1 Calibration data quality. For the two types of stimuli, Natural and Artificial, different measures are reported for each observer:

			Natural stimuli			Artificial stimuli
		Missing	Missing	Uncertain	Outliers	Missing	Missing	Uncertain	Outliers
	Observer	(%)	(%)	(%)	(%)	(%)	(%)	(%)	(%)
		1 iteration	2 iterations			1 iteration	2 iterations
	AN001	29	9	28.9	6.7	40	23	35.6	6.7
	AN002	12	5	17.8	2.2	12	5	37.8	4.4
	RA003	25	0	15.6	2.2	9	3	37.8	2.2
	NA004	0	0	48.9	0	0	0	48.9	6.7
	FR005	3	0	44.4	8.9	7	0	44.4	17.8
	AL006	0	0	6.7	0	18	7	17.8	2.2
	AL007	12	0	24.4	0	25	7	20	2.2
	Mean	11.6	2	26.7	2.85	15.9	6.4	34.6	6

ACKNOWLEDGMENTS

The work presented in this paper was supported by the MOOV3D project, via the MINALOGIC and IMAGINOVE competitive clusters, and Rhône-Alpes region in France.


Pauline Mouawad
email: pauline.mouawad@u-bordeaux1.fr

Myriam Desainte-Catherine
email: myriam.desainte-catherine@u-bordeaux1.fr

Anne Gégout-Petit

Catherine Semal
email: catherine.semal@ipb.fr

The role of the singing acoustic cues in the perception of broad affect dimensions

Keywords: vocal, glottal, singing expressions, affect dimensions

This experiment investigated the role of acoustic correlates of the singing voice in the perception of broad affect dimensions using the twodimensional model of affect. The dataset consisted of vocal and glottal recordings of a sung vowel interpreted in different singing expressions.

Listeners were asked to rate the sounds according to four perceived affect dimensions. A cross-tabulation was done between the singing expressions and affect judgments. A one-way ANOVA was performed for 11 acoustic cues with the affect ratings. It was found that the singing power ratio (SPR), mean intensity, brightness, mean pitch, jitter, shimmer, mean harmonic-to-noise ratio (HNR), and mean autocorrelation discriminate broad affect dimensions. Principal component analysis (PCA) was performed on the acoustic correlates. Two components were retained that explained 78.1% of the total variance of vocal cues and 73.5% of that of the glottal cues.

Introduction

Voice "is a primary instrument for emotional expression" [START_REF] Scherer | Expression of Emotion in Voice and Music[END_REF] and "emotional expression is an essential aspect in singing" [START_REF] Sundberg | A Singer's Expression of Emotions in Sung Performance[END_REF]. Although substantial research has addressed affect perception in speech, it is still in its early stages for the singing voice. Previous experiments have asked professional singers to perform songs according to a set of discrete emotions achieving results varying in accuracy and different emotions not identified equally well [START_REF] Jansens | Perception and Acoustics of Emotions in Singing[END_REF], [START_REF] Scherer | Expression of Emotion in Voice and Music[END_REF]. Furthermore, the acoustic cues that determined listeners' judgments mediated the singers' emotional state and therefore no judgment could be made as to the inherent faculty of the singing voice in conveying emotions independently of the singer's affect expression.

This experiment has two aims: first, to learn whether listeners perceive broad affect dimensions in a singing voice that doesn't portray a specific emotion. And second if affect is perceived, to reveal the intrinsic role of the acoustical characteristics of the singing voice in the perception of affect. To our knowledge, these questions have not been studied before.

Experiment

Stimuli

The stimuli was taken from the Singing Voice Database 1 and consisted of scale recordings of vocal as well as glottal sounds of a sung vowel 'ah' interpreted by professional singers (1 male and 1 female). The musical notes range from A2 to E4 and A3 to A5 for male and female voice respectively. The recordings are mono files in WAVE PCM format, at 16 bits and 44 kHz. The sound files were trimmed using MIRToolbox [START_REF] Lartillot | A Matlab Toolbox for Musical Feature Extraction from Audio[END_REF] to remove the silence at the beginning, and were segmented using R statistical software [START_REF]R: A Language and Environment for Statistical Computing[END_REF] so that only the first note of the scale is retained. The final dataset consisted of 44 sound samples, 22 vocal and 22 glottal of 1 second duration each in the following singing expressions 2 : bounce, hallow, light, soft, sweet, flat, mature, sharp, clear, husky and no expression. The female sound files don't include the flat singing expression. The type of the stimuli was relevant as the singers didn't perform specific emotions and there was no accompanying music or lyrics to influence the listener's affect perceptions, hence their judgments were expected to relate to the voice alone.

Participants

The participants consisted of 9 males and 6 females, (age M = 26.1, SD = 9.6) of whom 1 is a professional singer and 4 have had some kind of formal singing training. 7 reported enjoying singing, 14 agreed that music expresses emotions and that the voice of the singer is important to their personal enjoyment of a song. All participants reported that the voice of the singer is important in expressing emotions in singing.

Procedure

Participants were asked to rate the perceived affect dimension of each voice sample on a 5-point Likert scale using the two-dimensional model of affect [START_REF] Russel | A Circumplex Model of Affect[END_REF] represented by four broad affect terms: pleasant-unpleasant for valence, and awake-tired for arousal [START_REF] Schimmack | Dimensional Models of Core Affect: A Quantitative Comparison by Means of Structural Equation Modeling[END_REF]. Considering that with today's internet bandwidth and sound technologies it has become possible to conduct psychoacoustic tests over the internet [START_REF] Cox | Tutorial: Public Engagement through Audio Internet Experiments[END_REF], the experiment was distributed through email with instructions explaining its objectives. Participants could play the sound file more than once, and could at any time save their answers and come back to complete it later. Each sample occurred 3 times in the dataset and the order of the files was randomized. Duration of the experiment was 30 minutes. ____________________________ 1 http://liliyatsirulnik.wix.com/liliyatsirulnik1411#!scale/cee5 2 http://liliyatsirulnik.wix.com/liliyatsirulnik1411#!synopsis/cjg9 3 Results

Affect Ratings

Considering that the number of responses for each of the 5 categories on the Likert scale was slight therefore making it difficult to meet the assumptions of statistical validity for the ANOVA, the responses were grouped under 'pleasant', 'unpleasant', 'neutral' for valence, and 'awake', 'tired', 'neutral' for arousal. For example, responses for 'awake' and 'extremely awake' were grouped under 'awake'. The mean of the ratings for the 3 occurrences of each file was computed, and then the file was classified according to the emotion that brought the highest total number of votes. On the valence dimension, 16 were rated as pleasant (13 vocal, 3 glottal), 22 were rated as unpleasant (7 vocal, 15 glottal) and 6 were rated as neutral (2 vocal, 4 glottal). On the arousal dimension, 22 were rated as awake (17 vocal, 5 glottal), 17 were rated as tired (3 vocal, 14 glottal) and 5 were rated as neutral (2 vocal, 3 glottal).

Acoustic Features

A total of 11 acoustic features were selected according to their perceptual validity as established in the relevant literature (see Table 1) and were extracted from the original sound files using Praat software [START_REF] Boersma | Praat, a System for Doing Phonetics by Computer[END_REF]. Pitch information was retrieved using a cross-correlation method for voice research optimization, with pitch floor and ceiling set to 75 Hz and 300 Hz respectively for male voice and to 100 Hz and 500 Hz respectively for female voice. The spectrum was obtained from the waveform using Fast Fourier Transform method with a dynamic range of 70 dB, a window length of 5 ms and a view range from 0 to 5000 Hz for male and from 0 to 5500 Hz for female voice. The singer's formant [START_REF] Sundberg | A Singer's Expression of Emotions in Sung Performance[END_REF], [START_REF] Millhouse | Perceptual Characterisation of the Singer's Formant Region: a Preliminary Study[END_REF] was quantified by computing the singing power ratio (SPR) [START_REF] Lundy | Acoustic Analysis of the Singing and Speaking Voice in Singing Students[END_REF]. To this end the two highest spectrum peaks between 2 and 4 kHz and between 0 and 2 kHz were identified and SPR was obtained by computing the 'amplitude difference in dB between the highest spectral peak within the 2 -4 kHz range and that within the 0 -2 kHz range' [START_REF] Jayakody | The Singing Power Ratio and Timbre-Related Acoustic Analysis of Singing Vowels and Musical Instruments[END_REF]. Since the 'perceptual singer's formant' is 'contributed by the underlying acoustic formants F2, F3 and F4' [START_REF] Millhouse | Perceptual Characterisation of the Singer's Formant Region: a Preliminary Study[END_REF], the means of F2, F3 and F4 were measured individually for each sound file. The mean intensity of the sound was measured using energy averaging method. Measures of jitter, shimmer mean autocorrelation and mean harmonics-to-noise ratio (HNR) were extracted from the voice report. Brightness was extracted using MIRToolbox [START_REF] Lartillot | A Matlab Toolbox for Musical Feature Extraction from Audio[END_REF].

Analysis

The entire analysis was carried out in the R statistical software environment [START_REF]R: A Language and Environment for Statistical Computing[END_REF].

Singing Expressions and Affect. To our knowledge, the relationship of various singing expressions to affect dimensions is not established in the literature. A crosstabulation was done for the affect judgments and the singing expressions to determine the counts of the combination of each factor level. On the valence dimension, all vocals in light, soft and sweet expressions as well as 67% of those with no specific expression were perceived as pleasant; mature and sharp vocals were perceived as unpleasant. All glottals in bounce, husky, mature, sharp and no expression were perceived as unpleasant, and soft glottals were perceived as pleasant. On the arousal dimension, all vocals in bounce, clear, mature, sharp and no expression were perceived as awake, and those in soft and sweet expressions were perceived as tired (low energy). All glottals in clear, hallow, soft and sweet as well as 67% of those having no specific singing expression were perceived as tired.

Acoustic Cues and Affect. A one-way ANOVA was performed for each acoustic measure with valence and arousal as factors with three levels each. The analysis results were verified using Tukey's multiple comparisons of means and were Bonferroni corrected. On the valence dimension, acoustic cues whose means were statistically different for the pleasant-unpleasant factors are SPR, mean intensity, jitter, shimmer, mean autocorrelation and mean HNR for vocal files (see Table 2), and brightness, mean intensity, shimmer and mean autocorrelation for glottal files, with brightness being significant for the pleasant-neutral factors as well (see Table 3). Comparing mean values between vocal and glottal sound files, it is noticed that on the pleasant dimension the shimmer's mean value is higher in glottal sounds and lower in vocal sounds, and mean autocorrelation's mean value is lower in glottal sounds and higher in vocal sounds.

On the arousal dimension, acoustic cues whose means were statistically different for the awake and tired factors are SPR and mean intensity for vocal files (see Table 4), and mean intensity, jitter, shimmer, mean HNR and mean pitch for glottal files, with mean HNR being also significant for the neutral-awake factors (see Table 5). On the pleasant dimension, the mean intensity's mean value is higher for both sound types. Principal Component Analysis. The motivation for performing a PCA on the acoustic correlates is duple: first, to determine what are the main components that best describe the stimuli knowing that these exist in the audio feature data, and second, to project the sounds on a factorial plane that illustrates graphically their distribution on the valence-arousal groups alongside the acoustic variables used for the PCA. Two components were retained that explained 78.1% of the total variance of vocal cues and 73.5% of that of the glottal cues.

For the vocal cues, the first component explains 57.7% of the original variance and accounts mainly for variations in SPR, F4, mean pitch, opposed to jitter and mean intensity; the second component explains a further 20.4% of the original variance and account mainly for variations in brightness. Figures 1 and2 show that the vocal files projected onto the PC1-PC2 planes appear to cluster reasonably according to valence and arousal, although a bit weaker for arousal. For example, pleasant sounds are those having higher values of SPR, F4 and mean pitch and lower values for jitter and mean intensity and/or lower values for brightness. Unpleasant sounds are those having higher values for jitter and mean intensity and lower values for SPR, F4 and mean pitch, and/or higher values for brightness. Sounds perceived as awake are those having higher values for jitter and mean intensity and rather lower values for brightness, and sounds perceived as tired are those having higher values for SPR, mean pitch and F4 and/or lower values for brightness. For the glottal cues, the first component explains 53.4% of the original variance and accounts for variations in shimmer, F2, F3, opposed to mean intensity, mean autocorrelation and mean HNR; the second component explains a further 20.1% of the original variance and accounts for variations in mean pitch and F4 (see Fig. 3 and Fig. 4).

Conclusion and Future Work

This experiment reveals that broad affect dimensions are perceived in a singing voice independently of the singer's emotional expression. The analysis revealed 8 features that explained the variance with respect to affect and are: SPR, mean intensity, brightness, jitter, shimmer, mean pitch, mean HNR and mean autocorrelation. This could have implications on the use of synthesized voices in the research on vocal expression of affect. PCA revealed 2 components that accounted for variations in 11 acoustic cues including the aforementioned 8 features. Further investigation is needed to assess the strength of the relationship between the components and the affect dimensions. Finally, this study will be replicated using singing voices expressing the four affect dimensions and the results will be contrasted with the present findings. We expect this would lead to conclusions of interest to affective voice synthesis.

Fig. .

 . Fig. . Vocal files projected on PC1-PC2 plane and clustered by valence

Fig. 2 .

 2 Fig. 2. Vocal files projected on PC1-PC2 plane and clustered by arousal

Fig. 3 .

 3 Fig. 3. Glottal files projected on PC1-PC2 plane and clustered by valence

Fig. 4 .

 4 Fig. 4. Glottal files projected on PC1-PC2 plane and clustered by arousal

Table 1 .

 1 List of acoustic features and relevant literatures

	Features	Literature
	Singing Formants: F2 to F4	Sundberg et al. 1994, Ishi and Campbell 2012, Millhouse and Clermont, 2006
		Grichkovtsova et al. 2011, Laukkanen et al. 1997,
	Singing Power Ratio (SPR)	Sundberg et al. 1994, Omori et al., 1996, Watts et al.,
		2004, Lundy et al., 2000
	Mean Intensity, Mean Pitch	Jansens et al. 1997, Patel et al. 2011
	Jitter, Shimmer, Harmonicity: Mean HNR, Mean Autocorrelation	Lundy et al., 2000, Scherer K., 1995
	Brightness	Ishi and Campbell, 2012
	General voice acoustic attributes	http://www.speech-therapy-information-and-resources.com

Table 2 .

 2 p values, mean and standard deviation of vocal cues for pleasant-unpleasant

		Pleasant		Unpleasant
	Acoustic features	P	M	SD	M	SD
	SPR	0.002 28.580	7.47 5	15.900 5.998
	Mean intensity	0.001 53.940	5.02 6	62.670 1.834
	Jitter	0.023 0.653	0.33 4	1.166	0.471
	Shimmer	0.032 3.591	0.85 7	5.123	1.710
	Mean Autocorrelation 0.004 0.985	0.00 6	0.952	0.031
	Mean HNR	0.001 21.440	2.13 1	16.200 3.305

Table 3 .

 3 p values, mean and standard deviation of glottal cues for pleasant-unpleasant

		Pleasant		Unpleasant
	Acoustic features	P	M	SD	M	SD
	Brightness	0.032 * 0.003	0.163 0.105 0.069 0.018
	Mean intensity	0.027	59.420 7.172 65.890 2.601
	Shimmer	0.011	7.583	3.865 3.750	1.528
	Mean Autocorrelation 0.042	0.970	0.026 0.988	0.007

* pleasant-neutral

Table 4 .

 4 p values, mean and standard deviation of vocal cues for awake-tired

		Awake		Tired
	Acoustic features	P	M	SD	M	SD
	SPR	0.002	19.13 0	6.689	32.43 0	7.275
	Mean intensity	0.002	60.31 0	3.898	52.50 0	5.394

Table 5 .

 5 p values, mean and standard deviation of glottal cues for awake-tired

		Awake		Tired
	Acoustic features	P	M	SD	M	SD
	Mean intensity	0.020	68.840	2.33 5	63.510	3.911
	Jitter	0.007	0.560	0.13 6	1.285	0.423
	Shimmer	0.023	2.314	0.70 4	5.257	2.263
	Mean HNR	0.006 0.031 *	29.320	3.01 9	23.570	3.328
	Mean Pitch	0.014	218.700	3.93 7	138.100 51.543

* awake-neutral

Pauline Mouawad et al.