Viviane Kostrubiec

Jeanne Kruck

Kruck Kostrubiec

Collaborative Research Project: Developing and Testing a Robot-Assisted Intervention for Children With Autism

Keywords: social robotics, social skills, evidence-based practices, robot acceptance, applied analysis of behavior

The present work is a collaborative research aimed at testing the effectiveness of the robot-assisted intervention administered in real clinical settings by real educators. Social robots dedicated to assisting persons with autism spectrum disorder (ASD) are rarely used in clinics. In a collaborative effort to bridge the gap between innovation in research and clinical practice, a team of engineers, clinicians and researchers working in the field of psychology developed and tested a robot-assisted educational intervention for children with low-functioning ASD (N = 20) A total of 14 lessons targeting requesting and turn-taking were elaborated, based on the Pivotal Training Method and principles of Applied Analysis of Behavior. Results showed that sensory rewards provided by the robot elicited more positive reactions than verbal praises from humans. The robot was of greatest benefit to children with a low level of disability. The educators were quite enthusiastic about children's progress in learning basic psychosocial skills from interactions with the robot. The robot nonetheless failed to act as a social mediator, as more prosocial behaviors were observed in the control condition, where instead of interacting with the robot children played with a ball. We discuss how to program robots to the distinct needs of individuals with ASD, how to harness robots' likability in order to enhance social skill learning, and how to arrive at a consensus about the standards of excellence that need to be met in interdisciplinary co-creation research. Our intuition is that robotic assistance, obviously judged as to be positive by educators, may contribute to the dissemination of innovative evidence-based practice for individuals with ASD.

INTRODUCTION

There is a growing recognition of the innovation-to-practice gap arisen in social robotics [START_REF] Fernaeus | How do you play with a robotic toy animal?: a long-term study of Pleo[END_REF][START_REF] Pennisi | Autism and social robotics: a systematic review: autism and social robotics[END_REF][START_REF] Walters | Dead robots raise questions on how far home technology has come Rogers[END_REF][START_REF] Ismail | Leveraging robotics research for children with autism: a review[END_REF], a field dedicated to developing robots to assist persons with special needs. To date, few social robots have gone beyond the prototype stage, or else are only deployed for research purposes [START_REF] Wagenmakers | Social Robots[END_REF]. Their sale volume is still low (6,423 units in 2017), compared with that of domestic help robots (6.1 million units in 2017) [START_REF] Ifr | IFR Executive Summary World Robotics 2018 Service Robots. International Federation for Robotics (IFR)[END_REF]. [START_REF] Kim | Bridging the research gap: making HRI useful to individuals with autism[END_REF] (see also [START_REF] Cabibihan | Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism[END_REF][START_REF] Pennisi | Autism and social robotics: a systematic review: autism and social robotics[END_REF] ascribed these difficulties to the lack of collaboration between researchers and end-users. Too long, research effort focused on the technological features of newly engineered robots (e.g., [START_REF] Kozima | Children-robot interaction: a pilot study in autism therapy[END_REF][START_REF] Robins | From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot[END_REF], not taking into account the specific needs of end-users. End-users do not evaluate a technical innovation, however outstanding it may be [START_REF] Payne | How to Kill a Unicorn and Build the Bold Ideas That Make It to Market, Drive Growth and Transform Industries[END_REF]. Rather, they evaluate its added value relative to existing alternatives and its accordance to work routines [START_REF] Joachim | Active innovation resistance: an empirical study on functional and psychological barriers to innovation adoption in different contexts[END_REF].

The hard earned lesson now is that to overcome the innovation-to-practice gap, close collaboration between engineers, researchers, caregivers and management team is needed. The collaboration may take the form of a participatory, pragmatic, or collaborative approach, where all the stakeholders work hand in hand to co-create tools best fitting the needs of end-users [START_REF] Schwartz | Explanatory and pragmatic attitudes in therapeutical trials[END_REF][START_REF] March | The case for practical clinical trials in psychiatry[END_REF][START_REF] Zwarenstein | Improving the reporting of pragmatic trials: an extension of the CONSORT statement[END_REF][START_REF] Marchand | Moving from efficacy to effectiveness trials in prevention research[END_REF][START_REF] Forman | Implementation science and school psychology[END_REF][START_REF] Bauer | An introduction to implementation science for the non-specialist[END_REF]. In this emerging framework, having recently gained impetus from the paper by [START_REF] Balas | Managing clinical knowledge for health care improvement[END_REF], researcher does not solely ask whether a new tool works when used in optimal laboratory conditions. Rather, he evaluates whether the tool works when used in real-life clinical settings, without highly-qualified staff, a homogenous group of patients, or tight experimental control [START_REF] Cargo | The value and challenges of participatory research: strengthening its practice[END_REF][START_REF] Zwarenstein | Improving the reporting of pragmatic trials: an extension of the CONSORT statement[END_REF][START_REF] Brownson | Dissemination and Implementation Research in Health Translating Science to Practice[END_REF]. The tool's acceptance is assessed by a questionnaire and implementation failures and context reported as a result on its own [START_REF] Stahmer | Training teachers to use evidence-based practices for autism: examining procedural implementation fidelity: training teachers in autism practices[END_REF]. We exploit here the collaborative approach to co-create and test socially assistive robot during an educational intervention dedicated to children with autism spectrum disorder (ASD).

Robots and ASD

ASD is an early-onset, pervasive developmental disorder that manifests itself in anomalies in social communication and interaction, together with abnormal restricted and/or repetitive patterns of behavior and interests [START_REF] Lord | Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders[END_REF]DSM 5, 2013). For instance, children with ASD avoid physical contact, do not orient toward humans, do not point to communicate, do not express enjoyment or interest, and may spend hours at lining up toys or flipping objects [START_REF] Rutter | The Social Communication Questionnaire Manual[END_REF]. As ASD is incurable, some persons with this disorder require costly and intensive lifetime care, support and treatment, motivating the development of social robots to assist them and their caregivers.

The arising of social robots dedicated to ASD can be traced back to the seminal study by [START_REF] Emanuel | Using LOGO to catalyse communication in an autistic child[END_REF] (see also [START_REF] Howe | Autism-Using a 'turtle' to establish communication[END_REF], where a computer-controlled electrotechnical device, a turtle-like robot (LOGO) moving on wheels around the floor, was used as a remedial tool for an ASD boy. It was not until the late 1990s that multiple laboratories adopted this topic for research (see [START_REF] Werry | Applying mobile robot technology to the rehabilitation of autistic children[END_REF][START_REF] Diehl | The clinical use of robots for individuals with Autism Spectrum Disorders: a critical review[END_REF][START_REF] Begum | Are robots ready to deliver autism interventions? A comprehensive review[END_REF][START_REF] Ismail | Leveraging robotics research for children with autism: a review[END_REF] for reviews).

To date, nearly 30 robots were tested as remedial tools for ASD [e.g., : Labo-1 [START_REF] Werry | Can social interaction skills be taught by a social agent? The role of a robotic mediator in autism therapy[END_REF]; Muu [START_REF] Miyamoto | How can robots facilitate social interaction of children with autism? Possible implications for educational environments[END_REF], Robota [START_REF] Billard | Building robota, a mini-humanoid robot for the rehabilitation of children with autism[END_REF], FACE [START_REF] Pioggia | Human-robot interaction in autism: FACE, an android-based social therapy[END_REF], Keepon [START_REF] Kozima | Children-robot interaction: a pilot study in autism therapy[END_REF], Aibo [START_REF] Francois | A long-term study of children with autism playing with a robotic pet: taking inspirations from non-directive play therapy to encourage children's proactivity and initiative-taking[END_REF], IROMEC [START_REF] Iacono | Robots as social mediators for children with Autism -A preliminary analysis comparing two different robotic platforms[END_REF], Charlie [START_REF] Boccanfuso | Charlie: an adaptive robot design with hand and face tracking for use in autism therapy[END_REF], NAO [START_REF] Shamsuddin | Initial response in HRI-a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot NAO[END_REF], Flobi [START_REF] Damm | Different gaze behavior in human-robot interaction in Asperger's syndrome: an eye-tracking study[END_REF]; GIPY-1 [START_REF] Giannopulu | Multimodal cognitive nonverbal and verbal interactions: the neurorehabilitation of autistic children via mobile toy robots[END_REF], Pleo [START_REF] Kim | Social robots as embedded reinforcers of social behavior in children with autism[END_REF], KASPAR [START_REF] Wainer | A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism[END_REF], Darwin-OP [START_REF] Peng | Using a humanoid robot for music therapy with autistic children[END_REF], Pabi [START_REF] Dickstein-Fischer | Combining psychological and engineering approaches to utilizing social robots with children with Autism[END_REF], Zeno [START_REF] Salvador | An emotion recognition comparative study of autistic and typically-developing children using the zeno robot[END_REF], Jibo [START_REF] Guizzo | Jibo is as good as social robots get. but is that good enough?[END_REF], Probo [START_REF] Simut | Children with autism spectrum disorders make a fruit salad with probo, the social robot: an interaction study[END_REF], Maria [START_REF] Valadao | Analysis of the use of a robot to improve social skills in children with autism spectrum disorder[END_REF], Sphero [START_REF] Golestan | Feasibility of using sphero in rehabilitation of children with autism in social and communication skills[END_REF], CARO [START_REF] Yun | Social skills training for children with autism spectrum disorder using a robotic behavioral intervention system: social skills training for children with ASD[END_REF], KiliRo [START_REF] Bharatharaj | Social engagement of children with autism spectrum disorder in interaction with a parrot-inspired therapeutic robot[END_REF], MINA (Ghorbandaei Pour et al., 2018), QTrobot [START_REF] Costa | More attention and less repetitive and stereotyped behaviors using a robot with children with autism[END_REF], Milo [START_REF] Chalmers | Robotics and computational thinking in primary school[END_REF], Leo [START_REF] She | Improving LEO robot conversational ability via deep learning algorithms for children with autism[END_REF], Daisy [START_REF] Pliasa | Can a robot be an efficient mediator in promoting dyadic activities among children with Autism Spectrum Disorders and children of Typical Development?[END_REF], SAM [START_REF] Lebersfeld | Characteristics associated with improvement following the SAM robot intervention for children with autism spectrum disorder[END_REF], SPRITE [START_REF] Clabaugh | Long-term personalization of an in-home socially assistive robot for children with autism spectrum disorders[END_REF], Actroid-F (Yoshikawa et al., 2019) etc.].

The key hypothesis behind this endeavor states that social robots can maybe overcome some of the motivational and sensory barriers encountered by individuals with ASD when they interact with humans partners [START_REF] Dautenhahn | Robots as social actors: AURORA and the case of autism[END_REF]. In contrast to their typically developing peers, for whom social interactions are inherently rewarding, children with ASD exhibit only weak activation of the brain's reward system in response to social reinforcement [START_REF] Chevallier | The social motivation theory of autism[END_REF][START_REF] Delmonte | Social and monetary reward processing in autism spectrum disorders[END_REF][START_REF] Watson | Increased reward value of non-social stimuli in children and adolescents with autism[END_REF]. Social Motivation Theory of ASD, [START_REF] Chevallier | The social motivation theory of autism[END_REF] argued that ASD children neither seek out nor seek to maintain relations with human partners, showing instead a preference for nonhuman and often mechanic stimuli [START_REF] Watson | Increased reward value of non-social stimuli in children and adolescents with autism[END_REF].

In addition to these motivational issues, sensory processing of persons with ASD is abnormal: they are often intolerant of complex multimodal stimuli [START_REF] Bogdashina | Autism and the Edges of the Known World: Sensitivities, Language, and Constructed Reality[END_REF][START_REF] Bogdashina | Questions Sensorielles et Perceptives Dans L'autisme et le Syndrome d'Asperger: Des Expériences Sensorielles Diffférentes, des Mondes Perceptifs Différents[END_REF], display detail-focused perception [START_REF] Happé | The weak coherence account: detail-focused cognitive style in autism spectrum disorders[END_REF], and sensory sensitivities or aversions [START_REF] Bogdashina | Autism and the Edges of the Known World: Sensitivities, Language, and Constructed Reality[END_REF], with intense social anxiety [START_REF] Spain | Social anxiety in autism spectrum disorder: a systematic review[END_REF]. According to the Weak Central Coherence theory [START_REF] Happé | Exploring the cognitive phenotype of autism: weak "central coherence" in parents and siblings of children with autism: I. Experimental tests[END_REF] and Enhanced Perceptual Functioning model [START_REF] Mottron | Enhanced perceptual functioning in autism: an update, and eight principles of autistic perception[END_REF], the perceptual processing of ASD persons is biased toward local features: these children are incapable of integrating the variety of individual pieces of information into global patterns. Intense World Theory of Autism [START_REF] Markram | The intense world syndrome-an alternative hypothesis for autism[END_REF] sugested that these persons suffer from excessive neuronal information processing causing informational overload and abnormal levels of anxiety, which they seek to reduce with stereotypical and repetitive behaviors [START_REF] Rodgers | The relationship between anxiety and repetitive behaviours in autism spectrum disorder[END_REF].

Given these characteristics of ASD, it seems useful to examine whether a social robot, with its motivational appeal, behavioral repetitiveness, simplified appearance and lack of social judgment, may be more appealing to individuals with ASD than real humans. Therefore, in line with Social Motivation Theory of ASD [START_REF] Chevallier | The social motivation theory of autism[END_REF] our first working hypothesis (Hypothesis 1) is that children with ASD should positively react to sensory rewards delivered by a robot, by manifesting their interest and satisfaction when these stimuli are provided. In line with Intense World Theory of Autism [START_REF] Markram | The intense world syndrome-an alternative hypothesis for autism[END_REF], we also expect a reduction of anxiety-related undesirable behaviors (e.g., stereotypes, screams, auto-aggressions, etc.) in the presence of the robot (Hypothesis 2).

Yet, the key hope behind social robotics for ASD is that robots act as social mediators: they mediate, that is, promote or "catalyze" a cascade of so-called prosocial behaviors directed toward humans: eye or head orienting, physical contact, pointing to shared interest etc. [START_REF] Dautenhahn | Roles and functions of robots in human society: implications from research in autism therapy[END_REF][START_REF] Feil Seifer | Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders[END_REF][START_REF] Diehl | The clinical use of robots for individuals with Autism Spectrum Disorders: a critical review[END_REF]. Our third working hypothesis (Hypothesis 3) is that in robot-assisted experimental conditions the child produces prosocial behaviors not only toward the robot but also toward humans. For the sake of clarity, a behavior is coined below as "prosocial" only in case it is dedicated to human, not to robot.

Building Up Robot Acceptance

In order to fulfill acceptance criteria of end-users, robot-assisted interventions should meet the efficiency standards of health services, tasked with assessing the level of experimental evidence supporting the added value of newly created tools [START_REF] Burns | The levels of evidence and their role in evidence-based medicine: plastic and reconstructive surgery[END_REF], and providing recommendations to practitioners (GRADE Working Group, 2004). To accumulate such supportive evidence, multiple experiences should show that interventions for ASD work better when assisted by robots than in control condition, without the help of electromechanical devices.

To date, such evidence is scarce [START_REF] Cruz | What does the literature say about using robots on children with disabilities?[END_REF]. Of the 758 studies on robot-assisted interventions for ASD listed by [START_REF] Pennisi | Autism and social robotics: a systematic review: autism and social robotics[END_REF], only 29 (0.04%!) were selected as meeting clinical concerns. Publications still too often take the form of pilot studies (e.g., [START_REF] Werry | Can social interaction skills be taught by a social agent? The role of a robotic mediator in autism therapy[END_REF][START_REF] Miyamoto | How can robots facilitate social interaction of children with autism? Possible implications for educational environments[END_REF][START_REF] Duquette | Exploring the use of a mobile robot as an imitation agent with children with low-functioning autism[END_REF][START_REF] Robins | From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot[END_REF][START_REF] Costa | An approach to promote social and communication behaviors in children with autism spectrum disorders: robot based intervention[END_REF][START_REF] Dickstein-Fischer | Combining psychological and engineering approaches to utilizing social robots with children with Autism[END_REF] without control conditions, inferential statistics, diagnosis methods and inclusion/exclusion criteria (see [START_REF] Pennisi | Autism and social robotics: a systematic review: autism and social robotics[END_REF][START_REF] Ismail | Leveraging robotics research for children with autism: a review[END_REF] for critical reviews). Although necessary as a starting point, these preliminary studies are unable to establish the effectiveness of robotic tools in clinical samples, according to the rules of clinical methodology [START_REF] Kazdin | Research Design in Clinical Psychology[END_REF]. The best-established effect is the "likability" of robots [START_REF] Begum | Are robots ready to deliver autism interventions? A comprehensive review[END_REF]: children with ASD show enthusiasm for robotic devices and willingly participate in games assisted by these devices [START_REF] Pliasa | Can a robot be an efficient mediator in promoting dyadic activities among children with Autism Spectrum Disorders and children of Typical Development?[END_REF] To fit the needs of special needs educators, a collaborative approach was adopted. The idea of the robot in this project was born in 2011 in France when a father asked a team of young engineers from School of Industrial Biology at Cergy Pontoise to create games for his child with ASD. In 2014, a newly created French start-up created a low-cost, remotely controlled robot ball, that moves by rolling, vibrates and illuminates its transparent cover with different colors. Similar to spherical GIPY-1 [START_REF] Giannopulu | Multimodal cognitive nonverbal and verbal interactions: the neurorehabilitation of autistic children via mobile toy robots[END_REF], Roball [START_REF] Michaud | Autonomous spherical mobile robot for child-development studies[END_REF], or SPRK+ Sphero [START_REF] Golestan | Feasibility of using sphero in rehabilitation of children with autism in social and communication skills[END_REF] the robot belongs thus to nonhumanoid devices.

The management team controlling the workflow enrolled the special educators and the children with ASD, and only then tasked researchers who could identify the educational goals and develop the procedure for the robot-assisted psychosocial skills training intervention. Children enrolled displayed lowfunctioning ASD, that is, intellectual quotient lower than 70 (i.e., intellectual dysfunction). Note however that the focus lies here on the effectiveness of the robot-assisted intervention, not on the specific functioning of these low-functioning children. At the end of our mission, we administered an acceptance questionnaire to analyze whether and how special educators accepted the robotassisted intervention. We hoped that the intervention is judged as useful and fitting work routines (Hypothesis 4).

Intervention

We proposed an educational intervention targeting social skills and evaluated how efficient the robot is, as compared to the intervention without robotic help. In order to teach the social skills, we designed two sets of lessons to be taught using the Applied Analysis of Behavior (ABA) [START_REF] Cooper | Applied Behavior Analysis. 3rd Edn[END_REF] educational method recommended by health services. The key idea of ABA is to increase the probability of desirable behaviors by providing reinforcers in the form of rewards [START_REF] Skinner | Selection by consequences[END_REF]. For the purpose of the present study, we chose the two general social skills that are most often targeted by educational interventions in ASD: requesting and turn-taking [START_REF] Still | Facilitating requesting skills using high-tech augmentative and alternative communication devices with individuals with autism spectrum disorders: a systematic review[END_REF][START_REF] Huijnen | Robots as new tools in therapy and education for children with autism[END_REF]. Requesting allows children to initiate a social interaction, express their needs and seek help, and leads to greater independence. Turn-taking is involved in the regulation of any social interaction. In order to exploit the added value of robots, compared with computer-mediated therapy, we administered tasks requiring body displacement in space, in particular during turn-taking lessons.

In line with ABA, the principles of the Pivotal Training Method (PTM) [START_REF] Koegel | Pivotal response intervention II: preliminary long-term outcome data[END_REF][START_REF] Koegel | Pivotal areas in intervention for autism[END_REF] proposes that the learning of general skills (here: turn-taking and requesting) should bring about collateral improvements in a variety of nontrained prosocial behaviors in interpersonal interaction. In the present study, we thus focused on these expected collateral improvements, hoping that nontrained prosocial behaviors (here: orienting toward human, physical contact with human, pointing to communicate enjoyment and interest etc.) are more frequent in the robot-assisted than in control condition (viz. Hypothesis 3).

To sum up, the goal of these analyses was twofold. ( 1) First, we assessed the efficiency of the robot as a reward deliverer (viz. Hypothesis. 1), as an undesirable behavior reducer (viz. Hypothesis 2) and as social mediator (viz. Hypothesis 3). We expected that positive reactions to reward and nontrained prosocial behaviors are more frequent and that undesirable behaviors are less frequent in the robot, as compared to the control condition. (2) Second, we evaluated the acceptance of robot-assisted intervention by special educators (viz. Hypothesis 4). As in collaborative research interventions are administered by real caregivers, we anticipated that they could derail from the experimental procedure dictated by experimenters (viz. Hypothesis 5).

According to the suggestions of collaborative approach [START_REF] Dingfelder | Bridging the research-to-practice gap in autism intervention: an application of diffusion of innovation theory[END_REF][START_REF] Marchand | Moving from efficacy to effectiveness trials in prevention research[END_REF], we conducted our study in two steps. After designing the first set of lessons devoted to requesting, we made successive modifications to the experimental protocol as problems emerged. Only then was the second turn-taking set of lessons administered and used for further analyses.

METHODS

Participants

The teamwork coordinator enrolled 20 children with ASD and 15 special educators in the study. They came from five specialneeds schools and centers in France (APEAI Ouest Herault in Béziers, ADAPEI Papillons Blancs in Dunkirk, ADAPEI Papillons Blancs d'Alsace in Mulhouse, Ar'Roch in Rennes, DASCA Adéle de Glaubitz in Strasbourg, ADAPEI 44 in Nantes, APPARTE) where children receive care for their behavioral disorders.

As these centers correspond to small structures taking care of children with various mental disorders, only 1-2 individuals in each center fitted our inclusion/exclusion criteria: (1) 60-122 months of age at enrollment; (2) developmental age of 18-30 months assessed by verbal and preverbal cognition subtest from Psychoeducational Profile (PEP-3) [START_REF] Schopler | Psychoeducational Profile Third Edition (PEP-3)[END_REF]) (see below); (2) a diagnostic of ASD made by expert psychologists from Regional Autism Resources Center, and reconfirmed here by Social communication Questionnaire (SCQ, [START_REF] Rutter | The Social Communication Questionnaire Manual[END_REF] see below); (3) no identifiable neurological disease or major neurological treatment. The ratio between developmental and maturational age was 0.28 (SD = 0.09), qualifying the children as low-functioning (i.e., severe intellectual deficit). Further psychological characteristics of our sample are provided in Table 1. The female-male ratio was 3/17.

As the robot had a low level of autonomy (Level 2; see [START_REF] Parasuraman | A model for types and levels of human interaction with automation[END_REF], in each experimental session, in addition to the special educator interacting with the child, another person controlled the robot. Fifteen educators who cared for the children applied the experimental protocol: 56% were special needs monitors and 31% were special needs professionals, 67% had more than 10 years of experience, and 93% were women. At least one special educator in each center reported having already undergone a short ABA familiarization course. Just under half (47%) stated that they had never used new technologies, and just over half (53%) that they used them occasionally. The interventionist and the families of all the children received a letter explaining the goals, experimental procedure and rights of parents and children, and provided their written informed consent, in accordance with the Declaration of Helsinki. Each parent completed a form provided by the University of Toulouse informing them about their rights and predictable risks in comparison with foreseeable benefits. An ethics and scientific committee of the consulting company in the role of intermediary between the start-up, researchers and investors approved the experimental protocol; the committee members were also present during the first meeting. A declaration of ethical collection and storage of data was also made to the French Data Protection Authority (CNIL; ref.: 7e42415863j).

Material

Robot

We used a white, spherical prototype, measuring 18 cm in diameter and weighing 900 grams that was enclosed in a transparent plexiglass sphere resistant to shocks and pressure. Designed with a smiling face, equipped with actuators (LEDs, motors) and sensors (IMU 6-Axis, RFID), the prototype could light up or blink in different colors, and moved on two wheels in contact with the sphere. The robot was powered by AAA batteries and had autonomy of 3 to 4 h. Its behavior was remotely controlled by a touch pad (iPad iOS 10 or 11) with which it communicated through Bluetooth Low Energy over a distance of about 20 m.

In view of the intervention, three key functions were programmed in the robot. It acted as reward deliver, displaying colored lights and spinning movements, and also as cue provider: it offered specific lights and displacements prescribing required behavior of the child (e.g., "Touch the robot if it is your turn and if the robot is lit up in blue, " see Table 5). Finally, it acted as lessons organizer, as explained below.

Two sets of seven lessons were developed. The application on the graphic tablet allowed the interventionist to consult the child's profile, which contained his/her experimental history and preferred sensory rewards, select a lesson, and display the lesson description and lesson control panel. The control panel featured various icons to launch the robot's cue, record the child's response, and provide rewards. Four types of responses from the child could be recorded: failure, success with total prompt, success with partial prompt, and success without prompt.

The control programs were developed on C++ for the robot and on Swift for the tablet. We were not allowed by investors to provide more technological details or the name of the device, never described in the literature and not commercialized to date.

In addition to the robot, a shoulder strap was provided to hold the graphic tablet. For the purpose of the experiment, a GoPro camera (Hero), a tripod (Fotopro), and a memory card (microSDHC SanDisk Extreme 32) were given to each center. A child's chair, and hoops were also required for the intervention. Because of the spherical design of the robot, balls were used in control condition.

Tutorials

Three tutorials were offered to the educators: (1) a brief introduction to ABA; (2) a technical description of the robot (see section 2.2.1), together with a detailed presentation of each set of lessons (see section 2.2.3); and (3) a description of the experimental design underlying the intervention (see section 2.3.2).

In the description of ABA, we recalled that in line with the principle of selection by consequences [START_REF] Skinner | Selection by consequences[END_REF], the educators would have to manage the sequence of events controlling each child's behavior (antecedent, behavior, consequence). According to the Discrete Trial Training method [START_REF] Smith | Discrete trial training in the treatment of autism[END_REF] learning should take the form of trials, each sequence involving an antecedent cue anticipating the appropriate behavior (e.g., "Touch the robot in turn"), a prompt wherein the educator assists the child (e.g., demonstration of required gesture, hand-over-hand assistance, pointing, nodding etc.), the child behavior (e.g., touching the robot in turn), the environmental consequence (e.g., verbal praise), and the intertrial interval (see Figure 1). We explained that providing a reward immediately after the to-be-learned target response reinforces the latter, increasing the probability of the target response being produced in the future.

Before each session, given their knowledge of the child's abilities and needs, the educators were asked to anticipate the required level of prompting, to avoid delays between the instruction and the prompt. They were told they should not hesitate to start with all prompts to facilitate learning. Prompts should be gradually faded out as learning proceeded, or increased in the case of a child failing [START_REF] Leaf | Comparison of most-to-least prompting to flexible prompt fading for children with autism spectrum disorder[END_REF]. We explained how instructions and rewards should be efficiently applied (e.g., brief, clear, short and consistent instructions, provided when the target response was not being produced; reward applied immediately after the target response). Undesirable behaviors had to be gently and briefly interrupted, and the child immediately prompted to provide the target response [START_REF] Cividini-Motta | The effect of response interruption and redirection with and without a differential reinforcement of alternative behavior component on stereotypy and appropriate responses[END_REF].

The descriptions of each lesson given to educators interacting with the child contained the learning goal (e.g., "Touch the robot in turn"), corresponding verbal instruction (e.g., "It's your turn"), required material (e.g., child's chair), preparation procedure (e.g., place the robot in the center of the room), a step-by-step procedure for learning, and a validation criterion (see below).

Sets of Lessons

Given that the volume of the tutorial depicting the lessons was 30 pages long, we provide below an abbreviate illustration of its content. Each set comprised a learning procedure that was ultimately aimed at enabling children to produce spontaneously and appropriately the general social skill targeted by the intervention: requesting (Set 1) and turn-taking (Set 2). Each set was composed of seven lessons, each with a learning goal, corresponding to a required response to be acquired by the child (e.g., "Look ate the robot, " see If it is your turn and if the robot is lit up in blue, imitate the adult who followed the robot along a short distance R6.

Wait until the robot has reached the end of a short pathway and, if it is your turn and if the robot is lit up in blue, follow the path and touch the robot R7.

Touch the robot to select the color controlling the turn-taking; wait until the robot has reached the end of a short pathway and, if the robot is lit up in blue, follow the path and touch the robot simple to complex, from prompted by the educator to initiated spontaneously by the child, from centered on the toy (robot or ball) to centered on the interaction with the educator (see Tables 2,3 for the sequence of lessons in each set).

In each lesson, a step-by-step procedure described the elementary actions required from the robot (e.g., light up in blue), the interventionist (e.g., say "It's my turn"), and the child (e.g., "Touch the robot in turn"). Each lesson entailed five discrete learning trials (e.g., five turn-takings) where the interventionist Required response Touch the robot in turn Antecedent 1. Sit facing the child, and place the robot between you.

The robot is inactive.

2. Touch the robot on the top: it will light up in blue for a moment.

3. Then encourage the child to do the same. Each time, say "It's my turn / It's your turn."

Behavior 4. If the child respects his/her turn, the robot will light up in blue.

5. If not, the interventionist will blocks him/her, saying "No, it's my turn".

6. If the child does not attempt to touch the robot, the educator selects a guidance specific to the child.

Consequence 7. After an errorless sequence of six turn-takings, the robot provides a sensory reward (specific to each child) and the interventionist gives verbal praise.

Validation Criterion 8. Repeat the sequence of turn-takings 5 times in a row (30 trials in all).

9. Go to the next lesson if the child has produced a correct turn-taking sequence four times out of five.

attempted to elicit the required response. In accordance with ABA criteria, a required response was deemed to be acquired if it was produced in 80% of these trials, without or with partial prompting (see Figure 1). If, after the five repetitions of the same trial, the child failed to meet this criterion, the educator stopped the whole experimental protocol. The step-by-step procedure for the first lesson in the turn-taking set appears in Table 4, for the second lesson in Table 5.

Workbooks

Information about the children and their caregivers was collected in two workbooks. The first workbook collected general information about the child (i.e., age, diagnostic tools used, developmental age) and provided five psychological tests for psychometric assessment: Social Communication Questionnaire (SCQ) [START_REF] Rutter | The Social Communication Questionnaire Manual[END_REF], Vineland II [START_REF] Sparrow | Vineland Adaptive Behavior Scales[END_REF], Psychoeducational Profile (PEP-3) [START_REF] Schopler | Psychoeducational Profile Third Edition (PEP-3)[END_REF], Sensory Profile Checklist Revised (SPCR) [START_REF] Bogdashina | Questions Sensorielles et Perceptives Dans L'autisme et le Syndrome d'Asperger: Des Expériences Sensorielles Diffférentes, des Mondes Perceptifs Différents[END_REF], and Educators' Sense of Efficacity Scale (ESES), adapted from Teachers' Sense of Efficacity Scale (Tschannen-Moran and Hoy, 2001). These tools are described in Appendix 1;

their key features and interpretation in Table 1. The second workbook included Educators' Sense of Efficacity Scale and the acceptance questionnaire.

Post-intervention Acceptance Questionnaire

To assess acceptance of the intervention, we developed a questionnaire for the educators targeting several issues: [START_REF] Kim | Social robots as embedded reinforcers of social behavior in children with autism[END_REF] for what kind of children is a robot-assisted intervention best suited?

(2) what is its added value, advantages and disadvantages? ( 3) what is its effect on workload, educational intervention, and children's learning? and ( 4) what training is required to use the robot in educative intervention? Go to the next lesson if the child has produced a correct turn-taking sequence four times out of five.

Procedure

Collaboration Procedure

In the present work, the stakeholders first met in order to discuss ethical issues, methodological requirements, and acceptance of the intervention by the children and educators. Two training meetings were organized for them. In the first training meeting, held before the start of experimentation, researchers described the experimental goals and procedure, simulated learning sessions, and described how to manage challenging behaviors. The second training meeting took place during the administration of the first set of lessons: the experimenters provided feedback to the educators, using videos of previous learning sessions. Half a day each week, a hotline was manned by JK to answer the educators' questions. The final meeting took place after the experimentation, in order to present the results and discuss the strengths and weaknesses of the robotassisted intervention. Each family received a brief summary of their child's progress.

Intervention Procedure

After the educators had taken notice of ABA principles, of lessons content, and of the experimental design, described in the tutorials (see section 2.2.2), they completed the psychological tests from the first workbook (see Table 1). Then, the children underwent a familiarization session, where they were merely put in the presence of an inactive robot. The following week, the lessons started: requesting (see Table 2) followed by turn-taking (see Table 3), according to the step-by-step procedure as described in the tutorials (see Tables 4,5). Each child was administered each lesson in two conditions, in random order: with the robot and with the ball (see Figure 2). At least one session with the robot and one with the ball was administered for each lesson. Each set of lessons was taught over 12 weeks. The entire intervention took place over 24 weeks. After the intervention, a second workbook was provided, including the ESES and acceptance questionnaire.

Data Reduction and Analysis

Observation Grid

After the end of interventions, the method of direct observation from videos was used [START_REF] Hops | Methodological issues in direct observation: illustrations with the living in familial environments (LIFE) coding system[END_REF]. Video recordings of all the experimental sessions were analyzed by two trained coders (psychology undergraduates), who were familiar with ABA and blind to the purpose of the experiment. They used an observation grid listing 16 categories of responses (e.g., proximal pointing, head/gaze oriented toward human, stereotypies, see Table 6, right column), organized in four global classes: positive reactions to reward, prosocial behaviors, undesirable behaviors, and orientations (see Table 6, left column). To assess child autonomy, coders were required to record the prompts initiated by educators. To assess implementation quality, they were also asked to record the educators' implementation errors. Cohen's kappa was calculated to measure interrater agreement (k = 0.92).

Dependent Variables

All dependent variables were measured after the end of interventions. For each child and each experimental condition (robot, ball), we recorded the number of times each response category (e.g., proximal pointing) occurred, resulting in 16 summed scores (see Table 6, right column). These scores were then combined to four dependent variables corresponding to above-mentioned global classes (i.e., positive reactions to reward, prosocial behaviors, undesirable behaviors, and orientations, see Table 6, left column).

To take a deeper look into the effect of robot-assisted intervention, we computed the proportion of prosocial and undesirable behaviors produced in robot condition. The proportion was then normalized (from 1 to -1): The normalized proportion takes a positive value when most of these behaviors were produced in robot condition, and inversely:

Normalized.Proportion = 2 × ( x robot x robot + x ball ) -1 (1)
   1 if x robot > x ball 0 if x robot = x ball -1 if x robot < x ball (2)
In the formula, x robot and x ball refer to the number of behaviors produced in robot and ball condition, respectively.

Statistical Analyses

To capture the characteristics of the children for whom the intervention was stopped and those who passed from lesson to lesson, one-tailed t-tests were carried out on all psychological test scores. Three groups were compared: the group who stopped the first set of lessons (i.e., Requesting), the group who started the second set (i.e., Turn-taking), and the group who completed the second lesson of the second set.

For further analysis, four experimental factors were envisioned: Condition (robot, ball), Reaction target (human, toy), Orientation Target (human, toy), and Prompt (with, without). Note, for Reaction target and Orientation target, the toy refers to robot in robot condition and to ball in ball condition.

To assess the efficacy of the robot-assisted intervention, we ran three statistical analyses. A 2 (Reaction Target = human in robot condition, human in ball condition, robot in robot condition) ANOVA was performed on positive reaction to reward and a 2 (Orientation Target = human, toy) × 2 (Condition = robot, ball) ANOVA was on orientations. A 2 (Condition = robot, ball) × 2 (Prompt = with, without) ANOVA was also run on prosocial behaviors and on undesirable behaviors to check whether the robot improved the children's social skills.

In all the ANOVAs, repeated measures were used on all dependent variables. Because each experimental factor (Condition, Reaction Target, Orientation Target and Prompt) had two levels, the assumptions of sphericity and of homogeneity of variances were always met. The distributions of dependent variables did not diverge from normal, as indicated by Lilliefors test for normality (D = 0.1052, p = 0.5939; D = 0.0636, p = 0.99; D = 0.1145, p = 0.2722; D = 0.0443, p = 0.9901, for reactions to reward, prosocial behaviors, orientations and undesirable behaviors, respectively).

If required, the ANOVAs were followed by appropriate twotailed t-tests. The sign of normalized proportion was tested using one-sample t-test with 0 as comparison value. Finally, a matrix of correlation indices (r) was computed using all scores from the psychological tests and categories of responses. For all the abovementioned analyses, the significance level was set at p <0.05, with the corresponding estimates of the effect size (η 2 ).

Statistical Analyses for Single Participant

Single-participant analyses were then performed on one of the children with ASD who successfully completed the whole intervention protocol. For this dataset, Bayesian statistics for single cases [START_REF] De Vries | Bayesian hypothesis testing for singlesubject designs[END_REF][START_REF] De Vries | A tutorial on computing bayes factors for single-subject designs[END_REF] were used. The posterior distribution for the standardized mean differences and Bayes factors were computed using the JZS+AR model with 10,000 Gibbs sampler iterations [START_REF] De Vries | A tutorial on computing bayes factors for single-subject designs[END_REF]. The Bayes factor quantifies evidence in the data for the null hypothesis against the alternative one: an inverse Bayes factor (1/BF) greater than 1 supports the alternative hypothesis. All 16 categories of responses, together with prosocial behaviors and undesirable behaviors, were submitted to this analysis.

Descriptive Statistics

To provide a glimpse into implementation fidelity, that is, the degree to which the educators strayed from the procedure specified by the experimenters, the coders were required to record any implementation error. The frequency of the failures was computed as a ratio of the number of failures to the number of videos. Finally, responses to the acceptance questionnaire were scored as percentages.

RESULTS

Child Sample Results

Children's Vineland-II and PEP-3 scores in our sample were low (see Table 1), indicating severe delays in social adaptive behavior, as well as in AE and SR skills. On average, sensory abnormalities were moderate. Of the 20 children with ASD who were initially enrolled, 15 reached the second set of lessons. The five participants who had to stop the first set had lower Vineland scores on listening, speaking and autonomy than the remaining participants, t (18) = 3.20, p <0.007; t (18) = 3.04, p <0.007; and t (18) = 2.29, p <0.032. Of the 15 children who started the second set of lessons, only eight completed it. These eight children had higher Vineland listening scores than those who failed to complete the first and second sets of lessons, t (13) = 2.23, p <0.044.

Robot-Assisted Intervention Results

Reward Deliver

A 2 (Reaction Target = human in robot condition, human in ball condition, robot in robot condition) ANOVA on positive reactions showed a main effect of Reaction Target, F (2,14) = 4.06, p = 0.04, η 2 = 0.546. Corrected pairwise comparisons (see Figure 3A) showed that there was more positive reactions to the reward when it was delivered by the robot rather than by the human in robot and in ball conditions [t (7) = 2.37, p = 0.049; t (7) = 2.50 p = 0.04].

Undesirable Behavior Reducer

A 2 (Condition) ×2 (Prompt) ANOVA on undesirable behaviors revealed no statistically reliable effects.

Social Mediator

A 2 (Orientation Target) × 2 (Condition) ANOVA on orientation indicated an important main effect of Orientation Target, F (1, 7) = 23.538, p <0.002, η 2 = 0.771. Children oriented more frequently toward the toy (i.e., ball or robot) than toward the educator. As illustrated in Figure 3B, there was also an Target Orientation × Condition interaction, F (1, 7) = 12.850, p <0.009, η 2 = 0.647. When the children played with the robot, they oriented more often toward the robot than toward the educator, t (7) = 7.78 p <0.0001. When they played with the ball, there was no effect of Orientation target, t (7) = 1.80, p = 0.1142.

A 2 (Condition)× 2 (Prompt) on prosocial behaviors revealed a main effect for Prompt on prosocial behaviors only, F (1, 7) = 9.688, p <0.017, η 2 = 0.581: Prosocial behaviors occurred more frequently with the prompt (20.06, SD = 10.75) than without it (9.50, SD = 8.45).

The value of the normalized proportion of prosocial behaviors was significantly negative, t (6) = 2.948, p = 0.026: There were more prosocial behaviors in the ball rather than in the robot condition.

ASD Children Characteristics

There was a positive correlation between SCQ scores and orientations toward the ball condition (r = 0.794, p = 0.033), and a negative correlation between orientations toward the robot and auditory sensory abnormalities (r = -0.907, p = 0.005).

Further conclusions were drawn from the correlation between the normalized proportion of prosocial behaviors and SCQ score: the more severe the symptoms (i.e., the higher the SCQ value), the lower the proportion of prosocial behaviors produced in the robot as compared to the ball condition (r = -0.813, p = 0.026).

6 Longitudinal Single-Participant Analysis

The child with ASD who completed all the sessions directed his gaze more often toward the robot than toward the ball (1/BF = 1.32 >1) (Figure 4A). He also produced more stereotypic behaviors in the robot than in the ball condition (1/BF = 2.82 >1) (Figure 4B).

Implementation Issues

Given that in collaborative/applied research, experimenters do not have total control of the implementation process and context of the experimental procedure, it is essential to describe the context delivery and the real-world difficulties encountered. This may prove to be particularly valuable in future efforts predicting, avoiding or better adapting to these socio-ecological constraints.

During the first set of lessons, the experimenters and coders identified five implementation failures where educators strayed from experimental requirements: instruction repeated too often or delivered at an inappropriate time; errors in action sequencing (i.e., instruction + prompt + interval, behavior + reward); reward omitted or delivered at an inappropriate time (e.g., before the child's behavior or after a failure); trial omission; and distractors not removed. In the set of 32 videos that were examined, 48 implementation failures were recorded, thus resulting in 1.5 failures per session. As indicated in Table 7, the most frequent failures were associated with reward or trial omission. However, the most severe procedural error was the omission of baseline conditions: before the intervention, the researchers had asked the educators to perform two baseline sessions: one with the robot and one with the ball, but some educators only carried out the baseline condition with the robot. The distributions of responses to the acceptance questionnaire showed that 87% of educators were satisfied or quite satisfied with their experience with the robot, 73% agreed that the robot brought substantial added value and transformed their practice, and 87% wanted to keep on using the robot in the future. Nevertheless, 67% of respondents confessed that they had been tempted to stop the intervention procedure. The reasons they gave included technical (80%) and organizational (33%) difficulties. The list of robot disadvantages also included substantial personal investment (60%) and increased workload (43%). In response to the questions assessing their training requirements, 40% of interventionists deemed that they need training in applying a structured educational approach.

Interventionists' Self-Efficacy Assessment

The interventionists' feeling of self-efficacy was initially high, and rose from 78.43 (SD = 11.97) before the intervention to 93.26 (SD = 10.29) after the intervention on a scale of 0-100, representing a significant increase, t (6) = -4.5962, p <0.004.

DISCUSSION

To better understand how to construct robotic tools for individuals with ASD, we conducted a collaborative study assessing the effects of a robot-assisted intervention on children with low-functioning ASD. Our intervention provided mixed results. As expected, children reacted more positive affect to rewards in robot as compared to control condition (viz. Hypothesis 1), and educators were quite enthusiastic about the robotic help in the learning task (viz. Hypothesis 4). However, contrary to our expectations, our robot was not able to act as a social mediator (viz. Hypothesis 3): when children played with the robot, they payed more attention to the toy than to the educator and the proportion of prosocial behaviors was higher in the control condition. Undesirable behaviors did not decrease (viz. Hypothesis 2). Of interest, the progression in the curriculum was IQ-specific: among the children we enrolled, those who displayed higher listening skills moved easily from lesson to lesson.

Reward Deliver

Children with ASD had more positive reactions to reward delivered by robot rather than to praises delivered by the eductor.

This observation is analogous to enthusiastic reactions to robot reported in previous case studies [START_REF] Dautenhahn | Robots as social actors: AURORA and the case of autism[END_REF][START_REF] Dautenhahn | Issues of robot-human interaction dynamics in the rehabilitation of children with autism[END_REF][START_REF] Kozima | Children-robot interaction: a pilot study in autism therapy[END_REF]. This enhanced reaction did not generalize to rewards delivered by the educator in robot condition though. The robot did not act as a general motivator (i.e., "motivating operation, " [START_REF] Laraway | Motivating operations and terms to describe them: some further refinements[END_REF][START_REF] Edwards | Motivating operations and stimulus control[END_REF] enhancing the reinforcing effectiveness of any reward delivered in its presence. Rather, it acted as a preferred object: a strongly attractive object for children with ASD (DeLeon et al., 2001). In further studies, robots might be thus used to reinforce behaviors targeted by interventions, and compared to already exiting preferred toys.

Undesirable Behavior Reducer

Our robot had no consistant effect on undesirable behaviors: stereotypic behaviors even increased in one child. [START_REF] Ismail | Robot-based intervention program for autistic children with humanoid robot NAO: initial response in stereotyped behavior[END_REF] suggested that robots may contribute to reduce the frequency of stereotypic behavior only for children with mild or no intellectual deficit. This demonstrates the need for psychometric descriptions of children in studies on robotassisted interventions.

Social Mediator

The proportion of prosocial behaviors was higher in the control condition, rather than the robot-assisted intervention. We failed to offer support to social mediator hypothesis. [START_REF] Robins | Robots as Isolators or Mediators for Children with Autism A Cautionary Tale[END_REF] warned that instead of social mediator, robots may sometimes take the role of social isolator. [START_REF] Meucci | The challenge of studying interaction in children with autism spectrum disorder during play activity with a robotic platform[END_REF] suggested that the advantage of the interaction with a robot depends on the level of intellectual functioning of the children with ASD.

In our data, we indeed noted that the more severe the ASD the lower the proportion of prosocial behaviors produced in the robot condition.

Note, extant information on social mediator hypothesis mostly comes from pilot studies or technical reports, without control condition, descriptive and inferential statistics [START_REF] Werry | Can social interaction skills be taught by a social agent? The role of a robotic mediator in autism therapy[END_REF][START_REF] Robins | From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot[END_REF][START_REF] Iacono | Robots as social mediators for children with Autism -A preliminary analysis comparing two different robotic platforms[END_REF][START_REF] Shamsuddin | Initial response in HRI-a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot NAO[END_REF] and/or without diagnostic method, exclusion and inclusion criteria, developmental age etc. [START_REF] Feil Seifer | Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders[END_REF][START_REF] Valadao | Analysis of the use of a robot to improve social skills in children with autism spectrum disorder[END_REF]. Further studies could better comply with the requirements of clinical methodology.

Our intuition here is that using a highly attractive tool comes with the risk of turning the child with ASD away from the interpersonal social interaction skill, target of the training program. Our data indeed showed that children with ASD primarily gazed at the toy, seeing it as more attractive than the educator, in line with Social Motivation Theory of Autism [START_REF] Chevallier | The social motivation theory of autism[END_REF][START_REF] Delmonte | Social and monetary reward processing in autism spectrum disorders[END_REF]. We suppose that robots would be more likely to "catalyze" prosocial behaviors if they interacted directly with the child, without any remote control, and if they endorsed a social role: that of prompter, teacher, helper in critical situations, etc. [START_REF] Zubrycki | Understanding therapists' needs and attitudes towards robotic support. The roboterapia project[END_REF][START_REF] Huijnen | Robots as new tools in therapy and education for children with autism[END_REF]. Children with ASD would be therefore efficiently trained to produce and interpret social cues exchanged with the robot, and perhaps could generalize this learning to interpersonal interaction. In future research, robots of higher autonomy, similar to Jibo [START_REF] Guizzo | Jibo is as good as social robots get. but is that good enough?[END_REF] or MINA [START_REF] Ghorbandaei Pour | Humanrobot facial expression reciprocal interaction platform: case studies on children with autism[END_REF] deserve particular attention.

Sensory Aversions and Inter-individual Heterogeneity Issue

Before the intervention, we feared that our robot, with its lighting signals and noisy functioning, might trigger anxiety among the children with ASD. The Intense World Theory of Autism [START_REF] Markram | The intense world syndrome-an alternative hypothesis for autism[END_REF] warned us indeed that children with ASD may be hypersensitive to these stimuli. This turned out to be a legitimate concern, as most of the auditory-sensitive children turned away from the robot.

This finding underscores the overlooked challenge faced by robots in the context of ASD: the inter-individual heterogeneity of children with ASD is shaping their reactions. This interindividual heterogeneity makes it unlikely that a given robot or a given intervention will work for all children with ASD. In clinical settings, interventionists are used to adjust to each individual [START_REF] Stahmer | Toward a technology of treatment individualization for young children with autism spectrum disorders[END_REF]. They identify the sensory and cognitive particularities of each individual in order to decide which toy and which educational goal may be selected. They determine in real time how to attract the child's attention and modulate child anxiety, and which instructions, prompts, rewards and pauses should be administered. In further studies, robots should be endowed with an extensive set of educational goals and sensory options so that the administration of the educational procedure can be personalized. A first step toward this goal was recently made by [START_REF] Clabaugh | Long-term personalization of an in-home socially assistive robot for children with autism spectrum disorders[END_REF] who developed a fully autonomous robot, SPRITE, able to personalize its instruction and feedback to each child's proficiency.

Collaboration Issues

One of the most often debated issues in the field of robotic assistance for children with ASD is infringement of the methodological rules of clinical research [START_REF] Kim | Bridging the research gap: making HRI useful to individuals with autism[END_REF][START_REF] Pennisi | Autism and social robotics: a systematic review: autism and social robotics[END_REF]. This was an acute problem in our participatory study too. In the face of the understandable enthusiasm of the other stakeholders, it was difficult for the researchers to make their warnings heard. Nonexperimentalists have difficulty accepting that the violation of methodological rules inexorably means that some of the data that are collected are unusable.

Despite the obvious advantages of participatory research, it is important to acknowledge that this strategy creates huge problems in terms of coping with the priorities and constraints of different stakeholders, often working at cross purposes [START_REF] Kim | Bridging the research gap: making HRI useful to individuals with autism[END_REF]. Evidently, investors need to deliver a compelling marketable innovation capable of a sustainable commercial growth. Engineers want to promote innovative technological platforms that make existing ones obsolescent [START_REF] Kim | Bridging the research gap: making HRI useful to individuals with autism[END_REF]. Researchers are concerned with the originality and efficacy of the educational intervention, and thus need to respect to rigorous methodological criteria [START_REF] Pennisi | Autism and social robotics: a systematic review: autism and social robotics[END_REF]. The special need educators are interested in creating a user-friendly, personalizable tool that meets the specific needs of individual patients and fits in with current learning routines [START_REF] Boardman | Special education teachers' views of research-based practices[END_REF]. The company organizing the project has to factor in the time-limited and evanescent nature of the funding. There may be insufficient time and financial resources to organize meetings in order to build communication and trust between partners and work out a consensus on the standards of excellence to be met.

Implementation Fidelity Issue

As feared, the educators derailed from procedure dictated by research design (viz. Hypothesis 5). Despite workbooks, demonstrations and a hotline, educators made 1.5 implementation failures per session. In this respect, our intervention attempt was no different from others: [START_REF] Stahmer | Training teachers to use evidence-based practices for autism: examining procedural implementation fidelity: training teachers in autism practices[END_REF]. showed that even after 28 h of intensive workshops, followed by 2 years of observation and coaching, the percentage of sessions meeting 80% implementation fidelity was just 60% for discrete trial teaching and as low as 20% for pivotal response training. Contrary to academic staff, special needs educators do not undergo years of training in administering trial-based, experiment-like procedures. Their skills imply intimate understanding of the child's difficulties and needs. Our intuition is that robots may play a non-negligible role here. If they can be designed to free educators from structuring the intervention according to the guidelines of educational protocol, they may contribute to the dissemination and application of structured educational approaches (e.g., ABA) recommended by health services.

Acceptance of the Robot-Assisted Intervention

The educators who took part in the present study were highly satisfied with their interaction with the robot. Coders noted that they seemed to take greater pleasure in interacting with the children. They had a greater feeling of self-efficiency after the experiment. Although we suspect that responses to the selfefficiency questionnaire were affected by a social desirability bias [START_REF] Troye | Consumer participation in coproduction: "I Made it Myself " effects on consumers' sensory perceptions and evaluations of outcome and input product[END_REF], leading the care staff to ignore undesirable traits such as self-doubt, it is quite possible that being supported by a robotic tool, instead of facing the child alone, engendered feelings of relief and satisfaction.

CONCLUSION

To better understand how to construct convincing tools for individuals with ASD, we conducted a collaborative study that assessed the effects of a robot-assisted intervention on both the prosocial and undesirable behaviors of children with lowfunctioning ASD. The robot attracted orienting responses from the children and the rewards it offered elicited more positive responses, but it failed to act as a social mediator: it did not motivate desired social behaviors toward humans. Robotic assistance was obviously judged to be positive by educators, thus contributing to the dissemination of evidence-based practices for individuals with ASD. In further studies, robots with higher levels of autonomy and differentiation, of richer set of educational goals and sensory response options might be tested as reinforcers of social behaviors targeted by educative intervention.

FIGURE 1 |

 1 FIGURE 1 | ABA-based procedure of learning.

  to the adult, who then activates it R7.Spontaneously hold inactive robot to the adult, who activates it

  Step by step procedure for the first lesson in the turn-taking set.

FIGURE 2 |

 2 FIGURE 2 | Intervention conditions: with robot (left) and with ball (right).

FIGURE 3 |

 3 FIGURE 3 | Positive reactions (A) and orientations (B) as a function of Condition (ball, robot). *p < 0.05, **p < 0.01and ***p < 0.001.

FIGURE 4 |

 4 FIGURE 4 | Gaze direction (A) and stereotyped behaviors (B) as a function of Lessons and Condition (robot, ball).

TABLE 1 |

 1 Psychological tests used in the present experiment.For each test, the number of items, score range, score interpretation, mean score and standard deviation (SD) are provided for the children with ASD. SCQ, Social Communication Questionnaire; PEP, Psychoeducational Profile; SPCR, Sensory Profile Checklist Revised; AE, affective expressions; SR, social reciprocity; V, Vineland.

	Test	No. items	Item scoring	Score interpretations	Child score
	SCQ	40	0-1	score>15: possible ASD	21.43 (3.06)
	V-listening	20	0-2	score <70: delay in receptive communication	16.81 (9.62)
	V-speaking	32	0-2	Score <70: delay in expressive communication	22.15 (7.95)
	V-autonomy	27	0-2	score <70: delay in personal autonomy	39.96 (15.46)
	V-socialization	26	0-2	score <70: delay in socialization	22.08 (7.09)
	V-adaptation	30	0-2	score <70: delay in social adaptation	9.56 (6.85)
	PEP-3: AEs	11	0-2	Higher score: better affective expression	9.93 (4.43)
	PEP3: SR	11	0-2	Higher score: better social reciprocity	11.14 (4.02)
	PEP3: CVPV	34	0-2	Provides developmental age	26.44 (7.37)
	SPCR	85	0-1	Higher score: more sensory abnormalities	26.86 (5.64)
	ESES	13	1-9	Higher score: higher self-efficacy belief	85.86 (10.31)

Table 2 ,

 2 or "Touch the robot in turn", see Table3). Required responses progressed from

TABLE 2 |

 2 Required responses (R) for requesting set of lessons.

TABLE 3 |

 3 Required

responses (R) for turn-taking set of lessons.

Set 2 Turn-taking

R1.

Touch the robot in turn R2.

Touch the robot if it is your turn and if the robot is lit up in blue R3.

Get closer to and touch the robot, in turn R4.

If it is your turn and if the robot is lit up in blue, get closer and touch the robot R5.

TABLE 5 |

 5 Step by step procedure for the second lesson in the turn-taking set.

	Required response	Touch the robot if it is your turn and if the robot is
		lit up in blue
	Antecedent	1. Sit facing the child, and place the robot between you.
		The robot is active and lit up either in blue or red.
		2. If the robot's light is blue say "The robot is blue! Touch
		it!.
		3. If the robot's light is red say "The robot is red! Don't
		touch it!".
	Behavior	4. If the robot's light is red and the child reaches to touch
		it, the educator will block the gesture, saying "The robot
		is red! Don't touch it!"
		5. If the robot's light is blue and the child does not
		attempt to touch it, the educator selects a guidance
		specific to the child (ex. The light is blue, you can touch
		it).
		6. If the robot lights up in blue and the child touches it,
		the robot light up in white for a moment.
	Consequence	6. After an errorless sequence of six turn-takings, the
		robot provides a sensory reward (specific to each child)
		and the educator gives verbal praise.
	Validation Criterion	7. Repeat the sequence of turn-takings 5 times in a row
		(30 trials in all)

TABLE 6 |

 6 Dependent variables and to-be-observed response catégories.Each dependent variable in the left hand column is a combination of responses categories shown in the middle column. Left hand colums displays response category labels.

	Dependent variables	Response categories	Label
	Positive reactions to reward	To reward delivered by human	(PRH)
		To reward delivered by robot	(PRR)
	Prosocial behaviors	Proximal pointing	(PP)
		Distal pointing	(DP)
		Joint gazing	(JG)
		Physical contact with human	(CH)
		Head/gaze oriented toward human	(OH)
		Social smiles	(SS)
		Desirable vocalizations	(DV)
	Orientations	Head/gaze targeting human	(OTH)
		Head/gaze targeting toy: ball or robot	(OTT)
	Undesirable behaviors	Inappropriate behaviors	(IA)
		Stereotypies	(S)
		Undesirable vocalizations	(UV)
		Lack of interest	(LI)
		Attentional dropout	(AD)

TABLE 7 |

 7 Implementation failures.

	Nature of implementation failure	Failure
		frequency
	Instruction	0.16
	Action sequencing	0.13
	Reward	0.69
	Trial	0.47
	Distractor	0.06
	3.4. Robot Acceptance
	3.4.1. Acceptance Questionnaire

Frontiers in Robotics and AI | www.frontiersin.org

March 2020 | Volume 7 | Article 37

ACKNOWLEDGMENTS

The authors would like to thank children with ASD, their families, special need workers and engineers for their cooperation and help. We also thank Teresa Blicharska for her careful reading of the final version of the manuscript.

FUNDING

We thank AG2R La Mondiale for funding a preliminary study, described in a confidential activity report (Kruck and Kostrubiec, 2018) focused on the analysis of other distinct variables, and for the acknowledgment of the present work.

DATA AVAILABILITY STATEMENT

The raw data supporting the conclusions of this article can be found through Figshare (10.6084/m9.figshare.11994801).

ETHICS STATEMENT

The studies involving human participants were reviewed and approved by the Research Ethics Committee for Non-Invasive Procedures (CERNI) of the Université Fédérale Toulouse Midi-Pyrénées. The interventionist and the families of all the children received a letter explaining the goals, experimental procedure and rights of parents and children, and provided their written informed consent, in accordance with the Declaration of Helsinki. Each parent completed a form provided by the University of Toulouse informing them about their rights and predictable risks in comparison with foreseeable benefits. Written informed consent was obtained from the individual(s) or the individuals' legal guardian/next of kin for the publication of any potentially identifiable images or data included in this article.

AUTHOR CONTRIBUTIONS

JK designed the study and supervised data collection. VK analyzed the results and wrote the manuscript. JK and VK critically reviewed and edited the manuscript for important intellectual content. All authors approved the final manuscript.

Conflict of Interest:

The authors declare that this study received funding from AG2R La Mondiale. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.

APPENDIX 1

List of Psychological Tests Used

The SCQ is a screening tool based on the DSM-IV criteria for autism and the ADI-R algorithm [START_REF] Rutter | The Social Communication Questionnaire Manual[END_REF]. It takes the form of a standardized parent questionnaire to assist in autism diagnosis by capturing key autistic symptoms (e.g., "did he/she ever show you things that interested him/her to engage your attention?").

The Vineland-II is a structured interview administered to primary caregiver(s) to assess a child's daily living skills (e.g., "looks at the caregiver when s/he hears his voice"). Using this tool, we evaluated three domains (communication, daily living skills, socialization), thus obtaining an overall adaptive behavior evaluation.

The PEP-3 identifies learning strengths and facilitates the selection of educational programs for children with ASD. In the present study, we scrutinized affective expressions (AE; e.g., "manifests an appropriate level of fear") and social reciprocity (SR; e.g., "initiates social interactions").

The SPCR assesses unusual sensory experiences of individuals with ASD (e.g., "covers ears when hears certain sounds").

The ESES comprises 13 items evaluating interventionists' beliefs about their efficiency in controlling children (e.g., "I am able to copy with disruptive behavior in a teaching session").

The SCQ and Vineland-II yield standardized scores, while the others yield raw scores. A high SCQ score indicates a severe form of ASD-like symptoms. For the remaining tests, low scores indicate a severe functional impairment (see Table 1).