domain: info math phys

text:
Machine Learning predictive models have been applied to many fields and applications so far. The majority of these learning algorithms rely on labeled training data which may be expensive to obtain as they require labeling by an expert. Additionally, with the new storage capabilities, large amounts of unlabeled data exist in abundance.

In this context, the development of new frameworks to learn efficient models from a small set of labeled data, together with a large amount of unlabeled data, is a crucial

emphasis of the current research community. Achieving this goal would significantly elevate the state-of-the-art machine intelligence to be comparable to or surpass the human capability of learning to generalize concepts from very few labeled examples. Semi-supervised learning and active learning are two ongoing active research subdomains that aim to achieve this goal.

In this thesis, we investigate two directions in machine learning theory for semisupervised and active learning. First, We are interested in the generalization properties of a self-training algorithm using halfspaces with explicit mislabel modeling. We propose an iterative algorithm to learn a list of halfspaces from labeled and unlabeled training data, in which each iteration consists of two steps, exploration and pruning.

We derive a generalization bound for the proposed algorithm under a Massart noise mislabeling model. Second, we propose a meta-approach for pool-based active learning strategies in the context of multi-class classification tasks, which relies on the proposed concept of learning on Proper Topological Regions (PTR) with an underlying smoothness assumption on the metric space. PTR allows the pool-based active learning strategies to obtain a better initial training set than random selection and increase the training sample size during the rounds while operating in a low-budget regime scenario. Experiments carried out on various benchmarks demonstrate the efficiency of our proposed approaches for semi-supervised and active learning compared to state-of-the-art methods.

A third contribution of the thesis concerns the development of practical deeplearning solutions in the challenging domain of Transmission Electron Microscopy i (TEM) for material design. In the context of orientation microscopy, ML-based approaches still need to catch up to traditional techniques, such as template matching or the Kikuchi technique, when it comes to generalization performance over unseen orientations and phases during training. This is due mainly to the limited experimental data about the studied phenomena for training the models. Nevertheless, it is a realistic and practical constraint, especially for narrow-domain applications where actual data are not widely available. Some successful attempts have been made to use unsupervised learning techniques to gain more insight into the data, but clustering information does not solve the orientation microscopy problem. To this end, we propose a multi-task learning framework based on neural architecture search for fast automation of phase and orientation determination in TEM images.

Résumé

Les modèles prédictifs d'apprentissage automatique ont été appliqués à de nombreux domaines et applications jusqu'à présent. La majorité de ces algorithmes d'apprentissage reposent sur des données d'apprentissage étiquetées qui peuvent être coûteuses à obtenir car elles nécessitent l'étiquetage par un expert. De plus, avec les nouvelles capacités de stockage, une grande quantité de données non étiquetées existe en abondance. Dans ce contexte, le développement de nouveaux cadres pour apprendre des modèles efficaces à partir d'un petit ensemble de données étiquetées, ainsi qu'une grande quantité de données non étiquetées est un accent crucial de la communauté de recherche actuelle. Atteindre cet objectif élèverait considérablement l'état de l'art de l'intelligence artificielle pour être comparable ou surpasser la capacité humaine sur comment apprendre à généraliser des concepts à partir de très peu d'exemples étiquetés. L'apprentissage semi-supervisé et l'apprentissage actif sont deux sous-domaines de recherche actifs en cours qui visent à atteindre cet objectif.

Dans cette thèse, nous étudions deux directions de la théorie de l'apprentissage automatique pour l'apprentissage semi-supervisé et actif. Premièrement, nous nous intéressons aux propriétés de généralisation d'un algorithme d'auto-apprentissage utilisant des demi-espaces avec une modélisation explicite des erreurs d'étiquetage. Nous proposons un algorithme itératif pour apprendre une liste de demi-espaces à partir de données d'apprentissage étiquetées et non étiquetées, dans lequel chaque itération consiste en deux étapes, l'exploration et l'élagage. Nous dérivons une borne de généralisation pour l'algorithme proposé sous un modèle d'étiquetage de bruit de Massart. Deuxièmement, nous proposons une méta-approche pour les stratégies d'apprentissage actif basées sur des pools dans le contexte de tâches de classification multi-classes, qui s'appuie sur le concept proposé d'apprentissage sur les régions topologiques propres (RTP) avec une hypothèse sous-jacente de lissage sur l'espace métrique. Le TRP permet aux stratégies d'apprentissage actif basées sur le pool d'obtenir un meilleur ensemble d'entraînement initial que la sélection aléatoire et d'augmenter la taille de l'échantillon d'entraînement pendant les tours tout en fonciii tionnant dans un scénario de régime à petit budget. Des expérimentations menées sur différents benchmarks démontrent l'efficacité de nos approches proposées pour l'apprentissage semi-supervisé et actif par rapport aux méthodes de l'état de l'art. Une troisième contribution de la thèse concerne le développement de solutions pratiques d'apprentissage en profondeur dans le domaine difficile de la microscopie électronique à transmission (TEM) pour la conception de matériaux. Dans le contexte de la microscopie d'orientation, les approches basées sur ML doivent encore rattraper les techniques traditionnelles, telles que l'appariement de modèles ou la technique de Kikuchi, en ce qui concerne les performances de généralisation sur des orientations et des phases inconnu lors de l'apprentissage. Cela est dû principalement au peu de données expérimentales sur les phénomènes étudiés pour l'entraînement des modèles. Néanmoins, il s'agit d'une contrainte réaliste et pratique, en particulier pour les applications à domaine étroit où les données réelles ne sont pas largement disponibles. Certaines tentatives réussies ont été faites pour utiliser des techniques d'apprentissage non supervisées pour mieux comprendre les données, mais le regroupement des informations ne résout pas le problème de la microscopie d'orientation. À cette fin, nous proposons un cadre d'apprentissage multi-tâches basé sur la recherche d'architecture neuronale pour l'automatisation rapide de la détermination de la phase et de l'orientation dans les images TEM.

List of Figures

Average balanced classification accuracy and standard deviation of dif-

ferent pool-based active learning strategies and budgets on protein dataset, using random forest estimator over 20 stratified random splits.

3.3 Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on banknote dataset, using random forest estimator over 20 stratified random splits. 3.4 Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on coil-20 dataset, using random forest estimator over 20 stratified random splits.

Average balanced classification accuracy and standard deviation of

different pool-based active learning strategies and budgets on isolet dataset, using random forest estimator over 20 stratified random splits.

3.6 Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on pendigits dataset, using random forest estimator over 20 stratified random splits.

Introduction

In this chapter, we will introduce our study by first presenting its context in Section 1.1; then by describing the main application we considered in Material Science that is the Transmission Electron Microscopy in Section 1.2, and the motivation of using Machine Learning for this task in Section 1.3. We will finally present the structure of this thesis in Section 1.4 and give our personal publications and those that have been submitted for this work.

Context

This thesis is being written as part of the "Multidisciplinary Institute in Artificial Intelligence's" (MIAI) 1 Magnet chair. MIAI's mission is to establish a center of excellence in AI for research in Grenoble, where scientists from different research domains may meet and form new alliances. Magnet Chair's purpose is to create new learning frameworks that incorporate contextual knowledge in training models that explore the multidimensional design space of materials. The development of new materials is at the heart of any technological transition, many of which are on the horizon: lighter transportation (more efficient structures), energy production (renewable materials), circular economy (recyclable materials), resource crisis (substitution of critical chemical species), gas capture and release (CO2, toxic gases). The vastness of the materials design space presents a critical opportunity to combine high-throughput materials exploration tactics based on experimental and simulation strategies with powerful artificial intelligence capabilities. In this regard, the objective is to create novel materials with optimum functionality to address the industrial difficulties posed by future societal restrictions. The functions that are being sought include structural, chemical, and physical qualities, as well as those linked to safety, ecology, recycling, low cost, and accessibility. The quest for novel materials with specified qualities remains highly empirical, typically directed by intuition and trial and error.

Beyond that, data-to-knowledge methodologies in materials research are particularly promising. The chair has used novel Machine Learning (ML) methodologies to produce genuine materials based on specified attributes (local structure, microstructure, thermodynamic and mechanical properties), anticipate new phases, and the atomic structure of materials.

The goal of my thesis is to use context to increase the effectiveness of learning models in two ways: first, by utilizing the structure of the data by using unlabeled instances in the training of the models, and secondly, by considering related tasks to the primary one in the training phase.

In this way the learning paradigms that we are taking into consideration; are self-training, active-learning, and multi-task learning. The next section gives a quick introduction to these frameworks. setting, the learning algorithm is presented with all the unlabeled examples at once in a pool. In the stream-based setting, the unlabelled examples are presented in a stream, where each example is sent individually to the learning algorithm [START_REF] Settles | Active learning literature survey[END_REF]. In Chapter 3, we propose a study on pool-based active learning algorithms.

Self-training

Transfer learning

In transfer learning, the knowledge of an already trained ML model is applied to a different but related problem. with already some patterns learned from solving a related task [START_REF] Yang | Transfer Learning[END_REF]. In Chapter 4, we show how to use TL in our applicative contributions to material science.

Multi-task learning

Multi-task learning (MTL) is another subfield of ML in which multiple learning tasks are solved at the same time by the learning algorithm. It has many denominations, such as joint learning, learning to learn, and learning with auxiliary tasks, etc., but they all share the same principle, improving the performance of multiple tasks by learning them jointly rather than solving them separately [127]. In Chapter 4, we design a use case for MTL and show its benefits for our applicative contributions to material science.

Figure 1.3: Multi-task learning framework in ML.

Application to Material Design: Transmission Electron Microscopy (TEM)

Transmission Electron Microscopy (TEM) is a particular type of microscopy that uses an electron beam traversing a thin sample (of the order of 100 nm) to characterize its microstructure (nature, orientation and spatial distribution of phases) at high magnification (down to the nanometer resolution or less). TEM has many applications and observation modes in a number of different fields, such as life sciences, nanotechnology, biological and material research, industry, etc. In Figure 1.4, we depict the general process of a TEM experiment under the particular observation mode considered in the present work, namely scanning transmission electron microscopy (STEM) accompanied by Automated Crystal Orientation Mapping (ACOM). In this mode, the sample is scanned (in 2D) by a small electron beam, generating a 2D map of typically 10 × 10 µm2 ; on each point of the map the diffraction diagram is acquired, which results in a 4D dataset [START_REF] Carter | Transmission Electron Microscopy: Diffraction, Imaging, and Spectrometry[END_REF]. Further analysis of the diffraction diagrams allows to generate many different information. For example, a virtual brightfield image (VBF) of the scanned area can be drawn by plotting the intensity of the transmitted spot More advanced interpretation requires the analysis of all the diffraction diagrams.

Because it is resource intensive, this is performed in an offline fashion after the experiment's end. The algorithms designed to analyze these data are versions of the template matching algorithm [START_REF] Brunelli | Template Matching Techniques in Computer Vision: Theory and Practice[END_REF], where the objective is to find the best match to each

Motivation

As previously mentioned, effectively reducing the training cost of learning algorithms in terms of labeled examples for ML is of utmost importance. It will contribute directly to the spread of ML in narrow-domain applications where publicly available data collections are in their premise growth and other applications where the cost of labeling is such that having extensive training collections for Deep-Learning (DL) is simply unrealistic. Therefore, the main aspect of this thesis was not only to implement well-known strategies from the previously mentioned sub-fields of ML, which aim to solve this problem but also to contribute to these subdomains by proposing in Chapter 2, and Chapter 3 novel approaches and algorithms with solid theoretical foundations. TEM is a good example of a narrow-domain application with relatively scarce publicly available datasets. Most of the matching algorithms designed to analyze TEM data, with millions of image to retrieve, have a high time complexity by definition, which implies that in the standard TEM workflow, the data analysis is performed offline after the experiment's end. ML approaches have a clear advantage over these algorithms because the model's prediction time is instantaneous, which enables online solutions during the TEM experiment. However, there are practical challenges and constraints to take into consideration for the development of ML solutions in this application:

The limited amount of available data to train ML models.

The algorithms should generalize to unseen orientations during training.

The TEM data is dependent on the experiment's setting and microscope.

TEM data exhibits a high frequency of duplicates, reducing the training data size even further.

Chapter 4 presents a detailed investigation of what DL has to offer in order to solve these challenges and proposes a DL model for the real-time analysis of TEM data.

Thesis structure

The rest of the thesis consists of the following:

In Chapter 3 uses topological clustering to provide a meta-approach for poolbased active learning algorithms in low-budget regime scenarios. We demonstrate how different active-learning algorithms might profit from this technique in order to operate on limited budgets and handle the cold-start problem in a cohesive manner.

In Chapter 4 shows how we can successfully use DL to automate the analysis of TEM data collections to achieve real-time prediction during the TEM experiment.

Finally, Chapter 5 concludes our study in general and offers some future prospects.

Personal References

Under Review

[HDAL22] Lies Hadjadj, Alexis Deschamps, Massih-Reza Amini, and Sana Louichi. Deep learning for automated phase and orientation determination in tem maps with ceramic microstructures. Materials Characterization Journal,

2022.

[HDMA22] Lies Hadjadj, Emilie Devijver, Rémi Molinier, and Massih-Reza Amini.

Pool-based active learning with topological clustering. Machine Learning Journal, 2022.

Chapter 2

Self-Training of Halfspaces with Generalization Guarantees under Massart Mislabeling Noise Model

We investigate the generalization properties of a self-training algorithm with halfspaces. The approach learns a list of halfspaces iteratively from labeled and unlabeled training data, in which each iteration consists of two steps: exploration and pruning. In the exploration phase, the halfspace is found sequentially by maximizing the unsigned-margin among unlabeled examples and then assigning pseudo-labels to those that have a distance higher than the current threshold. The pseudo-labeled examples are then added to the training set, and a new classifier is learned. This process is repeated until no more unlabeled examples remain for pseudo-labeling. In the pruning phase, pseudo-labeled samples that have a distance to the last halfspace greater than the associated unsigned-margin are then discarded. We prove that the misclassification error of the resulting sequence of classifiers is bounded and show that the resulting semi-supervised approach never degrades performance compared to the classifier learned using only the initial labeled training set. Experiments carried out on a variety of benchmarks demonstrate the efficiency of the proposed approach compared to state-of-the-art methods. This chapter is based on the following papers [HALD22? ].

Introduction

In recent years, several attempts have been made to establish a theoretical foundation for semi-supervised learning. These studies are mainly interested in the generalization ability of semi-supervised learning techniques [START_REF] Rigollet | Generalization error bounds in semi-supervised classification under the cluster assumption[END_REF][START_REF] Maximov | Rademacher complexity bounds for a penalized multi-class semi-supervised algorithm[END_REF] and the utility of unlabeled data in the training process [START_REF] Castelli | On the exponential value of labeled samples[END_REF][START_REF] Singh | Unlabeled data: Now it helps, now it doesn[END_REF][START_REF] Li | Towards Making Unlabeled Data Never Hurt[END_REF]. The majority of these works are based on the concept called compatibility in [START_REF] Balcan | An augmented PAC model for semisupervised learning[END_REF], and try to exploit the connection between the marginal data distribution and the target function to be learned. The common conclusion of these studies is that unlabeled data will only be useful for training if such a relationship exists.

The three key types of relations considered in the literature are cluster assumption, manifold assumption, and low-density separation [130,[START_REF] Chapelle | Semi-Supervised Learning[END_REF]. The cluster assumption states that data contains homogeneous labeled clusters, and unlabeled training examples allow to recognize these clusters. In this case, the marginal distribution is viewed as a mixture of class conditional distributions, and semi-supervised learning has been shown to be superior to supervised learning in terms of achieving smaller finitesample error bounds in some general cases, and in some others, it provides a faster rate of error convergence [START_REF] Castelli | On the exponential value of labeled samples[END_REF][START_REF] Rigollet | Generalization error bounds in semi-supervised classification under the cluster assumption[END_REF][START_REF] Maximov | Rademacher complexity bounds for a penalized multi-class semi-supervised algorithm[END_REF][START_REF] Singh | Unlabeled data: Now it helps, now it doesn[END_REF]. In this line, [START_REF] Ben | Does unlabeled data provably help? worstcase analysis of the sample complexity of semi-supervised learning[END_REF] showed that the access to the marginal distribution over unlabeled training data would not provide sample size guarantees better than those obtained by supervised learning unless one assumes very strong assumptions about the conditional distribution over the class labels. Manifold assumption stipulates that the target function is in a low-dimensional manifold. [START_REF] Niyogi | Manifold regularization and semi-supervised learning: Some theoretical analyses[END_REF] establishes a context through which such algorithms can be analyzed and potentially justified; the main result of this study is that unlabeled data may help the learning task in certain cases by defining the manifold. Finally, low-density separation states that the decision boundary lies in low-density regions. A principal way, in this case, is to employ a margin maximization strategy which results in pushing away the decision boundary from the unlabeled data [30, ch. 6]. Semi-supervised approaches based on this paradigm mainly assign pseudo-labels to high-confident unlabeled training examples with respect to the predictions and include these pseudo-labeled samples in the learning process [START_REF] Vittaut | Learning classification with both labeled and unlabeled data[END_REF]. However, [START_REF] Chawla | Learning from labeled and unlabeled data: An empirical study across techniques and domains[END_REF] investigated empirically the problem of label noise bias introduced during the pseudo-labeling process in this case and showed that the use of unlabeled examples could have a minimal gain or even degraded performance, depending on the generalization ability of the initial classifier trained over the labeled training data.

In this chapter, we study the generalization ability of a self-training algorithm with halfspaces that operates in two steps. In the first step, halfspaces are found In the remainder of the chapter, Section 2.2 presents the definitions and the learning objective. In Section 2.3, we present in detail the adaptation of the self-training algorithm for halfspaces. Section 2.4 presents a bound over the misclassification error of the classifier outputted by the proposed algorithm and demonstrates that this misclassification error is upper-bounded by the misclassification error of the fully supervised halfspace. In Section 2.5, we present experimental results, and we conclude this work in Section 2.6.

Framework and Notations

We consider binary classification problems where the input space X is a subset of R d , and the output space is Y = {-1, +1}. We study learning algorithms that operate in hypothesis space H d = {h w : X → Y} of centered halfspaces, where each h w ∈ H d is a Boolean function of the form h w (x) = sign(⟨w, x⟩), with w ∈ R d such that ∥w∥ 2 ≤ 1.

Our analysis succeeds the recent theoretical advances in robust supervised learning of polynomial algorithms for training halfspaces under large margin assumption [START_REF] Diakonikolas | Distributionindependent pac learning of halfspaces with massart noise[END_REF][START_REF] Montasser | Efficiently learning adversarially robust halfspaces with noise[END_REF][START_REF] Diakonikolas | Hardness of learning halfspaces with massart noise[END_REF], where the label distribution has been corrupted with the Massart noise model [START_REF] Massart | Risk bounds for statistical learning[END_REF].

Learning objective

Given S ℓ and X u , our goal is to find a learning algorithm that outputs a hypothesis h w ∈ H d such that with high probability, the misclassification error

P (x,y)∼D [h w (x) ̸ = y]
is minimized and to show with high probability that the performance of such algo- By considering the indicator function 1 π defined as 1 π = 1 if the predicate π is true and 0 otherwise, we prove in the following lemma that the probability of misclassification of halfspaces over examples with an unsigned-margin greater than a threshold γ > 0 is bounded by the same quantity 1 > η η η > 0 that upper-bounds the misclassification error of these examples.

Lemma 2.1. For all h w ∈ H d , if there exist η η η ∈]0, 1[ and γ > 0 such that

P x∼Dx [|⟨w, x⟩| ≥ γ] > 0 and that E x∼Dx [(η w (x) -η η η)1 |⟨w,x⟩|≥γ ] ≤ 0, then P (x,y)∼D [h w (x) ̸ = y |⟨w, x⟩| ≥ γ] ≤ η η η.
Proof. For all hypotheses h w in H d , we know that the error achieved by h w in the region of margin γ from w satisfies E x∼Dx [(η w (x) -η η η)1 |⟨w,x⟩|≥γ ] ≤ 0; by rewriting the expectation, we obtain the following

E x∼Dx [η w (x)1 |⟨w,x⟩|≥γ ] -η η ηP x∼Dx [|⟨w, x⟩| ≥ γ] ≤ 0.
We have then

E x∼Dx [ηw(x)1 |⟨w,x⟩|≥γ ] P x∼Dx [|⟨w,x⟩|≥γ]
≤ η η η and the result follows from the equality:

P (x,y)∼D [h w (x) ̸ = y |⟨w, x⟩| ≥ γ] = E x∼Dx [η w (x)1 |⟨w,x⟩|≥γ ] P x∼Dx [|⟨w, x⟩| ≥ γ]
.

Suppose that there exists a pair ( w, γ) minimizing:

( w, γ) ∈ arg min

w∈R d ,γ≥0 E x∼Dx [η w (x)1 |⟨w,x⟩|≥γ ] P x∼Dx [|⟨w, x⟩| ≥ γ]
.

(2.1)

By defining η as:

η = inf w∈R d ,γ≥0 E x∼Dx [η w (x)1 |⟨w,x⟩|≥γ ] P x∼Dx [|⟨w, x⟩| ≥ γ]
.

The following inequality holds:

η ≤ inf w∈R d E x∼Dx [η w (x)1 |⟨w,x⟩|≥0 ] P x∼Dx [|⟨w, x⟩| ≥ 0] = η η η * .
This inequality paves the way for the following claim, which is central to the selftraining strategy described in the next section.

Claim 2.2. Suppose that there exists a pair ( w, γ) satisfying the minimization prob-

lem (2.1) with P x∼Dx [|⟨ w, x⟩| ≥ γ] > 0 , then P (x,y)∼D [h w (x) ̸ = y |⟨ w, x⟩| ≥ γ] ≤ η η η * .
Proof. The requirements of Lemma 2.1 are satisfied with (w, γ) = ( w, γ) and η = η.

This claim is then proved using the conclusion of Lemma 2.1 together with the fact that η ≤ η * .

The claim above demonstrates that for examples generated by the probability distribution D, there exists a region in X on either side of a margin γ to the decision boundary defined by w solution of (Eq. 2.1); where the probability of misclassification error of the corresponding halfspace in this region is upper-bounded by the optimal misclassification error η * . This result is consistent with semi-supervised learning studies that consider the margin as an indicator of confidence and search the decision boundary on low-density regions [START_REF] Joachims | Transductive inference for text classification using support vector machines[END_REF][START_REF] Grandvalet | Semi-supervised learning by entropy minimization[END_REF][START_REF] Massih | A transductive bound for the voted classifier with an application to semi-supervised learning[END_REF][START_REF] Feofanov | Transductive bounds for the multi-class majority vote classifier[END_REF][START_REF] Usunier | Multiview semisupervised learning for ranking multilingual documents[END_REF].

Problem resolution

We use a block coordinate minimization method for solving the optimization problem (2.1). This strategy consists in first finding a halfspace with parameters w that minimizes Eq. (2.1) with a threshold γ = 0, and then by fixing w, finds the threshold γ for which Eq. (2.1) is minimum. We resolve this problem using the following claim, which links the misclassification error η w and the perceptron loss

ℓ p (y, h w (x)) : Y × Y → R + ; ℓ p (y, h w (x)) = -y⟨w, x⟩1 y⟨w,x⟩≤0 .
Claim 2.3. For a given weight vector w, we have:

E x∼Dx [|⟨w, x⟩|η w (x)] = E (x,y)∼D [ℓ p (y, h w (x))] (2.2)
Proof. For a fixed weight vector w, we have that: We then have:

E (x,y)∼D [ℓ p (y, h w (x))] = E (x,
γ R E x∼Dx [η w (x) |⟨ w, x⟩| ≥ γ] ≤ E x∼Dx [η w (x) |⟨w, x⟩| ≥ γ] ≤ E x∼Dx [η w (x) |⟨ w, x⟩| ≥ γ].
Proof. From the condition |⟨ w, x⟩| ≥ γ in the expectation, we have:

γE x∼Dx [η w (x) |⟨ w, x⟩| ≥ γ] ≤ E x∼Dx [|⟨ w, x⟩|η w (x) |⟨ w, x⟩| ≥ γ]
Applying the definition of w to the right-hand side of the above inequality gives:

γE x∼Dx [η w (x) |⟨ w, x⟩| ≥ γ] ≤ E x∼Dx [|⟨w, x⟩|η w (x) |⟨w, x⟩| ≥ γ]
Using the Cauchy-Schwarz inequality and the definition of R, we get:

γE x∼Dx [η w (x) |⟨ w, x⟩| ≥ γ] ≤ R E x∼Dx [η w (x) |⟨w, x⟩| ≥ γ]
Then from the definition of w, we know:

R E x∼Dx [η w (x) |⟨w, x⟩| ≥ γ] ≤ R E x∼Dx [η w (x) |⟨ w, x⟩| ≥ γ]
Dividing the two inequalities above by R gives the result.

Algorithm 1 Self-Training with Halfspaces 1: Input : S ℓ = (x i , y i ) 1≤i≤l , X u = (x i ) l+1≤i≤n , p = 5 number of threshold tests.

2: Set k ← 0, S (k) = S ℓ , U (k) = X u , w = |S (k) | p , L = []. 3: while |S (k) | ≥ ℓ do 4: Let RS (k) (w) = 1 |S (k) | (x,y)∈S (k) [ℓ p (y, h w (x))] 5:
Run projected SGD on RS (k) (w) to obtain w (k) such that ∥w (k) ∥ 2 ≤ 1.

6:

Order S (k) by decreasing order of margin from w (k) .

7:

Set a window of indices I = [w, 2w, ..., pw],

8:

find t = arg min i∈I 1 |S (k) ≥i | (x,y)∈S (k) ≥i 1 h w (k) (x)̸ =y . 9:
Set γ (k) to the margin of the sample at position I[t].

10:

Let U (k) = {x ∈ X u |⟨w (k) , x⟩| ≥ γ (k) }. 11: if |U (k) | > 0 then 12: S (k) u = {(x, y) x ∈ U (k) ∧ y = sign(⟨w (k) , x⟩)} 13: S (k+1) ← S (k) ∪ S (k) u 14: X u ← X u \ U (k)
15:

else 16:

L = L ∪ [(w (k) , γ (k) )]
17:

S (k+1) = {(x, y) ∈ S (k) |⟨w (k) , x⟩| < γ (k) } 18:
end if Lemma 2.4 guarantees that the approximation of the perceptron loss to the misclassification error is more accurate for examples that have a comparable distance to the halfspace. This result paves the way for our implementation of the self-learning algorithm.

19: Set k ← k + 1, w = |S (k) |

Self-Training with Halfspaces

Given S ℓ and X u drawn i.i.d. from a distribution D corrupted with O(f, D x , η (0) ). Algorithm 1 learns iteratively a list of halfspaces L m = [(w (1) , γ (1) ), ..., (w (m) , γ (m) )] with each round consisting of exploration and pruning steps. The goal of the exploration phase is to discover the halfspace with the highest margin on the set of unlabeled samples that are not still pseudo-labeled. This is done by first, learning a halfspace that minimizes the empirical surrogate loss of R D (w) = E (x,y)∼D [ℓ p (y, h w (x))] over a set of labeled and already pseudo-labeled examples S (k) from S ℓ and X u :

min w RS (k) (w) = 1 |S (k) | (x,y)∈S (k) ℓ p (y, h w (x)) (2.3) s.t. ||w|| 2 ≤ 1
At round k = 0, we have S (0) = S ℓ . Once the halfspace with parameters w (k) is found, a threshold γ (k) , defined as the highest unsigned margin in S (k) , is set such that the empirical loss over the set of examples in S (k) with unsigned-margin above γ (k) , is the lowest. In the pseudo-code of the algorithm, S

≥i refers to the subset of examples in S (k) having an unsigned margin greater or equal to ω × i. Unlabeled examples x ∈ X u that are not pseudo-labeled are assigned labels, i.e., y = sign(⟨w (k) , x⟩) iff |⟨w (k) , x⟩| ≥ γ (k) . These pseudo-labeled examples are added to S (k) and removed from X u , and a new halfspace minimizing Eq. (2.3) is found. Examples in S (k) are supposed to be misclassified by the oracle O(f, D x , η (k) ) following Definition 2.1 with the parameter function η (k) that refers to the conditional probability of corruption in k) . Once the halfspace with parameters w (k) and threshold γ (k) are found such that there are no more unlabeled samples having an unsigned-margin larger than γ (k) , the pair (w (k) , γ (k) ) is added to the list L m , and samples from S (k) having an unsignedmargin above γ (k) are removed (pruning phase). Remind that γ (k) is the largest threshold above which the misclassification error over S (k) increases.

S (k) defined as η (k) (x) = P y∼S (k) y (x) [f (x) ̸ = y] ≤ η (
In detail. The self-training algorithm takes as input the labeled set S ℓ , the unlabeled set X u and p, which refers to the number of tests for threshold estimation, set to 5. After finding the weight vector w (k) at round k, with projected SGD (step 5), we order the labeled set S (k) (with S (0) = S ℓ ) by decreasing order of unsignedmargin to w (k) . The threshold γ (k) is defined as the largest margin such that the error of examples in S (k) with an unsigned margin higher than γ (k) increases (step 9). At this stage, observations x ∈ X u with an unsigned margin greater than γ (k)

(step 12 -13) are pseudo-labeled and added to the labeled set S (k) and they are removed from the unlabeled set. This exploration phase of finding a halfspace with the largest threshold γ (k) is repeated until there are no more unlabeled samples with an unsigned margin larger than this threshold. After this phase, the pruning phase begins by removing examples in S (k) with an unsigned margin strictly less than γ (k)

(step 17). The parameters of the halfspace and the corresponding threshold are added to the list of selected classifiers L m , and the procedure is repeated until the size of the labeled set becomes less than ℓ.

To classify an unknown example x, the prediction of the first halfspace with normal vector w (i) in the list L m , such that the unsigned-margin |⟨w (i) , x⟩| of x is higher or equal to the corresponding threshold γ (i) , is returned. By abuse of notation, we note that the prediction for x is L m (x) = h w (i) (x). From Claim 2.2, we know that the misclassification error of this halfspace on the region where x lies is bounded by the optimal misclassification error η * . If no such halfspace exists, the observation is classified using the prediction of the first classifier h w (1) that was trained over all the labeled and the pseudo-labeled samples without pruning; i.e.,

L m (x) = h w (1) (x). L m (x) = h w (i) (x) if ∃i : i = arg min 1≤k≤m:|⟨w (k) ,x⟩|≥γ (k) |⟨w (k) , x⟩| -γ (k) , h w (1) (x) otherwise.

Corruption noise modeling and Generalization guarantees

In the following, we relate the process of pseudo-labeling to the corruption noise model

O(f, D x , η (k)
) for all pseudo-labeling iterations k in Algorithm 1, then we present a bound over the misclassification error of the classifier L m outputted by the algorithm and demonstrate that this misclassification error is upper-bounded by the misclassification error of the fully supervised halfspace.

Claim 2.5. Let S (0) = S ℓ be a labeled set drawn i.i.d. from D = O(f, D x , η (0) ) and

U (0) = X u an initial unlabeled set drawn i.i.d. from D x . For all iterations k ∈ [K] of Algorithm 1; the active labeled set S (k) is drawn i.i.d. from D = O(f, D x , η (k) )
where the corruption noise distribution η (k) is bounded by:

∀k ∈ [K], E x∼Dx [η (k) (x) x ∈ S (k) ] ≤ max j∈[K] η (j)
Proof. We know that ∀k ∈

[K], S (k) ⊆ S (0) ∪ k-1 i=0 S (i) u , where S (i) u is the set of pseudo-labeled pairs of examples x from U (i) , S (i) u = ∅ for the iterations i ∈ [K]
when no examples are pseudo-labeled. Then the noise distribution η (k) satisfies for all k ∈ [K]:

E x∼Dx [η (k) (x)1 x∈S (k) ] = E x∼Dx [η (k) (x)1 x∈S (k) ∩S (0) ] + k-1 i=0 E x∼Dx [η (k) (x)1 x∈S (k) ∩S (i) u ]
If we condition on x ∈ S (k) , we obtain for all k ∈ [K]:

E x∼Dx [η (k) (x) x ∈ S (k) ] = P[x ∈ S (0) x ∈ S (k) ]E x∼Dx [η (0) (x) x ∈ S (k) ∩ S (0) ]+ k-1 i=0 P[x ∈ S (i) u x ∈ S (k) ]E x∼Dx [η w (i) (x) x ∈ S (k) ∩ S (i) u ],
this equation includes the initial corruption of the labeled set S (0) = S ℓ in addition to the noise injected by each classifier h w (k) at each round k when pseudo-labeling occurs. Now that we have modeled the process of pseudo-labeling, the result is straightforward

considering the fact that E x∼Dx [η (0) (x)] ≤ η (0) ; ∀k ∈ [K], E x∼Dx [η w (k) (x)] ≤ η (k)
; and,

P x∼Dx [x ∈ S (0) x ∈ S (k) ] + k-1 i=0 P x∼Dx [x ∈ S (i) u x ∈ S (k) ] = P x∼Dx [x ∈ S (0) ∪ k-1 i=0 S (k) u x ∈ S (k) ] ≤ 1. □
We can now state our main contribution that bounds the generalization error of the classifier L m outputted by Algorithm 1 with respect to the optimal misclassification error η * in the case where projected SGD is used for the minimization of Eq. (2.3).

Note that in this case the time complexity of the algorithm is polynomial with respect to the dimension d, the upper bound on the bit complexity of examples, the total number of iterations, and the upper bound on SGD steps.

Theorem 2.6. Let S ℓ be a set of i.i.d. samples of size ℓ drawn from a distribution

D = O(f, D x , η (0) ) on R d × {-1, +1}
, where f is an unknown concept function and η (0) an unknown parameter function bounded by 1/2, let X u be an unlabeled set of size u drawn i.i.d. from D x . Algorithm 1 terminates after K iterations, and outputs a non-proper classifier L m of m halfspaces such that with high probability:

P (x,y)∼D [L m (x) ̸ = y] ≤ η * + max k∈I ϵ (k) + π K+1 ,
where I is the set of rounds k ∈ [K] at which the halfspaces were added to L m , ϵ (k) is the projected SGD convergence error rate at round k, and π K+1 a negligible not-accounted mass of D x .

The proof of Theorem 2.6 is based on the following property of projected SGD.

Lemma 2.7 (From [START_REF] Duchi | Introductory lectures on stochastic convex optimization[END_REF]). Let R be a convex function of any type. Consider the projected SGD iteration, which starts with w (0) and computes for each step.

w (t+ 1 2 ) = w (t) -α (t) g (t) ; w (t+1) = arg min w:||w|| 2 ≤1 ||w -w (t+ 1 2 ) || 2 . Where g (t) is a stochastic sub- gradient such that E x∼Dx [g(w, x)] ∈ ∂ R(w) = {g : R(w ′ ) ≥ R(w) + ⟨E[g], w ′ - w⟩ for all w ′ } and E x∼Dx [||g(w, x)|| 2 2 ] ≤ M 2 . For any ϵ, δ > 0; if the projected SGD is executed T = Ω(log(1/δ)/ϵ 2 ) times with a step size α (t) = 1 M √ t , then for w = 1 T T t=1 w (t)
, we have with probability at least 1 -δ that:

E x∼Dx [ R( w)] ≤ min w,∥w∥ 2 ≤1 E x∼Dx [ R(w)] + ϵ.
Proof of Theorem 2.6. We consider the steps of Algorithm 1. At iteration k of the while loop, we consider the active training set S (k) consisting of examples not handled in previous iterations.

We first note that the algorithm terminates after at most K iterations. From the fact that at every iteration k, we discard a non-empty set from S (k) when we do not pseudo-label or from U (k) when we pseudo-label, and that the empirical distributions S ℓ and X u are finite sets. By the guarantees of Lemma 2.7, running SGD (step 4) on RS (k) for T = Ω(log(1/δ)/ϵ 2 ) steps, we obtain a weight vector w (k) such that with probability at least 1 -δ:

E x∼Dx [ RS (k) (w (k) )] ≤ min w,∥w∥ 2 ≤1 E x∼Dx [ RS (k) (w)] + ϵ (k) ,
from Claim 2.3, we derive with high probability:

E x∼Dx [|⟨w (k) , x⟩|η w (k) (x)] ≤ min w,∥w∥ 2 ≤1 E x∼Dx [|⟨w, x⟩|η w (x)] + ϵ (k) .
Then the margin γ (k) is estimated minimizing Eq. (2.1) given w (k) , following Lemma 2.4

with

R (k) = max x∼Dx ∥x∥ 2 the radius of the truncated support of the marginal distri- bution D x at iteration k, we can assume that γ (k) R (k) ≈ 1, ∀k ∈ [K]
, one may argue that the assumption is unrealistic knowing that the sequence of (γ (k) ) m k=1 decreases overall, but as we show in the supplementary, we prove in Theorem B.1 that under some convergence guarantees of the pairs {(w (k) , w (k+1) )} m-1 k=1 , one can show that the sequence {R (k) } m k=1 decreases as a function of γ (k) respectively to k. As a result, we can derive with high probability:

E x∼Dx [η w (k) (x) |⟨w (k) , x⟩| ≥ γ (k) ] ≤ min w,∥w∥ 2 ≤1 E x∼Dx [η w (x) |⟨w, x⟩| ≥ γ (k) ] + ϵ (k) .
and the fact that for each round k only points with comparable large margins are considered, we can assume that the conditional covariance for these examples with an unsigned margin greater than γ

(k) satisfy Cov x∼Dx (|⟨w (k) , x⟩|, η w (k) (x)) ≈ Cov x∼Dx (|⟨w * , x⟩|, η w * (x)
), which implies that at round k:

E x∼Dx [η w (k) (x) |⟨w (k) , x⟩| ≥ γ (k) ] -E x∼Dx [η w * (x) |⟨w (k) , x⟩| ≥ γ (k) ] ≤ ϵ (k) where ϵ (k) = 3R (k) 2 √ P (k) E x∼Dx [|⟨w * ,x⟩| |⟨w (k) ,x⟩|≥γ (k) ] , ∀k ∈ [K].
From the statement of Claim 2.2 and giving the pair (w (k) , γ (k) ), we obtain with high probability that at round k:

P (x,y)∼D [h w (k) (x) ̸ = y |⟨w (k) , x⟩| ≥ γ (k) ] ≤ η η η * + ϵ (k) .
(2.4)

When the while loop terminates, we have accounted m ≤ K halfspaces in the list L m satisfying Eq. (2.4). For all k ∈ I, every classifier h w (k) in L m has guarantees on an empirical distribution mass of at least κ = min

k∈I P x∼S (k) [|⟨w (k) , x⟩| ≥ γ (k) ]
; the DKW (Dvoretzky-Kiefer-Wolfowitz) inequality [START_REF] Dvoretzky | Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator[END_REF] implies that the true probability

mass κ = min k∈I P x∼Dx [|⟨w (k) , x⟩| ≥ γ (k) ] of this region is at least κ - log 2 δ 2|S (n) | with probability 1 -δ, where n = arg min k∈I P x∼S (k) [|⟨w (k) , x⟩| ≥ γ (k) ].
The pruning phase in the algorithm ensures that these regions are disjoint for all halfspaces in L m , it follows that using the Boole-Fréchet inequality [START_REF] Boole | An Investigation of the Laws of Thought: On Which Are Founded the Mathematical Theories of Logic and Probabilities[END_REF] on the conjunctions of Eq. (2.4) overall rounds k ∈ [I], implies that L m classifies at least a (1 -mκ)-fraction of the total probability mass of D with guarantees of Eq. (2.4) with high probability, let π K+1 = P x∼Dx [x ∈ S (K+1) ] be the probability mass of the region not accounted by L m . We argue that this region is negligible from the fact that |S (K+1) | < ℓ and ℓ ≪ u, such that setting ϵ = max k∈I ϵ (k) + π K+1 provides the result. □ In the following, we show that the misclassification error of the classifier L m output of Algorithm 1 is at most equal to the error of the supervised classifier obtained over the labeled training set S ℓ , when using the same learning procedure. This result suggests that the use of unlabeled data in Algorithm 1 does not degrade the performance of the initially supervised classifier.

Theorem 2.8. Let S ℓ be a set of i.i.d. samples of size ℓ drawn from a distribution

D = O(f, D x , η (0) ) on R d × {-1, +1}
, where f is an unknown concept function and η (0) an unknown parameter function bounded by 1/2, let X u be an unlabeled set of size u drawn i.i.d. from D x . Let L m be the output of Algorithm 1 on input S ℓ and X u , and let h w (0) be the halfspace of the first iteration obtained from the empirical distribution S (0) = S ℓ , there is a high probability that:

P (x,y)∼D [L m (x) ̸ = y] ≤ P (x,y)∼D [h w (0) (x) ̸ = y]
Proof. By the guarantees of Lemma 2.7, the classifier h w (0) obtained on running SGD on RS (0) with projection to the unit l 2 -ball for P (0) steps satisfies :

E (x,y)∼D [Relu(-y⟨w (0) , x⟩)] -E (x,y)∼D [Relu(-y⟨w * , x⟩)] ≤ 3 max x∈S ℓ ∥x∥ 2 √ P (0)
Let k be the iteration at which the first pair (w (1) , γ (1) ) is added to L m . The first

pruning phase in Algorithm 1 results in a set S (k) ⊆ S ℓ ∪ k-1 i=1 S (i)
u . Claim 2.5 ensures that the probability of corruption in the pseudo-labeled set k-1 i=1 S

(i)

u is bounded by max j∈[k] η (j) ≤ η * + ϵ.
In other words, the weight vector w (1) is obtained from an empirical distribution that includes both the initial labeled set S ℓ and a pseudo-labeled set from X u . Particularly, if this pseudo-labeled set is not empty, then its pseudo-labeling error is nearly optimal, which implies that

P (x,y)∼D [h w (1) (x) ̸ = y] ≤ P (x,y)∼D [h w (0) (x) ̸ = y].
Ultimately, L m classifies a large fraction of the probability mass of D with nearly optimal guarantees (e.i., Eq. (2.4) in proof of Theorem 2.6) and the rest using h w (1) with an error of misclassification at most equal to

P (x,y)∼D [h w (0) (x) ̸ = y].
We show the assumption admitted for the proof of Theorem 4.5 in the following Theorem.

Theorem 2.9. Let S ℓ be a set of i.i.d. samples of size ℓ drawn from a distribution

D = O(f, D x , η (0) ) on B d ×{-1, +1}
, where f is an unknown concept function and η (0) an unknown parameter function bounded by 1/2, let X u be an unlabeled set of size u

drawn i.i.d. from D x , let L m = [(w (i) , γ (i) )] m
i=1 be the outputted list by Algorithm 1 on input S ℓ and X u , and let α (k) be the smallest angle between two consecutive halfspaces

(w (k) , w (k+1) ) in L m for all k ∈ [m -1]. We define (R (k) ) m i=1 the sequence of bounds where each R (k) is the bound of the margin |⟨w (k) , x⟩| over D x when the pair (w (k) , γ (k) )
is obtained, we have for all k in [m]:

R (1) = 1 ; R (k+1) = sin α (k) + arcsin γ (k) if α (k) ∈ 0, arccos γ (k) , 1 otherwise.
Proof. For k = 1, it is trivial to say that R (1) is the upper-bound for the margin distribution of w (1) using Cauchy-Schwarz inequality and given ∥w (1) ∥ 2 ≤ 1. Next, we suppose that the definition is true for k, and we will show in the following that the definition holds for k + 1, for that we will distinguish two different cases:

Case when α (k) ∈ 0, arccos γ (k)

In Figure 2.1, left, we show that if the halfspace with weight vector w (k+1) does not extremely deviates from w (k) , then we can express its upper-bound R (k+1) of the margin distribution on the truncated space of D x as a function of γ (k) and the angle deviation α (k) . Note that if α (k) = 0, then we have that R (k+1) = γ (k) .

Case when α (k) ∈ arccos γ (k) , π 2 In Figure 2.1, right, we show that if the halfspace with weight vector w (k+1) extremely deviates from w (k) , then its upper-bound R (k+1) of the margin distribution on the truncated space of D x is equal to the radius of the unit ball.

w (k) γ (k) γ (k) α (k) w (k+1) R (k+1) w (k) γ (k) γ (k) α (k) w (k+1) R (k+1) Figure 2.1: Case when α (k) ∈ 0, arccos γ (k) (left) and α (k) ∈ arccos γ (k) , π 2 (right) for a pair w (k) , w (k+1) in L m . For a pair (w (k) , γ (k) ) estimated in Algorithm 1 at iteration k ∈ [K], the con- ditional covariance Cov x∼Dx (|⟨w (k) , x⟩|, η w (k) (x) | |⟨w (k) , x⟩| ≥ γ (k) ) for examples in D with an unsigned margin greater or equal than γ (k) to w (k) is comparable to the conditional covariance Cov x∼Dx (|⟨w * , x⟩|, η w * (x) | |⟨w (k) , x⟩| ≥ γ (k) ) for these same examples. Similarly, the unsigned margin average of these examples to w (k) denoted as E x∼Dx (|⟨w (k) , x⟩| | |⟨w (k) , x⟩| ≥ γ (k) ) is also comparable to the unsigned margin average to w * denoted as E x∼Dx (|⟨w * , x⟩| | |⟨w (k) , x⟩| ≥ γ (k) ).
In the following, we relate the process of pseudo-labeling to the corruption noise model O(f, D x , η (k) ) for all pseudo-labeling iterations k in Algorithm 1, then we present a bound over the misclassification error of the classifier L m outputted by the algorithm and demonstrate that this misclassification error is upper-bounded by the misclassification error of the fully supervised halfspace.

Claim 2.10. Let S (0) = S ℓ be a labeled set drawn i.i.d. from D = O(f, D x , η (0) ) and

U (0) = X u an initial unlabeled set drawn i.i.d. from D x . For all iterations k ∈ [K] of Algorithm 1; the active labeled set S (k) is drawn i.i.d. from D = O(f, D x , η (k) )
where the corruption noise distribution η (k) is bounded by:

∀k ∈ [K], E x∼Dx [η (k) (x) x ∈ S (k) ] ≤ max j∈[K] η (j) Proof. We know that ∀k ∈ [K], S (k) ⊆ S (0) ∪ k-1 i=0 S (i) u , where S (i) u is the set of pseudo-labeled pairs of examples x from U (i) , S (i) u = ∅ for the iterations i ∈ [K]
when no examples are pseudo-labeled. Then the noise distribution η (k) satisfies for all k ∈ [K]:

E x∼Dx [η (k) (x)1 x∈S (k) ] = E x∼Dx [η (k) (x)1 x∈S (k) ∩S (0) ] + k-1 i=0 E x∼Dx [η (k) (x)1 x∈S (k) ∩S (i) u ] = P x∼Dx [x ∈ S (k) ∩ S (0) ]E x∼Dx [η (0) (x) x ∈ S (k) ∩ S (0) ]+ k-1 i=1 P x∼Dx [x ∈ S (k) ∩ S (i) u ]E x∼Dx [η w (i) (x) x ∈ S (k) ∩ S (i) u ]
If we condition on x ∈ S (k) , we obtain for all k ∈ [K]:

E x∼Dx [η (k) (x) x ∈ S (k) ] = P[x ∈ S (0) x ∈ S (k) ]E x∼Dx [η (0) (x) x ∈ S (k) ∩ S (0) ]+ k-1 i=0 P[x ∈ S (i) u x ∈ S (k) ]E x∼Dx [η w (i) (x) x ∈ S (k) ∩ S (i) u ],
this equation includes the initial corruption of the labeled set S (0) = S ℓ in addition to the noise injected by each classifier h w (k) at each round k when pseudo-labeling occurs. Now that we have modeled the process of pseudo-labeling, the result is straightforward k) ; and,

considering the fact that E x∼Dx [η (0) (x)] ≤ η (0) ; ∀k ∈ [K], E x∼Dx [η w (k) (x)] ≤ η (
P x∼Dx [x ∈ S (0) x ∈ S (k) ]+ k-1 i=0 P x∼Dx [x ∈ S (i) u x ∈ S (k) ] = P x∼Dx [x ∈ S (0) ∪ k-1 i=0 S (k) u x ∈ S (k) ] ≤ 1. □

Empirical Results

We compare the proposed approach to state-of-the-art strategies developed over the three fundamental working assumptions in semi-supervised learning over ten publicly available datasets. We shall now describe the corpora and methodology.

Datasets. We mainly consider benchmark data sets from [START_REF] Chapelle | Semi-Supervised Learning[END_REF]. Some of these collections such as baseball-hockey, pc-mac and religion-atheism are binary classification tasks extracted from the 20-newsgroups data set. We used tf-idf representation for all textual data sets above. spambase is a collection of spam e-mails from the UCI repository [START_REF] Dua | UCI machine learning repository[END_REF]. one-two, odd-even are handwritten digits recognition tasks originally from optical recognition of handwritten digits database also from UCI repository, one-two is digits "1" versus "2"; odd-even is the artificial task of classifying odd "1, 3, 5, 7, 9" versus even "0, 2, 4, 6, 8" digits.

weather is a data set from Kaggle which contains about ten years of daily weather observations from many locations across Australia, and the objective is to classify the next-day rain target variable. We have also included data sets from extreme classification repository [START_REF] Bhatia | The extreme classification repository: Multi-label datasets and code[END_REF] mediamill2 and delicious2 by selecting the label which gives the best ratio in class distribution. The statistics of these data sets are given in Table 2.1.

Baseline methods. We implemented the halfspace or Linear Threshold Function (LTF) using TensorFlow 2.0 in python aside from Algorithm 11 (L m ), we ran a Support Vector Machine (SVM) [START_REF] Cortes | Support-vector networks[END_REF] with a linear kernel from the LIBLINEAR library [START_REF] Fan | Liblinear: A library for large linear classification[END_REF] as another supervised classifier. We compared results with a semi-supervised Gaussian naive Bayes model (GM) [START_REF] Chapelle | Semi-Supervised Learning[END_REF] from the scikit-learn library. The working hypothesis behind (GM) is the cluster assumption stipulating that data contains homogeneous labeled clusters, which can be detected using unlabeled training samples.

We also compared results with label propagation (LP) [131] which is a semi-supervised graph-based technique. We used the implementation of LP from the scikit-learn library. This approach follows the manifold assumption that the decision boundary is located on a low-dimensional manifold and that unlabeled data may be utilized to identify it. We also included entropy regularized logistic regression (ERLR) proposed by [START_REF] Grandvalet | Semi-supervised learning by entropy minimization[END_REF] from [START_REF] Krijthe | Rssl: Semi-supervised learning in r[END_REF]. This approach is based on low-density separation that stipulates that the decision boundary lies on low-density regions. In the implementation of [START_REF] Krijthe | Rssl: Semi-supervised learning in r[END_REF], the initially supervised classifier is a logistic regression that has a similar performance to the SVM classifier. We tested these approaches with relatively small labeled training sets ℓ ∈ {10, 50, 100}, and because labeled information is scarce, we used the default hyper-parameters for all approaches.

Experimental setup. algorithms exhibiting the generalization ability of the method can provide a better understanding of the usefulness of unlabeled training data in the learning process.

Conclusion

In this chapter, we presented a first bound over the misclassification error of a selftraining algorithm that iteratively finds a list of halfspaces from partially labeled training data. Each round consists of two steps: exploration and pruning. The exploration phase aims to determine the halfspace with the largest margin and assign pseudo-labels to unlabeled observations with an unsigned margin larger than the discovered threshold. The pseudo-labeled instances are then added to the training set, and the procedure is repeated until there are no more unlabeled instances to pseudolabel. In the pruning phase, the last halfspace with the largest threshold is preserved, ensuring that there are no more unlabeled samples with an unsigned margin greater than this threshold and pseudo-labeled samples with an unsigned margin greater than the specified threshold are removed. Our findings are based on recent theoretical advances in robust supervised learning of polynomial algorithms for training halfspaces under large margin assumptions with a corrupted label distribution using the Massart noise model. We ultimately show that the use of unlabeled data in the proposed self-training algorithm does not degrade the performance of the initially supervised classifier. As future work, we are interested in quantifying the real gain of learning with unlabeled and labeled training data compared to a fully supervised scheme.

Chapter 3

Pool-Based Active Learning with Proper Topological Regions

Pool-based active learning methods are one of the most promising paradigms of active learning in solving the problem of annotation efficiency. One of the main criticism of these approaches is that they are supposed to operate under low-budget regimes where they can have an advantage over semi-supervised or self-supervised methods.

However, most of these approaches rely on the underlying trained estimator accuracy, which often has a higher sample complexity than the low-budget regime scenario.

Secondly, they commonly share the initial training set selection drawback, namely the cold-start problem. This chapter presents a meta-approach for pool-based active learning strategies in the context of multi-class classification tasks. Our approach relies on the proposed concept of learning on proper topological regions with an underlying smoothness assumption on the metric space. This allows us to increase the training sample size during the rounds while operating in a low-budget regime scenario. We show empirically on various real benchmark datasets that our approach dramatically improves the performance of uncertainty-based sampling strategies over the random selection, not only for the cold-start problem but overall the iterations in a low-budget regime. Furthermore, comparisons on the same benchmarks show that the performance of our approach is competitive to the state-of-the-art methods from the literature that address the cold-start problem in active learning. This chapter is based on the following paper [HDMA22].

Introduction

In recent years, machine learning has found gainful application in diverse domains.

However, it still has a heavy dependence on expensive labeled data: advances in cheap computing and storage have made it easier to store and process large amounts of unlabeled data, but labeling needs often to be done by humans or using costly tools. Therefore, there is a need to develop general domain-independent methods to learn models effectively from a large amount of unlabeled data at the disposal, along with a minimal amount of labeled data. Active learning specifically aims to detect the observations to be labeled to optimize the learning process and efficiently reduce the labeling cost. In this setting, learning occurs iteratively. At each round, the algorithms can interactively query a ground truth oracle to label unlabeled examples.

Then, after training, the algorithms proactively select the subset of examples to be labeled next from the pool of unlabeled data. The primary assumption behind the active learner algorithm concept is that machine learning algorithms could reach a higher level of performance while using a smaller number of training labels if they were allowed to choose the training data set [START_REF] Settles | Active learning literature survey[END_REF]. Most common and straightforward active learning approaches are iterative, also known as pool-based methods [START_REF] Lewis | Heterogeneous uncertainty sampling for supervised learning[END_REF][START_REF] Cohn | Improving generalization with active learning[END_REF],

where we first derive a model trained on a small random labeled subsample. Then, at each iteration, we choose unlabeled examples to query based on the predictions of the current model and a predefined priority score. These approaches show their limitations in low-budget regime scenarios from their need for a sufficient budget to learn a weak model [START_REF] Pourahmadi | A simple baseline for low-budget active learning[END_REF]. The literature has shown that for active learning to operate in a low-budget regime successfully, we need to introduce a form of regularization in training [START_REF] Guyon | Results of the active learning challenge[END_REF] usually found in other sub-domains, such as semi-supervised learning or self-learning [START_REF] Chapelle | Semi-Supervised Learning[END_REF]. Another line of work shows that the choice of the initial seed set in these approaches significantly impacts the end performance of their models [START_REF] Hu | Off to a good start: Using clustering to select the initial training set in active learning[END_REF][START_REF] Chen | Making your first choice: To address cold start problem in vision active learning[END_REF], also known as the cold-start problem in active learning. Our work is a step further in this direction. We propose a unified meta-approach for pool-based active learning methods to efficiently resolve these previously mentioned drawbacks and to enhance even further the performance of these methods while reducing the amount of queried examples.

Topological data analysis (TDA) [START_REF] Edelsbrunner | Computational Topology -an Introduction[END_REF][START_REF] Adams | Persistence images: A stable vector representation of persistent homology[END_REF] has been successful in various fields [START_REF] Xia | Persistent homology analysis of protein structure, flexibility, and folding[END_REF][START_REF] Rieck | Uncovering the topology of time-varying fmri data using cubical persistence[END_REF][START_REF] Jiang | Topological representations of crystalline compounds for the machine-learning prediction of materials properties[END_REF][START_REF] Aditi | Machine learning with persistent homology and chemical word embeddings improves prediction accuracy and interpretability in metalorganic frameworks[END_REF], including machine learning. A critical insight in TDA, a widely accepted assumption, is that data sets often have nontrivial topologies that should be exploited in their analysis [START_REF] Carlsson | The Shape of Data[END_REF]. TDA provides mathematically well-founded and flexible tools based on the algebraic topology to recover topological information from data to get insights from this hidden information. Many of these tools use persistent homology which allows studying the underlying topological information of a wide variety data types, even in high-dimension. To understand the underlying topology, we can construct Vietoris-Rips complexes [START_REF] Hausmann | On the Vietoris-Rips complexes and a cohomology theory for metric spaces[END_REF] from the data which are then inspected through persistent homology, topological information is then encoded with persistence modules and diagrams [START_REF] Edelsbrunner | Topological persistence and simplification[END_REF]. These topological insights can then be exploited to enhance the study of the structure of the data [START_REF] Singh | Topological methods for the analysis of high dimensional data sets and 3d object recognition[END_REF][START_REF] Lum | Extracting insights from the shape of complex data using topology[END_REF][START_REF] Carlsson | Topological approaches to deep learning[END_REF].

Related literature

Different attempts have been made to reduce the annotation burden of machine learning algorithms. We can refer to the remarkable advances made in semi-supervised learning [131, [START_REF] Grandvalet | Semi-supervised learning by entropy minimization[END_REF][START_REF] Belkin | Manifold regularization: A geometric framework for learning from labeled and unlabeled examples[END_REF][START_REF] Amini | Learning with Partially Labeled and Interdependent Data[END_REF][START_REF] Zhang | mixup: Beyond empirical risk minimization[END_REF][START_REF] Berthelot | Mixmatch: A holistic approach to semi-supervised learning[END_REF], these methods take as input a small set of labeled training data together with a large number of unlabeled examples. They introduce a form of consistency regularization to the supervised loss function by applying data augmentation using unlabeled observations [START_REF] Chapelle | Semi-Supervised Learning[END_REF]. Similarly, pool-based active learning methods also take as input a large number of unlabeled examples together with an expert in which they iteratively query to annotate data samples in order to maximize the model knowledge while minimizing the number of queries. Most commonly known pool-based strategies are uncertainty sampling [START_REF] Lewis | Heterogeneous uncertainty sampling for supervised learning[END_REF]129], margin sampling and entropy sampling strategies [START_REF] Settles | Active learning literature survey[END_REF]. Some proposed strategies rely on the query-by-committee approach [128, 120, 78], which learns an ensemble of models at each round. Query by bagging and query by boosting are two practical implementations of this approach that use bagging and boosting to build the committees [START_REF] Abe | Query learning strategies using boosting and bagging[END_REF]. There has been exhaustive research on how to derive efficient disagreement measures and query strategies from a committee, including vote entropy, consensus entropy, and maximum disagreement [START_REF] Settles | Active learning literature survey[END_REF], whereas [START_REF] Ali | Active learning with model selection[END_REF] introduces model selection for a committee. Some research focuses on solving a derived optimization problem for optimal query selection, in [START_REF] Roy | Toward optimal active learning through sampling estimation of error reduction[END_REF] they use Monte Carlo estimation of the expected error reduction on test examples. In contrast, other strategies employ Bayesian optimization on acquisition functions such as the probability of improvement or the expected improvement [START_REF] Garnett | Bayesian Optimization[END_REF], and in [START_REF] Auer | Finite-time analysis of the multiarmed bandit problem[END_REF], the authors propose to cast the problem of selecting the most relevant active learning criterion as an instance of the multi-armed bandit problem. Aside from the pool-based setting, we also find the stream-based setting for active learning in the literature [START_REF] Lughofer | Single-pass active learning with conflict and ignorance[END_REF][START_REF] Baram | Online choice of active learning algorithms[END_REF]. In this case, the learner has no access to any unlabeled examples. Instead, each unlabeled sample is given to him individually, and he queries its label if he finds it helpful. For instance, an example can be marked as valuable if the prediction is uncertain, and acquiring its label would remove this uncertainty.

Recent advances in active learning propose enhancing the pool-based methods by extracting knowledge from the distribution of unlabeled examples [START_REF] Bonnin | A cluster-based strategy for active learning of rgb-d object detectors[END_REF]. [START_REF] Perez | Cluster-based active learning[END_REF] propose to use clustering of unlabeled examples to boost the performance of pool-based active learners, with the expert annotating at each iteration cluster rather than single examples. Such strategy allows to reduce the annotation effort under the assumption that the cost of cluster annotation is comparable to single example labeling.

Similarly, [START_REF] Krempl | Clustering-based optimised probabilistic active learning (copal)[END_REF][START_REF] Krempl | Optimised probabilistic active learning (opal)[END_REF] propose to combine clustering with Bayesian optimization in the stream-based setting. In [START_REF] Urner | Plal: Cluster-based active learning[END_REF]authors propose a procedure for binary domain feature sets to recover the labeling of a set of examples while minimizing the number of queries. They show that this routine reduces label complexity for training learners, [START_REF] Yu | Active learning based constrained clustering for speaker diarization[END_REF] propose a two-stage clustering constraint in the active learning algorithm, a first exploration phase to discover representative clusters of all classes, and a postclustering reassignment phase where the learner is constrained on the initial clusters found at the first stage. Finally, unsupervised algorithms such as clustering showed promising results for addressing the cold-start problem in pool-based active learning strategies [START_REF] Hu | Off to a good start: Using clustering to select the initial training set in active learning[END_REF][START_REF] Chen | Making your first choice: To address cold start problem in vision active learning[END_REF].

The meta-method that we propose for pool-based active learning relies on notions from topological data analysis (TDA), which has recently brought exciting new ideas to the machine learning community. Primarily, topological clustering has been used in unsupervised learning [START_REF] Bonis | A fuzzy clustering algorithm for the modeseeking framework[END_REF][START_REF] Cabanes | A new topological clustering algorithm for interval data[END_REF]. Among these studies, ToMATo [START_REF] Frederic | Persistence-based clustering in riemannian manifolds[END_REF] is a mode-seeking clustering algorithm with a cluster merging phase guided by topological persistence [START_REF] Polterovich | Topological Persistence in Geometry and Analysis[END_REF].

Framework and topological considerations

Framework and notations

We consider multi-class classification problems such that the input space X is a subset of R m , the output space Y = {1, . . . , c} is a set of unknown classes of cardinal c ∈ N, c ≥ 2, the pair (X , d) is a metric space, and d : X ×X → [0, ∞) is a fixed and known distance metric. Let S = {(x i , y i )} n i=1 be the data sample of size n generated by some unknown distribution over X × Y with unknown labels y i , and let P be the unknown marginal distribution over X . An active learner will have access to the unlabeled sample set S x = {x i } n i=1 and the conditional concept function O : X → Y. We denote C R : {1, . . . , n} → {1, . . . , k} the partition function induced by a graph R = (S x , E) of

k connected components with k ∈ N * , where C R (x i ) = {∀x j ∈ S x , C R (i) = C R (j)} is
the connected component of graph R that includes the node x i . For all i ∈ {1, . . . , n}, we define C P R : S x → Y as the labeling function that propagates the label of the sample with the highest density in the connected component C R (x i ) to all the examples of the same connected component in graph R :

C P R (x i ) = O arg max x j ∈C R (x i ) P(x j ) , ∀i ∈ {1, . . . , n}, note that C P R (.
) is a crucial notion in our proposed meta-approach to allow pool-based active learning strategies to operate in a low-budget regime.

Definition 3.1 (Rips graph). Given a finite point cloud S x = {x i } n i=1 from a metric space (X , d) and a real number δ ≥ 0, the Rips graph R δ (S x ) is the graph of vertex set S x whose edges correspond to the pairs of points x i , x j ∈ S x such that d(x i , x j ) ≤ δ:

R δ (S x ) = (V, E) : V = S x , E = {(x i , x j ) ∈ V 2 , i ̸ = j, d(x i , x j ) < δ}, let the hypothesis class of Rips graphs over S x be H R = {R δ (S x ), ∀δ ∈ R + }. Definition 3.2 (σ-Rips graph). Given a finite point cloud S x = {x i } n i=1 from a metric space (X , d), a real-valued function σ δ : X 2 → R * + with parameters δ, the σ-Rips graph R σ δ (S x
) is the graph of vertex set S x whose edges correspond to the pairs of points

x i , x j ∈ S x such that d(x i , x j ) ≤ σ δ (x i , x j ): R σ δ (S x ) = (V, E) : V = S x , E = {(x i , x j ) ∈ V 2 , i ̸ = j, d(x i , x j ) < σ δ (x i , x j )},
let the hypothesis class of σ-Rips graphs over S x be H R σ = {R σ δ (S x ), ∀δ ∈ dom(σ)}. Classification algorithms in machine learning generally assume (often implicitly) that close samples in the considered metric space (X , d) are associated with similar labels, also known as the smoothness assumption. Given a data sample S, the Rips graph R δ (S x ) encodes this notion to some extent with an appropriate threshold δ.

However, class similarity might be different over the metric space. For example, samples in high-density regions should be closer to being associated with similar labels than those in low-density regions. Consequently, we need to generalize the definition of the Rips graph to account for such cases, namely the σ-Rips graph R σ δ (S x ) with an appropriate threshold function σ δ , and parameters δ. In this work, we choose the following threshold function:

σ (a,r,t) : X × X -→ R * + (x, x ′ ) -→ a(r -max (P(x), P(x ′ ))) 1 t , (3.1)
with t ∈ (0, 1], and a, r ∈ R * + such that r > max x P(x), note that the Rips graph is a special case of the σ-Rips graph when σ δ is a constant function. Next, we compare the persistence between the Rips and the σ-Rips graphs.

Persistence on superlevel sets

We refer to [START_REF] Edelsbrunner | Computational Topology -an Introduction[END_REF] for an introduction to topological persistence and its applications.

Let X be a Riemannian manifold, and P be a K-Lipschitz-continuous probability density function with respect to the Hausdorff measure for a real constant K ≥ 0.

A persistence module is a sequence of vector spaces X = (X α ) α∈R where R = R ∪ {-∞, +∞} together with linear maps X β → X α whenever α ≤ β (setting X α → X α as the identity). The persistence diagram DX of this persistence module is then a multi-set of points in R 2 containing the diagonal ∆ = {(x, x) | x ∈ R} and points (i, j) corresponding to the lifespan of some generator appearing at time i and dying at time j < i (here, according to the way our spaces are connected, we see alpha starting from +∞ and at -∞). The multiplicity of a point of D 0 X is +∞ for the points of ∆, and a finite alternating sums of ranks of composed linear maps (see for example [133] for more details).

Persistence is often used with homology, and we refer the reader to [START_REF] Hatcher | Algebraic topology[END_REF] for more details. Here we will only use the 0-dimensional homology, which detects connected components. More precisely, if X is a topological space or a graph, H 0 (X) will be the vector space spanned by the (path) connected components of X. Moreover, if g : X → Y is a continuous map between spaces or a graph homomorphism between graphs, it induces a natural linear application f * : H 0 (X) → H 0 (Y ). Let us now look at meaningful examples for the rest of the chapter. The first is the 0dimensional persistence homology induced by P. More precisely, for α ∈ R, we set

F α = P -1 ([α, +∞]
). If α ≤ β are two reals, then there is an inclusion F β ⊆ F α , and this induces linear maps H 0 (F β ) → H 0 (F α ). We will denote by D 0 P the corresponding persistence diagram (the 0 is there to remind us that we are working with the 0-dimensional homology). Another persistence diagram we will consider is the one induced by the Rips graph.

Definition 3.3 (upper-star Rips filtration). Given a finite point cloud S x from a metric space (X , d) with the probability density function P, a real value δ ∈ R + , The upper-star Rips filtration of P, denoted R δ (S x , P), is the nested family of subgraphs of the Rips graph R δ (S x ) defined as R δ (S x , P) = (R δ (S x ∩ P -1 ([α, +∞])) α∈R .

Such a nested family of graphs give rise to, after applying the 0-dimensional homology, a persistent module R δ (S x , P) and a persistence diagram D 0 R δ (S x , P). A word of caution might be necessary. Technical difficulties can occur when there are infinitely many points (counted with multiplicity) away from the diagonal in a persistent diagram. Fortunately, with an upper-star Rips filtration, it is not an issue if the point cloud S x is finite since only a finite number of changes appear in the nested family of graphs. When considering the persistence diagram D 0 P induced by a function P which is continuous, one can for example require that P has finitely many critical points to avoid problems. The bottleneck distance is an effective and natural proximity measure for these objects to compare persistence diagrams:

Definition 3.4 (bottleneck distance). Given two multi-subsets A 1 , A 2 of R2 , a multibijection γ between A 1 and A 2 is a bijection:

γ : p∈|A 1 | ⨿ µ(p) i=1 p → q∈|A 2 | ⨿ µ(q) i=1 q,
where, for i ∈ {1, 2}, |A i | denotes the support of A i and µ(p) denotes the multiplicities

of point p ∈ |A i |. The bottleneck distance d ∞ B (A 1 , A 2 ) between A 1 and A 2 is the quantity: d ∞ B (A 1 , A 2 ) = min γ max p∈A 1 ∥p -γ(p)∥ ∞
To show that two persistence diagrams are close to one another with respect to the bottleneck distance, one can use the following notion introduced in [START_REF] Chazal | Proximity of persistence modules and their diagrams[END_REF]. Definition 3.5 (ε-interleaved). Let X = (X α ) α∈R and Y = (Y α ) α∈R be two persistence modules and let D 0 X and D 0 Y be there associated persistence diagrams. We say that X and Y are strongly ε-interleaved if there exists two families of linear application {φ α : X α → Y α-ε } α∈R and {ψ α : Y α → X α-ε } α∈R , such that for all α, β ∈ R, if α ≤ β, then the following diagrams, whenever they make sens, are commutative:

X β+ε G G φ β+ε × × X α-ε Y β G G Y α ψα X β G G φ β × × X α φα × × Y β-ε G G Y α-ε X β G G X α φα × × Y β+ε ψ β+ε G G Y α-ε X β-ε G G X α-ε Y β G G ψ β Y α ψα
The idea behind these diagrams is that every component appearing (resp. dying) in X at some time α must appear (resp. die) in Y within [α -ε, α +ε], and vice-versa.

The following lemma highlights how important this notion is. Lemma 3.1. Let X and Y be two persistence modules such that D 0 X and D 0 Y have only finitely many points away from the diagonal, and let ε > 0. If X and Y are strongly ε-interleaved, then D 0 X and D 0 Y are at a distance at most ε with respect to the bottleneck distance.

Proof. This is a direct consequence of [START_REF] Chazal | Proximity of persistence modules and their diagrams[END_REF]Theorem 4.4] where the result is proven for every homological dimension.

For example, in [START_REF] Chazal | Scalar field analysis over point cloud data[END_REF]Theorem 5], it is proven that given the density function P on a point cloud S x with sufficient sampling density, the persistence diagram D 0 R δ (S x , P) built upon the Rips graph R δ (S x ) with an appropriate δ is a good approximation of D 0 P the persistence diagram of P. Consequently, D 0 R δ (S x , P) encodes the 0th homology groups of the underlying space of S x , this is a crucial ingredient in the proof of the theoretical guarantees of ToMATo.

Persistence of Rips graph and σ-Rips graph

ToMATo is a clustering method that uses the hill climbing algorithm on the Rips graph along with a merging rule on the Rips graph's persistence, it comes with theoretical guarantees under the manifold assumption, we would like to derive similar guarantees for our proposed approach. As previously mentioned, ToMATo guarantees are deduced from a careful comparison (with respect to the bottleneck distance) between D 0 P and D 0 R δ (S x , P), one way to get similar guarantees for our procedure is to control the bottleneck distance between D 0 R δ (S x , P) and the persistence diagram of the σ-Rips graph. To do so, we need to introduce the following. Lemma 3.2. Given a finite point cloud S x from a metric space (X , d), for all σ-Rips graphs R σ δ (S x ) with real-valued function σ δ : X 2 → R * + and parameters δ, there exist a non-metric space (X , d) such that R σ δ (S x ) is the Rips graph R 1 (S x ).

Proof. The proof is trivial by the following definition of d:

d : X × X -→ R + (x, x ′ ) -→ d(x, x ′ ) σ δ (x, x ′ ) .
Given a graph R(S x ), we will denote by P R (x i , x j ) the set of all paths in R(S x ) from the vertex x i to the vertex x j , where a path p is a sequence of vertices of R(S x )

where two consecutive vertices of p are adjacent in R(S x ).

Definition 3.6 (appearance level). Given a finite point cloud S x = {x i } n i=1 from a metric space (X , d) with the probability density function P, and a graph R(S x ). We define f R (x i , x j ) as the level α at which the first connection between the vertices x i , x j appearances in the upper-star Rips filtration R δ (S x , P), ∀i, j ∈ {1, . . . , n}, i ̸ = j:

f R (x i , x j ) = max p∈P R (x i ,x j ) min x∈p P(x) if P R (x i , x j ) ̸ = ∅, 0
otherwise. Now we can for example prove that the persistent module R δ (S x , P) of the Rips graph R δ (S x ) over the metric space (X , d) and the persistent module R 1 (S x , P) of the σ-Rips graph R σ δ (S x ) over the non-metric space (X , d) of Lemma 3.2 are ϵ-interleaved.

Theorem 3.3. Given a finite point cloud S x = {x i } n i=1 from a metric space (X , d) with the probability density function P. Let the Rips graph R δ ′ (S x ) with parameter δ ′ , and the σ-Rips graph R σ δ (S x ) with a threshold function σ of parameter set δ.

Let denote by R = R δ ′ (S x , P), R σ = R 1 (S x , P), R = R δ ′ (S x ), and R σ = R σ δ (S x ). For α ∈ R, we set: R α = R δ ′ S x ∩ P -1 ([α, +∞]) and R σ α = R σ δ S x ∩ P -1 ([α, +∞]) .
Concretely, for all i, j ∈ {1, . . . , n} such that i ̸ = j, x i and x j appear in R and R σ at α = P(x i ) and P(x j ), respectively. They are then merged in R, resp. R σ , at α = f R (x i , x j ), resp. α = f R σ (x i , x j ). Finally, by choosing ε as ε = max x i ,x j ∈Sxi̸ =j |f R (x i , x j )-f R σ (x i , x j )|, we have that R and R σ are strongly ε-interleaved.

Proof. For α ∈ R, let C 1 , . . . , C k be the connected components of R α . For every i ∈ {1, . . . , k}, and each vertices x, x ′ ∈ C i , we have that f Rα (x, x ′ ) ≥ α and thus, by

definition of ε, f R σ α (x, x ′ ) ≥ α -ε. Hence C i is contained in a connected component of R σ α-ε .
This gives a linear map:

φ α : H 0 (R α ) → H 0 (R σ α-ε ).
By a similar argument, we get a linear map:

ψ α : H 0 (R σ α ) → H 0 (R σ α-ε ).
By construction, the following diagrams are commutative (inclusions on connected components induce the linear maps involved).

H 0 (R β+ε ) G G φ β+ε × × H 0 (R α-ε ) H 0 (R σ β ) G G H 0 (R σ α ) ψα H 0 (R β ) G G φ β × × H 0 (R α ) φα × × H 0 (R σ β-ε ) G G H 0 (R σ α-ε ) H 0 (R β ) G G H 0 (R α ) φα × × H 0 (R σ β+ε ) ψ β+ε G G H 0 (R σ α-ε ) H 0 (R β-ε ) G G H 0 (R α-ε ) H 0 (R σ β ) G G ψ β H 0 (R σ α )
ψα Consequently, R and R σ are strongly ε-interleaved.

In other words, when switching from the metric distance d to the non-metric distance d, if the dendrogram induced by the upper star Rips graph is mostly the same during the persistence process, our procedure enjoys the same theoretical guarantees as the ToMATo method.

Learning with proper topological regions

In the following, we will first clarify our proposed notion of proper topological regions in the context of our framework, and then derive our meta-approach for pool-based active learning strategies.

Proper topological regions

The proper topological regions of a sample set S = {(x i , y i )} n i=1 is the σ-Rips graph R σ δ * (S x ), with an appropriate threshold function σ, resulting from solving the following optimization problem:

minimize R∈H R σ PuritySize(R σ δ (S x )) = k n + 1 n n i=1 1 C P R (x i )̸ =y i ∈ [0, 1] subject to d ∞ B (R σ , D 0 P) ≤ ε. (3.2)
Similarly, we can define the optimal Rips graph R δ * (S x ) that encodes the proper topological regions of S. The PuritySize is an objective function that penalizes the labeling error when propagating the labels inside the connected components of the graph with C P R , and the coverage with k, the number of connected components in the graph R. However, there is a need to derive an unsupervised objective function in the context of our approach. To this end, we empirically investigated the following score functions, typically used to assess clustering quality. For a given graph R(S x ), let C 1 , . . . , C k be the connected components of this graph,

µ i = 1 |C i | x∈C i x,
S ch (R(S x )) = (n -k)B (k -1) k i=1 W i ∈ [0, +∞), with B = k i=1 |C i |∥µ i -µ∥ 2
is the inter-group variance, and W i = x∈C i ∥xµ i ∥ 2 is the intra-group variance, for all i ∈ {1, . . . , k}. It translates that good partitioning should maximize the average inter-group variance and minimize the average intra-group variance; some well known clustering algorithms, such as K-means [START_REF] Lloyd | Least squares quantization in pcm[END_REF], maximize this criterion by construction.

Davies-Bouldin score

S db (R(S x )) = 1 k k i=1 max j̸ =i δi + δj d(µ i , µ j ) ∈ (+∞, 0], with δi = 1 |C i | x∈C i d(x, µ i )
is the average distance of all samples in the group to their mean-sample group, for all i ∈ {1, . . . , n}.

Dunn score

S d (R(S x )) = min i,j d(µ i , µ j ) max i ∆ i ∈ [0, +∞), with ∆ i = max x,x ′ ∈C i d(x, x ′
) being the diameter of group C i , similar to the Calinski-Harbasz score, we aim to maximize the minimum distance between the meansample groups and minimize the maximum group diameter.

Silhouette score

S sil (R(S x )) = 1 k k i=1 1 |C i | x∈C i s il (x) ∈ [-1, 1],
this score affects s il (x) = b(x)-a(x) max(a(x),b(x)) , the silhouette coefficient to every sample, with a(x) = x ′ ∈C j d(x, x ′ ) being the average distance of sample x to his neighbor group.

1 |C R (x)|-1 x ′ ∈C R (x),x̸ =x ′ d(x, x ′ )
We observed promising empirical evidence that the Silhouette score is the best candidate among the above scores to substitute the propagation error term in the PuritySize cost function in (3.2). Therefore, we define the unsupervised cost function SilSize(R, S x ) that we use in solving the unsupervised setting of problem (3.2).

SilSize α (R(S x )) = S Sil (R(S x )) -α k n , with α ∈ R + . (3.3)
Given our choice of the threshold function σ δ in (3.1), and the new objective function (3.3), our problem (3.2) becomes:

maximize δ=(a,r,t)∈dom(σ) SilSize α (R σ δ (S x )) = S Sil (R σ δ (S x )) -α k n ∈ -1 -α, 1 - α n subject to d ∞ B (R σ , D 0 P) ≤ ε.
(3.4) Theorem 3.3 tells us that one way to ensure the bottleneck constraint in (3.4) is to apply the same post-processing phase used in the ToMATo algorithm on the σ-Rips graph. It consists of applying a merging rule along the hill-climbing method on the graph with P. This merging rule compares the topological persistence of groups to an additional merging parameter τ ∈ [0, max x∈Sx P(x)] [START_REF] Frederic | Persistence-based clustering in riemannian manifolds[END_REF]. We will refer to this procedure as ToMATo τ (R(S x ), P), which returns the partition function C R that encodes the proper topological regions of S x . We describe in Algorithm 2 a two-stage black-box optimization scheme to uncover the σ-graph parameters δ, and the merging parameter τ , solution to our optimization problem 3.4, for the proper topological regions of S.

Algorithm 2 Optimization procedure for PTR Require: S x := {x i } n i=1 , d : X × X → [0, ∞), s the step size for the linear search, and l the number of trials for the optimization strategy. 1: Set α = s. 2: Compute density estimator P with (3.5). 3: Optimize the unconstrained problem (3.4) for l trials, and return δ = (ã, r, t). 4: Build the σ-Rips graph R σ δ (S x ). 5: while R σ δ (S x ) is not a degenerate graph do 6:

Save the current graph parameters δ.

7:

Update α ←-α + s.

8:

Optimize the unconstrained problem (3.4) for l trials.

9:

Build the σ-Rips graph R σ δ (S x ), with new parameters δ. 10: end while 11: Update α ←-α -s. 12: Optimize problem (3.4) with ToMATo τ (R σ δ (S x ), P) for l trials, on merging parameter τ , given the fixed parameters δ of line 6, and return τ . 13: Output : parameters δ = (ã, r, t), and τ .

Remark 1. Note that the trade-off parameter α in (3.3) is key in uncovering the proper topological regions of the sample set S. Higher α values penalize the coverage compactness, resulting in partitions with a high degree of agglomeration, meaning fewer groups with large cardinals, which is typically the case in clustering methods, for example. However, an additional way to control the labeling propagation error term of the PuritySize objective in an unsupervised setting is to control the size distribution of groups in the resulting partition. Put differently, minimizing the group size is an excellent proxy for minimizing the labeling propagation error. Inversely, lower α values results in highly fragmented partitions with many groups with small cardinals, such setting is sub-optimal to our purpose of increasing the training sample size, additionally, the Silhouette is a score metric used to evaluate clustering quality and defined for non-singleton groups. Using it solely as an objective function in (3.4) often converges to graphs with a single non-singleton connected component. Accordingly, there should be a middle ground for α values that we find with a line search method and a stopping criterion on the size distribution of groups. We will clarify other technical details and choices in the next subsection. Train the learning agent h st (S i , B).

7:

Ask a set S r from h st of size B.

S i+1 = S i ∪ {label ccs containing S r with C P R σ δ }. 9:
if extra budget then 10:

S i+1 = S i+1 ∪ {label largest ccs of R σ δ (S x ) with C P R σ δ }. 11:
end if 12: end for 13: Output : trained agent h st Algorithm 3 presents the main contribution of this work, our meta-approach for training pool-based active learning strategies on proper topological regions of a sample set S x . In addition to standard inputs in active learning methods such as the unlabeled sample set S x , the oracle O, the budget B, and the number of rounds r. It also takes as input the metric distance d, a given pool-based active learning method h st (S x , B), the parameters δ and τ tuned by Algorithm 2. The proper topological regions of S x are encoded in the partition function C R σ δ , we typically obtain a much higher number of regions than the number of classes c, or what we expect to have with clustering methods. Initially, we aim to maximize the initial training set size by labeling the largest regions. Then the underlying active learner strategy consumes the rest of the regions during the rounds of active training. We might receive queries during these rounds which contain samples from the same region; in that case, we use the extra budget to label the largest regions. After r rounds, we return the trained estimator of the strategy. Note that we also can have cases where all the regions are consumed before the end of rounds of active training. Next, we shall discuss practical considerations and technical details related to implementing this approach.

Practical considerations

We consider for d, the Euclidean distance overall experiments. Furthermore, we use l-nearest neighbors for the estimation of the distance matrix D as follows: Let D = (d i,j ) ∈ R n×n be a sparse distance matrix, with only ℓ non zero values in each row:

d i,j = d(x i , x j ) if x j is one of the ℓ-nearest neighbors of x i , 0 otherwise.
The density estimation P : S x → R + is calculated as follows:

P(x i ) = 1 l n j=1 m 2 i,j -1/2
, for all i ∈ {1, . . . , n}.

(3.5)

We consider ℓ = 2000, for all datasets of greater size. We choose the Tree-structured Parzen Estimator (TPE) [START_REF] Bergstra | Algorithms for hyper-parameter optimization[END_REF] for the optimization procedure of Algorithm 2, with a number of trials l = 1000, and a step size s of 0.1 for the line search procedure.

Empirical results

In this section, we will describe the corpora and methodology.

Datasets

We conduct experiments on benchmark datasets for classification problems also often used in active learning: coil-20 [START_REF] Yang | Robust affine invariant descriptors[END_REF], isolet [START_REF] Fanty | Spoken letter recognition[END_REF], protein [START_REF] Higuera | Self-organizing feature maps identify proteins critical to learning in a mouse model of down syndrome[END_REF], banknote, pendigits, nursery, and adult [START_REF] Joseph D Romano | Pmlb v1.0: an open source dataset collection for benchmarking machine learning methods[END_REF].

K-Medoids clustering

The K-Medoids algorithm [START_REF] Kaufman | Finding Groups in Data: An Introduction To Cluster Analysis[END_REF] is very similar to K-Means except that it uses the actual samples for centers, namely medoids, as the center of each cluster.

These medoids are then used to form the initial training set in active learning.

Agglomerative Hierarchical Clustering (AHC)

Agglomerative hierarchical clustering [START_REF] Voorhees | The Effectiveness & Efficiency of Agglomerative Hierarchic Clustering in Document Retrieval[END_REF] is a bottom-up clustering approach that builds a hierarchy of clusters. Initially, each sample represents a singleton cluster. Then the algorithm recursively merges the closest clusters using a linkage function until until only one cluster is left. This process is usually presented in a dendogram, where each level refers to a merge in the algorithm.

AHC has been used for active learning in [START_REF] Dasgupta | Hierarchical sampling for active learning[END_REF] by pruning the dendogram at a certain level to obtain clusters, then similar to K-Means, selecting the closest samples to the centroid clusters to generate the initial training set.

Furthest-First-Traversal (FFT)

The farthest-first traversal of a sample set is a sequence of a selected sample, where the first sample in the sequence is selected arbitrarily, and each successive sample in the sequence is located the furthest away from the set of previouslyselected samples. The resulting sequence is then used as the initial training set for active learning. The FFT algorithm has been used for active learning in [START_REF] Baram | Online choice of active learning algorithms[END_REF].

Affinity Propagation Clustering (APC)

Affinity propagation is a clustering algorithm designed to find exemplars of the sample set which are representative of clusters. It simultaneously considers all the sample set as possible exemplars and uses the message-passing procedure to converge to a relevant set of exemplars. The exemplars found are then used as an initial training set for active learning [START_REF] Hu | Off to a good start: Using clustering to select the initial training set in active learning[END_REF].

For the active learning experiments, and following results from [START_REF] Siméoni | Rethinking deep active learning: Using unlabeled data at model training[END_REF], we only consider the comparison against the random labeling strategy, as it outperforms many recent strategies in active learning in small budget scenarios. In all our experiments, we use the random forest classifier [START_REF] Tin | Random decision forests[END_REF] as base estimator for the different strategies with default parameters, we also consider several budgets [START_REF] Amini | Learning with Partially Labeled and Interdependent Data[END_REF][START_REF] Bonnin | A cluster-based strategy for active learning of rgb-d object detectors[END_REF], and 20 stratified random splits, with 70% of the data in the training set and 30% in the test set. For all the datasets, we observe that the optimal threshold rule's values found in the hypothesis class of the σ-Rips graph with our proposed threshold function σ δ in (3.1) are negatively correlated to the estimation density P. We also observe that the best σ-Rips graph achieves better PuritySize scores overall datasets, except for coil-20 and nursery datasets, where it has similar scores to the best Rips graph found.

B ∈ [3,

Rips graph vs σ-Rips graph

Particularly for the coil-20 dataset where the optimal threshold seems to be a constant, we notice that, in this case, both graphs converge to the same threshold function, this shows that our proposed threshold function (3.1) can effectively approximate constant threshold functions. These findings confirm our hypothesis that class similarity is a density-aware measure. It also supports our choice of σ δ in (3.1) as an appropriate threshold function to generalize the Rips graph.

Cold-start results

Table 3.2 presents the cold-start results of our meta-approach for pool-based active learning strategies, denoted TPR(USRG) where USRG is refering to the unsupervised setting of our optimization procedure for solving Problem (3.4) using the σ-Rips graph, next to the Random Selection (RS), and other considered baseline methods overall the datasets. In all cases, TPR(USRG) provides significantly better results than the random selection approach except for the imbalanced dataset nursery with the largest budget. This shows that using the largest proper topological regions found by Algorithm 2 as an initial training set (Line 4 of Algorithm 3) provides a better starting point for pool-based active learning strategies than random selection. Furthermore, our meta-approach shows very competitive results overall datasets, when compared to the baseline methods that are solely designed to tackle the cold-start problem in active learning.

Active learning results

Lastly, we present the results of our meta-approach for pool-based active learning strategies. We consider the strategies mentioned above, namely the uncertainty sampling query strategy, the entropy sampling query strategy, and the margin sampling query strategy. When using our meta-approach presented in Algorithm 3 with USRG as described in the previous subsection. Compared to RS, the vanilla training approach in pool-based active learning, when using random selection to initiate the active learning strategies. We also show SSRG to illustrate the difference of performance, when we minimize the supervised setting for TPR (Problem(3.2)), compared to the unsupervised setting (Problem(3.4)). We present one figure per each dataset, and each figure is constituted of six error bars plots, referring to the average balanced accuracy and standard deviation over the splits, for all the active learning rounds, plus the initial round. The plots are indexed to show a specific budget per row, and a specific active learning strategy per column.

We can see from the results that all the considered pool-based active learning strategies clearly benefit from our approach in comparison to the vanilla setting. The only instance where we don't see such advantage is for nursery dataset. The reason being that nursery has a high class imbalance ratio. We choose in Algorithm 3 to prioritize the gain in the training sample size, regardless of class discovery, or class ratio, which may empathizes the class imbalance in such case. This shows that we need to introduce other sampling criterion of TPR in Algorithm 3, than simply selecting the largest ones, when training with highly class-imbalanced datasets.

Conclusion

In this chapter, we proposed a data driven meta-approach for pool-based active learning strategies for multi-class classification problems. Our approach is based on an introduced notion of Topological Proper Regions (TPR) of a given sample set, we showed the theoretical foundations of this notion, and derived a black-box optimization problem to uncover the TPR. Our empirical study validates our meta-approach on different benchmarks, in low budget scenario, for various pool-based active learning strategies. Challenging open questions are left, a theoretical analysis that guarantee good performance in active learning, such as, generalization bounds. The use of semisupervised approaches to conclude the analysis with a model dependent approach, by having a regularization term derived from the TPR.

Chapter 4 Deep Learning for Rapid Automation of Transmission Electron Microscopy Analysis

Deep learning is revolutionizing many areas of science and technology, including the analysis of data obtained by Transmission Electron Microscopy (TEM). This chapter presents our practical contributions aimed at automating the analysis of phase and orientation mapping from scanning diffraction data obtained during TEM analysis.

More precisely, we aim to derive a DL approach capable of accurately predicting a crystal's phase and orientation, given its diffraction diagram. These contributions aim to achieve real-time orientation and phase determination maps during the acquisition experiments. This chapter is based on the following paper [HDR + 22, HDAL22].

Introduction

Transmission Electron Microscopy (TEM) has expanded the type of information obtained on nanocrystalline microstructures, such as phase and orientation [START_REF] Carter | Transmission Electron Microscopy: Diffraction, Imaging, and Spectrometry[END_REF]. Orientation microscopy is a technique that enables spatially resolved measurements of crystal phases and orientations in a sample and reconstructs the microstructure from this information. Using a scanning mode and acquiring on each scanning data point a full diffraction diagram, orientation mapping TEM experiments, alternatively called ACOM (Automated Crystal Orientation Mapping) or SPED (Scanning Precession Electron Diffraction) are producing large collections of datasets, which are often impossible to process manually. As a result, extensive research [START_REF] Rauch | Rapid diffraction patterns identification through template matching[END_REF][START_REF] Zaefferer | Development of a TEM-Based Orientation Microscopy System[END_REF] has proposed semi-automated approaches to analyze these datasets. These deterministic methods rely on classical computer vision techniques (e.g., Hough transform, Fourier filtering, segmentation, and cross-correlation for similarity measure), which typically require manual hyperparameter tunning and a computation cost for each experiment. Deep neural networks (DNNs) have shown superior performance compared to classical computer vision techniques in most benchmark tasks. This led to the emergence of fully automated approaches [132,[START_REF] Aguiar | Decoding crystallography from high-resolution electron imaging and diffraction datasets with deep learning[END_REF] and tools [START_REF] Xu | Automating electron microscopy through machine learning and usetem[END_REF][START_REF] Munshi | 4d crystal: Deep learning crystallographic information from electron diffraction images[END_REF] for various TEM tasks. In the context of orientation microscopy, ML-based approaches are still falling behind traditional techniques such as template matching [START_REF] Rauch | Rapid diffraction patterns identification through template matching[END_REF] or Kikuchi technique [START_REF] Kikuchi | Transmission Electron Microscopy (TEM[END_REF] when it comes to generalization performance to unseen crystal orientations and phases during training. This is due mainly to the limited experimental data about the studied phenomena for training the models. It is a realistic and practical constraint, especially for narrow-domain applications where real data is not widely available. Some successful attempts have been made to use unsupervised learning techniques to gain more insight into the data [START_REF] Ben | Unsupervised machine learning applied to scanning precession electron diffraction data[END_REF][START_REF] Shi | Rapid and semiautomated analysis of 4d-stem data via unsupervised learning[END_REF], but clustering information does not directly solve the orientation microscopy problem.

Early Deep learning breakthroughs were primarily in the computer vision domain, mainly due to the increased availability of new big data benchmarks and organized competitions such as ImageNet [START_REF] Jia | Imagenet: A large-scale hierarchical image database[END_REF] since 2009. This dynamic resulted in many sophisticated models for image classification [START_REF] He | Deep residual learning for image recognition[END_REF][START_REF] Simonyan | Very deep convolutional networks for large-scale image recognition[END_REF][START_REF] Huang | Convolutional networks with dense connectivity[END_REF][START_REF] Chollet | Xception: Deep learning with depthwise separable convolutions[END_REF]. There is a clear potential for automated image analysis tools using state-of-the-art machine learning techniques for phase and orientation determination to complement the existing relatively slow, complex, and hyperparameter-dependent approaches. To this end, we investigate multi-task DL solutions with the purpose of boosting the existing slow phase and orientation determination techniques by replacing them with DL models for fast realtime prediction during data acquisition but with lower generalization accuracy to be used as a less accurate but real-time analysis for TEM experiments.

Experimental

We conduct our experiments using two batches of maps from two different studies. The second batch of TEM data was collected in a study investigating the structural and mechanical properties of different ultrafine-grained (UFG) structures obtained from aluminum alloys [START_REF] Duchaussoy | Structure and mechanical behavior of ultrafine-grained aluminum-iron alloy stabilized by nanoscaled intermetallic particles[END_REF].The study investigated a specimen of an Al-2wt%Fe alloy after severe plastic deformation (SPD) by high-pressure torsion (HPT) at strain levels

Labeling strategy

Transmission Electron Microscopy (TEM) was performed using a JEOL 2100F microscope using a Stingray camera recording the phosphorus screen and equipped with automated crystal orientation mapping using the (ASTAR) package [START_REF] Rauch | Rapid diffraction patterns identification through template matching[END_REF][START_REF] Edgar | Orientation and phase mapping in tem microscopy (ebsd-tem like): Applications to materials science[END_REF][START_REF] Viladot | Orientation and phase mapping in the transmission electron microscope using precession-assisted diffraction spot recognition: State-of-the-art results[END_REF]. The ASTAR template matching package was used to analyze the phase and orientation distribution maps, which will be considered as the ground truth for the following. (c) Map 3 : 97.4% alpha iron (α-Fe), 0.3% niobium carbide (NbC), and 2.3% cementite (Fe 3 C).

(d) Map 10T : 98.0% aluminium (Al), and 2.0% aluminium-iron (Al 6 Fe).

(e) Map as-cast : 89.6% aluminium (Al), and 10.4% aluminium-iron (Al 6 Fe).

(f) Map 100T : 99.1% aluminium (Al), and 0.9% aluminium-iron (Al 6 Fe).

The crystal orientations in the specimen are also provided from the template matching analysis. The Euler angles [START_REF] Goldstein | Classical Mechanics. Addison-Wesley series in physics[END_REF] usually denoted as (ϕ 1 , Φ, ϕ 2 ) can fully describe these crystal orientations. A compact approach for representing these orientations is to map them to the RGB channels to create an image showing a given micrograph's orientation map. Additionally, we have access to template diffraction diagrams where the diffraction patterns are simulated using the crystal information and the TEM experimental settings, Figure 4.4 shows a simulated diffraction pattern of alpha iron at a given orientation with Euler's angles. Each simulated template is provided as a set of coordinates with the corresponding intensities which is the radius at these spots. We draw simulated DPs using OpenCV [START_REF]Itseez. Open source computer vision library[END_REF], and we cover the Euler space of each crystal by simulating the fundamental zone corresponding to the class symmetry of each considered phase.

As mentioned previously, the objective of this study is to retrieve information about the crystal phase and orientation from the collected data during TEM experiments. Ultimately, we want to investigate Deep learning methods to infer Euler's orientation and phase determination maps from real diffraction images. From the descriptions provided in this section, we can already identify important challenges to take into consideration when designing such approaches: TEM data is highly heterogeneous: the experimental settings in which the data is collected are often different from one TEM experiment to another for practical reasons. This adds another difficulty for DL approaches to adapt to new experimental settings when analyzing new micrographs.

Data preprocessing for ML

A lot of effort has been made into researching and developing new ways of preprocessing real diffraction patterns or DPs and simulated DPs to improve the prediction accuracy of ML-based approaches [132,[START_REF] Munshi | 4d crystal: Deep learning crystallographic information from electron diffraction images[END_REF]. Nowadays, computer vision models rely on the End-to-End approach with minimal feature engineering. Nonetheless, such an approach has some underlying assumptions that cannot be met in our case, namely a highly favorable signal-to-noise ratio which is usually the case in standard highresolution RGB images in datasets such as ImageNet [START_REF] Jia | Imagenet: A large-scale hierarchical image database[END_REF], and a tremendous amount of relevant training data to allow the underlying algorithm to model and adapt to the noise distribution. Initial End-to-End experiments for phase classification with outof-the-shelf DL models showed that these models indeed fail to generalize to DPs from unseen micrographs, confirming our belief in the need for an appropriate preprocessing to alleviate this phenomenon. Additionally, traditional normalization techniques are not adapted to our use case. In figure 4.5, we present the mean experimental diffraction diagram for each map (calculated on all map's datapoints). These spots are present in the mean images because of the high frequency of duplicates in TEM data from the major grains. It is relevant information in frequent DPs, and subtracting it in a normalization scheme would result in a signal loss. However, the mean images present statistical noise intrinsic to the TEM experiment, which should be subtracted.

g σ (i, j) = 1 2πσ 2 e -(i 2 +j 2 )/(2σ 2 ) (4.1)
In our study, after standardizing the images, we propose to filter out the statistical noise by fitting a centered Gaussian filter in Eq (4.1), where i is the distance from the center in the horizontal axis, j is the distance from the center in the vertical axis, and σ is the standard deviation, to the mean images of each micrograph (map) and subtracting the resulted filter from all the DPs of that map. After subtraction, all negative points on the image are assigned a value of 0. Concretely, For each mean image m of a given micrograph, we solve:

σ * =

Deep learning for TEM data analysis

This section considers two different research directions, the first direction was to investigate the capability of DL approaches to train with simulated TEM data, and to evaluate how well it translates to our problem of real TEM data analysis. The second direction of this work was to focus on the performance of SOTA DL models in predicting accurate unseen maps while relying directly on real TEM data for training.

Training on simulated TEM data

To solve our objective of analyzing TEM data using DL models, we address two known tasks in ML, a classification task to identify phases and be able to predict the phase determination map of a micrograph (see Figure 4.2) given its diffraction data, and a regression task to predict the Euler's orientation map given the diffraction data of the considered datapoint (see Figure 4.3). In the following, we will only consider the first batch of micrographs, namely, the maps 1, 2, and 3 of Figure 4.1.

Additionally, we consider the desciptors extracted following the procedure detailed in the preprocessing section, of the fundamental zone of the phases alpha iron, niobium carbide, and cementite described in We consider the task of classifying the considered phases with their code label described in Table 4.1, and the regression task of Euler's angle prediction, such that for the angles of all signatures we apply the following transformation in order to map the cyclical angle space [0, 2ϕ] to a continuous space: f (ϕ 1 , Φ, ϕ 2 ) = (sin(ϕ 1 ), cos(ϕ 1 ), sin(Φ), cos(Φ), sin(ϕ 2 ), cos(ϕ 2 )) f -1 (x 1 , x 2 , x 3 , x 4 , x 5 , x 6 ) = (arctan2(x 1 , x 2 ), arctan2(x 3 , x 4 ), arctan2(x 5 , x 6 )) (4.2)

We reserved 20% of the total simulated data as a separate test set to estimate the performance of the trained DL models using two metrics: the balanced accuracy score for the classification task evaluation, and to evaluate the quality of the regression predictions we introduce the mean absolute angle error defined between a 1D vector A of true angles and 1D vector  of angle predictions both of size n as:

maae(A, Â) = 1 n n i=1 min(|A i -Âi |, 360 -|A i -Âi |) (4.3)
The rest of the simulated data is used for training and validating the considered DL models, in a 80%, 20% split sizes, we consider three DL architectures in this experiment:

MLP: a full Multi-Layer Perceptron [START_REF] Malsburg | Frank rosenblatt: Principles of neurodynamics: Perceptrons and the theory of brain mechanisms[END_REF], with three first dense layers of size 500 with gelu activations, and two last dense layers with sizes 100, 50 with also gelu activations.

CNN: a Convolutional Neural Network [START_REF] Lecun | Gradientbased learning applied to document recognition[END_REF], with four consecutive 1D convolutions of size 128, kernel size 7, and relu activations, followed by a 1d max pooling layer of kernel size 3, a flatten operation and a final dense layer of size 64 with relu activation.

LSTM: Long Short-Term Memory model [START_REF] Hochreiter | Long short-term memory[END_REF], with a first CNN layer of size 128, kernel size 7, and relu activation, followed by a 1d max pooling layer of kernel size 3, the LSTM layer with 256 units, a flatten layer output the full sequence of the LSTM layer.

The CNN and MLP models were retrieved using a Neural Architecture Search (NAS) procedure with AutoKeras [START_REF] Jin | Auto-keras: An efficient neural architecture search system[END_REF], the LSTM model was manually handcrafted based on the architecture presented in [START_REF] Meng | lncrnalstm: Prediction of plant long non-coding rnas using long short-term memory based on p-nts encoding[END_REF]. In this experiment, we compare these models in two different settings. The first setting where a first instance of a model is trained to classify the signatures, and three other dedicated instances for the regression task for each class. The second setting is the multi-task approach (MT) where we trained a single instance of each model with two heads one for the regression task and the other for the classification task, the classification head has an output of size 3 as the number of classes, and the regression head has an output of size 6 to predict the angle transformation f of Eq (4.2) of the signature's angles. All the models were trained with a batch size of 1024 for 500 epochs, and with an early stopping on the validation loss. The nuances between these two settings of predicting phase and angle information from DP descriptors are depicted in From Table 4.1, we show that the classification task on the descriptors extracted from simulated DPs is a relatively simple task compared to angle prediction, even during training, all the models reached a perfect accuracy score in training and validation after a few epochs. Each model is compared in the two settings described above in Multi Task MT, or in a hierarchical way with a model instance per each class for the regression and another anstance for classification only, the MT setting has the advantage of being less complex, having a single model handling both predictions simplify greatly the approach, and as we can see in training data and take advantage of the implicit knowledge between the two tasks to enhance the accuracy of each one of them.

Next, we investigate the capabilities of these models to adapt from simulated descriptors to the descriptors extract from real DPs, transfert learning has become a common technique used in ML, from NLP to computer vision, pretrained models are widely used in various applications to enhance model performance [START_REF] Yang | Transfer Learning[END_REF]. In the next set of experiments, we will investigate if the trained models from the previous step can transfer their knowledge from simulated TEM data to successfully analyze real TEM diffraction data. For this experiment, we consider the first batch of maps, where map 2 and map 3 are used for fine-tuning the models, and the map 1 for the performance evaluation. real diffraction images correctly. The preprocessing adopted in the previous section has played a critical role in facilitating this transfer. Secondly, fine-tuning shows superior performance compared to using the pre-trained models without fine-tuning, especially for the angle's predictions. This result is expected, there are an intrinsic difference between real TEM data, and simulations. Allowing DL models to fine-tune thier acquired knowledge on real data will naturally lead to better predictions. We also note that the balanced accuracy is relatively low, it is a consequence of the highly class imbalanced distribution in TEM micrographs (we refer the reader to Table 4.4).

Lastly, fine-tuning increased the overall prediction accuracy of Euler's angles for map 1. However, the accuracy is still not comparable to the level of precision that we obtained with simulated TEM data. In Figure 4.9, we depict the predicted maps for the orientation determination and the phases determination of map 1, by all the fine-tunned models. As expected from the classification accuracy, the phase maps are well predicted by the predictor. Concerning the orientation map, the situation is of course less favorable. However, regardless of the relatively high maae error reported in the previous table by these models on map 1, the predicted Euler's orientation map highlights the main grain boundary in the micrograph of map 1, although some other boundaries are not so clearly visible. the FT/MT/LSTM model achieved the best balanced accuracy metric, and it is visually validated by its predicted phases determination map, compared to the two other maps, from models FT/MT/CNN, and FT/MT/MLP. Finally, we can notice in the predicted orientation maps the presence of noise in the predictions compared to the ground truth map provided by ASTAR.

The lack of relevant real DPs data covering the Euler space has a consequence in the robustness of these estimators.

In summary, the quality of the similarity between the simulated and real descriptors heavily depends on the preprocessing steps, which has a direct implication on the final model performance. Fine-tuning, multi-task learning, and an efficient preprocessing procedure allow us to reduce this bias when training with real descriptors. We successfully analyzed TEM experimental data by combining all these tools. The qualitative and quantitative promising results show that DL approaches can successfully be used for real-time TEM data analysis, especially for phase identification. The approach presented in this section has however some limitations. First, it requires the simulation of all DPs in the fundamental zone of each considered phase.

This simulation might be expensive depending on the symmetry class of the considered crystals. Our choice of using compact descriptors rather than raw 2D images reduce this cost significantly at the expense of an information loss regarding the experimental DPs. Finally, even if the orientation maps present relevant information, the high noise rate in the predictions made by this initial DL analysis of the data much less efficient than the deterministic algorithms such as template matching.

Alternatively, in the next section, we will investigate the potential of the stateof-the-art DL models in analyzing experimental TEM data, relying solely on real diffraction diagrams, and using the images as inputs.

Training on real TEM data

We are interested in the following in the task of analyzing TEM data by relying solely on experimental DPs. For this purpose, we will use all the diffraction data available to us from the considered micrographs of Figure 4.1 to train and evaluate SOTA DL models from computer vision, next we will first show the potential of these models and their limitations in solving the TEM data analysis task. The aggregated diffraction data is presented in We consider for this set of experiments the SOTA models in computer vision tasks, the ResNet model [START_REF] He | Deep residual learning for image recognition[END_REF] and its variations, ResNet50, ResNet50V2, ResNet101, InceptionResNetV2, and ResNet152. The EfficientNet model [START_REF] Tan | Efficientnet: Rethinking model scaling for convolutional neural networks[END_REF] and its variations from B0 to B7. The DenseNet architecture [START_REF] Huang | Convolutional networks with dense connectivity[END_REF] and its variations, the Xception model [START_REF] Chollet | Xception: Deep learning with depthwise separable convolutions[END_REF], the Inception model [START_REF] Szegedy | Rethinking the inception architecture for computer vision[END_REF], VGG16 and VGG19 [START_REF] Simonyan | Very deep convolutional networks for large-scale image recognition[END_REF]. The barplot in Figure 4.10 presents the results for this SOTA models in phases classification with the unique DPs dataset in blue, and the 100 duplicate DPs dataset in orange. All models were trained on diffraction data from all the maps except for map 1 (from steel sample) and 100T (from Aluminum sample) which were kept for test set evaluation.

From the results depicted in observe a significant drop of performance when the models are trained and evaluated on the dataset with 100 DP duplicates at most. The class label distribution does not significantly shift between these two dataset as shown in Table 4.5, our interpretation of this phenomenon relies on the fact that the SOTA DL models fail to learn meaningful representations of TEM data when trained with limited diffraction TEM data containing noisy duplicated DPs, thus, making them inadequate to be used for TEM data analysis. To remediate to this inefficiency we introduce in the following a new DL model, designed in the spirit of analyzing TEM diffraction data in experimental conditions. But first, we introduce the segmentation map of a micrograph as the result of a deterministic function that maps unique DPs with a unique label and Euler angles, to a unique identification. Figure 4.11 presents the segmentation maps of all considered micrographs. We implement the encoding function that maps the angles and phase label to a unique identifier using label encoder, these identifier are then used are indices for the XKCD color list1 to retrieve the segmentation map.

By definition of the mapping function, a segmentation map aggregates the information of both phase determination and Euler's orientation maps. Therefore, it is essential to facilitate the interaction between DL models and existing software for TEM data analysis, correctly predicted segmentation maps will significantly reduce the cost of post-processing analysis of the data with deterministic approaches such as template matching. The accurate prediction of a segmentation map requires a DL model to learn to distinguish between real DPs. Intuitively, differentiating DP images seems more accessible than the orientation prediction and has a better chance to generalize to unseen DP orientations. Consequently, we will focus on a specifically designed DL model for solving the segmentation map prediction problem for the rest of this study. This model is denoted as Multi-task Pairwise Siamese Network (MPSN). Siamese networks [START_REF] Bromley | Signature verification using a "siamese" time delay neural network[END_REF] are a particular class of DL models that internally have a twin or more identical subnetworks. Siamese architecture is used in many applications, from anomaly detection and classification to similarity and representation learning, etc. [START_REF] Chopra | Learning a similarity metric discriminatively, with application to face verification[END_REF][START_REF] Chicco | Siamese Neural Networks: An Overview[END_REF]. The subnetworks in the siamese architecture are trained by mirroring the gradients during the backpropagation, they can take pairs or triplets as inputs, a rich literature exists on different training algorithms and losses, such as the contrastive loss or the triplet loss (for more details regarding siamese networks, please refer to [START_REF] Chicco | Siamese Neural Networks: An Overview[END_REF]). Furthermore, siamese networks are known to be more robust to class imbalance by implementing a particular sampling strategy for the inputs during training, and they were also For the MPSN architecture, we make use of the siamese idea in order to train our DL model to learn to distinguish between DP image pairs of the same phase class. The MPSN model takes as input DP image pairs (x 0 , x 1 ) from the same phase and a binary label vector y of size 7, the first coefficient of y corresponds to the label pair, which takes one for positive pairs and zero for negative pairs. A positive pair, in our case, is a pair of PD images of the same class with the same Euler orientation, meaning DP duplicates. Negative pairs, on the other hand, are PD image pairs of the same phase but at different Euler orientations. the latter 6 coefficients correspond to the one hot encoding of phase labels. The image pairs are sequentially forwarded through an image encoder. In our case, we chose the ResNet50 DL model [START_REF] He | Deep residual learning for image recognition[END_REF] as the encoder by removing the dense top layer of the classifier and flattening the latent representation of the model as the image embedding space. This architecture is depicted in Figure 4.12.

This embedding is then connected to two separate heads. The siamese head is composed of a dense layer with relu activation for feature extraction. The feature vectors are used to estimate the distance metric. Then the result is mapped to the 0-1 space with the sigmoid function S(x) = 1/(1 + e -x ). The second head is a standard classification architecture, composed of a dense layer with the same number of units as the number of classes and a softmax activation function defined as σ(x) i = e x i /( j x j ) for each coordinate i of x, to map the logits to a probability distribution vector. The image pairs are also forwarded sequentially to obtain the probability vectors for phase prediction of each DP image.

The MPSN model is trained in an MTL fashion with a composite loss function balanced by a hyperparameter λ, constituted of a binary cross-entropy for the siamese head and another cross-entropy loss for the classification head: ℓ λ (x 0 , x 1 , y) = -λ[(y 0 log(f s (x 0 , x 1 ; θ e , θ s )) + (1 -y 0 ) log(1 -f s (x 0 , x 1 ; θ e , θ s )))] Given the predicted segmentation maps by the MPSN model, we can recover Euler's orientation map and the phase map by querying a deterministic approach, such as template matching to label a single DP from each segment and propagate the labels of this DP through all the segments. Table 4.6 and Table 4.7 present the precision of these retrieved maps with respect to the ground truth maps provided by ASTAR. In addition to the metrics used in the previous section, we introduce the reduction metric as the proportion of queries saved when relying on label propagation with the predicted segmentation maps rather than querying all DPs of the micrograph.

-(1 -λ)
Note that with smaller κ, we obtain segmentation maps with fewer segments, which significantly reduces the number of queries needed to retrieve the Euler's orientation and phase's maps, as shown in the tables. On the other hand, high κ values ensure better precision in predicting the phases and angles. These results show that the MPSN model architecture can drastically reduce the cost of analyzing TEM data with deterministic approaches by over 90%, while providing a high accuracy on the resulted MAPS after the analysis. Furthermore, we show from our experimental protocol that the model can generalize to new experimental TEM data without the need of training on simulated data or fine-tuning. These arguments support the realistic deployment of such a DL approach in an interactive setting with an existing deterministic method to significantly speed up The TEM data analysis for a real-time use case.

Conclusion

In this work, we investigated the potential of deep learning for the rapid automation of TEM data analysis. We proposed a preprocessing of simulated and experimental DPs with descriptors. We demonstrated the value of multi-task learning for the regres- In the current state of the presented methods, it appears that accurate phase determination can be reached both based on training on simulated images and directly on experimental data. In the latter case, the main ussie is obviously the amount of data available and the diversity of data, since experimental maps contain a large proportion of duplicates. As for the simulated data strategy, in order to become more user-friendly, future work should also address how a pre-trained model could be easily transferred to different experimental configurations (camera length, precession conditions, etc.). Concerning the prediction of orientation angle, promising precision has been obtained on some Euler angles but not all, and further research is need to improve this precision to a degree where the noise on experimental maps can be reduced to observe relevant features in most microstructures. The possibility to implement a real time approximation of the phase and orientation map during TEM acquisition is not out of reach given the results presented here, and would be a valuable asset for more useful data collection by the experimentalists.

Chapter 5

Conclusions and Future Perspectives

The work in this thesis has concentrated on demonstrating the relevance of implicit information in the design of machine learning algorithms. This study direction has been extensively investigated by the community, with its different subdomains in semi-supervised learning, active learning, and transfer learning. We demonstrated that implicit information may take numerous forms and is especially useful in learning circumstances where labeled information is sparse and expensive. This implicit information can also come from a variety of sources, such as data distribution, a learning algorithm's knowledge model, or simulations. We studied these many sources of implicit information by developing tailored learning algorithms to recognize and exploit this knowledge to improve learning efficiency.

Further research into new approaches to develop learning algorithms to recognize and apply implicit information is critical. To solve our daily activities, we create effective ways of combining contextual knowledge and prior experiences. However, without enough labeled data, these activities remain beyond the capabilities of machine intelligence.

Future goals should be to achieve human intelligence not by completing a specific set of problems, as was previously regarded to be a milestone for artificial intelligence, but rather by developing learning models and algorithms that better blend memory, experience, and perception. With developing study paths such as few-shot learning or self-learning, the research community has already set its course to move in this direction. In my opinion, the research done in this area will be important in advancing AI to the next level.

1. 1

 1 Self-learning algorithm. . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2 Active learning compared to traditional passive learning. . . . . . . . 1.3 Multi-task learning framework in ML. . . . . . . . . . . . . . . . . . . 1.4 Transmission Electron Microscopy (TEM) analysis workflow. . . . . . 2.1 Case when α (k) ∈ 0, arccos γ (k) (left) and α (k) ∈ arccos γ (k) , π 2 (right) for a pair w (k) , w (k+1) in L m . . . . . . . . . . . . . . . . . . 3.1 Comparison study between Rips graph and σ-Rips graph overall datasets, the PuritySize score is reported for each minimizer. . . . . . . . . . .

4. 1

 1 Collected micrographs of size 500 × 500. . . . . . . . . . . . . . . . . 4.2 ASTAR phase determination maps for all considered micrographs. . . 4.3 ASTAR Euler's orientation determination maps for all considered micrographs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii 4.4 Simulation of diffraction patterns for TEM experiments. . . . . . . . 4.5 The two first rows coorespond to the mean diffraction diagram of DPs from each micrograph, and thier resulting Gaussian filters in the next rows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6 Preprocessing result on random sampled DPs. The first and second rows from the top are the raw DPs from each specimen, whereas the second and last rows are the resulting DPs after preprocessing. . . . . 4.7 Preprocessing steps of real diffraction diagrams vs template simulated real diffraction diagrams. . . . . . . . . . . . . . . . . . . . . . . . . . 4.8 Multi-Task Learning approach compared to hierarchical learning approach for training DL models in analyzing TEM data. . . . . . . . . 4.9 Predicted Euler's orientation maps, and phase determination maps of all fine-tunned DL models for the micrograph of map 1. . . . . . . . . 4.10 Classification results of SOTA DL models, accuracy scores are on experiments with two datasets, the unique DPs dataset and the 100 DPs duplicates dataset. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.11 Encoded segmentation maps for all considered micrographs. . . . . . 4.12 Multi Pairwise Siamese Network (MPSN) architecture. . . . . . . . . 4.13 First row corresponds to the segmentation maps of the micrographs 1 and 100T, in the second row are the ones predicted by the MPSN model with κ = 0.7. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.14 Phases and Euler's orientation maps found using the segmentation map predicted by the MPSN model on map 1. . . . . . . . . . . . . . . . . 4.15 Phases and Euler's orientation maps found using the segmentation map predicted by the MPSN model on map 100T. . . . . . . . . . . . . . . The expected value of a random variable X Cov The covariance of random variables ⊥ ⊥ The independence operator X The input space and subset of R d x An observation from X Y = {1, . . . , c} The output space of cardinal c ∈ N, c ≥ 2 D A joint probability distribution of the data h w A parametric model, with parameters w H d = {h w : X → Y} A hypothesis class S A sample set S ℓ The set of labeled examples of cardinal ℓ X u The set of unlabeled examples of cardinal u arctan2 The arc tangent function arg max The argument of the maxima arg min The argument of the minima Chapter 1

  Figure 1.1: Self-learning algorithm.

(

  central spot in the diffraction diagram), see micrograph in Figure 1.4.

Figure 1

 1 Figure 1.4: Transmission Electron Microscopy (TEM) analysis workflow.

  diffraction diagram from a predefined set of banks of different crystals (Section 4.1 of Chapter 4 details the literature). The resulting match provides information about the type of crystal (phase detection) and its orientation in the specimen (orientation detection) at the coordinate of the queried diffraction diagram. The analysis result is presented as two different maps, the phases map and the orientation map, shown on the right-hand side of Figure 1.4.

  Chapter 2, we investigate a new self-training algorithm for binary classification with halfspaces under the assumption the training set is corrupted by label noise. We use a Massart noise model to describe label corruption and examine the generalization properties of the classifier found by the self-training algorithm.

  iteratively over the set of labeled and unlabeled training data by maximizing the unsigned margin of unlabeled examples and then assigning pseudo-labels to those with a distance greater than a found threshold. The pseudo-labeled unlabeled examples are then added to the training set, and a new classifier is learned. This process is repeated until there are no more unlabeled examples to pseudo-label. In the second step, pseudo-labeled examples with an unsigned margin greater than the last found threshold are removed from the training set. Our contribution is twofold: (a) we present a first generalization bound for selftraining with halfspaces in the case where class labels of examples are supposed to be corrupted by a Massart noise model; (b) we show that the use of unlabeled data in the proposed self-training algorithm does not degrade the performance of the first halfspace trained over the labeled training data.

  rithm is better or equal to any hypothesis in H d obtained from S ℓ only. Here we denote by η w (x) = P y∼Dy(x) [h w (x) ̸ = y] the conditional misclassification error of a hypothesis h w ∈ H d with respect to D and w * the normal vector of h w * ∈ H d that achieves the optimal misclassification error; η η η * = min w,∥w∥ 2 ≤1 P (x,y)∼D [h w (x) ̸ = y].

p 20 : end while 21 :

 2021 Output : L m = [(w(1) , γ (1) ), ..., (w (m) , γ (m) )]

  ∀i ∈ {1, . . . , k}, and µ = 1 n n i=1 x i are the mean-sample per connected component C i , and the mean-sample of S x , respectively: Calinski-Harabasz score

  being the average distance of sample x to his group and b(x) = min j̸ =i,x∈C i 1 |C j |

Algorithm 3

 3 Pool-based active learning on PTR Require: S x := {x i } n i=1 , oracle O, budget B and d : X × X → [0, ∞), graph parameters δ and merging parameter τ , active learner agent h st (S x , B) with an underlying pool-based strategy st, and r the active training rounds. 1: Compute density estimator P with (3.5). 2: Build the σ-Rips graph R σ δ (S x ). 3: Apply ToMATo τ (R σ δ (S x ), P) to get C R σ δ , the partition function that encodes the proper topological regions of S x . 4: S 0 = {B largest connected components (ccs) of R σ δ (S x ) labeled with C P R σ δ }. 5: for i = 0, . . . , r do 6:

  Baseline methods For the cold-start experiments, we consider the following approaches from the literature:K-Means clusteringThe K-Means algorithm[START_REF] Lloyd | Least squares quantization in pcm[END_REF] partitions a collection of examples into K clusters by minimizing the sum of squared distances to the cluster centers. It has been used for active learning in [129], to generate the initial training set by labeling the closest sample to each centroid. Another variation proposed in [70] adds artificial samples from the centroids, named model examples, to the initial training set. This approach is named K-Means+ME and leads to an initial training set twice as large as the one created using K-Means.

  To validate our hypothesis of a density-aware threshold (3.1) for class similarity, and to motivate our generalization of the Rips graph to express this notion, we present a comparison study in Figure3.1 between the Rips and the σ-Rips graphs overall considered datasets. Each plot presents the threshold of the best Rips graph and σ-Rips graph in minimizing the PuritySize cost function on all the datasets with the same practical considerations of Subsection 3.4.2. Note that the Rips graph's threshold is a constant presented as a horizontal line in the plots. We also show two additional side plots. The x-axis plot shows the distribution of the density estimation P in the dataset. In contrast, the y-axis plot shows the distribution of the Euclidean distances in the dataset's distance matrix D. We are interested in comparing the threshold rules within these intervals because, from Definition 3.1 of the Rips graph, and Definition 3.2 of the σ-Rips graph, threshold values greater than the maximum distance will result in a clique graph.

  of best Rips graph : 0.1381 PuritySize of best σ-Rips graph : 0PuritySize of best Rips graph : 0.7776 PuritySize of best σ-Rips graph : 0

Figure 3 . 1 :

 31 Figure 3.1: Comparison study between Rips graph and σ-Rips graph overall datasets, the PuritySize score is reported for each minimizer.

Figure 3 . 2 :

 32 Figure 3.2: Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on protein dataset, using random forest estimator over 20 stratified random splits.

Figure 3 . 3 :

 33 Figure 3.3: Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on banknote dataset, using random forest estimator over 20 stratified random splits.

Figure 3

 3 Figure 3.4: Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on coil-20 dataset, using random forest estimator over 20 stratified random splits.

Figure 3 . 5 :

 35 Figure 3.5: Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on isolet dataset, using random forest estimator over 20 stratified random splits.

Figure 3 . 6 :

 36 Figure 3.6: Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on pendigits dataset, using random forest estimator over 20 stratified random splits.

Figure 3 . 7 :

 37 Figure 3.7: Average balanced classification accuracy and standard deviation of different pool-based active learning strategies and budgets on nursery dataset, using random forest estimator over 20 stratified random splits.

  The first batch is constituted of three different experimental Micrographs presented in (a),(b), and (c) of Figure4.1. Each collected map consists of 500 × 500 diffraction images of size 144 × 144 pixels each. The three micrographs contain four phases, namely the alpha iron (α-Fe), the gamma iron (γ-Fe), the niobium carbide (NbC), and the cementite (Fe 3 C).

(

  figure corresponds to the as-cast material microstructure used in the study, meaning the microstructure of the studied alloy in the as-cast conditions with no further SPD.

  Figure 4.1: Collected micrographs of size 500 × 500.

  Figure 4.2 shows the phase determination maps provided by ASTAR analysis of TEM data. We have the following microstructure composition:

Figure 4

 4 Figure 4.2: ASTAR phase determination maps for all considered micrographs.

  Figure 4.3: ASTAR Euler's orientation determination maps for all considered micrographs.

Figure 4 . 4 :

 44 Figure 4.4: Simulation of diffraction patterns for TEM experiments.

  Figure 4.5 shows the gaussian filters g σ * estimated from each micrograph, and Figure 4.6 shows the effect of our approach on random DPs from each micrograph before and after applying our preprocessing. On the other hand, we employ a similar preprocessing introduced in[START_REF] Zaefferer | Development of a TEM-Based Orientation Microscopy System[END_REF] to preprocess simulated DPs or templates. The simulation is parametrized by the number of spot diffractions and their size tuned to best fit the real DPs. Next we apply a blurring filter to smooth the intensities, then we extract intensity descriptors from their polar representation to obtain similar descriptors to those extracted from real diffraction diagrams.

Figure 4 . 5 :

 45 Figure 4.5: The two first rows coorespond to the mean diffraction diagram of DPs from each micrograph, and thier resulting Gaussian filters in the next rows.

Figure 4 . 6 :

 46 Figure 4.6: Preprocessing result on random sampled DPs. The first and second rows from the top are the raw DPs from each specimen, whereas the second and last rows are the resulting DPs after preprocessing.

  Figure 4.8.

Figure 4 . 8 :

 48 Figure 4.8: Multi-Task Learning approach compared to hierarchical learning approach for training DL models in analyzing TEM data.

  Phases and Euler's orientation maps of micrograph of map 1.α-Fe NbC Fe3C (b) Phases and Euler's orientation maps predicted by FT/MT/LSTM model. α-Fe NbC Fe3C (c) Phases and Euler's orientation maps predicted by FT/MT/MLP model. α-Fe NbC Fe3C (d) Phases and Euler's orientation maps predicted by FT/MT/CNN model.

Figure 4 . 9 :

 49 Figure 4.9: Predicted Euler's orientation maps, and phase determination maps of all fine-tunned DL models for the micrograph of map 1.

Figure 4 . 10 :

 410 Figure 4.10: Classification results of SOTA DL models, accuracy scores are on experiments with two datasets, the unique DPs dataset and the 100 DPs duplicates dataset.

Figure 4 . 11 :

 411 Figure 4.11: Encoded segmentation maps for all considered micrographs.

  successfully applied in representation learning algorithms; they focus on learning a latent representation with a semantic similarity, encoded in the similarity measure used during training.

Figure 4 . 12 :

 412 Figure 4.12: Multi Pairwise Siamese Network (MPSN) architecture.

Figure 4 .

 4 Figure 4.12 illustrates the architecture of the Multi-task Pairwise Siamese Network.

1 i=0 6 k=1y

 6 k log(f c (x i ; θ e , θ c )).

(4. 4 )

 4 Where f s (.; θ e , θ s ) is the siamese parametric function, with the shared encoder parameters θ e , and the task-specific parameters θ s , and f c (.; θ e , θ c ) the classification parametric function with the shared encoder parameters θ e , and the task-specific parameters θ c . MPSN is trained to optimize the following minimization formulation:

Figure 4 . 13 :

 413 Figure 4.13: First row corresponds to the segmentation maps of the micrographs 1 and 100T, in the second row are the ones predicted by the MPSN model with κ = 0.7.

Figure 4 .

 4 Figure 4.14 and Figure 4.15 show the predicted orientation and phase maps by label propagation, given the segmentation map predicted by the MPSN model with a confidence level κ = 0.8, for the micrographs of map 1 and map 100T respectively.

  Phases and Euler's orientation maps of micrograph of map 1.α-Fe NbC Fe3C (b) Predicted phases and Euler's orientation maps using the MPSN model with κ = 0.8.

Figure 4 . 14 :

 414 Figure 4.14: Phases and Euler's orientation maps found using the segmentation map predicted by the MPSN model on map 1.

Figure 4 . 15 :

 415 Figure 4.15: Phases and Euler's orientation maps found using the segmentation map predicted by the MPSN model on map 100T.

  sion task of orientation prediction and the classification task of phase determination and transfer learning by successfully learning to analyze simulated TEM diffraction data and applying it to experimental diffraction data. In parallel, we performed an extensive comparative study of SOTA DL models to analyze diffraction data with a realistic experimental protocol. Furthermore, we introduced the segmentation map a new visualization support to allow DL-based solutions to interact in an interactive way with existing deterministic approaches for TEM data analysis. In this context, we address the problem of TEM data analysis for DL as the task of differentiating between experimental DPs, in order to predict the corresponding segmentation map.We proposed a new DL model, namely the Multi-task Pairwise Siamese Network with dedicated training and inference procedures. The model is able to drastically reduce labeling cost in terms of the number of queries of traditional deterministic algorithms for TEM analysis while showing favorable results in the prediction of maps using label propagation on the predicted segmentation map with promising performance in generalizing to unseen micrographs.

  For example, suppose we trained a model to solve a classification problem on simulated data. In that case, we could use the knowledge gained during its training to solve a new classification problem on real data. The

advantage of this technique is here to uses the knowledge a model has learned from a source task with a lot of available labeled training data in a new task that does not have much data. Instead of starting the learning process from scratch, we start

Table 2

 2

	data set	d	-1	+1	ℓ + u	test
	one-two	64	177	182	251	108
	banknote	4	762	610	919	453
	odd-even	64	906	891	1257	540
	pc-mac	3868 982	963	1361	584
	baseball-hockey 5724 994	999	1395	598
	religion-atheism 7829 1796	628	1696	728
	spambase	57	2788 1813 3082 1519
	weather	17 43993 12427 37801 18619
	delicious2	500 9610 6495 12920 3185
	mediamill2	120 15969 27938 30993 12914

.1: data set statistics, -1 and +1 refer to the size of negative and positive class respectively, and test is the size of test set.

Table 2 .

 2 2: Mean and standard deviations of accuracy on test sets over the 20 trials for each data set. The best and the second-best performance are respectively in bold and underlined. ↓ indicates statistically significantly worse performance than the best result, according to a Wilcoxon rank-sum test (p < 0.01)[START_REF] Wolfe | Nonparametrics: Statistical Methods Based on Ranks and Its Impact on the Field of Nonparametric Statistics[END_REF].[START_REF] Baram | Online choice of active learning algorithms[END_REF].71 ↓ 70.87 ± 13.24 ↓ 48.61 ± 3.98 ↓ 75.09 ± 1.30 53.65 ± 10.65 ↓ 77.77 ± 1.75 92.77 ± 3.05 88.00 ± 3.24 ↓ 49.35 ± 4.20 ↓ 84.67 ± 4.98 ↓ 75.78 ± 8.74 ↓ 91.34 ± 3.21 100 96.15 ± 1.38 92.50 ± 1.43 ↓ 67.82 ± 12.99 ↓ 86.52 ± 3.26 ↓ 55.41 ± 3.16 ↓ 56.53 ± 5.18 49.86 ± 1.77 ↓ 49.88 ± 1.89 ↓ 56.47 ± 5.50 58.66 ± 6.90 ↓ 69.29 ± 4.32 50.11 ± 1.84 ↓ 66.76 ± 5.40 ↓ 50.16 ± 1.90 ↓ 72.85 ± 6.52 100 68.40 ± 4.65 ↓ 76.25 ± 2.41 ↓ 49.97 ± 1.82 ↓ 71.12 ± 5.06 ↓ 50.35 ± 1.89 ↓ 79.48 ± 4.36 religion-atheism 67.30 ± 6.95 57.30 ± 4.89 ↓ 67.59 ± 6.36 60.67 ± 16.37 ↓ 71.95 ± 5.03 64.25 ± 7.24 ↓ 74.61 ± 1.62 71.79 ± 1.98 ↓ 67.43 ± 6.05 62.59 ± 9.42 ↓ 74.99 ± 6.04 61.15 ± 0.86 ↓ 78.25 ± 2.62 53.63 ± 9.86 ↓ 76.13 ± 3.08 100 69.43 ± 10.19 ↓ 80.07 ± 4.08 61.24 ± 10.26 ↓ 79.08 ± 2.83

	Dataset	ℓ	SVM	LTF	LP	GM	ERLR	L m
	one-two		61.38 ± 79.25 ± 6.87 ↓	94.62 ± 2.46
			57.50 ± 7.21 ↓	69.40 ± 5.53 ↓	55.98 ± 2.00 ↓	69.04 ± 4.60 ↓	56.71 ± 4.53 ↓ 77.24 ± 3.81
	banknote		61.67 ± 4.86 ↓	82.31 ± 2.13 ↓	56.28 ± 1.89 ↓	75.48 ± 5.30 ↓	65.95 ± 2.01 ↓ 85.64 ± 5.36
		100 71.65 ± 6.24 ↓	89.38 ± 3.24	57.20 ± 2.19 ↓	77.56 ± 4.34 ↓	70.95 ± 3.24 ↓ 90.82 ± 3.31
			53.45 ± 4.80 ↓	58.20 ± 4.71 ↓	50.37 ± 1.95 ↓	60.69 ± 7.48	50.40 ± 2.21 ↓ 63.21 ± 7.51
	odd-even		64.75 ± 5.65 ↓	76.84 ± 2.99 ↓	50.37 ± 1.95 ↓	62.67 ± 5.82 ↓	53.17 ± 4.80 ↓ 80.61 ± 3.10
		100 75.89 ± 6.25 ↓	77.68 ± 4.56 ↓	53.37 ± 1.95 ↓	64.25 ± 8.18 ↓	59.23 ± 6.28 ↓ 84.58 ± 2.12
			51.00 ± 3.22 ↓	54.92 ± 2.00 ↓	50.93 ± 1.59 ↓	54.76 ± 3.42 ↓	50.14 ± 2.06 ↓ 57.75 ± 3.19
	pc-mac		58.85 ± 5.09 ↓	61.78 ± 2.86 ↓	50.83 ± 2.08 ↓	58.78 ± 4.31 ↓	49.71 ± 1.99 ↓ 64.31 ± 3.55
		100 64.57 ± 4.42 ↓	67.98 ± 2.37	50.76 ± 2.26 ↓	62.49 ± 1.88 ↓	50.36 ± 2.19 ↓ 68.15 ± 5.66
			51.57 ± 2.98 ↓
	baseball-hockey
								80 ↓
			60.04 ± 0.62 54.78 ± 2.57 ↓	60.00 ± 0.59	48.35 ± 1.31 ↓	53.48 ± 8.66 ↓ 55.37 ± 3.33 ↓
		100 58.88 ± 3.70	56.04 ± 1.83 83
		100 63.64 ± 0.15 ↓	64.26 ± 4.79	36.37 ± 0.15 ↓	67.34 ± 0.73	63.64 ± 0.16

In our experiments, we have randomly chosen 70% of each data collection for training and the remaining 30% for testing. We randomly selected sets of different sizes (i.e., ℓ ∈ {10, 50, 100}) from the training set as labeled examples; the remaining was considered as unlabeled training samples. Results are evaluated over the test set using the accuracy measure. Each reported performance value is the average over the 20 random (labeled/unlabeled/test) sets of the initial collection. All experiments are carried out on a machine with an Intel Core i7 processor, 2.2GhZ quad-core, and 16Go 1600 MHz of RAM memory.

Analysis of results. Table

2

.2 summarizes the results. We used boldface (resp. underline) to indicate the highest (resp. the second-highest) performance rate, and the symbol ↓ indicates that performance is significantly worse than the best result, according to a Wilcoxon rank-sum test with a p-value threshold of 0.01

[START_REF] Wolfe | Nonparametrics: Statistical Methods Based on Ranks and Its Impact on the Field of Nonparametric Statistics[END_REF]

. From these results, it comes out that the proposed approach (L m ) consistently outperforms the supervised halfspace (LTF). This finding is in line with the result of Theorem 2.8. Furthermore, compared to other techniques, L m generally performs the best or the second best. We also notice that in some cases, LP, GM, and ERLR outperform the supervised approaches, SVM and LTF (i.e., GM on spambase for ℓ ∈ {10, 50}), but in other cases, they are outperformed by both SVM and LTF (i.e., GM on religionatheism). These results suggest that unlabeled data contain useful information for classification and that existing semi-supervised techniques may use it to some extent. They also highlight that developing semi-supervised algorithms following the given assumptions are necessary for learning with labeled and unlabeled training data but not sufficient. The importance of developing theoretically founded semi-supervised ↓ 69.16 ± 7.88 74.16 ± 1.88 72.47 ± 2.00 100 74.66 ± 1.59 73.67 ± 1.76 62.84 ± 19.33 ↓ 70.45 ± 4.39 ↓ 73.21 ± 1.75 73.77 ± 1.82 spambase 61.20 ± 5.15 ↓ 57.80 ± 5.29 ↓ 60.82 ± 0.84 ↓ 74.41 ± 6.64 53.38 ± 11.23 ↓ 68.92 ± 5.83 ↓ ↓ 58.21 ± 6.34 ↓ 81.93 ± 2.46 weather 74.85 ± 0.51 68.09 ± 1.73 ↓ 75.49 ± 0.34 75.02 ± 2.79 40.35 ± 17.29 ↓ 75.08 ± 4.18 75.79 ± 0.28 75.30 ± 3.85 77.99 ± 0.31 75.68 ± 2.78 41.55 ± 27.39 ↓ 75.34 ± 3.80 100 77.99 ± 0.25 76.27 ± 3.64 77.99 ± 0.25 74.92 ± 1.92 46.00 ± 24.87 ↓ 77.28 ± 2.99 delicious2 51.83 ± 9.88 50.59 ± 2.65 ↓ 60.02 ± 0.61 49.41 ± 3.83 ↓ 51.83 ± 10.42 ↓ 51.08 ± 1.↓ 59.87 ± 0.67 48.92 ± 0.94 ↓ 54.43 ± 7.27 ↓ 56.54 ± 1.87 ↓ mediamill2 62.54 ± 2.62 ↓ 60.98 ± 6.85 ↓ 36.35 ± 0.15 ↓ 63.92 ± 1.71 47.24 ± 14.08 ↓ 64.31 ± 3.14 63.64 ± 0.15 ↓ 60.88 ± 7.45 ↓ 36.36 ± 0.15 ↓ 65.98 ± 3.32 58.58 ± 11.88 ↓ 65.41 ± 4.↓ 67.80 ± 2.21

Table 3 .

 3 Table 3.1 presents statistics of the datasets. 1: dataset statistics, n is the size of training set, test is the size of test set and imbalance corresponds to class imbalance ratio. The third column corresponds to the dimension of the feature space R p .

	dataset	n	p	c imbalance test
	protein	756	77	8	0.70	324
	banknote 943	4	2	0.83	405
	coil-20	1008 1024 20	1.00	432
	isolet	4366 617 26	0.99	1872
	pendigits 7694	16 10	0.92	3298
	nursery	9070	8	4	0.09	3888
	adult	34.2k	14	2	0.31	14.7k

Table 3 .

 3 2: Average balanced classification accuracy (in %) and standard deviation of random forest classifier with the initial training set obtained from different methods over 20 stratified random splits for different budgets B. ↑ / ↓ indicate statistically significantly better/worse performance than Random Selection RS, according to a Wilcoxon rank sum test (p < 0.05) [117]. 84.32 ± 5.58 ↑ 62.48 ± 3.32 ↑ 63.69 ± 4.49 ↑ 58.22 ± 7.30 ↑ 58.74 ± 7.96 70.21 ± 14.73 ↑ 10 79.88 ± 9.91 85.23 ± 5.68 ↑ 86.80 ± 4.75 ↑ 87.59 ± 3.33 ↑ 85.59 ± 5.08 ↑ 70.58 ± 5.30 ↓ 82.40 ± 6.92 88.68 ± 4.43 ↑ 20 87.58 ± 2.91 90.74 ± 2.40 ↑ 92.43 ± 2.00 ↑ 92.34 ± 2.44 ↑ 92.58 ± 2.86 ↑ 71.89 ± 7.16 ↓ 90.92 ± 3.18 ↑ 93.88 ± 3.44 ↑ ± 0.00 ↑ 14.99 ± 0.00 ↑ 14.99 ± .00 ↑ 14.99 ± 0.00 ↑ 10.83 ± 1.98 ↓ 11.70 ± 2.26 13.59 ± 1.66 10 28.97 ± 5.66 36.68 ± 4.24 ↑ 38.15 ± 2.70 ↑ 32.85 ± 5.14 ↑ 36.00 ± 3.66 ↑ 18.56 ± 3.38 ↓ 27.21 ± 4.80 44.18 ± 2.43 ↑ 20 42.02 ± 5.83 56.69 ± 3.74 ↑ 62.99 ± 2.78 ↑ 42.30 ± 3.47 58.10 ± 4.07 ↑ 25.61 ± 2.46 ↓ 41.40 ± 4.74 71.05 ± 3.78 ↑ 07.81 ± 1.63 09.05 ± 1.86 ↑ 09.24 ± 0.96 ↑ 07.51 ± 1.84 10.82 ± 1.05 ↑ 10 13.78 ± 2.97 22.30 ± 1.55 ↑ 27.61 ± 1.59 ↑ 07.06 ± 1.85 ↓ 23.26 ± 1.76 ↑ 16.47 ± 1.67 ↑ 15.41 ± 3.18 27.53 ± 2.84 ↑ 20 19.20 ± 2.69 27.88 ± 2.46 ↑ 40.37 ± 3.22 ↑ 10.73 ± 1.98 ↓ 28.19 ± 2.14 ↑ 18.79 ± 2.42 21.14 ± 3.13 ↑ 38.63 ± 3.17 ↑ ± 2.55 ↑ 19.42 ± 1.79 ↓ 17.26 ± 3.72 ↓ 17.81 ± 4.86 ↓ 29.89 ± 0.04 ↑ 10 37.35 ± 7.19 62.54 ± 3.46 ↑ 65.63 ± 2.25 ↑ 53.90 ± 5.21 ↑ 61.39 ± 1.86 ↑ 27.17 ± 4.87 ↓ 38.33 ± 8.20 80.11 ± 2.60 ↑ 20 54.25 ± 5.86 72.26 ± 2.72 ↑ 75.80 ± 2.31 ↑ 64.00 ± 3.64 ↑ 72.34 ± 2.45 ↑ 34.78 ± 4.49 ↓ 52.24 ± 5.93 87.68 ± 4.10 ↑ ± 0.15 ↓ 28.33 ± 3.86 ↓ 29.97 ± 3.24 29.99 ± 3.74 35.07 ± 5.57 ↑ 10 42.74 ± 7.20 44.45 ± 5.71 49.26 ± 4.01 ↑ 28.43 ± 1.30 ↓ 44.92 ± 7.22 39.06 ± 3.52 45.12 ± 6.70 46.47 ± 5.98 20 55.33 ± 2.77 52.78 ± 3.27 ↓ 54.42 ± 2.99 32.91 ± 1.10 ↓ 53.82 ± 2.71 39.79 ± 1.07 ↓ 52.52 ± 4.90 ↓ 54.08 ± 4.51

	Dataset	B RS	K-Means	K-Means+ME K-Medoids	AHC	FFT	APC	TPR(USRG)
		3 16.91 ± 3.98	21.21 ± 1.80 ↑	23.87 ± 2.16 ↑ 21.24 ± 4.36 ↑ 22.74 ± 2.54 ↑	17.35 ± 3.33 16.72 ± 3.32 22.07 ± 6.20 ↑
	protein	10 28.20 ± 3.21	30.61 ± 4.56 ↑	31.40 ± 4.53 ↑	29.28 ± 4.35 31.58 ± 3.67 ↑	21.78 ± 3.80 ↓ 28.79 ± 3.43 40.49 ± 3.92 ↑
		20 36.42 ± 3.76	42.07 ± 3.90 ↑	45.53 ± 2.52 ↑	39.16 ± 4.84 43.43 ± 3.40 ↑	26.11 ± 3.37 ↓ 39.18 ± 3.70 53.99 ± 3.39 ↑
		3 55.48 ± 7.22	73.98 ± 4.59 ↑
	banknote
	coil-20 14.99 isolet 3 12.35 ± 2.62 3 07.64 ± 1.54 08.69 ± 0.85 ↑	09.68 ± 0.63 ↑
	pendigits 26.57 nursery 3 21.45 ± 3.49 21.27 ± 1.93 22.53 ± 2.09 3 30.71 ± 4.00 29.20 ± 5.19 30.23 ± 6.50 25.04

Table 4

 4

	.1.

Table 4 .

 4 1: Statistics of signatures extracted from simulated DPs of three phases: the alpha iron, the niobium carbide, and the cementite.

Table 4

 4 Table 4.2: Balanced accuracy score and mean absolute angle error of the models LSTM, CNN, and MLP trained on hierarchy or in MT with simulated DPs.

	.1 it can provide

the models with a better accuracy by letting a single model ingest all available

  Table 4.3 presents the results of our experiments, for each MT model we report performance results for the prediction of angles with maae metric, and phases with accuracy and balanced accuracy metrics. The results are reported with and without fine-tuning for the models MT/LSTM, MT/MLP, and MT/CNN, fine-tuned models are prefixed with FT, best performance are in bold. * refers to the best overall performance for each metric.

	models	accuracy balanced accuracy	maae (degrees) ϕ 1 Φ ϕ 2
	MT/LSTM	98.6% *	34.5%	92.6	8.9 18.8
	FT/MT/LSTM	98.1%	37.8% *	46.0 6.2 7.5 *
	MT/MLP	83.7%	31.5%	101.4 6.5 17.1
	FT/MT/MLP	97.8%	34.4%	39.9 * 5.9 * 8.9
	MT/CNN	93.9%	35.0%	78.0	9.6 26.0
	FT/MT/CNN	93.2%	36.1%	40.6 6.37 8.2
	Table 4.3: Balanced accuracy score and mean absolute angle error of the pretrained
	models MT/LSTM, MT/CNN, and MT/MLP on map 1, each model is compared
	with and without fine-tuning using maps 2 and 3.
	From Table 4.3, we note that the classification accuracy of all pre-trained models
	is high. It indicates a benefit in transferring from training on simulated DP sig-
	natures. All the models can successfully apply the learned knowledge of classifying
	extracted signatures from simulated diffractions to classify extracted signatures from

Table 4

 4 Therefore, discarding the duplicates will drastically reduce the data for training DL models. Additionally, for experimental TEM data, DP duplicates do not contain the same signal, depending on the detailed electron beam diffraction, the superposition of grains, each diffraction pattern is slightly different and results in a different signal in the duplicates. Hence, trained models should be able to correctly predict these DPs in experimental conditions, to consider a realistic evaluation for TEM data analysis by DL approaches.To this end, we design the following experimental protocol to evaluate the potential of DL models to analyze TEM data. We used all available diffraction data from Table 4.4, to constitute two datasets, the first dataset contains only unique DPs, and the second dataset, contains DPs dupliactes up to 100 duplicates. To sample this dataset, we undersampled all DPs images that have more than 100 duplicates, Table 4.5 resumes the statistics of this two sampled datasets.

	.4.
	phase	size	proportion label
	Al	818260	56.1%	1
	Al 6 Fe 35246	2.4%	2
	α-Fe 557322	38.2%	3
	NbC	3943	0.3%	4
	Fe 3 C 40390	2.8%	5
	γ-Fe	2252	0.2%	6
	Table 4.4: Raw TEM data statistics overall micrographs.
	The majority of traditional ML experimental protocols include the filtering of
	sample duplicates in their feature engineering steps. Sample duplicates are, in our
	case, all DP images that share the same class label and the same Euler's angles.

Thus, dropping sample duplicates is a crucial step in learning efficient models. Yet, when analyzing TEM data, sample duplicates may be essential for training DL models. First, as previously mentioned, TEM data exhibits a high volume of duplicates.

Table 4 .

 4

5: Sampled TEM data statistics from all available diffraction data.

  Table 4.6: Accuracy, balanced accuracy and mean absolute angle error of the MPSN model predictions on map 1, the reduction is in terms of number of queries. Table 4.7: Accuracy, balanced accuracy and mean absolute angle error of the MPSN model predictions on map 100T, the reduction is in terms of number of queries.

	κ reduction accuracy balanced accuracy	maae (degrees) ϕ 1 Φ ϕ 2
	0.6 99.58%	95.7%	55.9%	10.0 5.3 7.2
	0.7 98.59%	97.5%	63.5%	5.7 3.2 4.7
	0.8 94.70%	98.4%	75.7%	3.6 2.1 3.2
	0.9 66.54%	99.4%	88.8%	1.3 0.8 1.2
	κ reduction accuracy balanced accuracy	maae (degrees) ϕ 1 Φ ϕ 2
	0.6 99.50%	99.2%	66.6%	50.9 39.3 51.0
	0.7 97.84%	99.3%	73.3%	22.4 18.1 24.3
	0.8 92.37%	99.6%	87.9%	11.3 9.0 12.8
	0.9 65.67%	99.9%	95.2%	4.8 3.9 5.8

https://miai.univ-grenoble-alpes.fr

For research purposes, the code will be freely available.

https://blog.xkcd.com/2010/05/03/color-survey-results/

size allows us to efficiently simulate the Euler's orientation space of a given phase.

Once the Euler's orientation space is simulated for a given phase, the last step of preprocessing is to filter out the symmetries and keep only the descriptors of angles in the fundamental zone of each phase. This last step is dependent on the symmetry class of each phase since for different classes' symmetries, different fundamental zones need to be considered [START_REF] Nolze | Euler angles and crystal symmetry[END_REF]). minimize

Where t refers to the t th pair in the created sample set of pairs. The strategy for sampling image pairs is crucial for standard siamese models as same as for MPSN After training the model, we can predict the class label for the phase determination map and the segmentation map from preprocessed DPs using the algorithm below, which takes as input the TEM diffraction data of a micrograph and return, phase labels and segmentation ids to construct the maps. Predict pair labels on pairs (g, duplicate(x)) with the classification head of mpsn using the confidence level κ.

Add set of the positive pairs from the prediction to L with labels (p, c).

Remove this set from g. Set c = c + 1 end while end for Output : L the set of labeled TEM DP images, given unlabeled as input in S.

The algorithm above takes advantage of both predictions in the MPSN model to retrieve the segmentation map of a given micrograph, the parameter κ determines the precision of the retrieved map, higher values will result in a segmentation map with a high number of segments, whereas values close to 0.5 will produce segmentations with fewer and larger segments. The figure below shows the predicted segmentation maps of the micrographs 1 and 100T by the MPSN model. Figure 4.13 shows the segmentation maps of map 1 and 100T, predicted by the trained MPSN model using the algorithms described above. For the purpose of visualization clarity we fixed κ to 0.7 rather than the default value of 0.8. We observe that the predicted are visually similar to the ground truth maps, note that for the segmentation maps, we are interested in the segment shapes and not there color. The color id is just a code to differentiate between different segment. In our case, we suppose that each segment contains a unique DP with a given phase label and orientation. Especially for the micrograph of map 100T, the MPSN model is able to retrieved the mosaic patterns in the Euler's angle map, this confirms our intuition that using DL to differentiate between DP pairs may leads to better results than by addressing the regression task of angles, in particular when generalizing to unseen orientations.