François Bachoc

José Daniel Betancourt
email: jose.betancourt@math.univ-toulouse.fr

Reinhard Furrer
email: reinhard.furrer@math.uzh.ch

Thierry Klein
email: thierry.klein@math.univ-toulouse.fr

Francois Bachoc
email: francois.bachoc@math.univ-toulouse.fr

José Bétancourt

Asymptotic properties of the maximum likelihood and cross validation estimators for transformed Gaussian processes

Keywords: AMS 2000 subject classifications: Primary 62M30; secondary 62F12 covariance parameters, asymptotic normality, consistency, weak dependence, random fields, increasing-domain asymptotics

Introduction

Kriging [START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF][START_REF] Rasmussen | Gaussian Processes for Machine Learning[END_REF] consists of inferring the values of a (Gaussian) random field given observations at a finite set of points. It has become a popular method for a large range of applications, such as geostatistics [START_REF] Matheron | La Théorie des Variables Régionalisées et ses Applications[END_REF], numerical code approximation [START_REF] Sacks | Design and analysis of computer experiments[END_REF][START_REF] Santner | The Design and Analysis of Computer Experiments[END_REF][START_REF] Bachoc | Improvement of code behavior in a design of experiments by metamodeling[END_REF], calibration [START_REF] Paulo | Calibration of computer models with multivariate output[END_REF][START_REF] Bachoc | Calibration and improved prediction of computer models by universal Kriging[END_REF], global optimization [START_REF] Jones | Efficient global optimization of expensive black box functions[END_REF], and machine learning [START_REF] Rasmussen | Gaussian Processes for Machine Learning[END_REF].

When considering a Gaussian process, one has to deal with the estimation of its covariance function. Usually, it is assumed that the covariance function belongs to a given parametric family (see [START_REF] Abrahamsen | A review of Gaussian random fields and correlation functions[END_REF] for a review of classical families). In this case, the estimation boils down to estimating the corresponding covariance parameters. Nowadays, the main estimation techniques are based on maximum likelihood [START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF][START_REF] Rasmussen | Gaussian Processes for Machine Learning[END_REF], cross-validation [START_REF] Zhang | Kriging and cross validation for massive spatial data[END_REF][START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF][START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF][START_REF] Bachoc | Cross-validation estimation of covariance parameters under fixed-domain asymptotics[END_REF] and variation estimators [START_REF] Istas | Quadratic variations and estimation of the local Hölder index of a Gaussian process[END_REF][START_REF] Anderes | On the consistent separation of scale and variance for Gaussian random fields[END_REF][START_REF] Azaïs | Semiparametric estimation of the variogram of a Gaussian process with stationary increments[END_REF].

The asymptotic properties of estimators of the covariance parameters have been widely studied in the two following frameworks. The fixed-domain asymptotic framework, sometimes called infill asymptotics [START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF][START_REF] Cressie | Statistics for Spatial Data[END_REF], corresponds to the case where more and more data are observed in some fixed bounded sampling domain. The increasing-domain asymptotic framework corresponds to the case where the sampling domain increases with the number of observed data.

Under fixed-domain asymptotics, and particularly in low dimensional settings, not all covariance parameters can be estimated consistently (see [START_REF] Ibragimov | Gaussian Random Processes[END_REF][START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF]). Hence, the distinction is made between microergodic and non-microergodic covariance parameters [START_REF] Ibragimov | Gaussian Random Processes[END_REF][START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF]. Although non-microergodic parameters cannot be estimated consistently, they have an asymptotically negligible impact on prediction [START_REF] Stein | Asymptotically efficient prediction of a random field with a misspecified covariance function[END_REF][START_REF] Stein | Bounds on the efficiency of linear predictions using an incorrect covariance function[END_REF][START_REF] Stein | Uniform asymptotic optimality of linear predictions of a random field using an incorrect second-order structure[END_REF][START_REF] Zhang | Inconsistent estimation and asymptotically equivalent interpolations in model-based geostatistics[END_REF]. There is, however, a fair amount of literature on the consistent estimation of microergodic parameters (see for instance [START_REF] Zhang | Inconsistent estimation and asymptotically equivalent interpolations in model-based geostatistics[END_REF][START_REF] Kaufman | The role of the range parameter for estimation and prediction in geostatistics[END_REF][START_REF] Du | Fixed-domain asymptotic properties of tapered maximum likelihood estimators[END_REF][START_REF] Wang | On fixed-domain asymptotics and covariance tapering in Gaussian random field models[END_REF][START_REF] Ying | /10/16 file: nonGaussRF.tex date: November 27, 2019 data from a Gaussian process[END_REF][START_REF] Ying | Maximum likelihood estimation of parameters under a spatial sampling scheme[END_REF]).

This paper focuses on the increasing-domain asymptotic framework. Indeed, generally speaking, increasing-domain asymptotic results hold for significantly more general families of covariance functions than fixed-domain ones. Under increasing-domain asymptotics, the maximum likelihood and cross validation estimators of the covariance parameters are consistent and asymptotically normal under mild regularity conditions [START_REF] Mardia | Maximum likelihood estimation of models for residual covariance in spatial regression[END_REF][START_REF] Shaby | Tapered covariance: Bayesian estimation and asymptotics[END_REF][START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF][START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF].

All the asymptotic results discussed above are based on the assumption that the data come from a Gaussian random field. This assumption is indeed theoretically convenient but might be unrealistic for real applications. When the data stem from a non-Gaussian random field, it is still relevant to estimate the covariance function of this random field. Hence, it would be valuable to extend the asymptotic results discussed above to the problem of estimating the covariance parameters of a non-Gaussian random field.

In this paper, we provide such an extension, in the special case where the non-Gaussian random field is a deterministic (unknown) transformation of a Gaussian random field. Models of transformed Gaussian random fields have been used extensively in practice (for example in [START_REF] Chiles | Geostatistics: Modeling Spatial Uncertainty[END_REF][START_REF] Xu | Tukey g-and-h random fields[END_REF][START_REF] Alegría | Estimating covariance functions of multivariate skew-Gaussian random fields on the sphere[END_REF][START_REF] Yan | Gaussian likelihood inference on data from trans-Gaussian random fields with Matérn covariance function[END_REF]).

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: [START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF] Under reasonable regularity assumptions, we prove that applying the (Gaussian) maximum likelihood estimator to data from a transformed Gaussian random field yields a consistent and asymptotically normal estimator of the covariance parameters of the transformed random field. This (Gaussian) maximum likelihood estimator corresponds to what would typically be done in practice when applying a Gaussian process model to a non-Gaussian spatial process. This estimator does not need to know the existence of the non-linear transformation function and is not based on the exact density of the non-Gaussian data. We refer to Remark 2 for further details and discussion on this point.

We then obtain the same consistency and asymptotic normality result when considering a cross validation estimator. In addition, we establish the joint asymptotic normality of both these estimators, which provides the asymptotic distribution of a large family of aggregated estimators. Our asymptotic results on maximum likelihood and cross validation are illustrated by numerical simulations.

To the best of our knowledge, our results (Theorems 3, 4, 5, 6 and 7) provide the first increasing-domain asymptotic analysis of Gaussian maximum likelihood and cross validation for non-Gaussian random fields. Our proofs intensively rely on Theorems 1 and 2. Theorem 1 shows that the components of inverse covariance matrices are bounded by inverse polynomial functions of the corresponding distance between observation locations. Theorem 2 provides a generic central limit theorem for quadratic forms constructed from transformed Gaussian processes. These two theorems have an interest in themselves.

The rest of the paper is organized as follows. In Section 2, general properties of transformed Gaussian processes are provided. In Section 3, Theorems 1 and 2 are stated. In Section 4, an application of these two theorems is given to the case of estimating a single variance parameter. In Section 5, the consistency and asymptotic normality results for general covariance parameters are given. The joint asymptotic normality result is also given in this section. The simulation results are provided in Section 6. All the proofs are provided in the appendix.

General properties of transformed Gaussian processes

In applications, the use of Gaussian process models may be too restrictive. One possibility for obtaining larger and more flexible classes of random fields is to consider transformations of Gaussian processes. In this section, we now introduce the family of transformed Gaussian processes that we will study asymptotically in this paper. This family is determined by regularity conditions on the covariance function of the original Gaussian process and on the transformation function.

Let us first introduce some notation. Throughout the paper, C inf > 0 (resp. C sup < ∞) denotes a generic strictly positive (resp. finite) constant. This constant never depends on the number of observations n, or on the covariance parameters (see Section 5), but is allowed to depend on other variables. We mention these dependences explicitly in cases of ambiguity. The values of C inf and C sup may change across different occurrences.

For a vector x of dimension d we let |x| = max i=1,...,d |x i |. Further, the Euclidean and operator norms are denoted by ||x|| and by ||M || op = sup{||M x|| : ||x|| ≤ 1}, for any matrix M . We let λ 1 (B) ≥ . . . ≥ λ r (B) be the r eigenvalues of a r ×r symmetric matrix B. We let ρ 1 (B) ≥ . . . ≥ ρ r (B) ≥ 0 be the r singular values of a r × r matrix B. We let N be the set of non-zero natural numbers.

Further, we define the Fourier transform of a function h : R d → R by ĥ(f ) = (2π) -d R d h(t)e -if t dt, where i 2 = -1. For a sequence of observation locations, the next condition ensures that a fixed distance between any two observation locations exists. This condition is classical [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF][START_REF] Bachoc | On the smallest eigenvalues of covariance matrices of multivariate spatial processes[END_REF].

Condition 1. We say that a sequence of observation locations, (x i ) i∈N , x i ∈ R d , is asymptotically well-separated if we have inf i,j∈N,i =j |x i -x j | > 0.

The next condition on a stationary covariance function is classical under increasing-domain asymptotics. This condition provides asymptotic decorrelation for pairs of distant observation locations and implies that covariance matrices are asymptotically well-conditioned when a minimal distance between any two distinct observation locations exists [START_REF] Mardia | Maximum likelihood estimation of models for residual covariance in spatial regression[END_REF][START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].

Condition 2. We say that a stationary covariance function k on R d is subexponential and asymptotically positive if: i) C sup and C inf exist such that, for all s ∈ R d , we have |k(s)| ≤ C sup exp (-C inf |s|);

(1)

ii) For any sequence (x i ) i∈N satisfying Condition 1, we have inf n∈N λ n (Σ) > 0, where Σ is the n × n matrix (k(x i -x j )) i,j=1,...,n .

In Condition 2, we remark that k : R d → R is called a stationary covariance function in the sense that (x 1 , x 2 ) → k(x 1 -x 2 ) is a covariance function. We use this slight language abuse for convenience.

We also remark that, when non-transformed Gaussian processes are considered, a polynomial decay of the covariance function in Condition 2 i) is sufficient to obtain asymptotic results [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF][START_REF] Bachoc | Asymptotic analysis of covariance parameter estimation for Gaussian processes in the misspecified case[END_REF]. Here an exponential decay is needed in the proofs to deal with the non-Gaussian case. Nevertheless, most classical families of covariance functions satisfy inequality [START_REF] Abrahamsen | A review of Gaussian random fields and correlation functions[END_REF].

When considering a transformed Gaussian process, we will consider a transformation satisfying the following regularity condition, which enables us to subsequently obtain regularity conditions on the covariance function of the transformed Gaussian process. Condition 3. Let F : R → R be a fixed non-constant continuously differentiable function, with derivative F . We say that F is sub-exponential and non-decreasing if: ii) The function F is non-decreasing on R.

In the following lemma, we show that the covariance function of a transformed Gaussian process satisfies Condition 2, when Conditions 2 and 3 are satisfied, for the original process and for the transformation.

Lemma 1. Assume that the stationary covariance function k satisfies Condition 2 and that the transformation F satisfies Condition 3. Let X be a zero-mean Gaussian process with covariance function k and let k be the stationary covariance function of F (X(•)). Then, k satisfies Condition 2.

In the next lemma, we show that we can replace the condition of an increasingtransformation by the condition of a monomial transformation of even degree (with an additive constant).

Lemma 2. If a covariance function k satisfies Condition 2 (i) and if the Fourier transform k of k is strictly positive on R d , then k satisfies Condition 2 (ii). Furthermore, in this case, in Lemma 1, Condition 3 (ii) can be replaced by the condition F (x) = x 2r + u for r ∈ N, u ∈ R and x ∈ R.

Two main technical results

Transformed Gaussian process framework

Throughout the paper, we will consider an unobserved latent Gaussian process Z on R d with d ∈ N fixed. Assume that Z has zero-mean and stationary covariance function k Z . We assume throughout that k Z satisfies Condition 2.

We consider a fixed transformation function T satisfying Condition 3. We assume that we observe the transformed Gaussian process Y , defined by Y (s) = T (Z(s)) for any s ∈ R d .

We assume throughout that the random field Y has zero-mean. We remark that, for a non-linear transformation F : R → R, the random variable F (X(s)) does not necessarily have zero mean for s ∈ R d . Hence, we implicitly assume that T is of the form F -E[F (Z(x))], where F satisfies Condition 3. Note that E[F (Z(x))] is constant by stationarity and that, if F satisfies Condition 3 or the condition specified in Lemma 2, then F -E[F (Z(x))] also satisfies these conditions. Here, as in many references, the assumption of a zero-mean for Y is made by notational convenience and for the sake of brevity, and could be alleviated.

We let k Y be the covariance function of Y . We remark that, from Lemma 1, k Y also satisfies Condition 2.

We let (s i ) i∈N be the sequence of observation locations, with s i ∈ R d for i ∈ N. We assume that (s i ) i∈N satisfies Condition 1.

For n ∈ N, we let y = (y 1 , . . . , y n ) = (Y (s 1 ), . . . , Y (s n )) be the (non-Gaussian) observation vector and R = (k Y (s i -s j )) i,j=1,...,n be its covariance matrix.

The problem of estimating the covariance function k Y from the observation vector y is crucial and has been extensively studied in the Gaussian case (when T is a linear function). Classically, we assume that k Y belongs to a parametric family of covariance functions. We will provide the asymptotic properties of two of the most popular estimators of the covariance parameters: the one based on the (Gaussian) maximum likelihood [START_REF] Rasmussen | Gaussian Processes for Machine Learning[END_REF][START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF] and the one based on cross validation [START_REF] Bachoc | Cross-validation estimation of covariance parameters under fixed-domain asymptotics[END_REF][START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF][START_REF] Zhang | Kriging and cross validation for massive spatial data[END_REF]. To our knowledge, such properties are currently known only for Gaussian processes, and we will provide analogous properties in the transformed Gaussian framework.

Bounds on the elements of inverse covariance matrices

In the case of (non-transformed) Gaussian processes, one important argument for establishing the asymptotic properties of the maximum likelihood and cross validation estimators is to bound the largest eigenvalue of the inverse covariance matrix R -1 . Unfortunately, due to the non-linearity of the transformation T , such a bound on the largest eigenvalue is no longer sufficient in our setting.

To circumvent this issue, we obtain in the following theorem stronger control over the matrix R -1 : we show that its coefficients decrease polynomially quickly with respect to the corresponding distance between observation locations. This theorem may have an interest in itself.

Theorem 1. Consider the setting of Section 3.1. For all fixed 0 < τ < ∞, we have, for all n ∈ N and i, j = 1, . . . , n

R -1 i,j ≤ C sup 1 + |s i -s j | d+τ ,
where C sup depends on τ but does not depend on n, i, j.

Central limit theorem for quadratic forms of transformed

Gaussian processes

In the proofs on covariance parameter estimation of Gaussian processes, a central step is to show the asymptotic normality of quadratic forms of large Gaussian vectors. This asymptotic normality is established by diagonalizing the matrices of the quadratic forms. This diagonalization provides sums of squares of decorrelated Gaussian variables and thus sums of independent variables [START_REF] Istas | Quadratic variations and estimation of the local Hölder index of a Gaussian process[END_REF][START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].

In the transformed Gaussian case, one has to deal with quadratic forms involving transformations of Gaussian vectors. Hence, the previous arguments are not longer valid. To overcome this issue, we provide below a general central limit theorem for quadratic forms of transformed Gaussian vectors. This theorem may have an interest in itself.

This asymptotic normality result is established by considering a metric d w generating the topology of weak convergence on the set of Borel probability measures on Euclidean spaces (see, e.g., [START_REF] Dudley | Real Analysis and Probability[END_REF] p. 393). We prove that the distance between the sequence of the standardized distributions of the quadratic forms and Gaussian distributions decreases to zero when n increases. The introduction of the metric d w enables us to formulate asymptotic normality results in cases when the sequence of standardized variances of the quadratic forms does not necessarily converge as n → ∞.

Theorem 2. Consider the setting of Section 3.1. Let (A n ) n∈N be a sequence of matrices such that A n has dimension n × n for any n ∈ N. Let A = A n for concision. Assume that for all n ∈ N and for all i, j = 1, . . . , n,

|A i,j | ≤ C sup 1 + |s i -s j | d+C inf ,
where C sup does not depend on i, j. Let

V n = 1 n y Ay. ( 2
)
Let L n be the distribution of √ n(V n -E[V n ]). Then, as n → ∞, d w L n , N [0, n Var(V n )] → 0.
In addition, the sequence (n Var(V n )) n∈N is bounded.

Remark 1. In the case where limits E ∞ and σ ∞ exist, such that

E[V n ] -E ∞ = o(n -1/2 )
and the sequence (n Var(V n )) n∈N converges to a fixed variance σ 2 ∞ , the result of Theorem 2 can be written in the classical form

√ n (V n -E ∞ ) L → N [0, σ 2 ∞ ],
as n → ∞.

Estimation of a single variance parameter

We let σ 2 0 be the marginal variance of Y , that is Var(Y (s)) = σ 2 0 for any s ∈ R d . We let k Y = σ 2 0 c Y be the stationary covariance function of Y , where c Y is a correlation function. We assume that the same conditions as in Section 3 hold. Then, the standard Gaussian maximum likelihood estimator of the variance parameter is

σ2 ML = 1 n y C -1 y,
where C = (c Y (s i -s j )) 1≤i,j≤n . One can simply show that E[σ 2 ML ] = σ 2 0 even though y is not a Gaussian vector, since y has mean vector 0 and covariance matrix σ 2 0 C. Hence, a direct consequence of Theorems 1 and 2 is then that the maximum likelihood estimator is asymptotically Gaussian, with a n 1/2 rate of convergence, even though the transformed process Y is not a Gaussian process.

Corollary 1. Let L n be the distribution of √ n(σ 2 ML -σ 2 0 ). Then, as n → ∞, d w L n , N [0, n Var(σ 2 ML -σ 2 0 )] → 0.
In addition, the sequence n Var(σ 2 ML -σ 2 0 ) n∈N is bounded. The proof of Theorem 2 actually allows us to study another estimator of the variance σ 2 0 of the form σ2

ML,K = 1 n y C -1 K y, where (C -1 K ) i,j = (C -1 ) i,j 1 |si-sj |≤K .
The proof of Theorem 2 then directly implies the following.

Corollary 2. Let K n be any sequence of positive numbers tending to infinity. Let L Kn,n be the distribution of √ n(σ 2 ML,Kn -σ 2 0 ). Then, as n → ∞,

d w L Kn,n , N [0, n Var(σ 2 ML,Kn -σ 2 0 )] → 0.
In addition, we have

n Var(σ 2 ML,Kn -σ 2 0 ) -n Var(σ 2 ML -σ 2 0 ) → 0.
The above corollary shows that one can taper the elements of C -1 when estimating the variance parameter, and obtain the same asymptotic distribution of the error, as long as the taper range goes to infinity, with no rate assumption. This result may have an interest in itself, in view of the existing literature on covariance tapering for Gaussian processes under increasing-domain asymptotics [START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF][START_REF] Shaby | Tapered covariance: Bayesian estimation and asymptotics[END_REF]. We also remark that the computation costs of σ2 ML,K and σ2 ML have the same orders of magnitude because C -1 needs to be computed in both cases.

General covariance

Framework

As in Section 3.1, we consider a zero-mean Gaussian process Z defined on R d with covariance function k Z satisfying Condition 2. Let Y be the random field defined for any s ∈ R d by Y (s) = T (Z(s)), where T is a fixed function satisfying Condition 3. Furthermore we assume that Y has zero-mean function and we recall that from Lemma 1, its covariance function k Y also satisfies Condition 2. Finally, the sequence of observation locations (s i ) i∈N satisfies Condition 1.

Let {k Y,θ ; θ ∈ Θ} be a parametric set of stationary covariance functions on R d , with Θ a compact set of R p . We consider the following condition on this parametric set of covariance functions. Condition 4. For all s ∈ R d , k Y,θ (s) is three times continuously differentiable with respect to θ, and we have

sup θ∈Θ |k Y,θ (s)| ≤ C sup exp (-C inf |s|), (3)
≤ C sup 1 + |s| d+C inf . (4)
The smoothness condition in ( 4) is classical and is assumed for instance in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF]. As discussed after Condition 2, milder versions of (3) can be assumed for nontransformed Gaussian processes, but (3) is satisfied by most classical families of covariance functions nonetheless.

The next condition, on the Fourier transforms of the covariance functions in the model, is standard.

Condition 5. We let kY,θ be the Fourier transform of k Y,θ . Then kY,θ (s) is jointly continuous with respect to θ and s and is strictly positive on Θ × R d .

Finally, the next condition means that we address the well-specified case [START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF][START_REF] Bachoc | Asymptotic analysis of covariance parameter estimation for Gaussian processes in the misspecified case[END_REF], where the family of covariance functions does contain the true covariance function of Y . The well-specified case is considered in the majority of the literature on Gaussian processes. Condition 6. There exists θ 0 in the interior of Θ such that k Y = k Y,θ0 .

In the next two subsections, we study the asymptotic properties of two classical estimators (maximum likelihood and cross validation) for the covariance parameter θ 0 . The asymptotic properties of these estimators are already known for Gaussian processes and we extend them to the non-Gaussian process Y .

Maximum Likelihood

For n ∈ N, let R θ be the n × n matrix k Y,θ (s i -s j ) i,j=1,...,n , and let θML ∈ argmin θ∈Θ L θ [START_REF] Azaïs | Level Sets and Extrema of Random Processes and Fields[END_REF] with

L θ = 1 n log(det(R θ )) + y R -1 θ y
be a maximum likelihood estimator. We will provide its consistency under the following condition.

Condition 7. For all α > 0 we have

lim inf n→∞ inf ||θ-θ0||≥α 1 n n i,j=1 k Y,θ (s i -s j ) -k Y,θ0 (s i -s j ) 2 > 0.
Condition 7 can be interpreted as a global indentifiability condition. It implies in particular that two different covariance parameters yield two different distributions for the observation vector. It is used in several studies, for instance [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF]. Remark 2. The (Gaussian) maximum likelihood estimator θML in Theorem 3 is not, strictly speaking, a maximum likelihood estimator, because the distribution of the observation vector y is non-Gaussian. If the transformation T is known, and assuming that the covariance function of the Gaussian process Z belongs to a parametric set {k Z,α , α ∈ A}, a (non-Gaussian) maximum likelihood estimator αZ,ML (y) could be defined. When T is bijective, y is a fixed invertible transformation of (Z(s 1 ), . . . , Z(s n )) and so this maximum likelihood estimator αZ,ML (y) coincides with the standard Gaussian maximum likelihood estimator based on Z. Asymptotically, it is known that αZ,ML (y) converges to the true parameter α 0 for which Z has covariance function k Z,α0 . In Theorem 3, we show that θML similarly converges to the true parameter θ 0 for which Y has covariance function k Y,θ0 . Notice that α 0 and θ 0 usually do not coincide. For instance, if the covariance models {k Y,θ ; θ ∈ Θ} and {k Z,α ; α ∈ A} are both {σ 2 e -ρ||•|| }, then if α 0 = (σ 2 0 , ρ 0 ), by Mehler's formula [START_REF] Azaïs | Level Sets and Extrema of Random Processes and Fields[END_REF],

Cov(Y (s + τ ), Y (s)) = 2 Cov(Z(s + τ ), Z(s)) 2 = 2σ 4 0 e -2ρ0||τ ||
and thus θ 0 = (2σ 4 0 , 2ρ 0 ). Hence, the exact (non-Gaussian) maximum likelihood estimator αZ,ML (y) based on the knowledge of T and modeling the covariance function of Z and the pseudo (Gaussian) maximum likelihood estimator θML that ignores T and models the covariance function of Y estimate covariance parameters of different natures and do not have the same limit. Condition 8. For any (α 1 , . . . , α p ) = (0, . . . , 0), we have

lim inf n→∞ 1 n n i,j=1 p =1 α ∂k Y,θ0 (s i -s j ) ∂θ 2 > 0.
Condition 8 can be interpreted as a regularity condition and as a local indentifiability condition around θ 0 . In the next theorem, we provide the asymptotic normality of the maximum likelihood estimator. In this theorem, the matrices M θ0 and Σ θ0 depend on the number of observation locations. Theorem 4. Consider the setting of Section 5.1 for Z, T , Y and (s i ) i∈N . Assume that Conditions 4, 5, 6, 7 and 8 hold. Let M θ0 be the p × p matrix defined by

(M θ0 ) i,j = 1 n tr R -1 θ0 ∂R θ0 ∂θ i R -1 θ0 ∂R θ0 ∂θ j .
Let Σ θ0 be the p×p covariance matrix defined by (Σ θ0 ) i,j = Cov(n 1/2 ∂L θ0 /∂θ i , n 1/2 ∂L θ0 /∂θ j ).

Let L θ0,n be the distribution of √ n( θML -θ 0 ). Then, as n → ∞,

d w L θ0,n , N [0, M -1 θ0 Σ θ0 M -1 θ0 ] → 0. ( 6
)
imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

In addition, lim sup

n→∞ λ 1 (M -1 θ0 Σ θ0 M -1 θ0 ) < +∞. ( 7
)
Remark 3. If the sequences of matrices M θ0 and Σ θ0 converge as n → ∞, then √ n( θML -θ 0 ) converges in distribution to a fixed centered Gaussian distribution where the limiting covariance matrix is given by

lim n→∞ M -1 θ0 Σ θ0 M -1 θ0 .
Conditions 7 and 8 involve the model of covariance functions {k Y,θ ; θ ∈ Θ} and the sequence of observation locations (s i ) i∈N but not the transformation T . They are further discussed, in a different context, in [START_REF] Bachoc | A Gaussian process regression model for distribution inputs[END_REF]. We believe that these conditions are mild. For instance, Conditions 7 and 8 hold when the sequence of observation locations (s i ) i∈N is a randomly perturbed regular grid, as in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].

Lemma 3 (see [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF]). For i ∈ N, let s i = g i + i , where (g i ) i∈N is a sequence with, for N ∈ N, {g 1 , . . . , g N d } = {(i 1 , . . . , i d ); i 1 = 1, . . . , N, . . . , i d = 1, . . . , N } and where ( i ) i∈N is a sequence of i.i.d. random variables with distribution on [-1/2 + δ, 1/2 -δ] d with 0 < δ < 1/2. Then, Condition 7 holds almost surely, provided that, for θ = θ 0 , there exists i ∈ Z d for which k Y,θ (i + 1 -2 ) and k Y,θ0 (i + 1 -2 ) are not almost surely equal.

Furthermore, Condition 8 holds almost surely, provided that for (α 1 , . . . , α p ) = (0, . . . , 0), there exists i ∈ Z d for which p =1 α ∂k Y,θ0 (i + 1 -2 )/∂θ is not almost surely equal to zero.

Cross Validation

We consider the cross validation estimator consisting of minimizing the sum of leave-one-out square errors.

Since the leave-one-out errors do not depend on the variance k Y,θ (0), we introduce some additional notation. In Subsections 5.3 and 5.4, we let Θ = [σ 2 inf , σ 2 sup ] × S where 0 < σ 2 inf < σ 2 sup < ∞ are fixed and where S is compact in R p-1 . We let θ = (σ 2 , ψ) with σ 2 inf ≤ σ 2 ≤ σ 2 sup and ψ ∈ S. We assume that for θ ∈ Θ, k Y,θ = σ 2 c Y,ψ , with c Y,ψ a stationary correlation function. Similarly, we let θ 0 = (σ 2 0 , ψ 0 ). For ψ ∈ S, we let

C ψ = c Y,ψ (s i -s j ) i,j=1,...,n . Cross validation is defined for n ∈ N by ψCV ∈ argmin ψ∈S CV ψ , (8)
with

CV ψ = 1 n y C -1 ψ diag(C -1 ψ ) -2 C -1 ψ y,
where diag(M ) is obtained by setting the off-diagonal elements of a square matrix M to zero. The criterion CV ψ is the sum of leave-one-out square errors, as is shown for instance in [START_REF] Dubrule | Cross validation of Kriging in a unique neighborhood[END_REF][START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]. The asymptotic behaviour of ψCV was studied in the Gaussian framework in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF] and under increasing-domain asymptotics. We also remark that, in the Gaussian framework, a modified leave-one-out criterion was studied in [START_REF] Bachoc | Cross-validation estimation of covariance parameters under fixed-domain asymptotics[END_REF] in the case of infill asymptotics.

The next identifiability condition is also made in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].

Condition 9. For all α > 0, we have

lim inf n→∞ inf ||ψ-ψ0||≥α 1 n n i,j=1 (c Y,ψ (s i -s j ) -c Y,ψ0 (s i -s j )) 2 > 0.
The next theorem provides the consistency of the cross validation estimator.

Theorem 5. Consider the setting of Section 5.1 for Z, T , Y and (s i ) i∈N . Assume that Conditions 4, 5, 6 and 9 hold. Then, as n → ∞,

ψCV p → ψ 0 .
The next condition is a local identifiability condition.

Condition 10. For any (α 1 , . . . , α p-1 ) = (0, . . . , 0), we have

lim inf n→∞ 1 n n i,j=1 p-1 =1 α ∂ ∂ψ (c Y,ψ0 (s i -s j )) 2 > 0.
In the next theorem, we provide the asymptotic normality of the cross validation estimator. In this theorem, the matrices N ψ0 and Γ ψ0 depend on the number of observation locations. Theorem 6. Consider the setting of Section 5.1 for Z, T , Y and (s i ) i∈N . Assume that Conditions 4, 5, 6, 9 and 10 hold. Let N ψ0 be the (p -1) × (p -1) matrix defined by

(N ψ0 ) i,j = - 8 n tr ∂C ψ0 ∂ψ j C -1 ψ0 diag(C -1 ψ0 ) -3 diag C -1 ψ0 ∂C ψ0 ∂ψ i C -1 ψ0 C -1 ψ0 + 2 n tr ∂C ψ0 ∂ψ j C -1 ψ0 diag(C -1 ψ0 ) -2 C -1 ψ0 ∂C ψ0 ∂ψ i C -1 ψ0 + 6 n tr diag(C -1 ψ0 ) -4 diag C -1 ψ0 ∂C ψ0 ∂ψ i C -1 ψ0 diag C -1 ψ0 ∂C ψ0 ∂ψ j C -1 ψ0 C -1 ψ0 .
Let Γ ψ0 be the (p-1)×(p-1) covariance matrix defined by

(Γ ψ0 ) i,j = Cov(n 1/2 ∂CV ψ0 /∂ψ i , n 1/2 ∂CV ψ0 /∂ψ j ). Let Q ψ0,n be the distribution of √ n( ψCV -ψ 0 ). Then, as n → ∞, d w Q ψ0,n , N [0, N -1 ψ0 Γ ψ0 N -1 ψ0 ] → 0. ( 9
)
In addition, lim sup

n→∞ λ 1 (N -1 ψ0 Γ ψ0 N -1 ψ0 ) < +∞. ( 10
)
imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

Similarly as for maximum likelihood, Condition 9 is a global identifiability condition for the correlation function. In the same way, Condition 10 is a local identifiability condition for the correlation function around ψ 0 . The sequence of observation locations presented in Lemma 3 also satisfies Conditions 9 and 10 by replacing k Y,θ with c Y,ψ .

We remark that the conditions for cross validation imply those for maximum likelihood.

Joint asymptotic normality

From Theorems 4 and 6, both the maximum likelihood and cross validation estimators converge at the standard parametric rate n 1/2 . Let us write θML = (σ 2 ML , ψML ). In the case where T is the identity function (that is, where we observe Gaussian processes instead of transformed Gaussian processes), numerical experiments tend to show that ψML is more accurate than ψCV [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF]. Indeed, when T is the identity function, maximum likelihood is based on the Gaussian probability density function of the observation vector.

In contrast, when T is not the identity function, ψML is an M-estimator based on a criterion which does not coincide with the observation probability density function anymore. Hence, it is conceivable that ψCV could become more accurate than ψML . Furthermore, it is possible that using linear combinations of these two estimators could result in a third one with improved accuracy [START_REF] Lavancier | A general procedure to combine estimators[END_REF][START_REF] Bates | The combination of forecasts[END_REF].

Motivated by this discussion, we now provide a joint central limit theorem for the maximum likelihood and cross validation estimators. Theorem 7. Consider the setting of Section 5.1 for Z, T , Y and (s i ) i∈N . Assume that Conditions 4, 5, 6, 9 and 10 hold. Let D θ0 be the (2p -1) × (2p -1) block diagonal matrix with first p×p block equal to M θ0 and second (p-1)×(p-1) block equal to N ψ0 , with the notation of Theorems 4 and 6. Also let Ψ θ0 be the (2p -1) × (2p -1) covariance matrix of the vector n 1/2 (∂L θ0 /∂θ, ∂CV ψ0 /∂ψ).

Let Q θ0,n be the distribution of

√ n θML -θ 0 ψCV -ψ 0 .
Then, as n → ∞,

d w Q θ0,n , N [0, D -1 θ0 Ψ θ0 D -1 θ0 ] → 0. ( 11
)
In addition, lim sup obtain the asymptotic normality of the new estimator f ( ψML , ψCV ). A classical choice for f is f (ψ 1 , ψ 2 ) = λψ 1 + (1 -λ)ψ 2 , which leads to linear aggregation [START_REF] Lavancier | A general procedure to combine estimators[END_REF][START_REF] Bates | The combination of forecasts[END_REF]. We remark that selecting an optimal λ leading to the smallest asymptotic covariance matrix necessitates an estimation of the asymptotic covariance matrix in Theorem 7. We leave this as an open problem for further research.

n→∞ λ 1 (D -1 θ0 Ψ θ0 D -1 θ0 ) < +∞. ( 12
)

Illustration

In this section we numerically illustrate the convergence of different estimators as stated in Corollary 1 and Theorems 4, 6 and 7. We use the following simulation setup in dimension d = 2. For n = 4(m + 1/2) 2 we define the grid {-m, . . . , m} 2 and add i.i.d. variables with uniform distribution on [-0.4, 0.4] 2 to obtain n observation points. Thus, we have a distance of at least ∆ = 0.2 between the individual observation locations. The zero-mean Gaussian process Z has stationary covariance function k Z (s) = σ 2 0 exp(-||s||/ρ 0 ), s ∈ R 2 and we will denote this reference case as the Gaussian case throughout. We define the zero-mean process Y = T (Z) = Z 2 -σ 2 0 and we will denote this case as the non-Gaussian case. Recall that k Y (s) = 2k Z (2s) = 2σ 4 0 exp(-2||s||/ρ 0 ) (see Remark 2). We set the marginal variance to σ 2 0 = 1.5 and the range to ρ 0 = 2. Hence, in the non-Gaussian case, the marginal variance of Y is 2σ 4 0 = 4.5 with a range of ρ 0 /2 which is equal to a half of that of Z.

To start, we consider the maximum likelihood estimates of the marginal variance parameters, when the range of Y or Z is assumed to be known, i.e., Corollary 1. Figure 1 illustrates the empirical densities of L n in Corollary 1 for n = 100, 400 and 900 observation locations based on N = 2500 replicates. For moderate n sizes and in the non-Gaussian case, the asymptotic variance σ 2 ∞ := n Var(σ 2 ML -2σ 2 0 ) (Corollary 1) can be calculated based on (26) and using

Cov(y i y j , y k y l ) = 4(k 2 i,k k 2 j,l + k 2 i,l k 2 j,k ) + 16(k i,k k i,l k j,k k j,l + k i,j k i,l k j,k k k,l + k i,j k i,k k j,l k k,l ), with k i,j = k Z (s i -s j ).
The above display follows from tedious computations based on Isserlis' theorem. The densities in red in Figure 1 are based on the asymptotic distribution N [0, σ 2 ∞ ]. In the non-Gaussian case and for n ≥ 400, the calculation of σ 2 ∞ is computationally prohibitive, so σ 2 ∞ has instead been approximated by the empirical variance with the corresponding densities indicated in green. As expected, the convergence for the Gaussian case is faster than for the non Gaussian case. But in both situations, the results behave nicely.

We now turn to Theorem 4 and consider the bivariate variance and range maximum likelihood estimation. That is, we consider the two-dimensional maximum likelihood estimates of (σ 2 0 , ρ 0 ) in the Gaussian case and of (2σ 2 0 , ρ 0 /2) in the non-Gaussian case. Again, we do not observe many surprises. Skewness of the empirical distribution is slightly higher compared to the single variance parameter estimation, and convergence is slightly slower, as is illustrated in Figure 2. For the general setting, when estimating jointly the variance and range parameter, the asymptotic bivariate covariance matrix is challenging to compute (see Theorem 4) and thus Figure 2 illustrates the empirical densities and densities based on the empirical bivariate covariance matrix.

We now consider not only maximum likelihood estimation of the variance and range, but also cross validation estimation of the range (see the beginning of Section 5.3). We have observed that the range estimates based on cross validation are much more variable, and in many situations the maximum was attained at the (imposed) boundary. Here we used the bound [2/15, 12], i.e., smaller than the minimal distance between two observation locations and 6 (resp. 12) times the diameter of the observation points of Z (resp. Y ). Estimates at or close to the boundary indicate convergence issues and would imply a second, possibly manual, inspection. For the reported results, we eliminated all cross validation cases that yielded estimates outside [0. 14, 11.4].

Figure 3 shows the mean squared error, squared bias and variance of σ2 ML , ρML and ρCV under different settings. For maximum likelihood, we consider the univariate case (one parameter is estimated while the other is known) and the bivariate case (both parameters are jointly estimated). For cross validation, only the range parameter is estimated (see the beginning of Section 5.3), and thus only the univariate case is considered. The mean squared error is dominated by the variance component. Univariate maximum likelihood estimation for Gaus- q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q + Range Variance 1 2 3 4 5 10 15 20 25 q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q + 7 points outside plotting area Range Variance 1.0 1.5 2.0 2.5 3.0 3.5

1.0 1.5 2.0 2.5 q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q + Range Variance 0.5 1.0 1.5 2.0 2 4 6 8 10 12 14 q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q + 3 points outside plotting area Range Variance 1.0 1.5 2.0 2.5 3.0 3.5 1.0 1.5 2.0 2.5 q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q + Range Variance 0.5 1.0 1.5 2.0 2 4 6 8 10 12 14 q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q + Fig 2 . Scatter plots of variance and range maximum likelihood estimates. Blue: contour lines of kernel density estimates; green: contour lines of asymptotic density based on the empirical bivariate covariance matrix; red cross: true mean (true parameter values). The top row shows results for the process Z (Gaussian case), the bottom row for the transformed process Y = Z 2 -σ 2 0 (non-Gaussian case). The columns are for n = 100, 400, 900. All panels are based on N = 2500 replicates.

sian cases have low bias and the lowest variance (top left and right panel). Joint maximum likelihood estimation has a somewhat larger variance than individual estimation. Surprisingly, cross validation for Gaussian cases has a higher variance compared to cross validation for non-Gaussian cases.

Recall that Theorems 4, 6 and 7 show that, as n increases, the distribution of the standardized estimation error is close to a Gaussian distribution in terms of the metric d w . In Figure 4, we illustrate this by computing one-dimensional Wasserstein distances between the empirical distribution of the standardized estimation errors and Gaussian distributions. The figure shows the Wasserstein distance (p = 1) as a function of the number of observation locations n for individual parameters and for specific bivariate settings (similarly as for Figure 3). In each case, the samples have been centered around the true mean (true parameter values) and standardized by an empirical standard deviation (n-weighted average over all the samples). Their empirical distribution is compared to the standardized Gaussian distribution. The top left panel shows that the densities of the cross validation parameters are converging slowest whereas their mean squared error is comparable (see Figure 3); the densities are highly skewed and thus lead to much larger Wasserstein distances compared to the distributions of the maximum likelihood derived parameters. For the bivariate maximum likelihood estimation the marginal distributions have very similar Wasserstein distances; in the center panels: the dashed and solid colored lines are visually hardly separable. As suggested by the individual panels of Figures 1 and2, convergence in the Gaussian case is much faster compared to the non-Gaussian case. The right column of Figure 4 illustrates the joint asymptotic normality of the range parameter estimators by maximum likelihood and cross validation. The gray lines there illustrate Theorem 7 and are Wasserstein distances for linear combinations of the range estimates by maximum likelihood and cross validation, i.e., λρ ML + (1 -λ)ρ CV for λ = j/10, j = 1, . . . , 9. The highly skewed distribution of the cross validation-estimated range parameter for Gaussian processes is clearly visible. In the non Gaussian case, the effect of the skewness is less pronounced since the maximum likelihood is skewed as well.

Conclusion

We have shown that the covariance parameters of transformed Gaussian processes can be estimated by cross validation and Gaussian maximum likelihood, with the same rate of convergence as in the case of non-transformed Gaussian processes. In particular, Gaussian maximum likelihood works well asymptotically, despite the fact that the observations do not have a Gaussian distribution. Hence Gaussian maximum likelihood is here robust with respect to non-Gaussian data. This provides the first step of a theoretical validation of the use of Gaussian maximum likelihood in frequent cases where the data are non-Gaussian. In future research, it would be interesting to extend the results of this paper to other classes of non-Gaussian random fields rather than only transformed Gaussian processes. In addition, the asymptotic analysis of estimators of the transformation of transformed Gaussian processes is of great interest.

Appendix A: Proofs

A.1. Technical results

Lemma 5. Let q ∈ N be fixed. Let g : R q → R + be fixed and satisfy g(x) ≤ C sup exp(C sup |x|). Let W be a Gaussian vector of dimension q. Then E[g(W )] < ∞.

Proof. Without loss of generality, we can assume that W i has variance 1 for imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019 i = 1, . . . , q. We let w i be the mean of W i for i = 1, . . . , q. We have, for t > 1, P(g(W ) ≥ t) ≤ P(C sup exp(C sup max i=1,...,q

|W i |) ≥ t) ≤ q i=1 P(C sup exp(C sup |W i |) ≥ t) = q i=1 P(|W i | ≥ (1/C sup ) log(t/C sup )) ≤ 2 q i=1 P(W ≥ (1/C sup ) log(t/C sup ) -|w i |),
where W ∼ N [0, 1]. From the Gaussian tail inequality, we obtain, for t ≥ C sup exp(C sup ( max i=1,...,q

|w i | + 1)), that P(g(W ) ≥ t) ≤ 2q √ 2π exp -(1/2) (1/C sup ) log(t/C sup ) -max i=1,...,q |w i | 2 .
The function of t above is clearly summable as t → +∞. Hence, we have E[g(W )] = ∞ 0 P(g(W ) ≥ t) < +∞. Lemma 6. Let X be centered Gaussian process with covariance function k X satisfying Condition 2. Let F satisfy Condition 3. Let W be the spatial process F (X(•)) and assume that W is centered. Let (x i ) i∈N satisfy Condition 1.

Then, we have, for any r 1 , r 2 ∈ N and ∆ ≥ 0, sup i1,...,ir 1 ∈N j1,...,jr 2 ∈N min a=1,...,r 1 ,b=1,...,r 2 |xi a -xj b |≥∆ Cov(W (x i1 ) . . . W (x ir 1 ), W (x j1 ) . . . W (x jr 2 )) ≤ C sup e -C inf ∆ , where C sup and C inf depend on r 1 , r 2 but not on ∆.

Proof. Let ∆ ≥ 0, i 1 , . . . , i r1 ∈ N and j 1 , . . . , j r2 ∈ N such that min a=1,...,r1,b=1,...,r2 |x ia -

x j b | ≥ ∆.
Let 3 ∼ N [0, I r1 ] and 4 ∼ N [0, I r2 ], 3 and 4 being independent. Let R be the

r 2 × r 1 matrix (k X (x ja , x i b )) a,b , let C 1 be the r 1 × r 1 matrix (k X (x ia , x i b )) a,b and let C 2 be the r 2 × r 2 matrix (k X (x ja , x j b )) a,b . Let M = RC -1 1 . Let K be a matrix square root of C 2 -RC -1
1 R . Let K 1 be the unique symmetric matrix square root of C 1 .

Then the vector ((K 1 3 ) , (M K 1 3 + K 4 ) ) has the same distribution as X(x i1 ), . . . , X(x ir 1 ), X(x j1 ), . . . , X(x jr 2 ) .

For i = 1, 2, for x = (x 1 , . . . , x ri ) ∈ R ri , let f i (x) = F (x 1 ) • • • F (x ri ) ∈ R. Then we have Cov(W (x i1 ) • • • W (x ir 1 ), W (x j1 ) • • • W (x jr 2 )) = Cov (f 1 (K 1 3 ), f 2 (M K 1 3 + K 4 )) .
imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

By a Taylor expansion, there exists a random vector 5 belonging to the segment with endpoints K 4 and M K 1 3 + K 4 such that, with G 2 ( 5 ) the gradient column vector of f 2 at 5 , we have

f 2 (M K 1 3 + K 4 ) = f 2 (K 4 ) + (M K 1 3 ) G 2 ( 5 ). This yields Cov(W (x i1 ) . . . W (x ir 1 ), W (x j1 ) . . . W (x jr 2 )) = Cov(f 1 (K 1 3 ), 3 K 1 M G 2 ( 5 )) ≤ E[f 2 1 (K 1 3 )] E[( 3 K 1 M G 2 ( 5 )) 2 ].
From

)) ≤ C sup e -C inf ∆ E[f 2 1 (K 1 3 )]E[(|| 3 || ||G 2 ( 5 )||) 2 ]. Now, || 5 || ≤ ||M K 1 3 || + ||K 4 || ≤ C sup (|| 3 || + || 4 ||) ,
from Condition 2 ii), where, again, C sup does not depend on i 1 , . . . , i r1 , j 1 , . . . , j r2 , ∆. Furthermore,

||K 1 3 || ≤ C sup || 3 ||. Eventually, we have Cov(W (x i1 ) • • • W (x ir 1 ), W (x j1 ) • • • W (x jr 2 )) ≤ C sup exp(-C inf ∆) E[f 2 1 (K 1 3 )] E || 3 || sup ||x||≤Csup(|| 3||+|| 4||) ||G 2 (x)|| 2 .
From Condition 3 i), we have |f 1 (K Proof. Let I = {I(i, ĩ); i = 1, . . . , a, ĩ = 1, . . . , α i } and let J = {J(j, j); j = 1, . . . , b, j = 1, . . . , β j }. In [START_REF] Billingsley | Convergence of Probability Measures[END_REF], any of the events A (resp. B) is an event defined on the set of random variables {Z(s i )} i∈I (resp. {Z(s j )} j∈J ). We thus obtain α {v (1) , . . . , v (a) }, {w (1) , . . . , w

(b) } ≤ α {Z(s i )} i∈I , {Z(s j )} j∈J := sup P(A ∩ B) -P(A)P(B) ; A ∈ σ({Z(s i )} i∈I ), B ∈ σ({Z(s j )} j∈J ) . Let I 1 < • • • < I ᾱ be such that {I 1 , . . . , I ᾱ} = I and let v Z = (Z(s I1 ), . . . , Z(s I ᾱ )) . Let J 1 < • • • < J β be such that {J 1 , . . . , J β } = J and let w Z = (Z(s J1 ), . . . , Z(s J β )) . From Lemma 1 in Section 2.1 of [19], we have α {Z(s i )} i∈I ,{Z(s j )} j∈J ≤ sup Cov(v v Z , w w Z ) ; Var(v v Z ) = 1, Var(w w Z ) = 1 . (16)
Let v and w be vectors belonging to the set in [START_REF] Cacoullos | On upper and lower bounds for the variance of a function of a random variable[END_REF]. The smallest eigenvalues of the covariance matrices of v Z and w Z are larger that a constant C inf , not depending on I and J , since k Z satisfies Condition 2. Thus we have

1 = Var(v v Z ) = v Cov(v Z )v ≥ C inf ||v|| 2 .
It follows that ||v|| 2 ≤ C sup , where C sup does not depend on I, J and ∆. Similarly ||w|| 2 ≤ C sup .

We have where the different C sup and C inf do not depend on b, J and ∆. This concludes the proof from [START_REF] Cacoullos | On upper and lower bounds for the variance of a function of a random variable[END_REF].

Cov 2 (v v Z , w w Z ) ≤ || Cov(v v Z , w Z )|| 2 ||w|| 2 ≤ C sup j=1,..., β Cov(v v Z , Z(s Jj )) 2 ≤ C sup ||v||
(v v Z , w w Z ) ≤ C sup (α 1 + . . . + α a ) +∞ k=0 C sup (∆ + k) d e -C inf |∆+k| ≤ C sup e -C inf |∆|/2 (α 1 + . . . + α a ) +∞ k=1 (∆ + k) d e -C inf |∆+k|/2 ≤ C sup e -C
Lemma 10. Consider a sequence (x i ) i∈N of points in R d satisfying Condition 1. Let τ > 0 be fixed. For n ∈ N, let (A θ ) θ∈Θ and (B θ ) θ∈Θ be families of n × n matrices. Assume that for all n ∈ N, i, j = 1, . . . , n and θ ∈ Θ,

|(A θ ) i,j | ≤ C sup 1 + |x i -x j | d+τ and |(B θ ) i,j | ≤ C sup 1 + |x i -x j | d+τ
where C sup does not depend on n, i, j, θ. Then we have for all n ∈ N, i, j = 1, . . . , n and θ ∈ Θ,

|(A θ B θ ) i,j | ≤ C sup 1 + |x i -x j | d+τ
where C sup does not depend on n, i, j, θ.

Proof. We have,

|(A θ B θ ) i,j | = n =1 (A θ ) i, (B θ ) ,j ≤ n =1 C sup 1 + |x i -x | d+τ C sup 1 + |x j -x | d+τ ≤ =1,...,n |xi-x |≤|xj -x | C sup 1 + |x i -x | d+τ C sup 1 + (|x i -x j |/2) d+τ + =1,...,n |xj -x |≤|xi-x | C sup 1 + (|x i -x j |/2) d+τ C sup 1 + |x j -x | d+τ ≤ C sup C sup 1 + |x i -x j | d+τ max a=1,...,n n b=1 1 1 + |x a -x b | d+τ ≤ C sup 1 + |x i -x j | d+τ from Lemma 4 in [23].
Lemma 11. Consider the setting of Section 5.1. Under Conditions 4 and 5, we have sup

θ∈Θ λ 1 (R -1 θ ) ≤ C sup , (17)
sup θ∈Θ λ 1 (R θ ) ≤ C sup , (18)
(R -1 θ ) i,j ≤ C sup 1 + |s i -s j | d+C inf ,
where C sup and C inf do not depend on n, i, j, θ.

Proof. One can show that the proof of Theorem 1 can be made uniform over θ ∈ Θ, thus yielding Lemma 12.

Lemma 13. Consider the setting of Section 5.1. Under Conditions 4 and 5, we have,

inf θ∈Θ λ n (R θ ) ≥ C inf , (20)
inf θ∈Θ λ n (diag(R -1 θ )) ≥ C inf . (21)
Proof. Equation ( 20) holds from [START_REF] Chiles | Geostatistics: Modeling Spatial Uncertainty[END_REF]. Then, [START_REF] Dubrule | Cross validation of Kriging in a unique neighborhood[END_REF] follows from [START_REF] Du | Fixed-domain asymptotic properties of tapered maximum likelihood estimators[END_REF] as in Lemma D.6 in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].

A.2. Proofs of the main results

Proof of Lemma 1. As a special case of Lemma 6, k satisfies Condition 2 i).

Let us now show that k satisfies Condition 2 ii). Let (x i ) satisfy Condition 1. Let n ∈ N be fixed and let R be the n × n covariance matrix k(x i -x j ) i,j=1,...,n . Let a 1 , . . . , a n ∈ R. We have n i,j=1

a i a j R i,j = Var n i=1 a i F (X(x i )) .
We now let z = (X(x 1 ), . . . , X(x n )) and g : R n → R be defined by g(t) = n i=1 a i F (t i ). The gradient of g at t is ∇g(t) = (a 1 F (t 1 ), . . . , a n F (t n )) . We use the inequality in Theorem 3.7 in [START_REF] Cacoullos | On upper and lower bounds for the variance of a function of a random variable[END_REF]. This yields n i,j=1 From Condition 3, the above expectation is non-zero, which concludes the proof.

a i a j R i,j ≥ E [∇g(z)] Cov(z)E [∇g(z)] . From Condition 2 ii), we have λ 1 (Cov(z)) ≥ C inf . This yields n i,j=1 a i a j R i,j ≥ C inf n i=1 E 2 [(∇g(z)) i ] = C inf n i=1 a 2 i E[F (z i )] 2 = C inf n i=1 a 2 i E[F (z 1 )]
Proof of Lemma 2. The fact that k satisfies Condition 2 ii) follows from Theorem 4 in [START_REF] Bachoc | On the smallest eigenvalues of covariance matrices of multivariate spatial processes[END_REF].

Let us now consider the case where F is defined by F (x) = x 2r + u. Since we consider a covariance function we can assume that u = 0 without loss of generality. Assume also that k(0) = 1 without loss of generality. From Lemma 6,

k satisfies Condition 2 i). Let us show that Condition 2 ii) is satisfied. Let a, b ∈ R d , let c = k(a -b) and let λ = (1 -c 2 ) 1/2 . With (A 1 , A 2 ) ∼ N [0, I 2 ], we have k (a -b) = Cov(A 2r 1 , (cA 1 + λA 2 ) 2r ) = Cov A 2r 1 , 2r i=0 2r i c i λ 2r-i A i 1 A 2r-i 2 = 2r i=0 2r i c i λ 2r-i Cov A 2r 1 , A i 1 A 2r-i 2 .
By independence of A 1 and A 2 , we obtain, for i = 0, . . . , 2r,

Cov A 2r 1 , A i 1 A 2r-i 2 = E[A 2r-i 2 ] E[A 2r+i 1 ] -E[A 2r 1 ]E[A i 1 ] . (22)
From Isserlis' theorem, one can show that ( 22) is zero if i is odd and is strictly positive if i is even. As a consequence, we have

k (a -b) = r i=0 α i k(a -b) 2i
with α 1 , . . . , α r > 0. Hence, the Fourier transform of k is a linear combination of multiple convolutions of the Fourier transform of k, with strictly positive components. Since the Fourier transform of k is strictly positive everywhere, then also the Fourier transform of k is strictly positive everywhere. Hence, from Theorem 4 in [START_REF] Bachoc | On the smallest eigenvalues of covariance matrices of multivariate spatial processes[END_REF], k satisfies Condition 2 ii).

Proof of Theorem 1. Condition 1 and Lemma 6 in [START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF] imply that the spectral norms of R -1 and R are bounded functions of n.

Let C sup = sup n λ 1 (R) < ∞ and C inf = inf n λ n (R) > 0.
We write

R -1 = 1 C sup I -I - R C sup -1 = 1 C sup ∞ =0 I - R C sup . ( 23
)
We remark that the above sum is well-defined because the eigenvalues of I -R/C sup are between 0 and 1 -C inf /C sup .

We denote M = I -C -1 sup R and h i,j = |s i -s j |. Let 1 ≤ A < ∞ and a > 0 be fixed such that M i,j ≤ Ae -2ahi,j . Let δ = inf i,j∈N,i =j |s i -s j | > 0 (Condition 1). Let D < ∞ be a constant such that D ≥ 1 and, for any L ≥ δ and i ∈ N, the set {j ∈ N; |s i -s j | ≤ L} has no more than (D/2)L d elements.

Let 0 < µ < ∞ be fixed. We show by induction over ∈ N that there exists a constant 1 ≤ ϕ < ∞, depending on µ but not depending on , i, j, such that for ≤ µ log(h i,j ),

|(M ) i,j | ≤ A ϕ D h d -d i,j e -ahi,j . (24)
In the case log(h i,j ) < 0, there is nothing to prove in [START_REF] Ibragimov | Gaussian Random Processes[END_REF], so we consider i, j such that log(h i,j ) ≥ 0 when proving [START_REF] Ibragimov | Gaussian Random Processes[END_REF]. For = 1, (24) holds. Assume that (24) holds for some ∈ N. We have

|(M +1 ) i,j | = n r=1 (M ) i,r M j,r ≤ n r=1 A ϕ D h d -d i,r e -ahi,r Ae -2ahr,j = A +1 ϕ D n r=1 h d -d i,r e -ahi,r e -2ahr,j . Let now B i = {x ∈ R d ; |x-s i | ≤ |s i -s j |} and B j = {x ∈ R d ; |x-s j | ≤ |s i -s j |}.
From the triangle inequality we obtain

|(M +1 ) i,j | ≤ A +1 ϕ D r∈N;sr∈Bi∪Bj h d -d i,r e -ahi,r e -2ahr,j + A +1 ϕ D r∈N;sr∈B c i ∩B c j h d -d i,r e -ahi,r e -2ahr,j ≤ A +1 ϕ D 2(D/2)h d i,j h d -d i,j e -ahi,j + A +1 ϕ D e -2ahi,j r∈N;sr∈B c i h d -d i,r e -ahi,r ≤ A +1 ϕ D +1 h d( +1)-d i,j
e -ahi,j + A +1 ϕ D e -ahi,j e -ahi,j r∈N Qr dµ log(hi,j ) e -a(r-1) ,

where for the last inequality we let Qr d be an upper bound on the cardinality of

{b ∈ N; |s b -s i | ∈ [r -1, r]} for all i ∈ N.
The constant Q is finite and depends only on d and δ from Condition 1. We also let ≤ µ log(h i,j ) to show the last above inequality. Hence, in order to finish the proof of [START_REF] Ibragimov | Gaussian Random Processes[END_REF], it remains to show that the term (.) in the above display is a bounded function of h i,j , and to let ϕ/2 ≥ 1 be a bound for the term (.). We have, for h i,j large enough, with • the integer ceiling, e -ahi,j r∈N Qr dµ log(hi,j ) e -a(r-1) = Qe a e -ahi,j r∈N r dµ log(hi,j ) e -ar = Qe a e -ahi,j 2 a dµ log(hi,j ) r∈N ar 2

dµ log(hi,j )

e -ar ≤ Qe a e -ahi,j 2 a dµ log(hi,j )

dµ log(h i,j ) ! r∈N e ar/2 e -ar = Qe a e -ahi,j 2 a dµ log(hi,j )

dµ log(h i,j ) ! 1 1 -e -ar/2 . The above function of h i,j clearly goes to 0 as h i,j goes to ∞. Thus, the above term (.) is bounded and thus ( 24) is proved.

Coming back to (23), using [START_REF] Ibragimov | Gaussian Random Processes[END_REF] and using the triangle inequality, we obtain, letting ∆ = 1 -C inf /C sup , and for h i,j large enough, (R -1 ) i,j ≤ 1≤ ≤µ log(hi,j )

A ϕ D h d -d i,j e -ahi,j + µ log(hi,j )≤ ≤∞ ∆ ≤ µ log(h i,j )(AϕD) µ log(hi,j ) h dµ log(hi,j ) i,j e -ahi,j + ∆ µ log(hi,j ) 1 -∆ = µ log(h i,j )(AϕD) µ log(hi,j ) h dµ log(hi,j ) i,j e -ahi,j + h µ log(∆) i,j

1 -∆ . (25)
In the above display, for any τ < ∞ in the statement of Theorem 1, we can choose µ such that µ log(∆) ≤ -d -τ . Then, it is clear that the first summand in [START_REF] Istas | Quadratic variations and estimation of the local Hölder index of a Gaussian process[END_REF] is also smaller than a constant (depending on τ ) time h -d-τ i,j

. This concludes the proof of Theorem 1, since also sup n∈N max i,j=1,...,n |(R -1 ) i,j | is bounded by C sup .

Proof of Theorem 2. We have

n Var(V n ) = 1 n n i,j,k,l=1
A i,j A k,l Cov(y i y j , y k y l ).

From Lemma 7, we obtain and ∂R θ /∂θ i are both valid choices for A θ and B θ in Lemma 10. From Gerschgorin Circle Theorem (GCT) and Lemma 4 in [START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF], we obtain sup θ∈Θ λ 1 (P θ,i P θ,i ) ≤ C sup and sup θ∈Θ λ 1 (Q θ,i ) ≤ C sup . This, in turn implies that sup θ∈Θ ρ 1 (P From Lemmas 10, 12 and 13 (that can be trivially adapted by replacing θ by ψ), as well as Theorem 2, applied with A n = C -1 ψ diag(C -1 ψ ) -2 C -1 ψ , we obtain Var(CV ψ ) → 0 as n → ∞.

n Var(V n ) ≤ 1 n C sup n i,j=1
For i = 1, . . . , p -1, ∂CV ψ ∂ψ i = 2 n y A ψ,i y with

A ψ,i = C -1 ψ diag(C -1 ψ ) -2 diag C -1 ψ ∂C ψ ∂ψ i C -1 ψ diag(C -1 ψ ) -1 -C -1 ψ ∂C ψ ∂ψ i C -1 ψ .
As in the proof of Theorem 3, GCT and Lemma 4 in [START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF] Hence, Theorem 5 can also be proved by proceeding as in the proof of Proposition 3.4 in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].

In addition, for i ∈ {1, . . . , p -1}, the sequence (n Var(∂CV ψ0 /∂ψ i )) is bounded and thus, the elements of Γ ψ0 are bounded too. One can check that the mean value of ∂CV ψ0 /∂ψ i ∂ψ j is (N ψ0 ) i,j . Furthermore, from Theorem 2, the variance of ∂CV ψ0 /∂ψ i ∂ψ j goes to zero as n → ∞. Hence, as n → ∞, ∂CV ψ0 /∂ψ i ∂ψ j → p (N ψ0 ) i,j .

It can be shown, similarly as in the proof of Proposition 3.7 in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF] Hence, [START_REF] Bachoc | Calibration and improved prediction of computer models by universal Kriging[END_REF] follows. On the other hand, for i, j = 1, . . . , p -1, we have ∂CV ψ ∂ψ i ∂ψ j = 1 n y D ψ,i,j y, where D ψ,i,j is computed as a sum of products of the matrices C -1 ψ , C ψ , the first and second derivative matrices of C ψ and the diag operator (see e.g., [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF]). Hence, from Condition

Also, λ 1 (N ψ0 ) is clearly bounded as n → ∞. From Theorem 2, λ 1 (Γ ψ0 ) is bounded as n → ∞. Hence, by considering subsequences along which N ψ0 and Γ ψ0 converge, and using [START_REF] Stein | Asymptotically efficient prediction of a random field with a misspecified covariance function[END_REF], [START_REF] Stein | Bounds on the efficiency of linear predictions using an incorrect covariance function[END_REF], [START_REF] Stein | Uniform asymptotic optimality of linear predictions of a random field using an incorrect second-order structure[END_REF] and [START_REF] Stein | Interpolation of Spatial Data: Some Theory for Kriging[END_REF], we can proceed as in the proof of Proposition D.10 in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF] and show [START_REF] Bachoc | Improvement of code behavior in a design of experiments by metamodeling[END_REF].

Proof of Lemma 4. We have, with θ = (σ 2 , ψ) ∈ Θ and θ 0 = (σ 2 0 , ψ 0 ), 1 n n i,j=1 (c Y,ψ (s i -s j ) -c Y,ψ0 (s i -s j )) (c Y,ψ (s i -s j ) -c Y,ψ0 (s i -s j ))

2 = 1 n n i,j=1 k Y,θ (s i -s j ) k Y,θ (0) - k Y,θ0 (s i -s j ) k Y,θ0 (0) 2 ≤ 2 n n i,j=1 k Y,θ (s i -s j ) k Y,θ (0) - k Y,θ0 (s i -s j ) k Y,θ (0) 2 + 2 n n i,j=1 k Y,θ0 (s i -s j ) k Y,θ (0) - k Y,θ0 (s i -s j ) k Y,θ0 (0) 2 ≤ C sup n n i,j=1 (k Y,θ (s i -s j ) -k Y,θ0 (s i -s j )) 2 + 1 k Y,θ (0) - 1 k Y,θ0 (0)
2 > 0. k Y,θn m (s i -s j ) -k Y,θ0 (s i -s j ) 2 > 0 from [START_REF] Wang | On fixed-domain asymptotics and covariance tapering in Gaussian random field models[END_REF]. Hence, Condition 7 holds.

Let us now assume that Condition 8 does not hold. We have, with θ = (σ 2 , ψ) ∈ Θ, with θ 0 = (σ 2 0 , ψ 0 ) and with (β 1 , . . . , β p ) = (β 1 , α 1 , . . . , α p-1 ), where β 1 ∈ R is arbitrary, As in the proofs of Theorems 4 and 6, one can check that ∂L θ0 /∂θ i has mean zero for i = 1, . . . , p and ∂CV ψ0 /∂ψ i has mean zero for i = 1, . . . , p -1. Thus, we can rewrite

1 n n i,j=1 p-1 =1 α ∂ ∂ψ c Y,ψ0 (s i -s j ) 2 = 1 n n i,j=1 p =1 β ∂ ∂θ k Y,θ0 (s i -s j ) k Y,θ0 (0)
W n = J n -E[J n ] + o p (n -1/2 )
with

J n = 1 n y p i=1 (λ M -1 θ0 ) i A θ0,i + p-1 i=1 (γ N -1 ψ0 ) i B ψ0,i y.
As the vectors λ and γ as well as the matrices M -1 θ0 and N -1 ψ0 are fixed, the bound

  i) For all t ∈ R, we have |F (t)| ≤ C sup exp (C sup |t|) and |F (t)| ≤ C sup exp (C sup |t|); imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

Theorem 3 .

 3 imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019 Consider the setting of Section 5.1 for Z, T , Y and (s i ) i∈N . Assume that Conditions 4, 5, 6 and 7 hold. Then, as n → ∞, θML p → θ 0 .

Lemma 4 .

 4 Condition 9 implies Condition 7 and Condition 10 implies Condition 8.

Fig 1 .

 1 Fig 1. Histograms of standardized and studentized variance maximum likelihood estimates. Blue: empirical density (kernel density estimates), red: asymptotic density, green: asymptotic density based on the empirical variance. The top row shows results for the process Z (the Gaussian case), the bottom row for the transformed process Y = Z 2 -σ 2 0 (the non-Gaussian case). The columns are for n = 100, 400, 900. All panels are based on N = 2500 replicates.

  imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

Fig 3 .

 3 Fig 3. Mean squared error (top left), squared bias (middle column) and variance (right column) as a function of n for different settings in log-scale. The variance parameter is represented in dashed lines, the range parameter in solid lines. Process Z is shown by reddish colors (Gaussian case), transformed process Y = Z 2 -σ 2 0 in blueish colors (non-Gaussian case). The panels are based on N = 250 replicates that did not reveal any convergence issues.

  imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

Fig 4 .

 4 Fig 4. Wasserstein distance (p = 1). Top left: marginal for each parameter. Center panels: bivariate estimation of range and variance by maximum likelihood as in Theorem 4 and linear combinations thereof; right panels: univariate estimation of the range parameter by maximum likelihood and cross validation and with linear combinations of these two estimators as in Theorem 7. Top middle and right panels: Gaussian cases. Lower row panels: non-Gaussian case. The colors and line styles follow those in Figure 3. The gray lines are Wasserstein distances for estimates based on linear combinations of maximum likelihood (center column) and of maximum likelihood and cross validation (right column). The panels are based on N = 250 replicates that did not reveal any convergence issues. The small boxplot on the right in each panel shows the Wasserstein distance for sample size n = 250 of 10000 realizations of N [0, 1]; the horizontal dotted line shows the median thereof.

1 +

 1 |s i -s j | d+C inf ≤ C sup from Lemma 4 in [23]. Hence, n Var(V n ) is bounded as n → ∞.imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

Proof of Theorem 6 .

 6 From Condition 4 and Lemma 12 used inside Lemma 10, we have for i = 1, . . . , p -1∂CV ψ ∂ψ i = 2 n y A ψ,i y, where A ψ,i is a n × n matrix satisfying sup ψ∈S |(A ψ,i ) a,b | ≤ C sup /(1 + |s as b | d+C inf ).As in the proof of Theorem 4, one can check that ∂CV ψ0 /∂ψ i has mean zero for i = 1, . . . , p -1. Let ∂CV ψ0 /∂ψ be the gradient column vector of CV ψ at ψ 0 . From Theorem 2, with L Γ,ψ0,n the distribution of √ n∂CV ψ0 /∂ψ, as n → ∞, d w (L Γ,ψ0,n , N [0, Γ ψ0 ]) → 0.

  [START_REF] Azaïs | Semiparametric estimation of the variogram of a Gaussian process with stationary increments[END_REF] and Lemma 12 used inside Lemma 10, we havesup ψ∈S |(D ψ,i ) a,b | ≤ C sup /(1 + |s a -s b | d+C inf ).Similarly, for i, j, ∈ {1, . . . , p -1}, we have∂CV ψ ∂ψ i ∂ψ j ∂ψ = 1 n y E ψ,i,j, y,where E ψ,i,j, is a sum of products of the matrices C -1 ψ , C ψ , the first, second and third derivative matrices of C ψ and the diag operator. Hence, from Condition 4 and Lemma 12 used inside Lemma 10, we havesup ψ∈S |(E ψ,i,j, ) a,b | ≤ C sup /(1 + |s a -s b | d+C inf ).Then, from GCT and Lemma 4 in[START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF], we have sup ψ∈S ρ 1 (E ψ,i,j, ) ≤ C sup . Hence, as in the proof of Theorem 3, we can show, for i, j, ∈ {1, . . . , p -1}, sup ψ∈S ∂CV ψ ∂ψ i ∂ψ j ∂ψ = O p (1).

  C sup comes from Lemma 11 and from the classical control of the square Frobenius norm by n times the largest square eigenvalue, for n × n symmetric matrices. If Condition 9 holds, then for all α > 0

(s i -s j ) 2 →

 2 ,θ0 (s i -s j ) k Y,θ0 (0) -p =1 β k Y,θ0 (s i -s j ) ∂ ∂θ k Y,θ0 (0) k Y,θ0 (0) ,θ0 (s i -s j ) k Y,θ0 (0) θ0 (s i -s j ) ∂ ∂θ k Y,θ0 (0) k Y,θ0(0) θ0 (s i -s j ) the second C sup comes from Lemma 11 and from the classical control of the square Frobenius norm by n times the largest square eigenvalue, for n × n symmetric matrices. If Condition 8 does not hold, there exists (β 1 , . . . , β p ) = (0, . . . , 0) and a subsequence n m such that m→∞ 0 and thus, considering the diagonal elements in the double sum above, θ0 (0) = 0. imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019 Bachoc, Bétancourt, Furrer, Klein/Asymptotics for transformed Gaussian processes 36Hence, from[START_REF] Xu | Tukey g-and-h random fields[END_REF], letting (β 1 , . . . , β p ) = (0, α 1 , . . . , α p-1 )10 does not hold.Proof of Theorem 7. Let λ and γ be two column vectors in R p and R p-1 . Let alsoW n = λ ( θML -θ 0 ) + γ ( ψCV -ψ 0 ), for n ∈ N.From the proofs of Theorems 4 and 6 (see also the proof of Proposition D.10 in[START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF] that is referred to there), we know√ n( θML -θ 0 ) = √ nM -1 θ0 ∂ ∂θ L θ0 + o p (1) and √ n( ψCV -ψ 0 ) = √ nN -1 ψ0 ∂ ∂ψ CV ψ0 + o p(1). Also, from Condition 4 and Lemma 12 used inside Lemma 10, we have for i = 1, . . . , p, ∂L θ0 /∂θ i = 1 n (y A θ0,i y) + c θ0 , where c θ0 ∈ R is deterministic and, for i = 1, . . . , p -1, ∂CV ψ0 /∂ψ i = 1 n (y B ψ0,i y), where A θ,i is a n × n symmetric matrix satisfying sup θ∈Θ |(A θ,i ) a,b | ≤ C sup /(1 + |s a -s b | d+C inf ) and B ψ,i is a n × n matrix satisfying sup ψ∈S |(B ψ,i ) a,b | ≤ C sup /(1 + |s a -s b | d+C inf ).

1 +

 1 |s k -s l | d+C inf imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

  Condition 2 ii) and from the equivalence of norms, we obtain ||M || op ≤ C sup e -C inf ∆ and ||K 1 || op ≤ C sup , where C sup and C inf do not depend on i 1 , . . . , i r1 , j 1 , . . . , j r2 , ∆. By equivalence of norms, we then obtain, with C sup and C inf not depending on i 1 , . . . , i r1 , j 1 , . . . , j r2 , ∆, Cov(W (x i1 ) . . . W (x ir 1 ), W (x j1 ) . . . W (x jr 2

  Csup||x|| and ||G 2 (x)|| ≤ C sup e Csup||x|| where C sup does not depend on x and i 1 , . . . , i r1 , j 1 , . . . , j r2 , ∆. Hence the above square roots are finite from Lemma 5 and do not depend on i 1 , . . . , i r1 , j 1 , . . . , j r2 and ∆. This concludes the proof. R d . It is enough to show that|Cov(y i y j , y k y l )| ≤ C sup exp -C inf max d(s k , (s i , s j )), d(s l , (s i , s j )) . (13)Indeed, let, for t ≥ 0, N i,j,t be the number of pairs (k, l), with 1 ≤ k, l ≤ n such that t ≤ max(d(s k , (s i , s j )), d(s l , (s i , s j ))) ≤ t + 1.

1 x)| ≤ C sup e Lemma 7. Consider the setting of Section 3.1, that is k Z satisfies Condition 2 and T satisfies Condition 3. For n ∈ N and i, j = 1, . . . , n we have k,l=1,...,n |Cov (y i y j , y k y l )| ≤ C sup , where C sup does not depend on n, i, j. Proof. We let d(a, (b, c)) = min(|a -b|, |a -c|) for a, b, c ∈ imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

  Z satisfies Condition 2 and where C sup and C inf do not depend on b, J and ∆. For any i ∈ {1, . . . , n}, the number of indices j ∈ {1, . . . , n} such that ∆ ≤ |s i -s j | ≤ ∆ + 1 is smaller than C sup ∆d , from Condition 1 and where C sup only depends on d. This yields Cov 2

2 i=1,..., ᾱ j=1,..., β Cov(Z(s Ii ), Z(s Jj )) 2 ≤ C sup i=1,..., ᾱ j=1,...,n |sj -si|≥∆ e -C inf |s I i -sj | , by definition of ∆, since k

  inf |∆| imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

  Conditions 1, 4 and 5 imply (17) from Theorem 5 in[START_REF] Bachoc | On the smallest eigenvalues of covariance matrices of multivariate spatial processes[END_REF]. Conditions 1 and 4 imply (18) and (19) from Lemma 6 in[START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF].

	Lemma 12. Consider the setting of Section 5.1. Under Conditions 4 and 5, we
	have, for n ∈ N and i, j ∈ {1, . . . , n},
		sup
		θ∈Θ
	and	sup θ∈Θ	λ 1	∂R θ ∂θ i1 . . . ∂θ i	≤ C sup .	(19)
		=1,2,3
		i1,...,i =1,...,p

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:

[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

Proof.

  θ,i ) ≤ C sup . It follows that Theorem 3 can be proved by proceeding as in the proof of Proposition 3.1 in[START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF].Proof of Theorem 4. From the proof of Theorem 3, we have for i = 1, . . . , p∂L θ /∂θ i = 1 n tr(P θ,i ) + 1 n (y Q θ,i y), where P θ,i is a n × n matrix satisfying sup θ∈Θ |(P θ,i ) a,b | ≤ C sup /(1 + |s as b | d+C inf ) and Q θ,i is a n × n symmetric matrix satisfying sup θ∈Θ |(Q θ,i ) a,b | ≤ C sup /(1 + |s a -s b | d+C inf ).One can check that ∂L θ0 /∂θ i has mean zero for i = 1, . . . , p, since the mean value of ∂L θ0 /∂θ i is calculated as if Y were a Gaussian process with zero-mean and covariance function k Y,θ0 . Let ∂L θ0 /∂θ be the gradient column vector of L θ at θ 0 . From Theorem 2, with L Σ,θ0,n the distribution of √ n∂L θ0 /∂θ, as n → ∞,

	max i=1,...,n	sup θ∈Θ	∂L θ ∂θ	≤ sup θ∈Θ	1 n	tr (P θ,i ) +	1 n	y Q θ,i y
				≤ C sup + C sup	||y|| 2 n
				= O p (1).
	Hence,

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:

[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

  lead us to sup ψ∈S λ 1 (A ψ,i A ψ,i ) ≤ C sup , which in turn implies sup ψ∈S ρ 1 (A ψ,i ) ≤ C sup . It follows that max i=1,...,p-1

	sup ψ∈S	∂CV ψ ∂ψ i	≤ sup ψ∈S	2 n	y A ψ,i y
			≤ C sup	||y|| 2 n
			= O

p (1).

  Bachoc, Bétancourt, Furrer, Klein/Asymptotics for transformed Gaussian processes 34

		that
	lim inf n→∞	λ p-1 (N ψ0 ) > 0.	(40)

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:

[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

  Bachoc, Bétancourt, Furrer, Klein/Asymptotics for transformed Gaussian processes 35Consider a sequence θ n = (σ 2 n , ψ n ) ∈ Θ such that ||θ n -θ 0 || ≥ α. If we can extract a subsequence n m such that lim inf m→∞ (σ 2 nm -σ 0 ) 2 > 0, then clearly Y,θn m (s i -s j ) -k Y,θ0 (s i -s j ) 2 > 0by considering the diagonal terms in the above double sum. If we can not extract such a subsequence, then we can extract a subsequence n m such that ||ψ nmψ 0 || ≥ α/2 and σ 2 nm → σ 2 0 as m → ∞. Along this subsequence

	lim inf m→∞	1 n m	nm i,j=1
	lim inf m→∞	1 n m	nm i,j=1

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019 k

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date:[START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019 Bachoc, Bétancourt, Furrer, Klein/Asymptotics for transformed Gaussian processes 7

Acknowledgements

RF acknowledges the support of the Swiss National Science Foundation SNSF-175529. FB acknowledges the support of a PEPS from the French Centre national de la recherche scientifique. This research was partly undertaken within the RISCOPE ANR project.

From Condition 1, we can show that we have sup n∈N,i,j=1,...,n N i,j,t ≤ C sup t 2d . Hence, we have n i,j=1 exp -C inf max d(s k , (s i , s j )), d(s l , (s i , s j )) ≤ +∞ k=0 C sup (k + 1) 2d exp (-C inf k) < +∞. Thus, [START_REF] Bachoc | Cross-validation estimation of covariance parameters under fixed-domain asymptotics[END_REF] implies the result of the lemma and it suffices to prove [START_REF] Bachoc | Cross-validation estimation of covariance parameters under fixed-domain asymptotics[END_REF].

Let i, j, k, l ∈ {1, . . . , n} and let ∆ = max(d(s k , (s i , s j )), d(s l , (s i , s j ))). By symmetry, we can consider that d(s k , (s i , s j )) = ∆.

If |s k -s l | ≤ |s i -s l | and |s k -s l | ≤ |s j -s l |, then |s i -s l | ≥ ∆/2 and |s j -s l | ≥ ∆/2. Hence, we can apply Lemma 6 with distance ∆/2 to obtain | Cov(y k y l , y i y j )| ≤ C sup exp(-C inf ∆/2), where C sup and C inf do not depend on n, i, j, k, l, ∆.

If |s i -s l | ≤ |s k -s l | and |s i -s l | ≤ |s j -s l |, then |s k -s l | ≥ ∆/2. We then have Cov(y i y j , y k y l ) = E[y i y j y k y l ] -E[y i y j ]E[y k y l ] = Cov(y i y j y l , y k ) -Cov(y i , y j ) Cov(y k , y l ) [START_REF] Bates | The combination of forecasts[END_REF] since it is assumed that Y has zero-mean. In [START_REF] Bates | The combination of forecasts[END_REF], the first and third covariances are bounded in absolute value by

, where C sup and C inf do not depend on n, i, j, k, l, ∆. If |s j -s l | ≤ |s k -s l | and |s j -s l | ≤ |s i -s l |, we obtain the same bound by symmetry. We have thus considered all possible cases and the proof of ( 13) is concluded.

In the context of Theorem 2, the following lemma provides an approximation of V n , based on replacing A by a sparse matrix. We remark that a similar approximation was shown in a time series context in [START_REF] Neumann | A central limit theorem for triangular arrays of weakly dependent random variables, with applications in statistics[END_REF]. Nevertheless, we find that our assumptions on the random field Y are more transparent and interpretable than the assumptions in [START_REF] Neumann | A central limit theorem for triangular arrays of weakly dependent random variables, with applications in statistics[END_REF], where cumulants are used. Because of these differences of assumptions, our proof of the following lemma differs from that in [START_REF] Neumann | A central limit theorem for triangular arrays of weakly dependent random variables, with applications in statistics[END_REF]. Lemma 8. Let, for K, n ∈ N, A (K) be the n × n matrix defined by

Then, under the same assumptions as in Lemma 7, we have

Proof. For any K, n ∈ N we have We observe that |(A-A (K) ) k,l | is equal to 0 or is smaller than C sup /(1+K d+C inf ) by assumption. Hence we have

where we have used Lemma 7 and where we have observed that

We have also used Lemma 4 in [START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF] for the last inequality above. All the above constants C sup and C inf naturally do not depend on n, so the lemma is proved.

Lemma 9. Consider the setting of Section 3.1, that is k Z satisfies Condition 2 and T satisfies Condition 3. Let a, b ∈ N. For i ∈ {1, . . . , a}, let α i ∈ N and let I(i, 1), . . . , I(i, α i ) ∈ {1, . . . , n}. For j ∈ {1, . . . , b}, let β j ∈ N and let J(j, 1), . . . , J(j, β j ) ∈ {1, . . . , n}. For i = 1, . . . , a, let f i be a function from R αi to R. For j = 1, . . . , b, let g j be a function from R βj to R. For i = 1, . . . , a, let v (i) = (f i (Z(s I(i,1) ), . . . , Z(s I(i,αi) )). For j = 1, . . . , b, let w (j) = (g j (Z(s J(j,1) ), . . . , Z(s J(j,βj ) )). Let α {v (1) , . . . , v (a) }, {w (1) , . . . , w (b) } = sup P(A ∩ B) -P(A)P(B) ; A ∈ σ({v (1) , . . . , v (a) }), B ∈ σ({w (1) , . . . , w (b) }) ,

where, for any set of random variables { 1 , . . . , r }, σ({ 1 , . . . , r }) is the sigma algebra generated by the random variables { 1 , . . . , r }. Let ∆ = inf i∈{1,...,a} j∈{1,...,b} ĩ∈{1,...,αi} j∈{1,...,βj

Then, we have α({v (1) , . . . , v (a) }, {w (1) , . . . , w

where C sup and C inf may depend on a, α 1 , . . . , α a but do not depend on b, (J(j, j)) j=1,...,b, j=1,...,βj and ∆. Assume now that

as n → ∞. If V = 0, then, from Chebyshev inequality, L φ(n) converges to a Dirac mass at zero and so [START_REF] Lavancier | A general procedure to combine estimators[END_REF] does not hold, yielding a contradiction. Hence it remains to consider the case φ(n) Var(V φ(n) ) → V ∈ (0, ∞) as n → ∞ and where (29) holds.

To reach a contradiction, we will show that

To simplify notations in the sequel, without loss of generality, we will consider that φ(n) = n and show that

where

For K ≥ 0, let

with the notation Lemma 8. We have

from Lemma 8 and because V > 0. Hence, from Theorem 4.2 in [START_REF] Billingsley | Convergence of Probability Measures[END_REF] (as in [START_REF] Neumann | A central limit theorem for triangular arrays of weakly dependent random variables, with applications in statistics[END_REF]), it is sufficient to show that there exists L ∈ (0, ∞) such that for any fixed K ≥ L, we have as n → ∞, in order to prove [START_REF] Matheron | La Théorie des Variables Régionalisées et ses Applications[END_REF] and thus to conclude the proof. We remark that, because of Lemma 8, we have lim inf n→∞ n Var(V (K) n

) -lim inf n→∞ n Var(V n ) goes to 0 as K → ∞. Hence, we may take L such that lim inf n→∞ n Var(V

where n Var(V

say, where X n can be interpreted as a centered random field defined on (s i ) i∈N .

We will now show that the sequence of random fields (X n ) n∈N satisfies the conditions of Corollary 1 of [START_REF] Jenish | Central limit theorems and uniform laws of large numbers for arrays of random fields[END_REF]. We let, for k, l ∈ N and r ≥ 0 ᾱk,l (r) = sup Let N K = sup n∈N max i=1,...,n n j=1 1 |sj -si|≤K . Then N K ≤ C sup , where C sup depends only on K, d and δ from Condition 1. We remark that for i = 1, . . . , n, X n (s i ) is a function of the variables Z(s I(n,i,1) ), . . . , Z(s I(n,i,γ(n,i)) ), with γ(n, i) ≤ N K and with |s I(n,i,γ) -s i | ≤ K for γ = 1, . . . , γ(n, i). Furthermore, for |s i -s j | ≥ r we have for γ i = 1, . . . , γ(n, i) and for γ j = 1, . . . , γ(n, j) that |s I(n,i,γi) -s I(n,j,γj ) | ≥ r -2K. Hence, form Lemma 9, we have, for any k ∈ N

where C sup and C inf may depend on k and K.

We

We also let c i,n = n -1/2 for n ∈ N and i = 1, . . . , n. We remark that Z i,n /c i,n can be written as f (w) where w is a Gaussian vector of dimension less than N K , with variances 1 and where |f (x)| ≤ C sup e Csup|x| , where C sup does not depend on n ∈ N and i = 1, . . . , n. One can thus show, from the Cauchy-Schwarz inequality and with the same techniques as in Lemma 5, that for any q > 0 lim

imsart-generic ver. 2014/10/16 file: nonGaussRF.tex date: November 27, 2019

Bachoc, Bétancourt, Furrer, Klein/Asymptotics for transformed Gaussian processes 31

With the previous notation and with [START_REF] Paulo | Calibration of computer models with multivariate output[END_REF], one can show that all the assumptions of Corollary 1 in [START_REF] Jenish | Central limit theorems and uniform laws of large numbers for arrays of random fields[END_REF] are satisfied. This shows [START_REF] Neumann | A central limit theorem for triangular arrays of weakly dependent random variables, with applications in statistics[END_REF] and thus concludes the proof.

Proof of Theorem 3. Let θ ∈ Θ be fixed. We have

In addition, for i ∈ {1, . . . , p}, the sequence (n Var(∂L θ0 /∂θ i )) is bounded, which implies that the elements of Σ θ0 are bounded too.

One can check that the mean value of ∂L θ0 /∂θ i ∂θ j is (M θ0 ) i,j (also because this mean value is calculated as if Y were a Gaussian process with zero-mean and covariance function k Y,θ0 ).

Also, for i, j = 1, . . . , p, we have

where C θ,i,j and D θ,i,j are sums of products of the matrices R -1 θ , R θ and the first and second derivative matrices of R θ (see e.g., [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF]). Hence, from Condition 4 and Lemma 12 used inside Lemma 10, we have

Thus, the variance of ∂L θ0 /∂θ i ∂θ j goes to zero as n → ∞ from Theorem 2. Hence ∂L θ0 /∂θ i ∂θ j → p (M θ0 ) i,j

as n → ∞.

It can be shown, similarly as in the proof of Proposition 3.3 in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF] that

Hence, (7) follows.

Then, for i, j, ∈ {1, . . . , p}, we have

where E θ,i,j, and F θ,i,j, are sums of products of the matrices R -1 θ , R θ and the first, second and third derivative matrices of R θ . Hence, from Condition 4 and Lemma 12 used inside Lemma 10, we have sup

Then, from GCT and Lemma 4 in [START_REF] Furrer | Asymptotic properties of multivariate tapering for estimation and prediction[END_REF], we have sup θ∈Θ ρ 1 (E θ,i ) ≤ C sup and sup θ∈Θ ρ 1 (F θ,i ) ≤ C sup . Hence, as in the proof of Theorem 3, we can show

Also, λ 1 (M θ0 ) is clearly bounded as n → ∞. From Theorem 2, λ 1 (Σ θ0 ) is bounded as n → ∞. Hence, by considering subsequences along which M θ0 and Σ θ0 converge, and using (34), [START_REF] Sacks | Design and analysis of computer experiments[END_REF], [START_REF] Santner | The Design and Analysis of Computer Experiments[END_REF] and [START_REF] Shaby | Tapered covariance: Bayesian estimation and asymptotics[END_REF], we can proceed as in the proof of Proposition D.10 in [START_REF] Bachoc | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes[END_REF] and show [START_REF] Bachoc | Cross validation and maximum likelihood estimations of hyperparameters of Gaussian processes with model mispecification[END_REF]. holds for all k, l ∈ {1, . . . , n}.

Let then L J,θ0,n be the distribution of n 1/2 (J n -E[J n ]). Then, from Theorem 2, as n → ∞, d w (L J,θ0,n , N [0, n Var(J n )]) → 0.

The variance can be written as n Var(J n ) = (λ M -1 θ0 ) i (γ N -1 ψ0 ) j (Ω θ0 ) i,j

with

Hence, by applying product by blocks we get the matrix form expression

We conclude the proof by applying the Wald Theorem.