Marie-Anne Burcklen

Hervé Sauer

Frédéric Diaz

François Goudail
email: francois.goudail@institutoptique.fr

Joint digital-optical design of complex lenses using surrogate image quality criterion adapted to commercial optical design software

As classical optical design, joint digital-optical design of complex lenses requires skilled optical designer helped by powerful optical design software. Consequently, if optimization criteria have to be modified to take into account digital post-processing, the convenient optimization environment provided by commercial optical design software needs to be preserved. For that purpose, we define a joint-design criterion based on a merit function that contains terms classically implemented in optical design software but used in a non-standard way. After validation on a simple design problem, the proposed method is applied to the design of a very fast (f/0.75) complex lens. The obtained joint-designed lens is shown to be superior to a classically designed one in terms of weight and image quality in the field.

INTRODUCTION

Nowadays nearly all imaging systems include image processing algorithms to improve image quality. Hence, when designing an imaging system, it seems natural to jointly optimize the lens and the image processing algorithms. This approach is called joint optimization or also co-design. Co-design has been pioneered by Dowski in 1999 et al. [START_REF] Dowski | Wavefront coding: a modern method of achieving high-performance and/or low-cost imaging systems[END_REF] who proposed phase masks that extend the depth of field (DOF) at the price of a degradation of the raw image quality, which was compensated by a digital deconvolution algorithm. Later, the co-design problem has been formulated in a rigorous signal processing framework. It consisted of defining the optimization criterion as the mean square difference between an ideally sharp image and the final image produced by the global system composed of the image forming lens and the digital image processing implemented by a Wiener deconvolution filter [START_REF] Mirani | Optimal co-design of computational imaging system[END_REF][START_REF] Robinson | Joint design of lens systems and digital image processing[END_REF][START_REF] Mirani | Computational imaging systems: joint design and end-to-end optimality[END_REF]. This approach has been used to optimize DOF-extending phase masks placed in the pupil of ideal or already optimized complex camera lenses [START_REF] Diaz | Comparison of depth-of-focus-enhancing pupil masks based on a signal-to-noiseratio criterion after deconvolution[END_REF][START_REF] Falcón | Performance limits of binary annular phase masks codesigned for depth-of-field extension[END_REF]. These masks have been implemented with success in real-world imagers [START_REF] Diaz | Realtime increase in depth of field of an uncooled thermal camera using several phase-mask technologies[END_REF][START_REF] Burcklen | Experimental demonstration of extended depth-of-field f/1.2 visible high definition camera with jointly optimized phase mask and real-time digital processing[END_REF]. This approach has also be used to design an iris recognition system by jointly optimizing phase masks placed in subapertures with Wiener filter [START_REF] Ashok | Point spread function engineering for iris recognition system design[END_REF]. Zammit et al. proposed systems with optimized antisymmetric phase masks and deconvolution filter with removed artefacts for 3D reconstruction [START_REF] Zammit | Extended depth-of-field imaging and ranging in a snapshot[END_REF], which was recently applied to microscopy [START_REF] Zhou | Computational localization microscopy with extended axial range[END_REF]. The design of optical phase mask component by taking post-processing into account has also be made using other criteria different from the above-mentioned image quality criterion [START_REF] Prasad | Pupil-phase optimization for extended-focus, aberrationcorrected imaging systems[END_REF][START_REF] Demenikov | Optimization of hybrid imaging systems based on maximization of kurtosis of the restored point spread function[END_REF][START_REF] Trouvé | Design of a chromatic 3d camera with an end-to-end performance model approach[END_REF][START_REF] Haim | Computational multi-focus imaging combining sparse model with color dependent phase mask[END_REF][START_REF] Du | Rotating asymmetrical phase mask method for improving signal-to-noise ratio in wavefront coding systems[END_REF].

Co-design based on final image quality optimization has also been applied to the design of complex lenses made of several optical elements. To design such lenses, it is necessary to use modern optical design software since they can efficiently take into account all the optical and manufacturing constraints related to system level specifications and physical and practical requisites for elements and their opto-mechanical mount. Robinson and Stork extended the co-design framework to complex lens design using the Zemax optical design software [START_REF] Robinson | Joint design of lens systems and digital image processing[END_REF]. They jointly optimized the lens, the sensor and the processing algorithm by implementing the mean-square image quality criterion directly in Zemax using C-extensions. This method has been used to design relatively simple lenses with two or three optical elements, like a Cooke triplet, in order to increase their performance in terms of optical path difference or of DOF. A similar approach has been applied to the joint optimization of infra-red optical systems including a phase mask, other optical elements and a deconvolution filter in order to make image quality invariant over the field [START_REF] Vettenburg | Holistic optical-digital hybrid-imaging design:wide-field reflective imaging[END_REF].

These first demonstrations of lens co-design have shown the feasibility and the benefits of this approach. They have been performed on simple lenses with few optical components and/or moderate apertures. In order to go further and address the de-sign of lenses with larger number of optical elements and/or more higher specifications in terms of aperture or imaging field, it is necessary to remember that optical design of such lenses is an art as well as a science. In classical design of complex lenses, the skilled optical designer uses a powerful optical design software with efficient ray tracing routines and efficient optimization algorithms, which are adapted to manage the numerous optical and mechanical constraints that an optical system must fulfil to be practically manufacturable. He also uses a lot of hints from experience in order to steer the lens optimization process, which consists of a succession of local optimizations and adjustments of the weights of the optimization criterion [START_REF] Fisher | Optical System Design[END_REF]. To make this iterative process convenient, optimization time is a key factor.

We think that in the near and even mid-future, co-design of hybrid optical system with complex lenses cannot be simply an automatic procedure, and that a skilled optical designer will still be required. In order to benefit from co-design approach, a key point is thus to introduce this approach into the usual optical design process, while staying as close as possible to the usual practice and environment of the optical designer, including familiar optical design software and figures of merit. The purpose of the present article is to propose a method to reach this objective.

The rigorous image quality criterion involves intricate calculations on the whole computation of the lens 2D optical transfer function. It is therefore computationally intensive to evaluate at each iteration of the optimization algorithm, and its direct optimization is thus highly time-consuming. Furthermore, the rigorous image quality criterion is extremely difficult to implement in such optical design software applications, like Code V, as it involves advanced computations on mega-pixel images or mega-element arrays in the Fourier domain.

Therefore, we define a surrogate lens optimization criterion based on a merit function, which uses, in a non-standard way, physical quantities and parameters that are natively and efficiently computed by optical design software. This approach is first evaluated on a simple co-design problem where the surrogate criterion and the image quality criterion can be compared and are shown to be equivalent. The proposed method is then applied to the design of a very fast (f/0.75) complex lens. This co-designed lens is found to be superior to a classically designed lens in terms of lens weight and homogeneity of image quality in the field.

The paper is organized as follows. Section 2 describes the imaging chain model, the mean-square joint design criterion based on final image quality (IQ), and discusses its implementation in optical design software. In Section 3, we propose a surrogate optical design (SOD) criterion, which can be more easily implemented in optical design software, as it uses a merit function based on native and efficiently computed physical quantities, such as the spot diagram diameter or the modulation transfer function (MTF) at given frequencies, fields and orientations. In Section 4, the efficiency of this criterion is demonstrated on the co-design of a complex lens with very large aperture.

IMAGE QUALITY CRITERION FOR CO-DESIGN

In this section, we define the mean-square image quality criterion that is generally used for co-design applications. We then discuss the problem of its implementation and its practical use in commercial optical design software.

A. Image Quality criterion

Let us consider an imaging system that consists of a lens, an array sensor, and a deconvolution algorithm that processes the acquired image. The problem we consider is to make the imaging system invariant with respect to a given parameter, such as the defocus value in order to increase the depth of field, or the field. In a local area of the imaging field, the lens is assumed to behave as a linear and translation-invariant filter, and is characterized by its point spread function (PSF) denoted PSF θ ψ . In this notation, θ is a vector representing the set of optical parameters on which the system response depends, such as for example surface curvature, lens materials, glass thicknesses or air spacing. The scalar ψ represents the parameter for which we want the system to be invariant, e.g. defocus values or positions in the field, and takes value among the set {ψ 1 , . . . , ψ K }. The finite size of the sensor pixels, which leads to some MTF drop at high spatial frequencies, is represented by an impulse response h p depending on the pitch p and a uniform spatial distribution of sensitivity over the pixel, assuming here a 100% fill-factor. The total impulse response is

h θ ψ (r) = h p (r) * PSF θ ψ (r) (1)
where * denotes the convolution operator and r = (x, y) denotes the spatial coordinate in the image plane.

Let us denote O(r) the image of the scene (minus its mean) that would be formed by an ideal imaging system devoid of any limitation. It is considered as a stationary random process with zero mean and Power Spectral Density (PSD) S OO (ν), where ν denotes the spatial frequency coordinates. The image acquired by the system is modeled as:

Y θ ψ (r) = h θ ψ (r) * O(r) + n(r) (2)
where n(r) denotes the detection noise that is assumed to be additive white, Gaussian, and of PSD S nn (ν). In order to minimize the required numerical processing load, and thus to minimize the electrical power consumption in an embedded system context, we choose to use a unique linear deconvolution filter of impulse response d(r) to be applied on the raw image. For given deconvolution filter d, parameter sets θ, and ψ, the quality of the deconvolved image is quantified by its mean-square difference with the ideal image:

MSE(d, θ, ψ) = d(r) * Y θ ψ (r) -O(r) 2 (3)
where the symbol < . > denotes ensemble averaging over O and n realizations.

The purpose is to find the deconvolution filter d and the optical system parameters θ that minimize this MSE for the set of K possible values of ψ. We choose the deconvolution filter that minimizes the mean of the MSE over the K values of ψ:

d θ opt = arg min d 1 K K ∑ k=1 MSE(d, θ, ψ k ) (4)
This is the average Wiener filter defined in [START_REF] Robinson | Joint design of lens systems and digital image processing[END_REF][START_REF] Diaz | Increase in depth of field taking into account deconvolution by optimization of pupil mask[END_REF], that we denoted d θ opt to emphasize that it depends on the system parameters θ.

Knowing the closed-form expression of d θ opt given in [START_REF] Diaz | Increase in depth of field taking into account deconvolution by optimization of pupil mask[END_REF], the optimal value of θ can be estimated by minimizing the MSE averaged on all values of ψ k . In practice, it has been noticed that this minimization can lead to high values of the MSE for some values of ψ k . In order to better control the image quality disparity among the ψ k set, we will rather use the following minimax criterion proposed by Diaz et al. [START_REF] Diaz | Increase in depth of field taking into account deconvolution by optimization of pupil mask[END_REF], that is to minimize

J IQ = max k MSE(d θ opt , θ, ψ k ) (5)
It will be referred to as Image Quality criterion in the following. We will also define the obtained image quality IQ for a given set of parameters θ at a given ψ value as IQ(θ, ψ) = 10 log 10

S OO (ν) d 2 ν MSE(d θ opt , θ, ψ) (6)
expressed in dB. It can be emphasized that minimizing J IQ , that is minimizing the highest MSE value over {ψ 1 , . . . , ψ K }, amounts to maximize the worst IQ value over the range of parameters ψ.

B. Implementation of the Image Quality criterion in optical design software

Our goal is to optimize the lens parameters θ following J IQ defined in Eq. ( 5). For that purpose, it is necessary to take into account all the nonlinear constraints that should be fulfilled by these parameters, such as, for example, that the effective focal length must be equal to a specified value, that lenses thickness at the center and edges must be strictly positive, or that the weight and size of the whole lens must not be above specified values. It is also of utmost importance to keep optimization times similar to what optical designers are used to in classical optical design -that is to say a few seconds or minutes for a local optimization. As the optimization algorithms implemented in optical design software are powerful and natively take into account the constraints specific to optical design, the natural strategy to reach our goal is to implement J IQ inside the optical design software. For that purpose, we first need to consider software limitations. Robinson and Stork [START_REF] Robinson | Joint design of lens systems and digital image processing[END_REF], and Vettenburg et al. [START_REF] Vettenburg | Holistic optical-digital hybrid-imaging design:wide-field reflective imaging[END_REF] made use of the Zemax software. They implemented the computation of a criterion similar to J IQ thanks to extensions programmed in C language. However, they do not precisely mention the used optimization algorithm, its sensitivity to choice of starting point or the typical computation time required. This latter point is of high importance regarding optimization practicality. Indeed, the optimization algorithms implemented in optical design software are adapted to classical merit functions, like the root mean square (RMS) diameter of the spot diagram. Employing a different user-defined objective function with different structure like J IQ , which requires to compute all the impulse responses {h θ ψ k } k=1...K at each merit function evaluation, would lead to much higher computation time, and possibly poor convergence to one of the numerous under-optimal local minima. One must also note that the direct implementation of the criterion J IQ , which involves products of Fourier transforms of PSFs, was not technically possible until recent months in the optimization procedure of the Optical Design software we used (Code V).

Taking into account these limitations, we decided to investigate an approach consisting in approximating J IQ with a surrogate criterion that can be efficiently implemented in standard optical design software. In other words, it should only make use of physical quantities natively and efficiently computed by optical design software. These physical quantities should be used in a way that mimics as best as possible the behavior of J IQ , so as to obtain a lens with performance similar to that obtained by optimizing directly J IQ . In the following section, our purpose will be to infer this surrogate optical design criterion from an analysis of the main imaging characteristic of a system optimized with J IQ .

CONSTRUCTION OF THE SURROGATE OPTICAL DE-SIGN CRITERION

We first analyze in sub-section A the imaging performance of a co-designed system optimized using the IQ criterion J IQ . From this analysis, we propose in sub-section B a surrogate to J IQ that can be simply and efficiently implemented with native quantities in optical design software. Finally, we validate this surrogate criterion in sub-section C by showing that its optimization leads to a system very similar to that obtained by directly optimizing J IQ .

A. Analysis of the imaging performance of a system codesigned with the IQ criterion

The imaging system we consider is the co-designed f/1.2 visible and near infra-red camera described in [START_REF] Burcklen | Experimental demonstration of extended depth-of-field f/1.2 visible high definition camera with jointly optimized phase mask and real-time digital processing[END_REF]. It consists of an already optimized complex lens and of a 6-ring binary phase mask placed in the stop plane of the lens. This optical system is co-optimized with the deconvolution algorithm to extend depth of field (DOF) of the camera. The set of variables on which it depends are θ = {r 1 , . . . , r 5 , δ}, where {r n } 1,5 are the 5 radii of the inner rings of the binary phase mask, and δ is an optical parameter that allows one to adjust the internal focus setting of the camera. It was required that the imaging performance be invariant for object distances ψ ∈ {4.8 m, 9.6 m, 10 km}. In [START_REF] Burcklen | Experimental demonstration of extended depth-of-field f/1.2 visible high definition camera with jointly optimized phase mask and real-time digital processing[END_REF], these parameters were optimized with J IQ . The optimization algorithm was the simplex method [START_REF] Press | Numerical Recipes in C (2Nd Ed.): The Art of Scientific Computing[END_REF], implemented with the Matlab numerical computation software. The Code V software was used only as a ray tracing subroutine to recompute at each iteration the PSFs of the system for all the considered object distances. Due to the communication time between the two software applications and simplex algorithm convergence speed, optimization took around one day. The optimal parameters obtained in this way are given in Tab. 1, column 1 (J IQ ).

Table 1. Binary phase mask optimal parameters and associated optimal value of defocus setting parameter for J IQ (column 1) and J SOD (column 2) We will now analyze two quantities characterizing the on-axis optical performance of this optimized imaging system, namely its PSFs, denoted PSF θ ψ k , and its modulation transfer functions (MTF), denoted MTF θ ψ k , which is the modulus of the Fourier transform of the PSF. The PSFs for the three object distances of 4.8 m, 9.6 m and 10 km are represented in Fig. 1.(a), (b) and (c). They are normalized so that PSF θ ψ k (r)d 2 r = 1. We observe that each of the three PSFs presents ringing induced by the presence of the binary phase mask in the stop plane of the lens. Among these three PSFs, the one at 9.6 m is the most spatially spread, as it is shown more precisely by their horizontal cross sections in Fig. 1.(d). However, it can be noted that the central peaks of each PSF are of quasi-similar width. The MTFs of the same system are represented in Fig. 2.(a) for the same three object distances. The MTF curves are plotted up to ν = 60 cy/mm, as the lens had initially been designed to resolve details up to this spatial frequency [START_REF] Burcklen | Experimental demonstration of extended depth-of-field f/1.2 visible high definition camera with jointly optimized phase mask and real-time digital processing[END_REF]. We also represented the evolution with spatial frequency of the normalized noise level ζ(ν) defined as

J IQ J SOD r 1 (
ζ(ν) = S nn (ν) S OO (ν) (7)
We observe that, thanks to the optimized phase mask inserted in the optical system, the MTFs for the three considered object distances are quasi similar to one another on the whole spatial frequency range. They never reach zero, and their values always stay higher than the normalized noise level ζ(ν). Finally, the "global" MTFs after pixel filtering and deconvolution, which are defined as

| d(ν) • h θ ψ k (ν)|, are presented in Fig. 2.(c).
The normalized noise level after deconvolution also represented is defined as d(ν) • ζ(ν). It is seen that the quality of the restored image is close to that of an ideal system with the same characteristics, even for high frequencies.

From this analysis we can conclude that an optimization of the system that would only rely on optical response (PSF or MTF) computations, while implicitly taking into account that images will have to be deconvolved, should be steered according to the three following criteria:

1. PSF θ ψ k size is quasi invariant with respect to ψ k , 2.
MTF θ ψ k are quasi invariant with respect to ψ k Fig. 2. MTF of the optical system including the binary phase mask that was optimized following (a) J IQ and (b) J SOD . Glob-alMTF after pixel filtering and deconvolution of the system with phase mask optimized following (c) J IQ and (d) J SOD .

3. for all ψ k , min ν MTF θ ψ k ≥ A > 0 where A is high enough to limit noise amplification induced by deconvolution.

In the following section, we will thus build along these lines a surrogate optimization criterion, denoted "SOD" for Surrogate Optical Design, that can be implemented using the native quantities and merit function of optical design software. From the observations made in this section, this SOD criterion will specifically be based on the quasi invariance of the PSF size and the MTF values as ψ varies. The goal is to obtain MTF curves that are quasi invariant with respect to ψ while having the largest value possible.

B. Surrogate optical design (SOD) criterion

In optical design software, the merit function to minimize is classically specified as a sum of weighted quadratic terms involving native physical quantities. Following the analysis made in the previous section, we chose to define the SOD objective function as follows:

J SOD (θ) = K ∑ k=1 w φ ψ k φ θ ψ k 2 + M ∑ m=1 w ∆c m ∆c θ m 2 + K ∑ k=2 ∑ ν ∑ ξ w ∆MTF ψ k ,ν,ξ 2 MTF θ ψ k (ξ, ν) -MTF θ ψ 1 (ξ, ν) 2 + K ∑ k=2 w ∆φ ψ k 2 φ θ ψ k -φ θ ψ 1 2 (8)
where

φ θ ψ k = P ∑ p=1 Q ∑ q=1 w 2 λ p δx θ ψ k ,λ p ,q 2 + δy θ ψ k ,λ p ,q 2 1/2 (9)
This latter equation defines the wavelength-weighted polychromatic spot diagram RMS diameter. It usually represents a rough estimation of the PSF size that is easily computable by ray tracing. The parameter Q denotes the number of rays that are traced throughout the optical system and that are used to compute the RMS spot size. The values δx θ ψ,λ,q and δy θ ψ,λ,q denote the distance along x and y between the intersection points of q-th ray and of the chief ray with the image plane. Hence the spot diagram RMS diameter is twice the root mean square distance between the intersection point of a given ray on the image plane, and the intersection point of the chief ray. The coefficients w λ p are the weights related to the wavelength λ ∈ {λ 1 , . . . , λ P }, where P is the number of wavelengths considered during the design to assess the polychromatic optical response. The first ∑ term of the SOD criterion in Eq. ( 8) is thus the sum of the squared RMS spot diagram diameters of each considered object distance ψ k with weights w φ ψ k . This criterion is the most classical one in optical design. It is often used during lens optimization run at the beginning and middle of conventional lens design process. The second ∑ term in Eq. ( 8) represents the usual set of M equality or active inequality constraints ∆c θ m with weights w ∆c m that are used to enforce, e.g., an effective focal length value and component edge thickness positivity.

The third ∑ term of Eq. ( 8) implements the new unconventional constraints (with weights w ∆MTF ψ,ν,ξ ) we introduced in order to enforce that the diffractive-MTF curves should be as similar as possible between each others among the {ψ k } set. Each of their sub-terms is computed at a given spatial frequency ν and for a chosen angle of azimut ξ (ξ = 0°corresponds to sagittal plane and ξ = 90°to tangential plane). Several sub-terms with different spatial frequencies can be used in order to set several control points on MTF curves. It is also possible to set inequality constraints on MTF values, especially when the MTF are too low, close to or below the normalized noise level. Such inequality constraints would ensure that the MTF is high enough to limit noise amplification after deconvolution, as described in sub-section 3.A, assuming that the degrees of freedom of the lens are sufficient to allow such quality to be reached. However, for the design problems considered in this paper, we found that implementing such inequality constraints was not necessary.

The fourth ∑ term of Eq. ( 8) implements new unconventional quasi invariance constraints among the {ψ k } set on the spot diagram RMS diameter with weight denoted w ∆φ ψ . This term, together with the first term, also allows one to control indirectly but efficiently the overall behaviour of the MTF curves at all frequencies. It is thus a good complement to the third term of Eq. ( 8), that enforces similarity of the MTF at discrete frequencies.

During the optimization process, if w ∆MTF ψ,ν,ξ and w ∆φ ψ are high enough, the quadratic terms corresponding to MTF and spot size quasi invariance compete with the usual minimization of the RMS spot diagram.

The final merit function is a nonlinear quadratic function of θ that can be minimized with nonlinear least square algorithms. Code V uses by default for local optimization the Levenberg-Marquardt algorithm [START_REF] Press | Numerical Recipes in C (2Nd Ed.): The Art of Scientific Computing[END_REF] also called damped least squares. The computer implementation of this optimization algorithm is highly optimized in commercial optical design software so that computation time is dramatically low. For example, the optimization of a conventional system of 6 optical elements over 10 iterations lasts a few seconds on present desktop computers. Even though global optimization are now available on commer-cial optical design software, the optical designer, instead of using random blind brute force, still usually leads the optimization process point to well-behaved solution, with her/his intuition, knowledge and skills. She or he uses a number of local optimization steps with slight adjustments of the system and/or the merit function weights to progressively shape the lens and its optical behavior to met the specifications.

In our case, optimization of the J SOD criterion is steered as follows. At the beginning of the optimization process, the weights w ∆MTF ψ,ν,ξ are generally set to zero. The RMS spot size is minimized while adding quasi invariance constraints over the RMS spot sizes for the different configurations that should give the same optical behavior to allow later the deconvolution of the raw image by a unique kernel. This means that minimization of the spot size is in competition with setting the same spot size for every value of ψ. The values of weights w ∆φ ψ should be quite small to obtain low φ θ ψ / high MTF values, but they are non zero in order to start with PSF close to each other. As the design moves forward, the MTF quasi invariance constraints at one or several spatial frequencies, that is, the weights w ∆MTF ψ,ν,ξ , are increased. They strongly influence the optimization path.

The design process is thus conducted in a way similar to classical lens design, where weighting coefficients are adjusted by the optical designer, these adjustments depending on the obtained performance but also and strongly on the experience of the designer. The advantage of the proposed method is that the optimization environment, as well as the optimization algorithm, remain the same as in classical optical design. The only change is in the merit function, that "mimics" the behavior of J IQ while using native merit functions of the software.

C. Comparison of imaging system optimized with SOD and IQ criteria

We will now validate the SOD criterion on a design example, that is, verify that optimization of SOD criterion leads to an imaging system similar to that obtained by optimizing J IQ . For that purpose, we consider again the optimization of the f/1.2 visible camera with DOF-extending binary phase mask introduced in Section 3.A. The advantage of this optimization problem is that it can be solved by both J IQ and J SOD , and thus makes it possible to compare the optimal system parameters and image qualities obtained with both criteria. It is however worth to note that diffractive optical elements (DOE) like the binary phase mask have nearly no effect on ray tracing and thus no pertinent effect on the spot diagram. As a consequence the spot diagram of an optical system with DOE is no more representative of the PSF. This problem is specific to the J SOD criterion. It is not the case for the J IQ criterion, which is based on diffractive PSF computations, and does clearly take properly into account the effect on the binary phase mask. Consequently J SOD first and fourth ∑ terms in Eq. ( 8) involve φ θ ψ k computations relying on pure ray-tracing that does not see the DOE-induced phase steps. We however choose to keep the first ∑ term with φ θ ψ k as it reveals to stabilize optimization convergence and the δ parameter value at the first design steps. We thus perform optimization with w ∆φ ψ k = 0, considering the fact that terms related to ∆φ θ ψ k are unuseful in that case. Please note that this problem is specific to DOE-enhanced optical systems and does not impact at all the more common DOE-free optical systems like the example that will be presented in Section 4.

In Code V, we create three configurations of the system. Each of them corresponds to one of the three considered object distances {4.8 m, 9.6 m, 10 km}. All the optical parameters (except the object distances) and variables are common to them, and the three configurations will be optimized simultaneously. The starting point of the optimization is chosen arbitrarily without any a priori information on the final solution. The initial values are r 1 = 1.0 mm, r 2 = 2.5 mm, r 3 = 4.0 mm, r 4 = 5.5 mm, r 5 = 7 mm, and δ = 0 mm. In Code V, it is mandatory to constrain the radii values by setting the following inequality constraints: r 1 > 0, r 5 < R, and ∀ ∈ {2, 3, 4, 5}, rr -1 > 0. In this particular case, we used only two quadratic terms related to MTF quasi invariance following Eq. ( 8) where ψ 1 = 10 km, ψ 2 = 9.6 m and ψ 3 = 4.8 m. They are computed at spatial frequencies ν 1 = 20 cy/mm and ν 2 = 60 cy/mm, so that we have a total of 4 MTF invariance constraints.

The parameters of the imaging system optimized in this way are presented in Tab. 1, column 2. We notice that the parameters of the mask are quite similar to those of the mask optimized with J IQ . The same observation holds for the optimal values of δ. The MTFs obtained with both imaging systems are represented for comparison on Fig. 2.(a) for the system optimized with J IQ and on Fig. 2.(b) for the system optimized with J SOD . We can see that for both systems, MTFs are quasi-invariant with respect to object distance. The MTF curves for 9.6 m or 10 km are particularly similar. The MTF curve for an object positioned at 4.8 m is slightly lower for the system optimized with J SOD than for the other one. The MTF after deconvolution for both systems are presented on Fig. 2.(c) and 2.(d). They are accordingly quasisimilar for distances 9.6 m and 10 km. For the distance 4.8 m, the curve of the system optimized with J SOD is lower, as could be expected from the observed difference in MTF curves before deconvolution, but remains well above the deconvolved noise level for all spatial frequencies until 60 cy/mm. Simulated images, together with IQ values, corresponding to both J SOD and J IQ -optimized systems are compared in Fig. 3, with respect to the object distance. Column 1 corresponds to the images given with the J IQ optimized system before deconvolution, and column 2 corresponds to the images obtained with the J SOD optimized system also before deconvolution. It is seen that for both systems, image qualities are quasi uniform with respect to the object distance, and that the IQ value (defined at Eq. ( 6)) is also of similar values from one system to the other at given object distance. The same observations hold after deconvolution where the images given by the J IQ -optimized system (column 3) and the J SOD -optimized system (column 4) are all enhanced and of similar image qualities. The slight yet acceptable drop in IQ for the image given by the J SOD -optimized system at 4.8 m is directly related to the drop in MTF that was observed in Fig.

2.(d).

We can thus conclude that optimization with the surrogate criterion J SOD provides imaging performance very close to that given by the rigorous image quality criterion J IQ . This surrogate criterion has several advantages. First, it has been designed to be fully implementable in an optical design software like Code V. It can thus be used like any conventional design method in the same environment familiar to the optical designer. Second, thanks to the use of native physical quantities in the merit function and to the efficiency of its optimization algorithm, the computation time has been dramatically reduced relatively to the direct J IQ optimization. Indeed, for the considered example, the whole optimization process, including several local optimizations followed by modifications of the merit function weights by the designer, took only a dozen minutes, whereas the optimiza-tion of J IQ took around one day with the Nelder-Mead simplex optimization algorithm and the communication between the numerical computation software steering the optimization process and the optical design software used for ray tracing. This point is very important, since in more complex optical design tasks, where all the lens surfaces have to be optimized with associated constraints, optimization of J IQ with a numerical computation software is practically unfeasible, whereas the optimization of J SOD inside the optical design software is possible while taking into account all the optical constraints that are required in optical design. The purpose of the next section is precisely to demonstrate the efficiency of the proposed method for the co-design of a complex lens.

CO-DESIGN OF A VERY FAST F/0.75 LENS WITH THE SOD CRITERION

In this section, our objective is to jointly optimize all the parameters of a complex lens, for which optimization of J IQ would be very difficult to perform. We will consequently use the J SOD optimization. We consider the design of a very fast f/0.75 lens with the following parameters: focal length of f = 24.7 mm, maximum half field of view (HFoV) of 20°, and sensor pitch p = 8 µm corresponding to Nyquist frequency ν Nyq = 62.5 cy/mm. The design will be performed in the near-infrared spectral range λ ∈ [600 nm; 900 nm]. Such a very high aperture is required when imaging in dim light conditions, where it is necessary to collect as many photons as possible. The lens considered in this section is aimed at equipping night vision goggles mounted on a soldier's helmet. It has to be as light as possible and its center of mass needs to be as close as possible to the helmet. Typical apertures for this type of optical systems are currently f/0.95 [START_REF] Thales | HELIE Night vision goggle for airborne operations[END_REF]. Conventional design of such lenses is complex. Very large apertures induce optical aberrations with high order and large amplitudes that are difficult to correct. Moreover, image quality becomes very sensitive to changes in optical parameters. Obtaining good imaging performance at f/0.75 while keeping low weight is thus a big challenge.

The potential added-value of co-design approach for this type of lenses is to allow for a higher, yet controlled, amount of aberrations than conventional design since these aberrations can be compensated by digital post-processing. Allowing and controlling the presence of aberrations can relax some constraints on the shapes of lenses, and thus enable for simplifying and lightening the optimized lens. In the following, we will compare results of both conventional and joint optical designs.

A. Conventional f/0.75 lens design

A first conventional f/0.75 lens was designed by a skilled optical designer from Thales Angénieux. The optimization was performed in the traditional way by minimizing the RMS spotdiagram diameter. The design constraints were the following:

1. Tangential MTFs in the field have to stay above 0.35 at ν Nyq , 2. Maximum distortion is of 2 %, 3. Illumination on the image in the field has to remain above 30% of illumination on-axis.

During optimization, performance assessment tools such as MTF or RMS spot diagram were computed on large spectral range [600 nm; 900 nm], and for the following horizontal field of view (HFoV) values before deconvolution (J SOD ) after deconvolution (J IQ ) after deconvolution (J SOD ) Fig. 3. Simulated images with respect to the object distance provided before deconvolution by the system with J IQ -optimized phase mask (column 1) and with the J SOD -optimized phase mask (column 2), and after deconvolution by the system with J IQ -optimized phase mask (column 3) and with the J SOD -optimized phase mask (column 4).

F k = (k -1) × 5°with k ∈ {1, . . . , 5}.
The obtained optical system is shown in Fig. 4. It consists of 6 optical elements denoted {L k ; k ∈ 1, 6 } with one aspherical surface on the first surface of the front lens, and a supplementary diaphragm placed in front of the system, which introduces vignetting to reduce field aberrations amplitude. The diaphragm consequently induces a drop in relative illumination across the field. It is seen in Tab. 2 that this illumination drops to 30% at maximal HFoV. The barrel distortion amplitudes with respect to the field are given in Tab. 2, column 2. The maximal value is 2% at 20°field. Images of optical PSFs and values of RMS spot diameters are given in Fig. 5 for the following HFoVvalues: on-axis, interme- The weights of the optical elements have been estimated using the WEI command of Code V, that takes into account the volumes and densities of each lens. Results are given in Tab. 3, column 1. The heaviest elements of the system are the front lens (L1), the third convergent lens (L3) and the second lens of the doublet (L5). Since the weight of L1 is due to its large diameter required by the system high aperture, it may be difficult to reduce it. In contrast, L3 and L5 weights may be modified by reducing their widths and curvatures, while ensuring that the mass center stays close to the image plane.

B. Co-designed f/0.75 lens

Our purpose is now to reduce the weight of the lens while keeping at least equivalent performance by using a co-design approach. For that purpose, we will optimize the SOD criterion defined in Eq. ( 8). Since we want to obtain a good performance uniformity in the field, the parameter ψ to which we require the performance to be invariant is the field angle, that is, ψ ∈ {F 1 , . . . , F 5 }. The optimization variables θ are the curvature radii of all surfaces, the width of all optical elements, air spacing between lenses, and potential aspherical coefficients. The distance between the last optical surface and the image plane is At the beginning of the optimization of J SOD , MTF weights w ∆MTF ψ,ν,ξ are set to zero. The terms related to quasi-invariance of RMS spot size (fourth term of Eq. ( 8)) are computed with respect to the reference field, i.e. ψ 1 = F1 = 0°. Once the MTF curves start to take off from nearly zero values at medium spatial frequencies due to the standard optimization criterion and are sufficient close to one another due to the φ θ ψ k quasi-invariance unconventional constraints, terms related to MTF quasi invariance are added. They are computed for the two azimut angles ξ = 0°and ξ = 90°, and at a given spatial frequency that evolves during optimization. Associated weights are also evolving once the MTFs are stabilized.

The lens resulting from this optimization keeps a shape similar to the conventional one, with one aspherical surface on the front lens. As shown in Tab. 2 (second column), relative illumination stays above 34.5 %, and barrel distorsion amplitude is low and under 0.43 %. The PSF images and corresponding RMS spot sizes are given in Fig 5 (right column). After optimization of J SOD , the RMS spot sizes are quite uniform in the field, and much more symmetric. As expected, the MTF represented in Fig. 6 (right column) are also very similar to each other, whether on the sagittal or tangential plane. Only the MTF curves at 20°a re further apart, with a noticeable difference between tangential and sagittal curves that reaches a maximal value of 0.1 at low spatial frequency (20 cy/mm).

We have represented the global MTF after deconvolution obtained for both conventional and co-designed systems in Fig. 6.(c) and (d). To compute the Wiener filter, we have assumed that the input SNR is equal to 34 dB. For the conventional lens, the average Wiener filter has the same closed-form expression as for the co-designed lens, but it is computed using the OTFs of the conventional lens. It is observed in Fig. 6 that global MTFs are globally enhanced, except where the original MTF curves are close to or lower than the noise level. The global MTFs of the co-designed system are again quasi-invariant with respect to HFoV and azimut angle. As their values before deconvolution were high enough and above the noise level, they are all significantly enhanced and are comparable to an ideal system with same optical characteristics. Fig. 6. MTF in tangential plane (plain curve) and sagittal plane (dots) for (a) the conventional optical system, and (b) the codesigned system. MTFs after deconvolution for (c) conventional system , and (d) co-designed system. Simulated images corresponding to conventional and codesigned systems, before and after deconvolution, are given in Fig. 7 together with the IQ value, for different values of HFoV. The first column corresponds to images obtained with the conventional lens. It is seen that image quality sharply decreases with the field. For instance, the roots on the pot become blurry for intermediate and high HFoV. On the contrary, it can be seen in the second column that the-co-designed lens provides images of very similar quality all over the field. Thanks to this property, the quality of images from the co-designed lens after deconvolution (fourth column) is excellent for all values of the field. It is much better than the deconvolved image from the conventional lens (third column) at 20°field angle, whereas it is similar for the two other values of the field.

The weights of the different elements of the co-designed lens are given in Tab. 3, column 2. The total mass of the co-designed system is 61.8 g, that is 10 g less than that of the conventional system. The third lens weight has been significantly reduced, and is the main contributor to the weight reduction of the system. We also note that the center of mass is closer to the sensor plane.

CONCLUSION

We have proposed a surrogate criterion (SOD) to replace the rigorous mean square error-based image quality (IQ) criterion in order to efficiently perform joint digital-optical design with commercial optical design software. This SOD criterion has been validated on the optimization of a phase mask for depth of field extension, and the obtained performance has been shown to be quite similar to that obtained by optimizing the rigorous IQ criterion. The new criterion has then been used for the design of a very fast (f/0.75) complex lens. This co-designed lens has been found to be superior to a classically designed lens in terms of lens weight and homogeneity of image quality in the field.

This surrogate criterion has several advantages. First, it is easily implementable in optical design software like Code V or Zemax, as it makes use of a merit function based on the default one completed by easy-to-compute terms involving natively implemented physical quantities and parameters that are wellknown to optical designers. Second, and as a direct consequence of the first point, it can fully exploit the efficiency of optical design software optimization algorithms. The computation time can thus be dramatically reduced, and made comparable to that of classical designs. In this paper, the performance of the SOD criterion has been illustrated on only a few design examples. The main perspective of this work is to validate this approach on many other design problems, with more complex lenses and/or other design tradeoffs. Of course, depending on the problem, the suitable form of the SOD criterion may be different, involving different combinations of native terms in the merit function. However, the philosophy should remain the same: to introduce as smoothly as possible the co-design approach into the classical optical design process, in order to make the most out of optical designer skills and art, and of digital processing. . Simulated images with respect to HFoV Fk, provided before deconvolution by the conventional system (column 1) and by the co-designed system (column 2), and provided after deconvolution by the conventional system (column 3) and by the codesigned system (column 4).

Fig. 1 .

 1 Fig. 1. Logarithmic scale (dB) display of hybrid system PSFs before deconvolution when ψ is (a) 10 km, (b) 9.6 m, and (c) 4.8 m. (d) Linear scale PSF cross-sections along x and for y = 0 including PSFs maxima.

Fig. 4 .

 4 Fig. 4. Conventional f/0.75 lens.

5 .

 5 Logarithmic scale (dB) display of polychromatic PSF with associated RMS spot size Φ RMS . Conventional system: (a) on-axis, (c) for intermediate HFoVof 10°, and (e) for maximum HFoVof 20°. Co-designed system: (b) on-axis, (d) for HFoVof 10°, and (f) for HFoVof 20°.

Table 3 .

 3 Estimated weight of each individual lens composing the conventional system (column 1) and the co-designed system (column 2) using the Code V WEI commandLensesWeight (conv. sys.) Weight (co-des. sys.1 mm. The number of optical elements is not changed during the optimization, and will remain equal to 6. The lens configuration used as the starting point of the co-design optimization is the conventionally optimized lens represented in Fig.4.

Fig. 7

 7 Fig.7. Simulated images with respect to HFoV Fk, provided before deconvolution by the conventional system (column 1) and by the co-designed system (column 2), and provided after deconvolution by the conventional system (column 3) and by the codesigned system (column 4).

Table 2 . Relative illumination and distortion

 2 Nyq . They decrease with the field but stay higher than 0.35 at ν Nyq in the tangential plane, as specified in the design constraints. However, for high HFoV, sagittal MTF values are much lower than tangential MTF values, the sagittal MTF taking zero value at 55 cy/mm. Again, this asymmetry between tangential and sagittal MTF is typical of coma and astigmatism.

		Conventional system	Codesigned system
	Field	Rel. illum. (%)	Distortion (%)	Rel. illum. (%)	Distortion (%)
	0°1 00	0	100	0
	5°8 5	-0.11	86.8	0.0
	10°6 8	-0.44	69.7	-0.02
	15°4 7	-1.05	52	-0.13
	20°3 0	-2	34.5	-0.43
	diate field of 10°and maximum field of 20°. We observe on the
	images that the PSF size increases rapidly with the field, and
	the RMS spot size increases accordingly. The PSF is wider in the
	sagittal plane (i.e. , following the horizontal x axis for fields in
	the y direction) than in the tangential plane, which is a charac-
	teristic feature of astigmatism. Correspondingly, it is observed
	in Fig. 6 that MTF values for low HFoV(0°and 5°) are high and
	similar to each other, reaching 0.7 at ν

ACKNOWLEDGMENT

This work is dedicated to the memory of Joël Rollin, who passed away suddenly in 2017, and who has largely encouraged this present work on the surrogate criterion, and made its application on the f/0.75 lens possible.

The authors kindly thank Damien Bigou for the design of the conventional f/0.75 lens.


Yaël Kolasa

Jean-Philippe Georges

Thierry Bastogne

Computer-aided design of ECG telemetry systems for online cardiac monitoring

est destinée au dépôt

COMPUTER-AIDED DESIGN OF ECG TELEMETRY SYSTEMS FOR ONLINE CARDIAC MONITORING

Y. KOLASA 1,2 , J.-P. GEORGES 2 , T. BASTOGNE 1,2,3 1 CYBERnano, 2 CRAN UL-CNRS UMR 7039, 3 INRIA BIGS Background. Telemetry is rapidly becoming standard practice for clinical studies. Remote monitoring may be performed at multiple locations of subjects over Blue-tooth, WiFi or 3G cell phone networks. Nevertheless, the accuracy and reliability of monitoring systems have still to be improved for clinical acceptability. Main challenges of wearable devices used in clinical trials have been identified in a very recent article (E. S. Izmailova et al., Clin. Pharma. Thera., 2018). They include scientific methodology as well as regulatory, legal, and operational hurdles. Its partial implementation was based on two consecutive sets of simulations. In a first step, a screening design of numerical experimentations (Plackett-Burman design) was carried out to identify the critical network parameters. In a second step, an optimization campaign, based on a central composite design, was implemented to identify the design space, i.e. the region of interest in which all the telecommunication parameters have to be kept fulfilling the quality specifications. Simulations were carried out in Omnet++ and the statistical analysis in the software environment R.

Results

For the number of packets received, two critical parameters were identified: message length and bit rate. For ECG distortion, the first two most critical factors are background noise power and energy detection of the radio receiver. For the battery lifetime, preliminary results tend to show that background noise power and bit rate are critical. For the transmission count, the bit rate and the max queue size of the message are decisive.

Conclusion

This study demonstrates the relevance to use numerical simulations to design but also check the compatibility of a telemetry system with predefined specifications on quality of services in a given and constrained context. Such an approach can be implemented in the early steps of development and can save of lot of time and money by preventing malfunctions, scraps and posteriori restructurations of the telemetry networks.

Annual Meeting of Safety Pharmacology Society, Washington DC, Sep 30 -Oct 3 2018

Methods

The objective is to propose an in silico-based method able to prevent some of those issues during the design of clinical trials. To illustrate its applicability, a study case is developed in which we apply this proposed method to identify critical telecommunication parameters to control quality of transmitted ECG in telemetry systems.

Objectives

  15 simulation parameters have been selected to test their criticality and four quality attributes have been examined: battery lifetime, number of received packets, transmission count and ECG distortion. The methodology framework relies on the Quality-by-Design guidelines (ICH Q8-Q12).

Fig. 1 :

 1 Fig.1: Design of numerical experiments for the robustness analysis of sensors networks


Levy Batista

Ricardo Contu

Brittney Van Hese

Fabian Zanella

Thierry Bastogne

Automated classification of early afterdepolarizations grades in flipr calcium assays

des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

AUTOMATED CLASSIFICATION OF EARLY AFTERDEPOLARIZATIONS GRADES IN FLIPR CALCIUM ASSAYS

L. BATISTA 1 , R. CONTU 2 , B. VAN HESE 2 , F. ZANELLA 2 , T. BASTOGNE 1,3,4 1 CYBERnano, 2 STEMONIX, 3 CRAN UL-CNRS UMR 7039, 4

Results

EAD classifications obtained from standard manual data plotting were compared to classifications obtained with Cybernano algorithms, and concordance between the datasets was analyzed for validation. Robust concordance was observed through this analysis, indicating that the algorithm has satisfactory fidelity to streamline data analysis for automated detection of EADs from high throughput calcium flux analysis in cardiomyocytes.

Conclusion

In summary, the comparison of data analysis obtained have demonstrated the proof of concept and very promising perspectives for automatic detection and grading EADs in high throughput calcium flux assays. This comparative study will serve as basis for extending the analysis to a larger library of molecules for additional validation.

  INRIA BIGS We developed a new integrated approach able to automatically classify severity grades of EADs observed in high throughput calcium flux data. StemoniX microHeart screening plates promote cardiomyocyte alignment and enable greater resolution over the analysis of pro-arrhythmic phenotypes observed in human induced pluripotent stem cell-derived cardiomyocytes (hiPSC-CMs). hiPSC-CMs were maintained in standard or microengineered microHeart 384-well screening plates for seven days prior to compound treatment and calcium flux analysis. Compound responses were categorized into 7 phenotypes: normal rythmic calcium flux behavior, five severity grades of EADs, and cessation of beating activity (quiescence). Data generated in the microHeart platform was used by Cybernano to develop and validate a statistical learning algorithm: Cybernano i-Cardio EAD to characterize transient patterns associated with different classes of EADs. Parametric modeling of the beating pattern was associated with a numeric degree of EADs with a value normalized between 0 (no beating) and 1 (no EAD). Finally, an multiclass classification is applied to discriminate the five severity grades of EADs.

Fig. 3 :

 3 Fig.3: Visualization of the EAD classes in a 2D-space associated with 2 classifiers: X1 and X2.

AnnualFig. 2 :

 2 Fig.1: Example of i-Cardio EAD report obtained from FLIPR data of a 384well screening plate. Each colour corresponds to a EAD severity grade on a scale composed of 5 levels.