Journées ANR Mistic : 6 et 7 avril 2023 à Paris

Lieu

MAP5 @ Université Paris Cité
45 Rue des Saints-Pères, 75006 Paris
Salle des thèses (voir plan ci-dessous).

Zoom ID : Demander le lien par email à jonathan.vacher’@’u-paris.fr

Restaurant jeudi soir à 19h30

Chez Françoise : https://goo.gl/maps/MVAVqyUu7CQ1cVAa6
Aérogare des Invalides, 75007 Paris

Programme

Jeudi 6 avril 2023

  • 10h00 – 10h30 Accueil + café
  • 10h30 – 11h15 Antoine Salmona
    Can push-forward models fit multimodal distributions ?
  • 11h15 – 12h00 Anton François
    Topological Data Analysis for Train-Free Glioblastoma Segmentation in MRI: Advantages and Potential Impact
  • 12h00 Pause déjeuner
  • 14h00-14h45 Vadim Lebovici
    Hybrid transforms for topological data analysis.
  • 14h45-15h30 Anna Song
    The geometry and topology of texture in shapes.
  • 15h30-16h00 Pause café
  • 16h00-16h45 Eddie Aamari
    Minimax Boundary Estimation and Estimation with Boundary.
  • 16h45-19h00 Discussions libres
  • 19h30 Diner au restaurant Chez Françoise (https://goo.gl/maps/MVAVqyUu7CQ1cVAa6)

Vendredi 7 avril 2023

  • 9h30 – 10h15 Frédéric Richard
    Full inference for the anisotropic fractional Brownian field.
  • 10h15 – 10h45 Pause café
  • 10h45 – 11h30 Barbara Pascal
    Texture segmentation based on fractal attributes using convex functional minimization with generalized Stein formalism for automated regularization parameter selection.
  • 11h30 – 12h15 Julien Rabin
    Semi-discrete Optimal Transport for Texture Generation and Image Stylization
  • 12h15 Pause déjeuner
  • 14h15-14h45 Jonathan Vacher
    Discussions : Images, Textures et Perception.
  • 14h45-17h00 Discussions libres

Hôtels recommandés

https://www.hoteldefleurieparis.com/

Résumés des exposés


Antoine Salmona 

Can push-forward models fit multimodal distributions? 

Les modèles génératifs sont aujourd’hui l’un des sujets de recherche les plus populaires en apprentissage automatique, notamment grâce à leur impressionnante capacité à générer des images synthétiques réalistes. Cependant, il reste souvent difficile de savoir si ces modèles s’approchent correctement de la distribution sous-jacente des données ou s’ils génèrent uniquement des échantillons qui semblent similaires aux données. Dans ce travail, nous nous concentrons sur la classe particulière des modèles génératifs push-forward, qui inclut les Variational Autoencoders, les Generative Adversarial Networks et les Normalizing Flows. Nous montrons que ces modèles doivent avoir de grandes constantes de Lipschitz afin de bien approcher les distributions multimodales. Ainsi, comme la majorité des méthodes pour stabiliser les modèles génératifs consistent à limiter, de façon plus ou moins directe,  la constante de Lipschitz des réseaux de neurones, il existe pour ces modèles un compromis entre la stabilité de leur apprentissage et leur expressivité.


Anton François

Topological Data Analysis for Train-Free Glioblastoma Segmentation in MRI: Advantages and Potential Impact

This presentation will describe a new method for glioblastoma segmentation in MRI scans using topological data analysis (TDA). Accurate segmentation of glioblastomas is critical for effective treatment planning and disease progression monitoring. Our TDA-based approach offers several advantages over traditional machine learning methods, such as the ability to perform segmentation without the need for large annotated datasets and the ability to adapt easily to different data sets and segmentation needs. TDA also provides a more interpretable and stable framework for segmentation by leveraging topological features. Overall, this TDA-based method has the potential to be a valuable tool for the medical imaging analysis.


Vadim Lebovici 

Hybrid transforms for topological data analysis

Euler calculus—integration of constructible functions with respect to the Euler characteristic—has led to important advances in topological data analysis.  

For instance, Schapira’s inversion theorem of the topological Radon transform is key to the following inverse problem: can one recover a shape embedded in the Euclidean space from the knowledge of the Euler characteristic of its intersections with all affine half-spaces? In this talk, I will introduce integral transforms combining Lebesgue integration and Euler calculus for constructible functions.

In this talk, I will present so-called « hybrid » transforms mixing Euler and Lebesgue calculus. These transforms provide more versatile shape descriptors than their topological analogues. I will show that these transforms output regular functions and are compatible with some topological operations on shapes. Finally, I will present an injectivity result for the hybrid Fourier transform.

Le calcul d’Euler, c’est-à-dire l’intégration des fonctions constructibles par rapport à la caractéristique d’Euler, a permis d’importantes avancées dans le domaine de l’analyse topologique de données. Par exemple, le théorème d’inversion de la transformée de Radon topologique dû à Schapira est la clé du problème inverse suivant : une forme de l’espace euclidien est-elle déterminée par la caractéristique d’Euler de ses intersections avec tous les demi-espaces affines ? 

Dans cet exposé, je présenterai des transformées intégrales dites « hybrides » mêlant le calcul d’Euler et l’intégrale de Lebesgue. Ces transformées fournissent des descripteurs de formes plus versatiles que leurs analogues purement topologiques. Je montrerai que ces transformées produisent des fonctions régulières et conservent une compatibilité à certaines opérations topologiques sur les formes. Je terminerai la présentation par un résultat d’injectivité pour la transformée de Fourier hybride.


Anna Song

The geometry and topology of texture in shapes

In biology and materials science, porous structures display a wide morphological variety. Their 3D shape texture constitutes an important reservoir of information, and is for instance a marker of disease progression in a vascular network. The disparity of these structures calls for a unified mathematical modelling, which poses real challenges.

First, I will present curvatubes, a generative geometric model for 3D porous shapes. A surface adopts an optimal shape with respect to a curvature energy which makes it fold into tubular or membranous shapes. This model is framed as a novel phase-field formulation compatible with the GPU and satisfying a Gamma-limsup property. This results in geometrically random but statistically controlled textures which has many applications.

Second, I will present a topological method that quantifies a shape by its components, loops and cavities, at several spatial scales. We will give an interpretation of the resulting persistence diagram in terms of thicknesses and gaps, and especially of shape texture. Inhomogeneous mixtures of textures are thus detectable.

Finally, I will show how to combine both approaches to study the remodelling of bone marrow blood vessels by leukaemia.


Eddie Aamarie 

Minimax Boundary Estimation and Estimation with Boundary

In this talk, we study the non-asymptotic minimax rates for the Hausdorff estimation of 𝑑-dimensional manifolds 𝑀 with (possibly) non-empty boundary 𝜕𝑀. The class of target sets that we consider reunites and extends the most prevalent C²-type models: manifolds without boundary, and full-dimensional domains. We will consider both the estimation of the manifold 𝑀 itself and that of its boundary 𝜕𝑀 if non-empty. In the process, we will present a Voronoi-based procedure that allows to identify enough points close to 𝜕𝑀 for reconstructing it. Explicit constant derivations are given, showing that these rates do not depend on the ambient dimension. If time permits, we will talk about possible extensions of the estimation procedure to smoother manifolds with corners.


Frédéric Richard (joint work with Paul Escande)

Full inference for the anisotropic fractional Brownian field 

The anisotropic fractional Brownian field is a non-stationary Gaussian field (Bonami and Estrade, 2003) which has been used for the modeling of image microtextures (Richard, 2016-18). Having stationary increments, its probability distribution is characterized by a semi-variogram whose spectral representation is determined by two non-negative -periodic functions called the topothesy and the Hurst functions, respectively. In this talk, we focus on the issue of estimating these two functions from a single realization of the field.

Solving that issue is a key point for the characterization and the classification of image textures. It would also pave the way to the simulation of realistic textures from the field model. In the literature, this issue has been partially tackled in two different studies. In (Biermé and Richard, 2008), a method was built upon the Radon transform of the field to estimate the Hurst function. But, due to discretisation issues, its application is restricted to a few directions and leads to inaccurate results. In (Richard, 2018), an inverse problem was stated and solved to estimate the topothesy in directions where the Hurst function is minimal.

In this talk, we will present a method for the estimation of the whole topothesy and Hurst functions. This method is based on a turning-band field which was initially proposed for the simulation of anisotropic fractional Brownian field (Biermé, Moisan and Richard, 2015), and whose semi-variogram approximates the one of an anisotropic fractional Brownian field. We will set an optimization problem to fit the semi-variogram of the turning-band field to the empirical semi-variogram. This problem is formulated as a non-linear separable least square problem (Golub, 2003). We then use a variable projection method to design an algorithm to solve numerically the problem. The design of this algorithm also includes a multigrid approach to improve the convergence. We will present a numerical study of the performances of this algorithm on textures generated by the python package PyAFBF. Eventually, we will show some applications of the approach to mammograms.


Pascal Barbara

Texture segmentation based on fractal attributes using convex functional minimization with generalized Stein formalism for automated regularization parameter selection.

Texture segmentation still constitutes an ongoing challenge, especially when processing large-size real world images. The aim of this work is twofold.

First, we provide a variational model for simultaneously extracting and regularizing local texture fractal features, namely the local regularity and the local variance. For this purpose, a scale-free model, based on wavelet leaders, penalized by a Total Variation regularizer, is embedded into a convex optimisation framework. The resulting functional is shown to be strongly-convex, leading to a fast minimization scheme.

Second, we investigate Stein-like strategies for the selection of regularization parameters. A generalized Stein estimator of the quadratic risk is built, taking into account the covariance structure of leader coefficients. Then it is minimized via a quasi-Newton algorithm relying on a proposed generalized estimator of the gradient of the risk with respect to hyperparameters, leading to an automated and data-driven tuning of regularization parameters.

The overall procedure is illustrated on multiphasic flow images, analyzed as part of a long-term collaboration with physicists from the Laboratoire de Physique of ENS Lyon. 


Julien Rabin

Semi-discrete Optimal Transport for Texture Generation and Image Stylization

In this presentation we focus on the problem of image generation in the specific setting of textures.

Various techniques have been proposed in the last decades to synthesize realistic images from a single example, from patch-based copy approaches to neural network training with perceptual features.

After a short overview, we introduce a new model which aims at taking advantages of these techniques by optimizing the optimal transport cost between the distributions of synthetic and exemplar features.

We will show that such model is capable of interpolating between characteristics from several textures.

Journées ANR Mistic : 23 et 24 juin 2022 à Orléans

Lieu

Hôtel Dupanloup au centre ville d’Orléans (Google maps)

Programme

Jeudi 23 juin 2022

  • 14h-17h30 : Exposés scientifiques de chercheurs invités
    Programme :
    • Accueil – café
    • 14h30-15h15 : Hermine Chatoux, The metrological use of fractals to study human perception and physical sensors
    • 15h15-16h : Nicolas Lutz, Champs cyclostationnaires pour la synthèse de textures
    • Pause
    • 16h30 – 17h15 : Raphaël Achddou, Synthetic images as a regularity prior for image restoration neural networks
  • Soir : Dîner avec tous les participants au restaurant l’Etage, 6 Rue Jean Hupeau,Orléans (Google maps)

Vendredi 24 juin 2022

  • 9h30-12h30 : Exposés scientifiques des membres du projet
    Programme :
    • 9h30-10h15 : Anne Estrade, Champs aléatoires gaussiens et mélanges gaussiens : géométrie stochastique, statistique inférentielle et extrêmes spatiaux
    • 10h15-10h45 : Pause café
    • 10h45-11h30 : Ryan Cotsakis, Estimating the perimeter of smooth shapes in binary, pixelated images
    • 11h30-12h15 : Hermine Biermé, Vector valued random fields for color images
  • Déjeuner avec tous les participants au Lutetia, 2 Rue Jeanne d’Arc, Orléans (Google maps)
  • 14h-15h (environ) : Discussion sur la suite du projet
  • 15h-17h30 : Echanges libres (plusieurs salles de réunions à disposition pour des travaux en petits groupes)

Hôtels recommandés

  • Hôtel de l’abeille, 64 rue Alsace Lorraine, 45000 Orléans
  • Urban Jungle. Hotel Orléans, 1 Rue de la Lionne, 45000 Orléans
  • Campanile Orléans Centre, 40 Rue de la République, 45000 Orléans
  • Hôtel Saint-Martin, 52 Bd Alexandre Martin, 45000 Orléans

Résumés des exposés

  • Raphaël Achddou, Synthetic images as a regularity prior for image restoration neural networks
    Despite their impressive results in most image restoration tasks, deep learning approaches fail to generalise to the slightest changes in either the acquisition modality or the distortion modality. To that end, the most common solution is to acquire a new database for each modality and retrain a new neural network, which is both costly and time consuming. To circumvent these limitations, we propose to train deep learning restoration methods on images generated with a simple dead leaves model equipped with a carefully designed distortion model. In this talk, I will first introduce this synthetic image model and the implementation choices we made. Then, I will explain how we modelled image distortions for various image restoration tasks. I will then present some experimental results confirming our intuition that synthetic images and a good deterioration model are sufficient to train a neural network with performances on par with its classical counterparts. Finally, we will give some perspectives to this work, with an ongoing study on the understanding of the distribution of colors in natural images, which is crucial to color dead leaves images.
  • Hermine Biermé, Vector valued random fields for color images
    The RGB color model is an additive color model in which the red, green and blue colors are added to reproduce colors. We consider the color monogenic framework to define random fields according to natural colors. This approach is based on the monogenic representation of a greyscale image, based on Riesz transform and particularly well-adapted to detect directionality of self-similar of operator scaling Gaussian fields. This talk is dedicated to the memory of Mark Marvin Meerschaert (1955-2020).
  • Hermine Chatoux, The metrological use of fractals to study human perception and physical sensors
    To study the human perception of texture, the fractional Brownian movement can be used to generate color texture images (a controlled variation in the spatio-chromatic space). Indeed, fractal textures are not directly related to a semantic subject and therefore will allow to measure “eye sensation” and not “brain analysis”. Our focus of interest is the physical and perceptual constraints to generate such a mathematical object. The fBm strong hypothesis is the continuity of the space. When applying the concept to color images, a quantification is realized both in the spatial and the chromatic space.
  • Ryan Cotsakis, Estimating the perimeter of smooth shapes in binary, pixelated images
    Suppose that a space is divided into two regions that are separated by a locally smooth boundary. Superpose the space with a regular lattice structure, and for each vertex of the lattice, record which region it belongs to. From the samples at the lattice vertices, our goal is to estimate the measure of the boundary. In this talk, I describe an algorithm that recovers the exact measure of the boundary as the size of the lattice cell approaches zero. This algorithm can be used to estimate the perimeter of excursion sets of 2D, anisotropic random fields, for example, with desirable probabilistic properties (see our preprint hal-03582844).
  • Anne Estrade, Champs aléatoires gaussiens et mélanges gaussiens : géométrie stochastique, statistique inférentielle et extrêmes spatiaux
    De nombreux résultats concernant les propriétés géométriques des champs aléatoires ont été établis dans le cas des champs gaussiens ; citons par exemple la longueur des lignes nodales ou la caractéristique d’Euler qui décrivent la structure topologique des excursions. Par ailleurs, les modèles les plus utilisés dans le cadre de l’analyse statistique des valeurs extrêmes de processus spatiaux sont les processus de mélange gaussien, en échelle ou en position. Dans cet exposé, on commencera par présenter quelques résultats concernant la géométrie des excursions gaussiennes et on montrera comment les utiliser en statistique inférentielle pour exhiber des propriétés du champ considéré. Ensuite, on étendra ces résultats à certains modèles de mélange ainsi qu’à des processus limites connus sous le nom de processus de Pareto généralisés.
    Travail en collaboration avec Elena Di Bernardino (LJAD, Nice) et Thomas Opitz (BioSP, INRAE Avignon).
  • Nicolas Lutz, Champs cyclostationnaires pour la synthèse de textures
    Le bruit procédural est utilisé dans les applications de rendu en temps réel pour texturer des surfaces de taille non bornée afin d’éviter les artefacts de répétition et d’alignement d’un pavage périodique classique. Comme les bruits procéduraux implémentent généralement des champs stationnaires Gaussiens, le type de textures pouvant être généré est statistiquement limité. Nous avons montré l’année dernière qu’il était possible d’instancier des champs cyclostationnaires Gaussiens pour générer en plus des textures dont l’organisation globale est périodique, soit à partir de spectres, soit à partir d’un exemple d’entrée, en adaptant certains des algorithmes existants. Cette présentation va principalement concerner notre article de Eurographics 2021 (https://hal.archives-ouvertes.fr/hal-03181139/), de quelques développements théoriques plus récents, et de pistes de recherches.

Vendredi 4 juin 2021 (virtual meeting)

Program

  • 13h30-14h15: Kevin Polisano (LKJ, CNRS, Grenoble-Alpes), Riesz-based orientation of localizable Gaussian fields
  • 14h15-15h00: Lara Raad (LTCI, Telecom Paris), Modélisation paramétrique des textures par des approches d’apprentissage profond
  • 15h00-15h15: Virtual coffee break
  • 15h15-16h00: Jonathan Vacher (LSP, ENS Paris), Texture Interpolation for Probing Visual Perception
  • 16h00-16h30: discussions

Mercredi 20 Janvier 2021 (virtual meeting)

Program

  • 9h30-10h15: Mariem Abaach (MAP5, Université de Paris), Testing marginal symmetry of digital noise images through the perimeter of excursion sets
  • 10h15-11h: Mohamed Kaseb (XLIM/LIAS, Poitiers), Monogenic measure of the quality of a synthetized phasor noise
  • 11h-11h30: Discussion

Mercredi 4 mars 2020 à l’Université de Paris

Programme :

  • 9h00-9h30 : accueil
  • 9h30-10h15 : Anne Estrade, MAP5, Paris Descartes
    Modèles d’ondes aléatoires anisotropes
  • 10h20-11h05 : Arthur Leclaire, IMB, Bordeaux
    Transport Optimal multi-couche et Synthèse de Textures
  • 11h10-11h55 : Bruno Galerne, IDP, Orléans
    Gestion de la couleur dans les algorithmes de synthèse de textures
  • 12h00-13h45 : discussions et déjeuner
  • 13h45-1600 : discussions sur le projet ANR