title: Architectural Constraints of Normalizing Flows
creator: Draxler, Felix Matthias
subject: ddc-004
subject: 004 Data processing Computer science
subject: ddc-510
subject: 510 Mathematics
description: In this thesis, we consider Normalizing Flows, a class of models that leverage neural networks to represent probability distributions, enabling efficient sampling and density estimation. The focus of our work is to develop versatile normalizing flows, that is flexible methods readily applicable to arbitrary problems.    We therefore theoretically examine the expressivity of existing architectures. We find that volume-preserving flows are fundamentally biased and identify a fix. We improve on universality guarantees for coupling-based flows, showing that well-conditioned affine coupling flows are universal. We find that the latter scale favorably with dimension in comparison to Gaussianization flows.    We then proceed to lift architectural restrictions from normalizing flows altogether via the introduction of Free-Form Flows. This framework trains arbitrary neural network architectures as normalizing flows. This allows for the first time, among others, cheap rotation-equivariant normalizing flows, normalizing flows on arbitrary Riemannian manifolds, and injective flows based on feed-forward autoencoders. This model is significantly more flexible to adapt to novel problems, performs comparable or better than existing normalizing flows and competitive with methods with iterative inference such as diffusion models and flow matching.
date: 2024
type: Dissertation
type: info:eu-repo/semantics/doctoralThesis
type: NonPeerReviewed
format: application/pdf
identifier: https://archiv.ub.uni-heidelberg.de/volltextserver/35516/1/PhD_Draxler-final.pdf
identifier: DOI:10.11588/heidok.00035516
identifier: urn:nbn:de:bsz:16-heidok-355164
identifier:   Draxler, Felix Matthias  (2024) Architectural Constraints of Normalizing Flows.  [Dissertation]     
relation: https://archiv.ub.uni-heidelberg.de/volltextserver/35516/
rights: info:eu-repo/semantics/openAccess
rights: http://archiv.ub.uni-heidelberg.de/volltextserver/help/license_urhg.html
language: eng