title: Solving Machine Learning Problems with Biological Principles
creator: Leng, Luziwei
subject: ddc-500
subject: 500 Natural sciences and mathematics
description: Spiking neural networks (SNNs) have been proposed both as models of cortical computation and as candidates for solving problems in machine learning. While increasing recent works have improved their performances in benchmark discriminative tasks, most of them learn by surrogates of backpropagation where biological features such as spikes are regarded more as defects than merits. In this thesis, we explore the  enerative abilities of SNNs with built-in biological mechanisms. When sampling from high-dimensional multimodal distributions, models based on general Markov chain Monte Carlo methods often have the mixing problem that the sampler is easy to get trapped in local minima. Inspired from traditional annealing or tempering approaches, we demonstrate that increasing the rate of background Poisson noise in an SNN can flatten the energy landscape and facilitate mixing of the system. In addition, we show that with synaptic short-term plasticity (STP) the SNN can achieve more efficient mixing by local modulation of active  attractors and eventually outperforming traditional benchmark models. We reveal diverse sampling statistics of SNNs induced by STP and finally study its implementation  on conventional machine learning methods. Our work thereby highlights important computational consequences of biological features that might otherwise appear as artifacts  of evolution.
date: 2020
type: Dissertation
type: info:eu-repo/semantics/doctoralThesis
type: NonPeerReviewed
format: application/pdf
identifier: https://archiv.ub.uni-heidelberg.de/volltextserverhttps://archiv.ub.uni-heidelberg.de/volltextserver/26863/1/Leng_thesis.pdf
identifier: DOI:10.11588/heidok.00026863
identifier: urn:nbn:de:bsz:16-heidok-268637
identifier:   Leng, Luziwei  (2020) Solving Machine Learning Problems with Biological Principles.  [Dissertation]     
relation: https://archiv.ub.uni-heidelberg.de/volltextserver/26863/
rights: info:eu-repo/semantics/openAccess
rights: http://archiv.ub.uni-heidelberg.de/volltextserver/help/license_urhg.html
language: eng