Deep Learning

Background Nerves generate magnetic fields when an action potential travels along them. Measuring these fields directly — rather than the electrical potentials picked up by electrodes — is attractive: the magnetic field passes through tissue essentially undistorted and requires no electrical contact with the sample. The catch is amplitude, as the field of a single nerve is in the nanotesla-to-picotesla range, orders of magnitude below the noise floor of a single measurement. ...

Background Modern deep neural networks, especially those in the overparameterized regime with a very large number of parameters, perform impressively well. Traditional learning theories contradict these empirical results and fail to explain this phenomenon, leading to new approaches that aim to understand why deep learning generalizes. A common belief is that flat minima [1] in the parameter space lead to models with good generalization properties. For instance, such models may learn to extract high-quality features from the data, known as representations. However, it has also been shown that models with equivalent performance can exist at sharp minima [2, 3]. These contradictory findings motivate us to study optimization, learned representations, and their impact on generalization from a geometric perspective. ...

Background Bayesian Neural Networks provide a principled way to learn the function mapping inputs to outputs, while also quantifying uncertainty in the predictions. Exact inference is typically computationally intractable due to computational complexity, and among the various approximate methods, Laplace approximation is a simple yet effective approach. Recently, a geometric extension using Riemannian manifolds has been proposed that enables Laplace approximation to adapt to the local structure of the posterior [1]. This Riemannian Laplace approximation is both effective and meaningful, and it opens up several potential research directions. ...

Project availability The project is already fully booked for Spring 2026. It will run again in Fall 2026. Background Global climate datasets (reanalyses or CMIP simulations) are commonly available as monthly means and daily aggregates (mean, max., and min.) for key atmospheric variables. In this study, we compiled such temporal low-resolution data from the ERA5 [1] reanalysis, using high-resolution hourly data from the CERRA [2] regional reanalysis as ground truth. ...

Motivation and Background Principal Component Analysis (PCA) is a widely-used method for dimensionality reduction, capturing maximum variance in data through orthogonal linear transformations. However, standard PCA ignores label information, potentially overlooking directions critical for predictive tasks. By incorporating label information into PCA, supervised PCA can extract dimensions directly related to the target variable, enhancing predictive performance and interpretability. Objectives The primary objective of this project is to develop a supervised neural network autoencoder (NN-AE) that integrates label information into PCA by learning orthogonal basis functions informed by supervised targets. This methodology aims to enhance interpretability and predictive accuracy relative to traditional PCA. ...

Add link to the project on the DTU website: Background At the Machine Learning in Life Science (MLSS) Research Center, we have been developing methodologies that we aim to apply and test on real-world data. In short, our work focuses on latent representations, typically obtained from a Variational Autoencoder (VAE), with the goal of extracting meaningful and reliable knowledge from them. An example of this research direction is this article, which explores representations of protein sequences. They found that the geodesic distances seem to recover evolutionary development protein sequences. ...

Background Relative representations are a powerful tool in machine learning and data analysis, where data points are represented based on their distances or similarities to a set of reference points called anchors. Traditional methods often rely on similarity measures, such as cosine similarity, which are invariant under rotation and scaling but may not satisfy the properties of a metric space, particularly the triangle inequality. This limitation can hinder the effectiveness of certain algorithms that require a proper distance metric. ...

Background Speech enhancement, the process of improving the quality speech signals, can not only improve quality of experience for listeners and the quality of communication, it can also aid the performance of machine-and deep-learning models in downstream tasks. However, the challenge of the trade-off between noise removal and artifact incorporation is ongoing [1]. The project aims to investigate the factors influencing noise reduction preferences and develop a technical framework around it. Low data-resources will be an important consideration in this project. ...

Background We are seeking students interested advancing speech technology in low-resource environments. The project is sufficiently open-ended and will be focused on developing machine learning models and algorithms tailored to address the unique challenges posed by limited data and computational resources in speech processing, also in high-stakes applications like healthcare and education. Objective(s) Potential directions are: Research and develop novel machine learning techniques optimized for low-resource speech technology applications. Design and implement efficient algorithms for speech recognition, synthesis, and understanding in resource-constrained settings. Conduct experiments, analyze results, and iterate on models to continuously improve performance and robustness. Contribute to the development of tools and frameworks to streamline the deployment and evaluation of low-resource speech models. Requirements Need to have: ...

Background Transcriptomics provide insights into gene expression and with it the ability to analyze one of the fundamental processes of life - the translation from gene to protein. Single Cell RNA sequencing (scRNAseq) is a technology that measures transcriptomics on the single cell level. However, biological data is highly complex, variability and noisy, making it challenging to analyze and work with. The goal of the project is to evaluate if deep learning can infer gene expression profiles of specific conditions (exposures) by only receiving prior information about an exposure, such as a drug’s known gene targets as well as a general protein-protein interaction network. The aim is to evaluate the model based on its zero-shot performance (e.g. unseen drugs). ...

Background Transcriptomics provide insights into gene expression and with it the ability to analyse one of the fundamental processes of life - the translation from gene to protein. single Cell RNA sequencing (scRNAseq) is a technology that measures transcriptomics on the single cell level. However, biological data is highly complex, variability and noisy, making it challenging to analyse and wo. By building on pre-trained general scRNAseq deep learning model we want to fine-tune and train the model task specific. Examples of existing models are Geneformer https://www.nature.com/articles/s41586-023-06139-9 or scGPT https://www.nature.com/articles/s41592-024-02201-0. If the student decides that existing models are not suitable there is also the option to build/train from scratch. ...