{"id":12044,"date":"2026-08-19T14:08:53","date_gmt":"2026-08-19T14:08:53","guid":{"rendered":"https:\/\/cyber-valley.de\/?post_type=researchfund-project&#038;p=12044"},"modified":"2026-09-01T12:01:14","modified_gmt":"2026-09-01T12:01:14","slug":"x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data","status":"publish","type":"researchfund-project","link":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/","title":{"rendered":"Contrastive learning for dimensionality reduction and visualization of transcriptomic data"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Overview<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Single-cell transcriptomics measures the activity of thousands of genes in individual cells, producing extremely high-dimensional datasets. To interpret these data, researchers typically project them into two or three dimensions for visualization. Widely used methods such as t-SNE and UMAP can reveal local structure but may distort global relationships or depend heavily on parameter choices.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Led by Dmitry Kobak at the University of T\u00fcbingen, the project <strong>\u201cContrastive learning for dimensionality reduction and visualization of transcriptomic data\u201d<\/strong> (2021\u20132025) investigated whether contrastive learning\u2014a self-supervised machine-learning approach\u2014could improve dimensionality reduction and visualization for single-cell and other transcriptomic datasets. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Key results<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Developed a conceptual link between t-SNE and UMAP via contrastive learning. The project showed that t-SNE can be optimised using noise-contrastive estimation, while UMAP relies on negative sampling, another contrastive method. This clarified why the two methods often produce visually different embeddings.<\/li>\n\n\n\n<li>Proposed and implemented a generalization of negative sampling that allows interpolation (and even extrapolation) between t-SNE-like and UMAP-like embeddings. Moving along this spectrum reveals a trade-off between local\/discrete and global\/continuous structure, reducing the risk of over-interpreting features of any single embedding.<\/li>\n\n\n\n<li>Created parametric contrastive-learning methods for 2D visualization, such as t-SimCNE and related approaches, which train neural networks to directly map high-dimensional data into two dimensions using contrastive objectives.<\/li>\n\n\n\n<li>Applied contrastive and manifold-learning ideas to single-cell RNA-seq and other biological datasets, improving the stability and interpretability of low-dimensional visualizations.<\/li>\n\n\n\n<li>Provided open-source implementations (e.g., in PyTorch and as part of the openTSNE ecosystem) to make these methods accessible to the bioinformatics and machine-learning communities.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Why it matters<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Dimensionality reduction and visualization are central to analysing modern transcriptomic datasets. By grounding popular methods like t-SNE and UMAP in a unified contrastive-learning framework, the project helps researchers understand what these visualizations represent and how they depend on algorithmic choices. The resulting methods and guidelines can support more reliable interpretation of single-cell data in neuroscience, immunology, developmental biology, and related fields. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">This project produced the following peer-reviewed publications:\u00a0<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Kobak, D., &amp; Berens, P. (2019). <em>The art of using t-SNE for single-cell transcriptomics<\/em>. Nature Communications, 10, 5416. <a href=\"https:\/\/doi.org\/10.1038\/s41467-019-13056-x\" target=\"_blank\" rel=\"noreferrer noopener\">doi:10.1038\/s41467-019-13056-x<\/a><\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Damrich, S., B\u00f6hm, J. N., Hamprecht, F. A., &amp; Kobak, D. (2023). <em>From t-SNE to UMAP with contrastive learning<\/em>. In International Conference on Learning Representations (ICLR) 2023. <a href=\"https:\/\/arxiv.org\/abs\/2206.01816\" target=\"_blank\" rel=\"noreferrer noopener\">arXiv:2206.01816 [cs.LG]<\/a><\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>B\u00f6hm, J. N., Berens, P., &amp; Kobak, D. (2023). <em>Unsupervised visualization of image datasets using contrastive learning<\/em>. In International Conference on Learning Representations (ICLR) 2023. <a href=\"https:\/\/arxiv.org\/abs\/2206.01816\" target=\"_blank\" rel=\"noreferrer noopener\">arXiv:2206.01816 [cs.LG]<\/a> (t-SimCNE work)<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Kobak, D., &amp; Berens, P. (2020). <em>Heavy-tailed kernels reveal a finer cluster structure in t-SNE<\/em>. Philosophical Transactions of the Royal Society A, 378(2180), 20190231. <a href=\"https:\/\/doi.org\/10.1098\/rsta.2019.0231\" target=\"_blank\" rel=\"noreferrer noopener\">doi:10.1098\/rsta.2019.0231<\/a><\/li>\n<\/ul>\n","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"_acf_changed":true},"cv-tag":[],"user-group":[],"class_list":["post-12044","researchfund-project","type-researchfund-project","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Contrastive learning for dimensionality reduction and visualization of transcriptomic data - Cyber Valley<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Contrastive learning for dimensionality reduction and visualization of transcriptomic data - Cyber Valley\" \/>\n<meta property=\"og:description\" content=\"Overview Single-cell transcriptomics measures the activity of thousands of genes in individual cells, producing extremely high-dimensional datasets. To interpret these data, researchers typically project them into two or three dimensions for visualization. Widely used methods such as t-SNE and UMAP can reveal local structure but may distort global relationships or depend heavily on parameter choices. [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyber Valley\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-01T12:01:14+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"2\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\\\/\",\"name\":\"Contrastive learning for dimensionality reduction and visualization of transcriptomic data - Cyber Valley\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\"},\"datePublished\":\"2026-08-19T14:08:53+00:00\",\"dateModified\":\"2026-09-01T12:01:14+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Contrastive learning for dimensionality reduction and visualization of transcriptomic data\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"name\":\"Cyber Valley\",\"description\":\"From lab to market\",\"publisher\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\",\"name\":\"Cyber Valley GmbH\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"contentUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"width\":1112,\"height\":317,\"caption\":\"Cyber Valley GmbH\"},\"image\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/cybervalley\\\/\",\"https:\\\/\\\/www.instagram.com\\\/cybervalley_bw\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCPi8donVDkcOeM4C0CfP5fg\",\"https:\\\/\\\/bsky.app\\\/profile\\\/cyber-valley.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Contrastive learning for dimensionality reduction and visualization of transcriptomic data - Cyber Valley","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/","og_locale":"de_DE","og_type":"article","og_title":"Contrastive learning for dimensionality reduction and visualization of transcriptomic data - Cyber Valley","og_description":"Overview Single-cell transcriptomics measures the activity of thousands of genes in individual cells, producing extremely high-dimensional datasets. To interpret these data, researchers typically project them into two or three dimensions for visualization. Widely used methods such as t-SNE and UMAP can reveal local structure but may distort global relationships or depend heavily on parameter choices. [&hellip;]","og_url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/","og_site_name":"Cyber Valley","article_modified_time":"2026-09-01T12:01:14+00:00","twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"2\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/","url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/","name":"Contrastive learning for dimensionality reduction and visualization of transcriptomic data - Cyber Valley","isPartOf":{"@id":"https:\/\/cyber-valley.de\/de\/#website"},"datePublished":"2026-08-19T14:08:53+00:00","dateModified":"2026-09-01T12:01:14+00:00","breadcrumb":{"@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_contrastive-learning-for-dimensionality-reduction-and-visualization-of-transcriptomic-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cyber-valley.de\/de\/"},{"@type":"ListItem","position":2,"name":"Contrastive learning for dimensionality reduction and visualization of transcriptomic data"}]},{"@type":"WebSite","@id":"https:\/\/cyber-valley.de\/de\/#website","url":"https:\/\/cyber-valley.de\/de\/","name":"Cyber Valley","description":"From lab to market","publisher":{"@id":"https:\/\/cyber-valley.de\/de\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cyber-valley.de\/de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/cyber-valley.de\/de\/#organization","name":"Cyber Valley GmbH","url":"https:\/\/cyber-valley.de\/de\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/","url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","contentUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","width":1112,"height":317,"caption":"Cyber Valley GmbH"},"image":{"@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/cybervalley\/","https:\/\/www.instagram.com\/cybervalley_bw\/","https:\/\/www.youtube.com\/channel\/UCPi8donVDkcOeM4C0CfP5fg","https:\/\/bsky.app\/profile\/cyber-valley.bsky.social"]}]}},"_links":{"self":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project\/12044","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project"}],"about":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/types\/researchfund-project"}],"wp:attachment":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/media?parent=12044"}],"wp:term":[{"taxonomy":"cv-tag","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/cv-tag?post=12044"},{"taxonomy":"user-group","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/user-group?post=12044"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}