{"id":12042,"date":"2026-08-19T14:06:08","date_gmt":"2026-08-19T14:06:08","guid":{"rendered":"https:\/\/cyber-valley.de\/?post_type=researchfund-project&#038;p=12042"},"modified":"2026-09-01T12:03:34","modified_gmt":"2026-09-01T12:03:34","slug":"x_embedding-combinatorial-reasoning-into-learned-control-policies","status":"publish","type":"researchfund-project","link":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/","title":{"rendered":"Embedding combinatorial reasoning into learned control policies"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Overview<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Many machine-learning systems can learn patterns from images or sensor data, but they often struggle when decisions must follow strict rules. Real-world tasks may involve budgets, capacities, safety limits, or actions that are required or forbidden.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Led by Georg Martius, this project investigated how neural networks can be combined with <strong>combinatorial optimization<\/strong>\u2014mathematical methods for choosing the best option from many discrete possibilities. The project developed ways to embed optimization algorithms into learning systems, allowing AI to learn from data while making decisions that respect predefined constraints. It ran from 2021 to 2024.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Key results<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Developed methods for integrating integer-programming and other combinatorial optimization problems into neural networks.<\/li>\n\n\n\n<li>Created <strong>neuro-algorithmic policies<\/strong> that combine learned representations with structured algorithms, improving generalization to new combinatorial problems.<\/li>\n\n\n\n<li>Developed methods for planning directly from visual input, connecting perception from images with decision-making in environments involving difficult search problems.<\/li>\n\n\n\n<li>Introduced techniques for training neural networks through discrete optimization procedures, even when these procedures are not naturally differentiable.<\/li>\n\n\n\n<li>Developed LPGD, a general framework for backpropagation through embedded optimization layers, making it easier to train systems that contain classical solvers.<\/li>\n\n\n\n<li>Demonstrated how optimization components can serve as trainable building blocks rather than being treated as separate tools.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Why it matters<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The project provides a foundation for AI systems that connect perception with structured, constraint-aware decision-making. Such systems could help robots plan actions safely, enable logistics systems to allocate limited resources, and support applications in scheduling, planning, and operations management.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The approach does not replace classical optimization solvers. Instead, it integrates them into larger learning pipelines so that neural networks can interpret data while established algorithms handle rules and constraints. This combination could make AI systems more reliable and adaptable, although their performance still depends on how accurately the relevant constraints and optimization problem are modelled.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">This project produced the following peer-reviewed publications:&nbsp;<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Anselm Paulus, Michal Rol\u00ednek, V\u00edt Musil, Brandon Amos, and Georg Martius. \u201cCombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints\u201d. In: Proceedings of the 38th International Conference on Machine Learning. Vol. 139. Proceedings of Machine Learning Research. PMLR, July 2021, pp. 8443\u20138453. url:\u00a0<a href=\"https:\/\/proceedings.mlr.press\/v139\/paulus21a.html\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/proceedings.mlr.press\/v139\/paulus21a.html<\/a>.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Marin Vlastelica, Michal Rolinek, and Georg Martius. \u201cNeuro-algorithmic Policies Enable Fast Combinatorial Generalization\u201d. In: Proceedings of the 2021 International Conference on Machine Learning (ICML). July 2021. url:\u00a0<a href=\"https:\/\/proceedings.mlr.press\/v139\/vlastelica21a.html\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/proceedings.mlr.press\/v139\/vlastelica21a.html<\/a>.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Marco Bagatella, Mirek Ol\u0161\u00e1k, Michal Rol\u00ednek, and Georg Martius. \u201cPlanning from Pixels in Environments with Combinatorially Hard Search Spaces\u201d. In: Advances in Information Processing Systems (NeurIPS 2021). 2021. url:\u00a0<a href=\"https:\/\/openreview.net\/forum?id=XgGUUaKgips\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/openreview.net\/forum?id=XgGUUaKgips<\/a>.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Subham Sahoo, Anselm Paulus, Marin Vlastelica, V\u00edt Musil, Volodymyr Kuleshov, and Georg Martius. \u201cBackpropagation through Combinatorial Algorithms: Identity with Projection Works\u201d. In: Proceedings of the Eleventh International Conference on Learning Representations. May 2023. url:\u00a0\u00a0<a href=\"https:\/\/openreview.net\/forum?id=JZMR727O29\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/openreview.net\/forum?id=JZMR727O29<\/a>.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A. Paulus, G. Martius, and V. Musil. \u201cLPGD: A General Framework for Backpropagation through Embedded Optimization Layers\u201d. In: Proceedings of the 41st International Conference on Machine Learning (ICML). Vol. 235. Proceedings of Machine Learning Research. PMLR, July 2024, pp. 39989\u201340014. url:\u00a0<a href=\"https:\/\/proceedings.mlr.press\/v235\/paulus24a.html\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/proceedings.mlr.press\/v235\/paulus24a.html<\/a>.<\/li>\n<\/ul>\n","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"_acf_changed":true},"cv-tag":[290],"user-group":[],"class_list":["post-12042","researchfund-project","type-researchfund-project","status-publish","hentry","cv-tag-university-of-tubingen"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Embedding combinatorial reasoning into learned control policies - Cyber Valley<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Embedding combinatorial reasoning into learned control policies - Cyber Valley\" \/>\n<meta property=\"og:description\" content=\"Overview Many machine-learning systems can learn patterns from images or sensor data, but they often struggle when decisions must follow strict rules. Real-world tasks may involve budgets, capacities, safety limits, or actions that are required or forbidden. Led by Georg Martius, this project investigated how neural networks can be combined with combinatorial optimization\u2014mathematical methods for [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyber Valley\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-01T12:03:34+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"3\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_embedding-combinatorial-reasoning-into-learned-control-policies\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_embedding-combinatorial-reasoning-into-learned-control-policies\\\/\",\"name\":\"Embedding combinatorial reasoning into learned control policies - Cyber Valley\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\"},\"datePublished\":\"2026-08-19T14:06:08+00:00\",\"dateModified\":\"2026-09-01T12:03:34+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_embedding-combinatorial-reasoning-into-learned-control-policies\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_embedding-combinatorial-reasoning-into-learned-control-policies\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_embedding-combinatorial-reasoning-into-learned-control-policies\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Embedding combinatorial reasoning into learned control policies\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"name\":\"Cyber Valley\",\"description\":\"From lab to market\",\"publisher\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\",\"name\":\"Cyber Valley GmbH\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"contentUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"width\":1112,\"height\":317,\"caption\":\"Cyber Valley GmbH\"},\"image\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/cybervalley\\\/\",\"https:\\\/\\\/www.instagram.com\\\/cybervalley_bw\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCPi8donVDkcOeM4C0CfP5fg\",\"https:\\\/\\\/bsky.app\\\/profile\\\/cyber-valley.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Embedding combinatorial reasoning into learned control policies - Cyber Valley","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/","og_locale":"de_DE","og_type":"article","og_title":"Embedding combinatorial reasoning into learned control policies - Cyber Valley","og_description":"Overview Many machine-learning systems can learn patterns from images or sensor data, but they often struggle when decisions must follow strict rules. Real-world tasks may involve budgets, capacities, safety limits, or actions that are required or forbidden. Led by Georg Martius, this project investigated how neural networks can be combined with combinatorial optimization\u2014mathematical methods for [&hellip;]","og_url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/","og_site_name":"Cyber Valley","article_modified_time":"2026-09-01T12:03:34+00:00","twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"3\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/","url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/","name":"Embedding combinatorial reasoning into learned control policies - Cyber Valley","isPartOf":{"@id":"https:\/\/cyber-valley.de\/de\/#website"},"datePublished":"2026-08-19T14:06:08+00:00","dateModified":"2026-09-01T12:03:34+00:00","breadcrumb":{"@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_embedding-combinatorial-reasoning-into-learned-control-policies\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cyber-valley.de\/de\/"},{"@type":"ListItem","position":2,"name":"Embedding combinatorial reasoning into learned control policies"}]},{"@type":"WebSite","@id":"https:\/\/cyber-valley.de\/de\/#website","url":"https:\/\/cyber-valley.de\/de\/","name":"Cyber Valley","description":"From lab to market","publisher":{"@id":"https:\/\/cyber-valley.de\/de\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cyber-valley.de\/de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/cyber-valley.de\/de\/#organization","name":"Cyber Valley GmbH","url":"https:\/\/cyber-valley.de\/de\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/","url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","contentUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","width":1112,"height":317,"caption":"Cyber Valley GmbH"},"image":{"@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/cybervalley\/","https:\/\/www.instagram.com\/cybervalley_bw\/","https:\/\/www.youtube.com\/channel\/UCPi8donVDkcOeM4C0CfP5fg","https:\/\/bsky.app\/profile\/cyber-valley.bsky.social"]}]}},"_links":{"self":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project\/12042","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project"}],"about":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/types\/researchfund-project"}],"wp:attachment":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/media?parent=12042"}],"wp:term":[{"taxonomy":"cv-tag","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/cv-tag?post=12042"},{"taxonomy":"user-group","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/user-group?post=12042"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}