{"id":8894,"date":"2026-03-22T22:55:26","date_gmt":"2026-03-22T22:55:26","guid":{"rendered":"https:\/\/cyber-valley.de\/?post_type=researchfund-project&#038;p=8894"},"modified":"2026-09-01T12:09:48","modified_gmt":"2026-09-01T12:09:48","slug":"self-supervised-learning-of-mobility-affordances-for-vision-based-navigation","status":"publish","type":"researchfund-project","link":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/","title":{"rendered":"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Overview<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Mobile robots, including logistics robots and autonomous vehicles, must estimate their motion and adapt to different surfaces, wheels, and control inputs. This project investigated how robots can learn these motion characteristics through interaction with their environment instead of relying entirely on fixed, manually calibrated models.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Led by J\u00f6rg St\u00fcckler, the research focused on <strong>self-supervised learning of mobility affordances<\/strong>\u2014learning how a robot\u2019s actions affect its movement. The team combined camera images with inertial measurements to develop visual-inertial odometry and online calibration methods for wheeled robots.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Key results<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Developed methods that calibrate a robot\u2019s kinematic or dynamic motion model while the robot is operating.<\/li>\n\n\n\n<li>Combined visual-inertial odometry with models of how control commands, such as velocity or steering inputs, affect robot motion.<\/li>\n\n\n\n<li>Improved motion prediction compared with unadapted or purely visual-inertial models, without requiring wheel encoders in some settings.<\/li>\n\n\n\n<li>Demonstrated that online calibration can adapt to changes in wheels, ground surfaces, and terrain, and can improve both motion prediction and tracking accuracy.<\/li>\n\n\n\n<li>Applied the methods to different platforms and environments, including indoor wheeled robots and car-like ground vehicles operating on varied terrain.<\/li>\n\n\n\n<li>Developed an event-camera method for tracking six-degree-of-freedom object motion. It combines high-frequency event data with conventional image frames to improve tracking during rapid motion and reduce the effects of motion blur.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Why it matters<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Robots need accurate motion models to navigate, plan movements, and respond to changes in their surroundings. By learning these models online, the research reduces reliance on fixed calibration and enables robots to adapt more flexibly to different surfaces and operating conditions. The results are relevant to logistics, autonomous vehicles, and other forms of mobile robotics.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Publications and outputs<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Li, H., Stueckler, J. Tracking 6-DoF Object Motion from Events and Frames. In Proc. of IEEE Int. Conf. on Robotics and Automation (ICRA), 2021. DOI: 10.1109\/ICRA48506.2021.9561760&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Li, H., Stueckler, J. Visual-Inertial Odometry with Online Calibration of Velocity-Control Based Kinematic Motion Models. IEEE Robotics and Automation Letters (RA-L), 2022. DOI: 10.1109\/LRA.2022.3169837&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Li, H., Stueckler, J. Online Calibration of a Single-Track Ground Vehicle Dynamics Model by Tight Fusion with Visual-Inertial Odometry, 2024. DOI: <a href=\"https:\/\/doi.org\/10.1109\/ICRA57147.2024.10610157\" target=\"_blank\" rel=\"noreferrer noopener\">doi:10.1109\/ICRA57147.2024.10610157<\/a>.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Li, H., Stueckler, J. Observability Analysis of Visual-Inertial Odometry with Online Calibration of Velocity-Control Based Kinematic Motion Models abs\/2204.06651, CoRR\/arxiv, 2022<\/li>\n<\/ul>\n","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"_acf_changed":true},"cv-tag":[],"user-group":[],"class_list":["post-8894","researchfund-project","type-researchfund-project","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation - Cyber Valley<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation - Cyber Valley\" \/>\n<meta property=\"og:description\" content=\"Overview Mobile robots, including logistics robots and autonomous vehicles, must estimate their motion and adapt to different surfaces, wheels, and control inputs. This project investigated how robots can learn these motion characteristics through interaction with their environment instead of relying entirely on fixed, manually calibrated models. Led by J\u00f6rg St\u00fcckler, the research focused on self-supervised [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyber Valley\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-01T12:09:48+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"2\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\\\/\",\"name\":\"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation - Cyber Valley\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\"},\"datePublished\":\"2026-03-22T22:55:26+00:00\",\"dateModified\":\"2026-09-01T12:09:48+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"name\":\"Cyber Valley\",\"description\":\"From lab to market\",\"publisher\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\",\"name\":\"Cyber Valley GmbH\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"contentUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"width\":1112,\"height\":317,\"caption\":\"Cyber Valley GmbH\"},\"image\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/cybervalley\\\/\",\"https:\\\/\\\/www.instagram.com\\\/cybervalley_bw\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCPi8donVDkcOeM4C0CfP5fg\",\"https:\\\/\\\/bsky.app\\\/profile\\\/cyber-valley.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation - Cyber Valley","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/","og_locale":"de_DE","og_type":"article","og_title":"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation - Cyber Valley","og_description":"Overview Mobile robots, including logistics robots and autonomous vehicles, must estimate their motion and adapt to different surfaces, wheels, and control inputs. This project investigated how robots can learn these motion characteristics through interaction with their environment instead of relying entirely on fixed, manually calibrated models. Led by J\u00f6rg St\u00fcckler, the research focused on self-supervised [&hellip;]","og_url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/","og_site_name":"Cyber Valley","article_modified_time":"2026-09-01T12:09:48+00:00","twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"2\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/","url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/","name":"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation - Cyber Valley","isPartOf":{"@id":"https:\/\/cyber-valley.de\/de\/#website"},"datePublished":"2026-03-22T22:55:26+00:00","dateModified":"2026-09-01T12:09:48+00:00","breadcrumb":{"@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/self-supervised-learning-of-mobility-affordances-for-vision-based-navigation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cyber-valley.de\/de\/"},{"@type":"ListItem","position":2,"name":"Self-Supervised Learning of Mobility Affordances for Vision-Based Navigation"}]},{"@type":"WebSite","@id":"https:\/\/cyber-valley.de\/de\/#website","url":"https:\/\/cyber-valley.de\/de\/","name":"Cyber Valley","description":"From lab to market","publisher":{"@id":"https:\/\/cyber-valley.de\/de\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cyber-valley.de\/de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/cyber-valley.de\/de\/#organization","name":"Cyber Valley GmbH","url":"https:\/\/cyber-valley.de\/de\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/","url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","contentUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","width":1112,"height":317,"caption":"Cyber Valley GmbH"},"image":{"@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/cybervalley\/","https:\/\/www.instagram.com\/cybervalley_bw\/","https:\/\/www.youtube.com\/channel\/UCPi8donVDkcOeM4C0CfP5fg","https:\/\/bsky.app\/profile\/cyber-valley.bsky.social"]}]}},"_links":{"self":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project\/8894","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project"}],"about":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/types\/researchfund-project"}],"wp:attachment":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/media?parent=8894"}],"wp:term":[{"taxonomy":"cv-tag","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/cv-tag?post=8894"},{"taxonomy":"user-group","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/user-group?post=8894"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}