{"id":12040,"date":"2026-08-19T14:01:27","date_gmt":"2026-08-19T14:01:27","guid":{"rendered":"https:\/\/cyber-valley.de\/?post_type=researchfund-project&#038;p=12040"},"modified":"2026-09-01T12:04:20","modified_gmt":"2026-09-01T12:04:20","slug":"x_instrudata-data-driven-musical-instrument-education","status":"publish","type":"researchfund-project","link":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/","title":{"rendered":"InstruData \u2013 Data-driven Musical Instrument Education"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Overview<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Learning to play a musical instrument requires extensive independent practice, but learners cannot always receive regular feedback from a teacher. Led by Michael Sedlmair and Frank Heyen at the University of Stuttgart, the <em>InstruData\u2014Data-driven Musical Instrument Education<\/em> project developed visual tools that help musicians identify mistakes and monitor their progress while practising.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The project ran from 2022 to 2025. Its Visual Analytics web tool uses data from practice sessions to generate visual feedback. The researchers designed it as a supplement to, rather than a replacement for, traditional music education.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Key results<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Developed methods that automatically colour parts of sheet music, making repetitions, changes, and the structure of a musical piece easier to identify.<\/li>\n\n\n\n<li>Created visualisations that show in real time how consistently a musician performs a particular rhythm across repeated attempts.<\/li>\n\n\n\n<li>Developed an interactive menu controlled directly through an electric guitar. The menu follows the grid-like structure of the guitar fretboard and requires neither modifications to the instrument nor additional hardware.<\/li>\n\n\n\n<li>Produced related tools for AI-assisted composition and augmented-reality guitar tutorials, including <em>guitARhero<\/em>.<\/li>\n\n\n\n<li>Developed <em>GuitarPie<\/em>, an audio-based interface that uses the guitar fretboard to control a computer menu.<\/li>\n\n\n\n<li>Produced six peer-reviewed publications between 2022 and 2026, alongside conference contributions and open-access research outputs.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Why it matters<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The project demonstrates how practice data can be transformed into visual feedback that helps musicians notice errors, understand musical structure, and monitor their consistency. This could make independent practice more efficient and support learners who have limited access to teachers. With further refinement and user-experience development, the tools could be adapted into smartphone or web applications.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">This project produced the following peer-reviewed publications:\u202f&nbsp;<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Frank Heyen, Michael Gleicher, Michael Sedlmair (2026).\u00a0Make the\u00a0Unhearable\u00a0Visible:\u00a0Exploring Visualization for Musical Instrument Practice. In IEEE Transactions on Visualization and\u00a0Computer Graphics (TVCG).\u00a0<a href=\"https:\/\/doi.org\/10.1109\/TVCG.2026.3658216%C2%A0\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1109\/TVCG.2026.3658216\u00a0<\/a><\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Simeon Rau, Frank Heyen, Stefan Wagner, &amp; Michael Sedlmair (2022).\u00a0Visualization for AI-Assisted Composing. In Proceedings of the 23rd International Society for Music Information\u00a0Retrieval Conference (ISMIR).\u00a0<a href=\"https:\/\/doi.org\/10.5281\/zenodo.7316618\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.5281\/zenodo.7316618<\/a>\u00a0(open access)\u00a0<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Lucchas R Skreinig, Denis Kalkofen, Ana Stanescu, Peter Mohr, Frank Heyen, Shohei Mori,\u00a0Michael Sedlmair, Dieter\u00a0Schmalstieg, &amp; Alexander Plopski (2023).\u00a0guitARhero: Interactive\u00a0Augmented Reality Guitar Tutorials. In IEEE Transactions on Visualization and Computer Graphics\u00a0(TVCG).\u00a0<a href=\"https:\/\/doi.org\/10.1109\/TVCG.2023.3320266\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1109\/TVCG.2023.3320266<\/a>\u00a0(open access)\u00a0<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Frank Heyen, Quynh Quang Ngo, &amp; Michael Sedlmair (2023). Visual Overviews for Sheet Music\u00a0Structure. In the 24th International Society for Music Information Retrieval Conference (ISMIR).\u00a0<a href=\"https:\/\/doi.org\/10.5281\/zenodo.10265383\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.5281\/zenodo.10265383<\/a>\u00a0(open access)\u00a0<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Simeon Rau, Frank Heyen, Benedikt Brachtel &amp; Michael Sedlmair (2025).\u00a0MAICO: A\u00a0Visualization Design Study on AI-Assisted Music Composition. In IEEE Transactions on\u00a0Visualization and Computer Graphics (TVCG).\u00a0<a href=\"https:\/\/doi.org\/10.1109\/TVCG.2025.3539779\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1109\/TVCG.2025.3539779<\/a>\u00a0<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Frank Heyen, Marius Labudda, Michael Sedlmair, &amp; Andreas Fender (2025).\u00a0GuitarPie: Using\u00a0the Fretboard of an Electric Guitar for Audio-Based Pie Menu Interaction. In Proceedings of the\u00a038th Annual ACM Symposium on User Interface Software and Technology (UIST).\u00a0<a href=\"https:\/\/doi.org\/10.1145\/3746059.3747799\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1145\/3746059.3747799<\/a>\u00a0(open access)\u00a0<\/li>\n<\/ul>\n","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"_acf_changed":true},"cv-tag":[],"user-group":[],"class_list":["post-12040","researchfund-project","type-researchfund-project","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>InstruData \u2013 Data-driven Musical Instrument Education - Cyber Valley<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"InstruData \u2013 Data-driven Musical Instrument Education - Cyber Valley\" \/>\n<meta property=\"og:description\" content=\"Overview Learning to play a musical instrument requires extensive independent practice, but learners cannot always receive regular feedback from a teacher. Led by Michael Sedlmair and Frank Heyen at the University of Stuttgart, the InstruData\u2014Data-driven Musical Instrument Education project developed visual tools that help musicians identify mistakes and monitor their progress while practising. The project [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyber Valley\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-01T12:04:20+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"2\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_instrudata-data-driven-musical-instrument-education\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_instrudata-data-driven-musical-instrument-education\\\/\",\"name\":\"InstruData \u2013 Data-driven Musical Instrument Education - Cyber Valley\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\"},\"datePublished\":\"2026-08-19T14:01:27+00:00\",\"dateModified\":\"2026-09-01T12:04:20+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_instrudata-data-driven-musical-instrument-education\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_instrudata-data-driven-musical-instrument-education\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/researchfund-project\\\/x_instrudata-data-driven-musical-instrument-education\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"InstruData \u2013 Data-driven Musical Instrument Education\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"name\":\"Cyber Valley\",\"description\":\"From lab to market\",\"publisher\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\",\"name\":\"Cyber Valley GmbH\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"contentUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"width\":1112,\"height\":317,\"caption\":\"Cyber Valley GmbH\"},\"image\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/cybervalley\\\/\",\"https:\\\/\\\/www.instagram.com\\\/cybervalley_bw\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCPi8donVDkcOeM4C0CfP5fg\",\"https:\\\/\\\/bsky.app\\\/profile\\\/cyber-valley.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"InstruData \u2013 Data-driven Musical Instrument Education - Cyber Valley","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/","og_locale":"de_DE","og_type":"article","og_title":"InstruData \u2013 Data-driven Musical Instrument Education - Cyber Valley","og_description":"Overview Learning to play a musical instrument requires extensive independent practice, but learners cannot always receive regular feedback from a teacher. Led by Michael Sedlmair and Frank Heyen at the University of Stuttgart, the InstruData\u2014Data-driven Musical Instrument Education project developed visual tools that help musicians identify mistakes and monitor their progress while practising. The project [&hellip;]","og_url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/","og_site_name":"Cyber Valley","article_modified_time":"2026-09-01T12:04:20+00:00","twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"2\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/","url":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/","name":"InstruData \u2013 Data-driven Musical Instrument Education - Cyber Valley","isPartOf":{"@id":"https:\/\/cyber-valley.de\/de\/#website"},"datePublished":"2026-08-19T14:01:27+00:00","dateModified":"2026-09-01T12:04:20+00:00","breadcrumb":{"@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/cyber-valley.de\/de\/researchfund-project\/x_instrudata-data-driven-musical-instrument-education\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cyber-valley.de\/de\/"},{"@type":"ListItem","position":2,"name":"InstruData \u2013 Data-driven Musical Instrument Education"}]},{"@type":"WebSite","@id":"https:\/\/cyber-valley.de\/de\/#website","url":"https:\/\/cyber-valley.de\/de\/","name":"Cyber Valley","description":"From lab to market","publisher":{"@id":"https:\/\/cyber-valley.de\/de\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cyber-valley.de\/de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/cyber-valley.de\/de\/#organization","name":"Cyber Valley GmbH","url":"https:\/\/cyber-valley.de\/de\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/","url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","contentUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","width":1112,"height":317,"caption":"Cyber Valley GmbH"},"image":{"@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/cybervalley\/","https:\/\/www.instagram.com\/cybervalley_bw\/","https:\/\/www.youtube.com\/channel\/UCPi8donVDkcOeM4C0CfP5fg","https:\/\/bsky.app\/profile\/cyber-valley.bsky.social"]}]}},"_links":{"self":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project\/12040","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/researchfund-project"}],"about":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/types\/researchfund-project"}],"wp:attachment":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/media?parent=12040"}],"wp:term":[{"taxonomy":"cv-tag","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/cv-tag?post=12040"},{"taxonomy":"user-group","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/user-group?post=12040"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}