{"id":11984,"date":"2026-08-13T09:55:04","date_gmt":"2026-08-13T09:55:04","guid":{"rendered":"https:\/\/cyber-valley.de\/?post_type=news&#038;p=11984"},"modified":"2026-11-10T16:52:39","modified_gmt":"2026-11-10T15:52:39","slug":"visualization-tools-for-learning-to-play-a-musical-instrument","status":"publish","type":"news","link":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/","title":{"rendered":"Visualization tools for learning to play a musical instrument"},"content":{"rendered":"\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-009b1483 wp-block-group-is-layout-constrained\" style=\"margin-top:var(--wp--preset--spacing--50);margin-bottom:var(--wp--preset--spacing--50)\">\n<p class=\"wp-block-paragraph\">Michael Sedlmair, Frank Heyen, and their research team have completed their research project \u201cInstruData\u2014Data-driven Musical Instrument Education\u201d.&nbsp;The project was funded by the Cyber\u00a0Valley Research Fund and was carried out between 2022 and 2025 at the University of Stuttgart. Its aim was to develop a music education tool to support musicians by providing them with automatically generated visual feedback so they can check for mistakes when practicing independently.&nbsp;&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Learning to play an instrument requires dedication, hard work, and plenty of independent practice. Not everyone has access to a teacher, and even with one, a musician cannot expect to receive constant and appropriate feedback when practicing their instrument. To address this problem, this research project developed a collection of data-driven techniques and tools that use data taken from a musician&#8217;s practice session to provide visual feedback. The resulting Visual Analytics web-tool enables musicians to detect errors and improve their style.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The visualization tools helped make practicing more efficient. The project designed two methods that automatically assign colors to parts of the sheet music to make its structure easier to see, so that it is easier for the musician to see repeats and changes. Moreover, the visualization tools can show in real time how consistently the musician is playing, for example, a specific rhythm over multiple repetitions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The research group also wanted to produce a practice support tool that did not take time away from actually practicing. Consequently, they designed a way to control the software running on a computer or similar device directly through the instrument. Using the electric guitar as a preliminary case, the group developed an on-screen menu that follows the grid-like guitar fretboard, so that the musician can use the guitar as a controller. This set-up did not require any modification of the guitar or additional hardware.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">With some refinement and user-experience engineering, the tools developed by this project could be turned into smartphone or web apps that support musicians when practicing independently. The researchers do not conceive of the visualization tools developed by this project as replacing traditional music education, but rather as a support for musicians when practicing independently. In this respect, this project aligns with Cyber\u00a0Valley&#8217;s mission to translate cutting-edge research into real-world applications for a better future.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-009b1483 wp-block-group-is-layout-constrained\" style=\"margin-top:var(--wp--preset--spacing--50);margin-bottom:var(--wp--preset--spacing--50)\">\n<h4 class=\"wp-block-heading\">This project produced the following peer-reviewed publications:\u202f&nbsp;<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Simeon Rau, Frank Heyen, Stefan Wagner, &amp; Michael Sedlmair (2022).&nbsp;Visualization for AI-Assisted Composing. In Proceedings of the 23rd International Society for Music Information&nbsp;Retrieval Conference (ISMIR).&nbsp;<a href=\"https:\/\/doi.org\/10.5281\/zenodo.7316618\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.5281\/zenodo.7316618<\/a>&nbsp;(open access)&nbsp;<\/li>\n\n\n\n<li>Lucchas R Skreinig, Denis Kalkofen, Ana Stanescu, Peter Mohr, Frank Heyen, Shohei Mori,&nbsp;Michael Sedlmair, Dieter&nbsp;Schmalstieg, &amp; Alexander Plopski (2023).&nbsp;guitARhero: Interactive&nbsp;Augmented Reality Guitar Tutorials. In IEEE Transactions on Visualization and Computer Graphics&nbsp;(TVCG).&nbsp;<a href=\"https:\/\/doi.org\/10.1109\/TVCG.2023.3320266\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1109\/TVCG.2023.3320266<\/a>&nbsp;(open access)&nbsp;<\/li>\n\n\n\n<li>Frank Heyen, Quynh Quang Ngo, &amp; Michael Sedlmair (2023). Visual Overviews for Sheet Music&nbsp;Structure. In the 24th International Society for Music Information Retrieval Conference (ISMIR).&nbsp;<a href=\"https:\/\/doi.org\/10.5281\/zenodo.10265383\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.5281\/zenodo.10265383<\/a>&nbsp;(open access)&nbsp;<\/li>\n\n\n\n<li>Simeon Rau, Frank Heyen, Benedikt Brachtel &amp; Michael Sedlmair (2025).&nbsp;MAICO: A&nbsp;Visualization Design Study on AI-Assisted Music Composition. In IEEE Transactions on&nbsp;Visualization and Computer Graphics (TVCG).&nbsp;<a href=\"https:\/\/doi.org\/10.1109\/TVCG.2025.3539779\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1109\/TVCG.2025.3539779<\/a>&nbsp;<\/li>\n\n\n\n<li>Frank Heyen, Marius Labudda, Michael Sedlmair, &amp; Andreas Fender (2025).&nbsp;GuitarPie: Using&nbsp;the Fretboard of an Electric Guitar for Audio-Based Pie Menu Interaction. In Proceedings of the&nbsp;38th Annual ACM Symposium on User Interface Software and Technology (UIST).&nbsp;<a href=\"https:\/\/doi.org\/10.1145\/3746059.3747799\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1145\/3746059.3747799<\/a>&nbsp;(open access)&nbsp;<\/li>\n\n\n\n<li>Frank Heyen, Michael Gleicher, Michael Sedlmair (2026).&nbsp;Make the&nbsp;Unhearable&nbsp;Visible:&nbsp;Exploring Visualization for Musical Instrument Practice. In IEEE Transactions on Visualization and&nbsp;Computer Graphics (TVCG).&nbsp;<a href=\"https:\/\/doi.org\/10.1109\/TVCG.2026.3658216%C2%A0\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1109\/TVCG.2026.3658216&nbsp;<\/a><\/li>\n<\/ul>\n<\/div>\n\n\n\n<div class=\"wp-block-group has-global-padding is-layout-constrained wp-container-core-group-is-layout-009b1483 wp-block-group-is-layout-constrained\" style=\"margin-top:var(--wp--preset--spacing--50);margin-bottom:var(--wp--preset--spacing--50)\">\n<h4 class=\"wp-block-heading\">About the Cyber\u00a0Valley Research Fund&nbsp;<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">The <a href=\"https:\/\/cyber-valley.de\/for-scientists\/research-fund\/\" data-type=\"link\" data-id=\"https:\/\/cyber-valley.de\/for-scientists\/research-fund\/\">Cyber\u00a0Valley Research Fund<\/a> was&nbsp;established&nbsp;to support Cyber\u00a0Valley research groups undertake basic research in the fields of artificial intelligence and robotics. The fund totaled five million euros, including contributions from six of Cyber\u00a0Valley\u2019s founding corporate partners: Amazon, BMW, Bosch, IAV, Mercedes-Benz, Porsche, and ZF. It&nbsp;supported 20 research projects, the first of which began in 2020, and the final of which will conclude in 2026.&nbsp;<\/p>\n<\/div>\n","protected":false},"featured_media":11985,"parent":0,"template":"","meta":{"_acf_changed":false},"cv-tag":[],"location":[441],"network-role":[],"news-category":[444],"user-group":[245,247],"class_list":["post-11984","news","type-news","status-publish","has-post-thumbnail","hentry","location-stuttgart","news-category-research-fund","user-group-researcher","user-group-phd-student"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Visualization tools for learning to play a musical instrument - Cyber Valley<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Visualization tools for learning to play a musical instrument - Cyber Valley\" \/>\n<meta property=\"og:description\" content=\"Michael Sedlmair, Frank Heyen, and their research team have completed their research project \u201cInstruData\u2014Data-driven Musical Instrument Education\u201d.&nbsp;The project was funded by the Cyber\u00a0Valley Research Fund and was carried out between 2022 and 2025 at the University of Stuttgart. Its aim was to develop a music education tool to support musicians by providing them with automatically [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/\" \/>\n<meta property=\"og:site_name\" content=\"Cyber Valley\" \/>\n<meta property=\"article:modified_time\" content=\"2026-11-10T15:52:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/08\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"523\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"4\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/\",\"name\":\"Visualization tools for learning to play a musical instrument - Cyber Valley\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png\",\"datePublished\":\"2026-08-13T09:55:04+00:00\",\"dateModified\":\"2026-11-10T15:52:39+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png\",\"contentUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/08\\\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png\",\"width\":1000,\"height\":523,\"caption\":\"Cyber Valley Graphic with Uni Stuttgart\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/news\\\/visualization-tools-for-learning-to-play-a-musical-instrument\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Visualization tools for learning to play a musical instrument\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"name\":\"Cyber Valley\",\"description\":\"From lab to market\",\"publisher\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#organization\",\"name\":\"Cyber Valley GmbH\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"contentUrl\":\"https:\\\/\\\/cyber-valley.de\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/CV_Logo-Lockup_RGB_20210412.svg\",\"width\":1112,\"height\":317,\"caption\":\"Cyber Valley GmbH\"},\"image\":{\"@id\":\"https:\\\/\\\/cyber-valley.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/cybervalley\\\/\",\"https:\\\/\\\/www.instagram.com\\\/cybervalley_bw\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCPi8donVDkcOeM4C0CfP5fg\",\"https:\\\/\\\/bsky.app\\\/profile\\\/cyber-valley.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Visualization tools for learning to play a musical instrument - Cyber Valley","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/","og_locale":"de_DE","og_type":"article","og_title":"Visualization tools for learning to play a musical instrument - Cyber Valley","og_description":"Michael Sedlmair, Frank Heyen, and their research team have completed their research project \u201cInstruData\u2014Data-driven Musical Instrument Education\u201d.&nbsp;The project was funded by the Cyber\u00a0Valley Research Fund and was carried out between 2022 and 2025 at the University of Stuttgart. Its aim was to develop a music education tool to support musicians by providing them with automatically [&hellip;]","og_url":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/","og_site_name":"Cyber Valley","article_modified_time":"2026-11-10T15:52:39+00:00","og_image":[{"width":1000,"height":523,"url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/08\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"4\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/","url":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/","name":"Visualization tools for learning to play a musical instrument - Cyber Valley","isPartOf":{"@id":"https:\/\/cyber-valley.de\/de\/#website"},"primaryImageOfPage":{"@id":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/#primaryimage"},"image":{"@id":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/#primaryimage"},"thumbnailUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/08\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png","datePublished":"2026-08-13T09:55:04+00:00","dateModified":"2026-11-10T15:52:39+00:00","breadcrumb":{"@id":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/"]}]},{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/#primaryimage","url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/08\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png","contentUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/08\/thumb_ticker_lg_Graphic_for_Uni_Stuttgart_news.png","width":1000,"height":523,"caption":"Cyber Valley Graphic with Uni Stuttgart"},{"@type":"BreadcrumbList","@id":"https:\/\/cyber-valley.de\/de\/news\/visualization-tools-for-learning-to-play-a-musical-instrument\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cyber-valley.de\/de\/"},{"@type":"ListItem","position":2,"name":"Visualization tools for learning to play a musical instrument"}]},{"@type":"WebSite","@id":"https:\/\/cyber-valley.de\/de\/#website","url":"https:\/\/cyber-valley.de\/de\/","name":"Cyber Valley","description":"From lab to market","publisher":{"@id":"https:\/\/cyber-valley.de\/de\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cyber-valley.de\/de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/cyber-valley.de\/de\/#organization","name":"Cyber Valley GmbH","url":"https:\/\/cyber-valley.de\/de\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/","url":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","contentUrl":"https:\/\/cyber-valley.de\/wp-content\/uploads\/2026\/05\/CV_Logo-Lockup_RGB_20210412.svg","width":1112,"height":317,"caption":"Cyber Valley GmbH"},"image":{"@id":"https:\/\/cyber-valley.de\/de\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/cybervalley\/","https:\/\/www.instagram.com\/cybervalley_bw\/","https:\/\/www.youtube.com\/channel\/UCPi8donVDkcOeM4C0CfP5fg","https:\/\/bsky.app\/profile\/cyber-valley.bsky.social"]}]}},"_links":{"self":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/news\/11984","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/types\/news"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/media\/11985"}],"wp:attachment":[{"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/media?parent=11984"}],"wp:term":[{"taxonomy":"cv-tag","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/cv-tag?post=11984"},{"taxonomy":"location","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/location?post=11984"},{"taxonomy":"network-role","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/network-role?post=11984"},{"taxonomy":"news-category","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/news-category?post=11984"},{"taxonomy":"user-group","embeddable":true,"href":"https:\/\/cyber-valley.de\/de\/wp-json\/wp\/v2\/user-group?post=11984"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}