CV Tag: Robotics

  • On a mission to one day battle cancer

    A team of scientists in the Physical Intelligence Department at the Max Planck Institute for Intelligent Systems have combined robotics with biology by equipping E. colibacteria with artificial components to construct biohybrid microrobots. Firstly, as can be seen in Figure 1, the team attached several nanoliposomes to each bacterium. On their outer circle, these spherical-shaped carriers enclose a material (ICG, green particles) that melts when illuminated by near infrared light. Further towards the middle, inside the aqueous core, the liposomes encapsulate water soluble chemotherapeutic drug molecules (DOX).

    The second component the researchers attached to the bacterium is magnetic nanoparticles. When exposed to a magnetic field, the iron oxide particles serve as an on-top booster to this already highly motile microorganism. In this way, it is easier to control the swimming of bacteria – an improved design toward an in vivo application. Meanwhile, the rope binding the liposomes and magnetic particles to the bacterium is a very stable and hard to break streptavidin and biotin complex, which was developed a few years prior and comes in useful when constructing biohybrid microrobots.

    Figure 1: Bacterial biohybrids carrying nanoliposomes (200 nm) and magnetic nanoparticles (100 nm). Nanoliposomes are loaded with chemotherapeutic DOX and photothermal agent ICG, and both cargoes are conjugated to E. coli bacteria (2 to 3 µm in length) via biotin-streptavidin interactions. Akolpoglu et al., Sci. Adv. 8, eabo6163 (2022).

    E.coli bacteria are fast and versatile swimmers that can navigate through material ranging from liquids to highly viscous tissues. But that is not all, they also have highly advanced sensing capabilities. Bacteria are drawn to chemical gradients such as low oxygen levels or high acidity – both prevalent near tumor tissue. Treating cancer by injecting bacteria in proximity is known as bacteria mediated tumor therapy. The microorganisms flow to where the tumor is located, grow there and in this way activate the immune system of patients. Bacteria mediated tumor therapy has been a therapeutic approach for more than a century.

    For the past few decades, scientists have looked for ways to increase the superpowers of this microorganism even further. They equipped bacteria with extra components to help fight the battle. However, adding artificial components is no easy task. Complex chemical reactions are at play, and the density rate of particles loaded onto the bacteria matters to avoid dilution. The team in Stuttgart has now raised the bar quite high. They managed to equip 86 out of 100 bacteria with both liposomes and magnetic particles.
     
    The scientists showed how they succeeded in externally steering such a high-density solution through different courses. First, through an L-shaped narrow channel with two compartments on each end, with one tumor spheroid in each. Second, an even narrower set-up resembling tiny blood vessels. They added an extra permanent magnet on one side and showed how they precisely control the drug-loaded microrobots towards tumor spheroids. And third – going one step further – the team steered the microrobots through a viscous collagen gel (resembling tumor tissue) with three levels of stiffness and porosity, ranging from soft to medium to stiff. The stiffer the collagen, the tighter the web of protein strings, the more difficult it becomes for the bacteria to find a way through the matrix (Figure 2). The team showed that once they add a magnetic field, the bacteria manage to navigate all the way to the other end of the gel as the bacteria had a higher force. Because of constant alignment, the bacteria found a way through the fibers.

    Figure 2: Schematic showing bacterial biohybrid microrobots magnetically guided through fibrous environments. Bacterial biohybrids can release their payload upon NIR irradiation. Akolpoglu et al., Sci. Adv. 8, eabo6163 (2022).

    Once the microrobots are accumulated at the desired point (the tumor spheroid), a near infrared laser generates rays with temperatures of up to 55 degrees Celsius, triggering a melting process of the liposome and a release of the enclosed drugs. A low pH level or acidic environment also causes the nanoliposomes to break open – hence the drugs are released near a tumor automatically.
     
    “Imagine we would inject such bacteria based microrobots into a cancer patient’s body. With a magnet, we could precisely steer the particles towards the tumor. Once enough microrobots surround the tumor, we point a laser at the tissue and by that trigger the drug release. Now, not only is the immune system triggered to wake up, but the additional drugs also help destroy the tumor,” says Birgül Akolpoglu, a Ph.D. student in the Physical Intelligence Department at MPI-IS. She is the first author of the publication titled “Magnetically steerable bacterial microrobots moving in 3D biological matrices for stimuli-responsive cargo delivery” co-led by former postdoctoral researcher in the Physical Intelligence Department, Dr. Yunus Alapan. It was published in Science Advances on July 15, 2022.
     
    “This on-the-spot delivery would be minimally invasive for the patient, painless, bear minimal toxicity and the drugs would develop their effect where needed and not inside the entire body,” Alapan adds.
     
    “Bacteria-based biohybrid microrobots with medical functionalities could one day battle cancer more effectively. It is a new therapeutic approach not too far away from how we treat cancer today,” says Prof. Dr. Metin Sitti, who leads the Physical Intelligence Department and is the last author of the publication. “The therapeutic effects of medical microrobots in seeking and destroying tumor cells could be substantial. Our work is a great example of basic research that aims to benefit our society.”

  • Cyber Valley Evening Colloquium on Autonomous Systems

    Cyber Valley Evening Colloquium on Autonomous Systems

    Tuesday, April 27, 2021

    17:00

    Multi-agent Replicator Reinforcement Learning Dynamics (Webex)

    Dr. Wolfram Barfuss (University of Tübingen)

    More information
     
    Abstract

    Autonomous multi-agent systems are important for various applications towards a sustainable future. However, without an adequate theoretical foundation, multi-agent learning applications are not only hindered by missing interpretability, their safe and beneficial application for a sustainable future cannot be ensured. In this talk, I will give an overview of my research on the link between evolutionary game theory and reinforcement learning, i.e., replicator reinforcement learning (RRL) dynamics. RRL is a semi-formal method to study idealised multi-agent learning behaviour for improved interpretability. Focusing on the example of social dilemmas, I will show how the agents’ caring for the future parameter alone can turn a tragedy of the commons into a comedy, given a sufficiently severe environmental threat. Regarding the safe and beneficial application of autonomous multi-agent systems, I will show conditions under which an optimisation paradigm is neither sustainable nor safe and reinforcement learning is neither stable nor predictable. I will end with a brief outlook on future work.

    Biographical Information

    Wolfram Barfuss is a postdoctoral research scientist working on collective learning for a sustainable future. He recently moved to the Tuebingen AI Center (Uni Tuebingen) and holds guest research positions at the Potsdam Institute for Climate Impact Research and Princeton University. Previously, he was a research fellow at the School of Mathematics (Uni Leeds) and the Max Planck Institute for Mathematics in the Sciences, Leipzig. He obtained his PhD from the Humboldt University of Berlin and the Potsdam Institute for Climate Impact Research in 2019.

    Link to talk details

    19:00

    Multimodal Traffic Operations with Connected and Automated Vehicles (Webex)

    Dr. Kaidi Yang (Stanford University, USA)

    More information
     
    Abstract

    Transportation systems are undertaking rapid transformation, thanks to the advances of disruptive technologies such as connected and automated vehicles. My research aims to leverage these advances to address the challenges in transportation systems. First, I will present my work on improving multimodal traffic operations using the information provided by connected vehicles. In particular, I will develop a multi-scale and multimodal perimeter control approach for large-scale traffic networks in a connected vehicle environment. Second, I will exploit the benefits of automated vehicles and devise strategies to innovate traffic operations in mobility-on-demand systems in a scenario with mixed autonomy.

    Biographical Information

    Dr. Kaidi Yang is currently a postdoctoral scholar with the Autonomous Systems Laboratory in the Department of Aeronautics and Astronautics at Stanford University. He obtained a Ph.D. degree from ETH Zurich in 2019, with a concentration on intelligent transportation systems. Before this, he received a BEng. in Automation, a BSc. in Pure and Applied Mathematics, and an MSc. in Control Science and Engineering from Tsinghua University. His main research interest lies in the design and operations of future mobility systems utilizing disruptive paradigms such as connected and automated vehicles, shared mobility, etc. He has published 11 papers in academic journals and made presentations at multiple international conferences, including a lectern presentation at International Symposium on Transportation and Traffic Theory (ISTTT). He is the recipient of two projects from the Swiss National Science Foundation (SNSF) Postdoc Mobility Fellowship. He has won the Best Paper Award for a paper published in 2019 on the journal Omega, the 2019 Chinese Government Award for Outstanding Self Finance Students Abroad, and the Best Student Paper (2nd place) in IEEE Intelligent Transportation Systems Conference. He serves as a Review Editor for Frontiers in Future Transportation.

    Link to talk details

    Wednesday, April 28, 2021

    16:00

    On the Rational Bounds of Human Cognition (Webex)

    Sebastian Musslick (Princeton University, USA)

    More information
     
    Abstract

    The human brain is one of the most complex autonomous systems on earth, with billions of neurons operating in parallel, giving rise to mental faculties such as reasoning, problem solving and the use of symbolic language. Despite the enormous capacity that the brain holds for parallel processing, humans are remarkably limited in the number of tasks they can execute simultaneously. Limitations in our ability to multitask are not only apparent in daily life. They are also universal assumptions of most general theories of human cognition. Yet, a rationale for why the human brain is subject to these constraints remains elusive. In this talk, I will draw on insights from neuroscience, psychology and machine learning to suggest that limitations in the brain’s ability to multitask result from a fundamental computational dilemma in neural architectures. Using a combination of graph-theoretic analysis, neural network simulation and behavioral experimentation, I will demonstrate that neural systems can face a tradeoff between learning efficacy, that is promoted through the shared use of neural representations across tasks, and multitasking capability, that is achieved through the separation of neural representations between tasks. This work suggests that it can be optimal for a neural system to sacrifice multitasking capability, to learn single tasks more quickly by sharing rather than separating representations between tasks. I will conclude by demonstrating that this tradeoff can explain a variety of behavioral and neural phenomena related to human multitasking and that it can inform the design of autonomous artificial agents tasked to navigate this tradeoff.

    Biographical Information

    Sebastian Musslick is a Fellow of the Cognitive Science Program at Princeton University where he is about to receive his PhD degree in Quantitative and Computational Neuroscience. His research program involves the study of fundamental computational dilemmas in neural systems, to explain limitations of human and artificial cognition. Sebastian received his diploma in Psychology at the Technische Universität Dresden in 2014, as well as a Master’s degree in Neuroscience at Princeton University. During his diploma studies, he joined the University of Colorado in Boulder as a short-term research scholar from 2012 to 2013 where he developed biologically inspired models of human task switching performance. Sebastian amassed a strong record of publishing and collaborating with partners from academia and industry across disciplines, including psychology, neuroscience, mathematics, physics and computer science. In an effort to facilitate interdisciplinary exchange about the study of human and artificial cognition, he co-organized several international workshops and conferences, including the annual Conference on the Mathematical Theory of Deep Neural Networks and the annual Workshop on Mental Effort.

    Link to talk details

    18:00

    Creating an Efficient Whole-body Tactile Skin using a Piezoresistive Structure and Contact Inference (Webex)

    Dr. Hyosang Lee (Max Planck Institute for Intelligent Systems, Stuttgart)

    More information
     
    Abstract

    Autonomous robots operating in complex and contact-rich environments are becoming essential for industry. These robots would benefit from a soft tactile skin that detects the location and strength of contacts over the entire robot's body surface. Implementing such tactile skin is challenging as the skin should seamlessly cover large and curved surfaces to monitor unexpected physical contacts. Human tactile skin efficiently resolves this challenge using an overlapped receptive field structure and cognitive processing. My research mimics this efficient feature by designing a piezoresistive structure with sparsely distributed electrodes and indirectly inferring contact locations and magnitudes from the electrodes. This approach considerably simplifies wholebody tactile sensor design and fabrication while achieving its contact sensing performance comparable to that of human skin. This talk will introduce key design components of a fabric-based tactile sensor and evaluation results, showing its potential toward efficient whole-body tactile skin applications.

    Biographical Information

    Dr. Hyosang Lee is currently a research scientist at the Max Planck Institute for Intelligent Systems, Stuttgart, Germany. He received a B.S. in Mechanical Engineering from Korea University in 2010. His passion for robotics led him to obtain an M.S. in Robotics from Korea Advanced Institute of Science and Technologies (KAIST), Daejeon, South Korea, in 2012, and a Ph. D. in Mechanical Engineering from KAIST in 2017 where he developed soft tactile skin using piezoresistive nanocomposites. Moved by his interest in haptics, he joined Max Planck Institute for Intelligent Systems as a postdoctoral research fellow in 2017. Since then, he works on the development of a feasible whole-body tactile skin and its possible applications.

    Link to talk details

  • Women in Tech Entrepreneurship

    Women in Tech Entrepreneurship

    In Germany, only 15 percent of all start-ups have at least one woman on the founding team, and just four percent of tech start-ups were founded by women only. In the AI & Robotics start-up scene, the numbers are even lower, and female founders and scientists can face gender bias.
     
    At this event, women will share their experiences and talk about female tech entrepreneurship. 

    Vivian Chu, Ph.D.

    Co-founder and CTO, Diligent Robotics

    Ksenia Keplinger, Ph.D.

    Group Leader, Max Planck Institute for Intelligent Systems, Group: Organizational Leadership & Diversity

    Katherine J. Kuchenbecker, Ph.D.

    Director, Max Planck Institute for Intelligent Systems, Department: Haptic Intelligence

    Co-founder and Chief Science Advisor, Tactai, Inc.

    Eva Wolfangel

    Science Journalist

    Registration

    Please register here, people of all gender identities are welcome. The meeting will be held in English on Zoom.

    Contact

    Oliwia Gust –  Event Manager for Cyber Valley
    Phone: +49 7071 601 1554
    Mobile: +49 151 4075 6302 
    Mail: oliwia.gust@cyber-valley.de 

     

    The event is taking place in the context of International Women's Day on March 8.