The Future Of Generative AI in Robotics

In this episode of The Future Of, Daniel Rosenstein, Group Product Manager of Advanced Autonomy and Applied Robotics at Microsoft, joins host Jeff Dance to discuss the future of generative AI in robotics. They share the importance of generative AI in robotics, particularly the integration of visual libraries and video analysis, how generative AI enhances human-robot collaboration, and the role robotics will play in our everyday lives in the near future.

They Cover:

[15:00] - Generative AI serves as a universal translator for robotics. It's more than just predicting text; it's about the possibility to understand complex semantics of computer codes, data formats, and languages. This allows generative AI to bridge communication gaps, like translating between various codes and facilitating machine-to-human interactions.
[17:51] - When combined with visual libraries, generative AI improves robotics by simulating human-like perception. This enables robots to accurately sense and interpret their surroundings. Furthermore, Large Language Models (LLMs) can merge diverse data, widening their context awareness and capabilities, such as generating images of iconic landmarks based on country criteria.
[25:42] - Enhanced by generative AI, robots can now understand and act on advanced commands, allowing better support for the aging baby boomer population, such as interpreting requests like "find my pills." This technology also improves consumer experiences, allowing voice assistants in robots to handle complex tasks. Moreover, in organizations like oil rigs and power plants, robots benefit from this AI by running more efficient inspections, interpreting diverse sensory data, and adapting to dynamic environments.
[29:32] - Major companies like Google, Meta, and Amazon are prioritizing the fusion of visual perception with robotic logic. For example, Microsoft's Azure OpenAI offers a distinctive model of OpenAI functionalities, which focuses on data privacy, ensuring users retain ownership of their data. Microsoft is also developing product interconnectivity across its major products.
[46:36] - Generative AI will revolutionize robotics by allowing them to adapt to unexpected circumstances, such as wildland fires. While robots excel in repetitive or dangerous tasks, they often lack the nuance of human touch. Generative AI is bridging this divide, paving the way for a more collaborative effort between humans and robots, where each complements the other's strengths and abilities.

If you're interested in the future of drone delivery, tune into this episode of "The Future Of", a Podcast by Fresh Consulting.

Subscribe here:

Apple: https://apple.co/3t0hujs
Spotify: https://spoti.fi/3BLB3ja
bCast: https://bit.ly/38yNx3l
RSS: https://bit.ly/3uaCPIB
Instructions on how to rate and review The Future Of can be found here

Episode resources:

Daniel Rosenstein: https://www.linkedin.com/in/daniel-rosenstein-8a87803
Microsoft: https://www.linkedin.com/company/microsoft
Ashish Kapoor: https://www.linkedin.com/in/ashish-kapoor-a2971b6/
Scaled Foundations: https://scaledfoundations.ai/
Jason Kelly: https://www.linkedin.com/in/jasonlkelly/
Freemont Robotics: https://www.fremont.ai/