Robotics Simulation with NVIDIA Isaac Sim - AI Build & Learn
Details
Welcome to AI Build & Learn, a weekly AI engineering stream where we pick a new topic and learn by building together.
This event is about robotics simulation with NVIDIA Isaac Sim, a simulation platform built on NVIDIA Omniverse for developing, testing, and training robotic systems in realistic virtual environments. We'll set up simulated robots, interact with sensors and environments, and experiment with controlling robots before ever touching physical hardware.
Isaac Sim combines GPU-accelerated physics, photorealistic rendering, synthetic sensor data, and robotics tooling in one environment. We'll explore how to load and control robots, work with cameras and other simulated sensors, build simple environments, and look at how simulation can be used for reinforcement learning, perception, and robotics development.
Depending on where people want to go, we can also experiment with Isaac Lab, NVIDIA's framework for robot learning and reinforcement learning built on top of Isaac Sim.
Some things to look up to get started:
Tooling:
- NVIDIA Isaac Sim: https://developer.nvidia.com/isaac/sim
- Isaac Sim Documentation: https://docs.isaacsim.omniverse.nvidia.com/
- Isaac Lab: https://github.com/isaac-sim/IsaacLab
- Isaac Lab Documentation: https://isaac-sim.github.io/IsaacLab/
- NVIDIA Omniverse: https://www.nvidia.com/en-us/omniverse/
Resources
- GitHub: https://github.com/sagecodes/ai-build-and-learn
- Events Calendar: https://luma.com/ai-builders-and-learners
- Slack (Discuss during the week): https://slack.flyte.org/
- Hosted by Sage Elliott: https://www.linkedin.com/in/sageelliott/
In this stream
- Intro to topic
- Community Discussion
- Practical examples
Community challenge (optional)
Try spending 30–90 minutes during the week learning or building something related to the topic, then share what you’re working on in Slack.
Note on Flyte / Union
You may see Flyte used in some demos. Flyte is an open-source AI orchestration platform maintained by Union (where I work) for building scalable, durable, and observable AI workflows. You do not need to use Flyte to participate.
- Union: https://www.union.ai/
- Flyte: https://flyte.org/
Drop a comment with ideas for future topics (agents, RAG, MLOps, robotics, frameworks, and more).