Skip to content

Conversation

Ruihyw
Copy link

@Ruihyw Ruihyw commented Jul 3, 2025

Description

Fixes an issue in IsaacSim where the camera observation (cam_position) does not update during environment steps. This leads to the planner always receiving the initial image as input, preventing meaningful path re-planning.
Motivation

In tasks that rely on visual input (such as path planning or navigation), the camera position needs to reflect the robot's movement. Previously, even though the robot moved correctly in the environment, the camera’s output remained static due to the missing update mechanism. This PR resolves that.
Dependencies

Type of change

Bug fix (non-breaking change which fixes an issue)

Screenshots
Before
Screenshot from 2025-07-03 16-34-02
After
Screenshot from 2025-07-03 16-31-52
Screenshot from 2025-07-03 16-34-02

Robot moved but camera image stayed fixed Camera image now updates with robot pose
Checklist

I have tested this fix in simulation and confirmed camera output updates

I have run the pre-commit checks with ./formatter.sh

I have made corresponding changes to the documentation (if applicable)

My changes generate no new warnings

…e import problem and the application problem in ros after version update
@pascal-roth
Copy link
Collaborator

Hi @Ruihyw ,

this seems to be a bigger change where also the IsaacSim and IsaacLab version have been updated. Which version are you using?

If you updated the code to the latest releases, we can adjust the README

@Ruihyw
Copy link
Author

Ruihyw commented Jul 9, 2025

Hi @Ruihyw ,

this seems to be a bigger change where also the IsaacSim and IsaacLab version have been updated. Which version are you using?

If you updated the code to the latest releases, we can adjust the README

My Isaaclab uses the release version, which is v2.1.0
IsaacSim uses the version 4.5.0-rc.36+release.19112.f59b3005.gl
Both are the latest versions

@pascal-roth
Copy link
Collaborator

So the current code is written for IsaacSim 4.2 and corresponding IsaacLab version. If we want to merge your PR, we would have to update the entire code and make sure that everything still works.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants