Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] Partial steps in env #2356

Open
vmoens opened this issue Aug 4, 2024 · 0 comments · Fixed by #2377
Open

[Feature Request] Partial steps in env #2356

vmoens opened this issue Aug 4, 2024 · 0 comments · Fixed by #2377
Assignees
@vmoens
Labels
enhancement New feature or request

Comments

@vmoens
Copy link
Contributor

vmoens commented Aug 4, 2024

Motivation

#2355 would be much cleaner if we could do partial steps in batched or stateless envs.

Design question

  • Should we index the batched env to make a partial step?
  • Should we pass an entry like "_reset" (say, "_step") that indicates who's to be stepped?
@vmoens vmoens added the enhancement New feature or request label Aug 4, 2024
@vmoens vmoens self-assigned this Aug 4, 2024
@vmoens vmoens mentioned this issue Aug 4, 2024
Open
23 tasks
@vmoens vmoens linked a pull request Aug 8, 2024 that will close this issue
[Feature] Partial steps in batched envs #2377
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vmoens vmoens

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Feature] Partial steps in batched envs pytorch/rl
1 participant
@vmoens