significance of flags described in the dist.py in ray context

[atinsood]

❓ Questions and Help

Question

We are trying to run torchx with ray as the scheduler and trying to understand the significance of some. of the flags and whether those flags are valid in ray scheduler setup

1. https://github.com/pytorch/torchx/blob/main/torchx/components/dist.py#L173
   is the image flag valid in ray setup

2. similar with port mapping https://github.com/pytorch/torchx/blob/main/torchx/components/dist.py#L179 . does this has any significance in ray setup.

[d4l3k]

1. Image field maps to the directory it runs in though under normal usage it is overridden by the TempDirWorkspace which is build from the local files

   torchx/torchx/workspace/dir_workspace.py

   Lines 19 to 31 in 8c0345c

   	class TmpDirWorkspace(Workspace):
   	def build_workspace_and_update_role(
   	self, role: Role, workspace: str, cfg: Mapping[str, CfgVal]
   	) -> None:
   	"""
   	Creates a new temp directory from the workspace. Role image fields will
   	be set to the ``job_dir``.
   	Any files listed in the ``.torchxignore`` folder will be skipped.
   	"""
   	job_dir = mkdtemp(prefix="torchx_workspace")
   	_copy_to_dir(workspace, job_dir)
   	role.image = job_dir

2. port_maps are mostly informative and aren't passed to Ray as there doesn't seem to be a way to do so https://github.com/pytorch/torchx/blob/main/torchx/schedulers/ray_scheduler.py#L308