Skip to content

Add RayCluster API with Kuberay support#222

Merged
hemildesai merged 9 commits intomainfrom
hemil/ray
May 12, 2025
Merged

Add RayCluster API with Kuberay support#222
hemildesai merged 9 commits intomainfrom
hemil/ray

Conversation

@hemildesai
Copy link
Copy Markdown
Contributor

Example usage:

   executor = KubeRayExecutor(
        namespace="your-namespace",
        ray_version="2.43.0",
        image="anyscale/ray:2.43.0-py312-cu125",
        head_cpu="4",
        head_memory="12Gi",
        worker_groups=[
            KubeRayWorkerGroup(
                group_name="worker-group",
                replicas=1,
                gpus_per_worker=8,
            )
        ],
        reuse_volumes_in_worker_groups=True,
        spec_kwargs={"schedulerName": "runai-scheduler"},
    )

    cluster = RayCluster(name="test-cluster", executor=executor)
    cluster.stop()
    cluster.start(wait_until_ready=True)
    
    cluster.port_forward(port=8265, target_port=8265, wait=False)
    cluster.port_forward(port=10001, target_port=10001, wait=True)

Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
hemildesai added 2 commits May 7, 2025 12:41
Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
hemildesai added 3 commits May 8, 2025 15:17
Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
terrykong
terrykong previously approved these changes May 12, 2025
Signed-off-by: Hemil Desai <hemild@nvidia.com>
@hemildesai hemildesai merged commit 9073a2c into main May 12, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants