Skip to content

Fix broken docs-build by pinning protobuf-3.20.x #1033

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 28, 2025

Conversation

kiukchung
Copy link
Contributor

Differential Revision: D72016216

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 27, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

Copy link
Contributor

@tonykao8080 tonykao8080 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@kiukchung kiukchung changed the title Fix broken docs-build by pinning apache-airflow==2.6.3 Fix broken docs-build by pinning apache-airflow==2.10.2 Mar 28, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:
Pull Request resolved: #1033

`apache-airflow>2.6.3` (installed in `docs/requirements.txt`) transitively brings in `opentelemetry` which depends on `protobuf>=4.x`. This version of `protobuf` conflicts with the one required by `kfp==1.8.x` (`protobuf <= 3.20.x`).

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:
Pull Request resolved: #1033

Pin protobuf-3.20.x (required by kfp-1.8.22) in dev-requirements and first install docs/requirements.txt then downgrade protobuf to 3.20.x.

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
@kiukchung kiukchung changed the title Fix broken docs-build by pinning apache-airflow==2.10.2 Fix broken docs-build by pinning protobuf-3.20.x Mar 28, 2025
kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:
Pull Request resolved: #1033

Pin protobuf-3.20.x (required by kfp-1.8.22) in dev-requirements and first install docs/requirements.txt then downgrade protobuf to 3.20.x.

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

facebook-github-bot pushed a commit that referenced this pull request Mar 28, 2025
Summary:

Pin protobuf-3.20.x (required by kfp-1.8.22) in dev-requirements and first install docs/requirements.txt then downgrade protobuf to 3.20.x.

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

facebook-github-bot pushed a commit that referenced this pull request Mar 28, 2025
Summary:

Pin protobuf-3.20.x (required by kfp-1.8.22) in dev-requirements and first install docs/requirements.txt then downgrade protobuf to 3.20.x.

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:

Pin protobuf-3.20.x (required by kfp-1.8.22) in dev-requirements and first install docs/requirements.txt then downgrade protobuf to 3.20.x.

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
Summary:
Pull Request resolved: #1033

Pin protobuf-3.20.x (required by kfp-1.8.22) in dev-requirements and first install docs/requirements.txt then downgrade protobuf to 3.20.x.

What we oughta do is to upgrade to `kfp-2.x` but that's a much more intrusive change as we are bumping major versions. So pin to `apache-airflow==2.6.3` so that protobuf doesn't conflict with kfp.

Reviewed By: tonykao8080

Differential Revision: D72016216
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D72016216

@facebook-github-bot facebook-github-bot merged commit 87e3e08 into main Mar 28, 2025
22 of 24 checks passed
@facebook-github-bot facebook-github-bot deleted the export-D72016216 branch March 28, 2025 06:07
facebook-github-bot pushed a commit that referenced this pull request Mar 28, 2025
Summary:
I fixed doc-build in #1033 by:

1. pinning `protobuf-3.20.x` in torchx's `dev-requirements.txt` since `apache-airflow` (defined in `docs/requirements.txt`) was upgrading to `protobuf>=5.x` which is incompatible with `kfp-1.8.x`.
2. installing `doc/requirements.txt` FIRST, then installing `torchx` so that the pinned version of `protobuf` is honored.

The above fixes `doc-build` but not `doc-push` because `doc-push` runs `scripts/doc-push.sh` which needed the same change as #2.

Differential Revision: D72059926
@kiukchung kiukchung mentioned this pull request Mar 28, 2025
kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:

I fixed doc-build in #1033 by:

1. pinning `protobuf-3.20.x` in torchx's `dev-requirements.txt` since `apache-airflow` (defined in `docs/requirements.txt`) was upgrading to `protobuf>=5.x` which is incompatible with `kfp-1.8.x`.
2. installing `doc/requirements.txt` FIRST, then installing `torchx` so that the pinned version of `protobuf` is honored.

The above fixes `doc-build` but not `doc-push` because `doc-push` runs `scripts/doc-push.sh` which needed the same change as #2.

NOTE: this wasn't caught in #1033 because we don't run `doc-push` for PRs (doc-push only runs for releases and commits in trunk since it literally pushes the built docs to https://pytorch.org/torchx)

Differential Revision: D72059926
kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:
Pull Request resolved: #1034

I fixed doc-build in #1033 by:

1. pinning `protobuf-3.20.x` in torchx's `dev-requirements.txt` since `apache-airflow` (defined in `docs/requirements.txt`) was upgrading to `protobuf>=5.x` which is incompatible with `kfp-1.8.x`.
2. installing `doc/requirements.txt` FIRST, then installing `torchx` so that the pinned version of `protobuf` is honored.

The above fixes `doc-build` but not `doc-push` because `doc-push` runs `scripts/doc-push.sh` which needed the same change as #2.

NOTE: this wasn't caught in #1033 because we don't run `doc-push` for PRs (doc-push only runs for releases and commits in trunk since it literally pushes the built docs to https://pytorch.org/torchx)

Differential Revision: D72059926
kiukchung added a commit that referenced this pull request Mar 28, 2025
Summary:
Pull Request resolved: #1034

I fixed doc-build in #1033 by:

1. pinning `protobuf-3.20.x` in torchx's `dev-requirements.txt` since `apache-airflow` (defined in `docs/requirements.txt`) was upgrading to `protobuf>=5.x` which is incompatible with `kfp-1.8.x`.
2. installing `doc/requirements.txt` FIRST, then installing `torchx` so that the pinned version of `protobuf` is honored.

The above fixes `doc-build` but not `doc-push` because `doc-push` runs `scripts/doc-push.sh` which needed the same change as #2.

NOTE: this wasn't caught in #1033 because we don't run `doc-push` for PRs (doc-push only runs for releases and commits in trunk since it literally pushes the built docs to https://pytorch.org/torchx)

Differential Revision: D72059926
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants