Skip to content

Commit 5857368

Browse files
chore(deps): bump the production-dependencies group with 6 updates (#2851)
* chore(deps): bump the production-dependencies group with 6 updates Bumps the production-dependencies group with 6 updates: | Package | From | To | | --- | --- | --- | | [boto3](https://github.com/boto/boto3) | `1.34.113` | `1.34.117` | | [botocore](https://github.com/boto/botocore) | `1.34.117` | `1.34.122` | | [typing-extensions](https://github.com/python/typing_extensions) | `4.12.1` | `4.12.2` | | [packaging](https://github.com/pypa/packaging) | `24.0` | `24.1` | | [deltalake](https://github.com/delta-io/delta-rs) | `0.17.4` | `0.18.0` | | [ray](https://github.com/ray-project/ray) | `2.23.0` | `2.24.0` | Updates `boto3` from 1.34.113 to 1.34.117 - [Release notes](https://github.com/boto/boto3/releases) - [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst) - [Commits](boto/boto3@1.34.113...1.34.117) Updates `botocore` from 1.34.117 to 1.34.122 - [Changelog](https://github.com/boto/botocore/blob/develop/CHANGELOG.rst) - [Commits](boto/botocore@1.34.117...1.34.122) Updates `typing-extensions` from 4.12.1 to 4.12.2 - [Release notes](https://github.com/python/typing_extensions/releases) - [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md) - [Commits](python/typing_extensions@4.12.1...4.12.2) Updates `packaging` from 24.0 to 24.1 - [Release notes](https://github.com/pypa/packaging/releases) - [Changelog](https://github.com/pypa/packaging/blob/main/CHANGELOG.rst) - [Commits](pypa/packaging@24.0...24.1) Updates `deltalake` from 0.17.4 to 0.18.0 - [Release notes](https://github.com/delta-io/delta-rs/releases) - [Changelog](https://github.com/delta-io/delta-rs/blob/main/CHANGELOG.md) - [Commits](delta-io/delta-rs@python-v0.17.4...python-v0.18.0) Updates `ray` from 2.23.0 to 2.24.0 - [Release notes](https://github.com/ray-project/ray/releases) - [Commits](ray-project/ray@ray-2.23.0...ray-2.24.0) --- updated-dependencies: - dependency-name: boto3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: production-dependencies - dependency-name: botocore dependency-type: direct:production update-type: version-update:semver-patch dependency-group: production-dependencies - dependency-name: typing-extensions dependency-type: direct:production update-type: version-update:semver-patch dependency-group: production-dependencies - dependency-name: packaging dependency-type: direct:production update-type: version-update:semver-minor dependency-group: production-dependencies - dependency-name: deltalake dependency-type: direct:production update-type: version-update:semver-minor dependency-group: production-dependencies - dependency-name: ray dependency-type: direct:production update-type: version-update:semver-minor dependency-group: production-dependencies ... Signed-off-by: dependabot[bot] <[email protected]> * fix: pin deltalake and adapt to breaking change * fix: upgrade cryptography in poetry.lock * fix: update test_read_deltalake_versioned test --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Abdel Jaidi <[email protected]>
1 parent 3cd64dd commit 5857368

File tree

4 files changed

+76
-75
lines changed

4 files changed

+76
-75
lines changed

awswrangler/s3/_write_deltalake.py

+4-4
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@ def to_deltalake(
5454
mode: Literal["error", "append", "overwrite", "ignore"] = "append",
5555
dtype: dict[str, str] | None = None,
5656
partition_cols: list[str] | None = None,
57-
overwrite_schema: bool = False,
57+
schema_mode: Literal["overwrite"] | None = None,
5858
lock_dynamodb_table: str | None = None,
5959
s3_allow_unsafe_rename: bool = False,
6060
boto3_session: boto3.Session | None = None,
@@ -81,8 +81,8 @@ def to_deltalake(
8181
(e.g. ``{'col name':'bigint', 'col2 name': 'int'})``
8282
partition_cols: list[str], optional
8383
List of columns to partition the table by. Only required when creating a new table.
84-
overwrite_schema: bool
85-
If True, allows updating the schema of the table.
84+
schema_mode: str, optional
85+
If set to "overwrite", allows replacing the schema of the table. Set to "merge" to merge with existing schema.
8686
lock_dynamodb_table: str | None
8787
DynamoDB table to use as a locking provider.
8888
A locking mechanism is needed to prevent unsafe concurrent writes to a delta lake directory when writing to S3.
@@ -130,6 +130,6 @@ def to_deltalake(
130130
data=table,
131131
partition_by=partition_cols,
132132
mode=mode,
133-
overwrite_schema=overwrite_schema,
133+
schema_mode=schema_mode,
134134
storage_options=storage_options,
135135
)

0 commit comments

Comments
 (0)