Skip to content

Commit bfa2e89

Browse files
dopierakboroszko
andauthored
feat: support Bigtable dataset (#1578)
* feat: reading from bigtable (#2) Implements reading from bigtable in a synchronous manner. * feat: RowRange and RowSet API. * feat: parallel read (#4) In this pr we make the read methods accept a row_set reading only rows specified by the user. We also add a parallel read, that leverages the sample_row_keys method to split work among workers. * feat: version filters (#6) This PR adds support for Bigtable version filters. * feat: support for other data types (#5) * fix: linter fixes (#8) * feat docs (#9) * fix: building on windows (#12) * fix: refactor bigtable package to api folder (#14) moved bigtable to tfensorflow_io.python.api * fix: tests hanging (#30) changed path to bigtable emulator and cbt in tests moved arguments' initializations to the body of the function in bigtable_ops.py fixed interleaveFromRange of column filters when using only one column * fix: temporarily disable macos tests (#32) * disable tests on macos Co-authored-by: Kajetan Boroszko <[email protected]> Co-authored-by: Kajetan Boroszko <[email protected]>
1 parent 3c332c3 commit bfa2e89

30 files changed

+3308
-125
lines changed

WORKSPACE

+16-4
Original file line numberDiff line numberDiff line change
@@ -59,14 +59,26 @@ http_archive(
5959
)
6060

6161
# Note com_google_googleapis is placed earlier as we need to adjust switched_rules_by_language option
62+
# Note we have to change one word in the field_behavior.proto so it compiles on WINDOWS
63+
# for more infor please refer to https://github.com/protocolbuffers/protobuf/issues/7076
64+
# Because of a bug in protocol buffers (protocolbuffers/protobuf#7076), new versions of this project
65+
# fail to compile on Windows. The problem hinges on OPTIONAL being defined as an empty string under
66+
# Windows. This makes the preprocessor remove every mention of OPTIONAL from the code, which causes
67+
# compilation failures. This temporary workaround renames the name of the protobuf value OPTIONAL to
68+
# OPIONAL. This should be safe as it does not affect the generated protobufs.
6269
http_archive(
6370
name = "com_google_googleapis",
6471
build_file = "@com_github_googleapis_google_cloud_cpp//bazel:googleapis.BUILD",
65-
sha256 = "7ebab01b06c555f4b6514453dc3e1667f810ef91d1d4d2d3aa29bb9fcb40a900",
66-
strip_prefix = "googleapis-541b1ded4abadcc38e8178680b0677f65594ea6f",
72+
patch_cmds = [
73+
"""sed -i.bak 's/OPTIONAL/OPIONAL/g' google/api/field_behavior.proto""",
74+
"""sed -i.bak 's/OPTIONAL/OPIONAL/g' google/pubsub/v1beta2/pubsub.proto""",
75+
"""sed -i.bak 's/OPTIONAL/OPIONAL/g' google/pubsub/v1/pubsub.proto""",
76+
],
77+
sha256 = "a53e15405f81d5a32594d7f6486e649131fadda5431cf28377dff4ae54d45d16",
78+
strip_prefix = "googleapis-d4d09eb3aec152015f35717102f9b423988b94f7",
6779
urls = [
68-
"https://storage.googleapis.com/mirror.tensorflow.org/github.com/googleapis/googleapis/archive/541b1ded4abadcc38e8178680b0677f65594ea6f.zip",
69-
"https://github.com/googleapis/googleapis/archive/541b1ded4abadcc38e8178680b0677f65594ea6f.zip",
80+
"https://storage.googleapis.com/mirror.tensorflow.org/github.com/googleapis/googleapis/archive/d4d09eb3aec152015f35717102f9b423988b94f7.zip",
81+
"https://github.com/googleapis/googleapis/archive/d4d09eb3aec152015f35717102f9b423988b94f7.zip",
7082
],
7183
)
7284

0 commit comments

Comments
 (0)