使用python Bigtable库运行条件过滤器时,大表仿真器中存在一个错误。针对生产Bigtable运行时不会发生此错误,因此我认为问题出在模拟器上。如果该链未返回任何结果,则条件true过滤器不应返回任何结果,但是针对仿真器运行代码时则不是这种情况。
# pip list | grep bigtable
google-cloud-bigtable 1.2.0
# gcloud version
Google Cloud SDK 274.0.0
beta 2019.05.17
bigtable
bq 2.0.51
cbt
core 2019.12.17
docker-credential-gcr
gsutil 4.46
kubectl 2019.11.04
import os
from google.cloud import bigtable
import google.cloud.bigtable.row_filters as btf
os.environ["BIGTABLE_EMULATOR_HOST"] = "localhost:8086"
TEST_PROJECT_NAME = "test-project"
TEST_INSTANCE_NAME = "test-instance"
TEST_TABLE = "test-table"
TEST_FAMILY = "a"
admin_client = bigtable.Client(project=TEST_PROJECT_NAME, admin=True)
admin_inst = admin_client.instance(TEST_INSTANCE_NAME)
tbl = admin_inst.table(TEST_TABLE)
fam = tbl.column_family(TEST_FAMILY)
if not tbl.exists():
tbl.create()
fam.create()
# write a row
row = tbl.direct_row("aaa")
row.set_cell(TEST_FAMILY, b'a', '\x01')
row.set_cell(TEST_FAMILY, b'b', '\x05')
row.commit()
chain1 = btf.RowFilterChain([
btf.ColumnQualifierRegexFilter(b'a'),
btf.ValueRangeFilter(start_value='\x01')
])
chain2 = btf.RowFilterChain([
btf.ColumnQualifierRegexFilter(b'b'),
btf.ValueRangeFilter(start_value='\x09')
])
union_filt = btf.RowFilterUnion([chain1, chain2])
chain_filter = btf.RowFilterChain([
union_filt,
btf.CellsRowOffsetFilter(1)
])
cond_filter = btf.ConditionalRowFilter(
chain_filter,
true_filter=btf.PassAllFilter(True))
print("Just union")
for r in tbl.read_rows(filter_=union_filt):
print(r.cells)
print("Just chain")
for r in tbl.read_rows(filter_=chain_filter):
print(r.cells)
print("Cond Filter")
for r in tbl.read_rows(filter_=cond_filter):
print(r.cells)
tbl.delete()
结果
Just union
{'a': {b'a': [<Cell value=b'\x01' timestamp=2019-12-27 19:23:27.402000+00:00>]}}
Just chain
Cond Filter. THIS SHOULD NOT RETURN ANYTHING
{'a': {b'a': [<Cell value=b'\x01' timestamp=2019-12-27 19:23:27.402000+00:00>], b'b': [<Cell value=b'\x05
' timestamp=2019-12-27 19:23:27.402000+00:00>]}}
这已从相关注释行确认为错误。
参考GitHub问题:https://github.com/googleapis/google-cloud-go/issues/1712