BigTable Emulator Filter Bug

问题描述 投票:0回答:1

使用python Bigtable库运行条件过滤器时,大表仿真器中存在一个错误。针对生产Bigtable运行时不会发生此错误,因此我认为问题出在模拟器上。如果该链未返回任何结果,则条件true过滤器不应返回任何结果,但是针对仿真器运行代码时则不是这种情况。

# pip list | grep bigtable
google-cloud-bigtable    1.2.0 

# gcloud version
Google Cloud SDK 274.0.0
beta 2019.05.17
bigtable 
bq 2.0.51
cbt 
core 2019.12.17
docker-credential-gcr 
gsutil 4.46
kubectl 2019.11.04
import os
from google.cloud import bigtable
import google.cloud.bigtable.row_filters as btf

os.environ["BIGTABLE_EMULATOR_HOST"] = "localhost:8086"
TEST_PROJECT_NAME = "test-project"
TEST_INSTANCE_NAME = "test-instance"

TEST_TABLE = "test-table"
TEST_FAMILY = "a"

admin_client = bigtable.Client(project=TEST_PROJECT_NAME, admin=True)
admin_inst = admin_client.instance(TEST_INSTANCE_NAME)
tbl = admin_inst.table(TEST_TABLE)
fam = tbl.column_family(TEST_FAMILY)
if not tbl.exists():
    tbl.create()
    fam.create()

# write a row
row = tbl.direct_row("aaa")
row.set_cell(TEST_FAMILY, b'a', '\x01')
row.set_cell(TEST_FAMILY, b'b', '\x05')
row.commit()

chain1 = btf.RowFilterChain([
    btf.ColumnQualifierRegexFilter(b'a'),
    btf.ValueRangeFilter(start_value='\x01')
    ])
chain2 = btf.RowFilterChain([
    btf.ColumnQualifierRegexFilter(b'b'),
    btf.ValueRangeFilter(start_value='\x09')
    ])

union_filt = btf.RowFilterUnion([chain1, chain2])

chain_filter = btf.RowFilterChain([
    union_filt,
    btf.CellsRowOffsetFilter(1)
    ])

cond_filter = btf.ConditionalRowFilter(
    chain_filter,
    true_filter=btf.PassAllFilter(True))

print("Just union")
for r in tbl.read_rows(filter_=union_filt):
    print(r.cells)

print("Just chain")
for r in tbl.read_rows(filter_=chain_filter):
    print(r.cells)

print("Cond Filter")
for r in tbl.read_rows(filter_=cond_filter):
    print(r.cells)

tbl.delete()

结果

Just union
{'a': {b'a': [<Cell value=b'\x01' timestamp=2019-12-27 19:23:27.402000+00:00>]}}
Just chain
Cond Filter. THIS SHOULD NOT RETURN ANYTHING
{'a': {b'a': [<Cell value=b'\x01' timestamp=2019-12-27 19:23:27.402000+00:00>], b'b': [<Cell value=b'\x05
' timestamp=2019-12-27 19:23:27.402000+00:00>]}}
google-cloud-bigtable bigtable
1个回答
0
投票

这已从相关注释行确认为错误。

参考GitHub问题:https://github.com/googleapis/google-cloud-go/issues/1712

© www.soinside.com 2019 - 2024. All rights reserved.