上传到Bigquery时,表情符号崩溃了

问题描述 投票:2回答:1

目前,我面临着将(使用python)EMOJI数据上传到BIG QUERY的问题

这是我尝试上传到BQ的示例代码:

 {"emojiCharts":{"emoji_icon":"\ud83d\udc4d","repost": 4, "doc": 4, "engagement": 0, "reach": 0, "impression": 0}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\udc49","repost": 4, "doc": 4, "engagement": 43, "reach": 722, "impression": 4816}} 
 {"emojiCharts":{"emoji_icon":"\u203c","repost": 4, "doc": 4, "engagement": 0, "reach": 0, "impression": 0}} 
 {"emojiCharts":{"emoji_icon":"\ud83c\udf89","repost": 5, "doc": 5, "engagement": 43, "reach": 829, "impression": 5529}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude34","repost": 5, "doc": 5, "engagement": 222, "reach": 420, "impression": 2805}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude31","repost": 3, "doc": 3, "engagement": 386, "reach": 2868, "impression": 19122}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\udc4d\ud83c\udffb","repost": 5, "doc": 5, "engagement": 43, "reach": 1064, "impression": 7098}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude3b","repost": 3, "doc": 3, "engagement": 93, "reach": 192, "impression": 1283}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude2d","repost": 6, "doc": 6, "engagement": 212, "reach": 909, "impression": 6143}} 
 {"emojiCharts":{"emoji_icon":"\ud83e\udd84","repost": 8, "doc": 8, "engagement": 313, "reach": 402, "impression": 2681}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude18","repost": 7, "doc": 7, "engagement": 0, "reach": 8454, "impression": 56366}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude05","repost": 5, "doc": 5, "engagement": 74, "reach": 1582, "impression": 10550}} 
 {"emojiCharts":{"emoji_icon":"\ud83d\ude04","repost": 5, "doc": 5, "engagement": 73, "reach": 3329, "impression": 22206}}

问题是大查询无法看到任何这个表情符号(\ud83d\ude04)并且只会以这种格式显示(\u203c

即使字段是STRING它显示2个黑色炸弹,为什么BQ不能将表情符号显示为字符串而不将其转换为实际的表情符号?

问题:

有没有办法将EMOJI上传到Big Query,它会正确加载? - “将在Google Data Studio中使用”

我应该手动(硬编码)将所有表情符号代码更改为可接受的表格,这是可接受的格式吗?

python google-bigquery google-data-studio
1个回答
1
投票

用户'数字'在评论中提到:

查看charbase.com/1f618-unicode-face-throwing-a-kiss您想要的是将javascript转义字符转换为实际的unicode数据。

,您需要更改表情符号的编码,以便将它们准确地表示为一个字符:

SELECT "\U0001f604 \U0001f4b8"
--   , "\ud83d\udcb8"
--   , "\ud83d\ude04"

第2行和第3行因Illegal escape sequence: Unicode value \ud83d is invalid at [2:7]错误而失败,但第一行在BigQuery和Data Studio中显示正确的显示:

enter image description here

enter image description here

关于此的其他想法:

© www.soinside.com 2019 - 2024. All rights reserved.