Skip to content

some emoji will become wrong character stored in bigquery while using load_table_from_json #864

Closed
@grimmerk

Description

@grimmerk

Thanks for stopping by to let us know something could be better!

PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Please run down the following list and make sure you've tried the usual "quick fixes":

If you are still having issues, please be sure to include as much information as possible:

Environment details

  • OS type and version: macOS Big Sur
  • Python version: python --version 3.8.8
  • pip version: pip --version: 21.0.1
  • google-cloud-bigquery version: pip show google-cloud-bigquery: 2.6.1

Steps to reproduce

  1. insert any emoji which is over 0xFFFF into a dict, e.g. 🏦 (\U0001F3E6)
  2. use client.load_table_from_json(rows_to_insert... to upload
  3. see that emoji icon become �� in BigQuery web console

Code example

    bank = "\U0001F3E6" 
    rows_to_insert = [{"emoji": bank}]
    client.load_table_from_json(rows_to_insert, table_id, job_config=job_config)

Stack trace

# example

Making sure to follow these steps will guarantee the quickest resolution possible.

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    api: bigqueryIssues related to the googleapis/python-bigquery API.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions