Skip to content

Date type percent

In this example we will check the data of bigquery-public-data.labeled_patents.extracted_data using date_type_percent check. A column publication_date is STRING type and is formatted: day.month.year. We would like to test this column and see the amount of records that satisfy this format.

Adding connection

GCP

You have to download and install Google Cloud SDK. After installing Google Cloud CLI, log in to your GCP account (you can start one for free), by running:

gcloud auth application-default login

After setting up your GCP account, create your GCP project. That will be your GCP billing project used to run SQL sensors on the public datasets provided by Google.

The examples are using a name of your GCP billing project, received as an environment variable GCP_PROJECT. You have to set and export this variable before starting DQO shell.

set GCP_PROJECT={here is your GCP billing project}

export GCP_PROJECT={here is your GCP billing project}

export GCP_PROJECT={here is your GCP billing project}

Navigate to the example directory and run the check

cd examples/bigquery-column-date-type-percent
..\..\dqo.cmd

cd examples/bigquery-column-date-type-percent
../../dqo

cd examples/bigquery-column-date-type-percent
../../dqo

After starting the example, run the following commands in the DQO shell: 

cloud login
This command will let up login or sign up for the cloud.dqo.ai account.

check run
The data quality checks will be executed. 
cloud sync data
The result files will be pushed to cloud.dqo.ai

Now, you can open the browser and navigate to https://cloud.dqo.ai/ and review the sensor results on the dashboards.

The result files will be pushed to cloud.dqo.ai

Now, you can open the browser and navigate to https://cloud.dqo.ai/ and review the sensor results on the dashboards.