CreateTable

yaml
type: "io.kestra.plugin.gcp.bigquery.createtable"

Examples

yaml
id: gcp_bq_create_table
namespace: company.team

tasks:
  - id: create_table
    type: io.kestra.plugin.gcp.bigquery.CreateTable
    projectId: my-project
    dataset: my-dataset
    table: my-table
    tableDefinition:
      type: TABLE
      schema:
        fields:
        - name: id
          type: INT64
        - name: name
          type: STRING
      standardTableDefinition:
        clustering:
        - id
        - name
    friendlyName: new_table

Properties

dataset *string

table *string

description string

encryptionConfiguration EncryptionConfiguration

expirationDuration string

Format duration

friendlyName string

impersonatedServiceAccount string

labels object

SubType string

location string

projectId string

requirePartitionFilter booleanstring

retryAuto Constant Exponential Random

retryMessages array

SubType string

Default ["due to concurrent update","Retrying the job may solve the problem","Retrying may solve the problem"]

retryReasons array

SubType string

Default ["rateLimitExceeded","jobBackendError","backendError","internalError","jobInternalError"]

scopes array

SubType string

Default ["https://www.googleapis.com/auth/cloud-platform"]

serviceAccount string

tableDefinition TableDefinition

Outputs

creationTime string

Format date-time

datasetId string

definition TableDefinition-Output

description string

encryptionConfiguration EncryptionConfiguration-Output

etag string

expirationTime string

Format date-time

friendlyName string

generatedId string

labels object

SubType string

lastModifiedTime string

Format date-time

numBytes integer

numLongTermBytes integer

numRows integer

projectId string

requirePartitionFilter boolean

selfLink string

table string

Definitions

io.kestra.core.models.tasks.retrys.Constant

interval *string

Format duration

type *object

behavior string

Default RETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

maxAttempts integer

Minimum >= 1

maxDuration string

Format duration

warningOnRetry boolean

Default false

io.kestra.plugin.gcp.bigquery.models.TableDefinition

externalTableDefinition ExternalTableDefinition

materializedViewDefinition MaterializedViewDefinition

schema Schema

standardTableDefinition StandardTableDefinition

type string

Possible Values

TABLEVIEWMATERIALIZED_VIEWEXTERNALMODEL

viewDefinition ViewDefinition

io.kestra.plugin.gcp.bigquery.models.EncryptionConfiguration-Output

kmsKeyName string

io.kestra.plugin.gcp.bigquery.models.StandardTableDefinition

clustering array

SubType string

rangePartitioning RangePartitioning

streamingBuffer StandardTableDefinition-StreamingBuffer

timePartitioning TimePartitioning

io.kestra.core.models.tasks.retrys.Exponential

interval *string

Format duration

maxInterval *string

Format duration

type *object

behavior string

Default RETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

delayFactor number

maxAttempts integer

Minimum >= 1

maxDuration string

Format duration

warningOnRetry boolean

Default false

io.kestra.plugin.gcp.bigquery.models.RangePartitioning-Range-Output

end integer

interval integer

start integer

io.kestra.plugin.gcp.bigquery.models.Schema-Output

fields array

SubType

io.kestra.plugin.gcp.bigquery.models.RangePartitioning-Range

The end of range partitioning. integerstring

The start of range partitioning. integerstring

The width of each interval. integerstring

io.kestra.core.models.tasks.retrys.Random

maxInterval *string

Format duration

minInterval *string

Format duration

type *object

behavior string

Default RETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

maxAttempts integer

Minimum >= 1

maxDuration string

Format duration

warningOnRetry boolean

Default false

io.kestra.plugin.gcp.bigquery.models.TableDefinition-Output

externalTableDefinition ExternalTableDefinition-Output

materializedViewDefinition MaterializedViewDefinition-Output

schema Schema-Output

standardTableDefinition StandardTableDefinition-Output

type string

Possible Values

TABLEVIEWMATERIALIZED_VIEWEXTERNALMODEL

viewDefinition ViewDefinition-Output

io.kestra.plugin.gcp.bigquery.models.PolicyTags

The policy tags' names. array

SubType string

io.kestra.plugin.gcp.bigquery.models.RangePartitioning

The range of range partitioning. RangePartitioning-Range

The range partitioning field. string

io.kestra.plugin.gcp.bigquery.models.MaterializedViewDefinition-Output

enableRefresh boolean

lastRefreshDate string

Format date-time

query string

refreshInterval string

Format duration

io.kestra.plugin.gcp.bigquery.models.Schema

The fields associated with this schema. array

SubType

io.kestra.plugin.gcp.bigquery.models.ViewDefinition

query string

viewUserDefinedFunctions array

SubType

io.kestra.plugin.gcp.bigquery.models.RangePartitioning-Output

field string

range RangePartitioning-Range-Output

io.kestra.plugin.gcp.bigquery.models.EncryptionConfiguration

The KMS key name. string

io.kestra.plugin.gcp.bigquery.models.PolicyTags-Output

names array

SubType string

io.kestra.plugin.gcp.bigquery.models.MaterializedViewDefinition

enableRefresh booleanstring

lastRefreshDate string

Format date-time

query string

refreshInterval string

Format duration

io.kestra.plugin.gcp.bigquery.models.TimePartitioning

expiration string

Format duration

field string

requirePartitionFilter booleanstring

type string

Possible Values

DAYHOURMONTHYEAR

io.kestra.plugin.gcp.bigquery.models.Field

description string

mode string

Possible Values

NULLABLEREQUIREDREPEATED

name string

policyTags PolicyTags

subFields array

SubType

type string

Possible Values

BOOLINT64FLOAT64NUMERICBIGNUMERICSTRINGBYTESSTRUCTARRAYTIMESTAMPDATETIMEDATETIMEGEOGRAPHYJSONINTERVALRANGE

io.kestra.plugin.gcp.bigquery.models.UserDefinedFunction

The type of user defined function. string

Possible Values

INLINEFROM_URI

Type of UserDefinedFunction string

io.kestra.plugin.gcp.bigquery.models.ExternalTableDefinition

autodetect booleanstring

compression string

formatType string

Possible Values

CSVJSONBIGTABLEDATASTORE_BACKUPAVROGOOGLE_SHEETSPARQUETORC

ignoreUnknownValues booleanstring

maxBadRecords integerstring

sourceUris array

SubType string

com.google.cloud.bigquery.StandardTableDefinition-StreamingBuffer

estimatedBytes integer

estimatedRows integer

oldestEntryTime integer

io.kestra.plugin.gcp.bigquery.models.Field-Output

description string

mode string

Possible Values

NULLABLEREQUIREDREPEATED

name string

policyTags PolicyTags-Output

subFields array

SubType

type string

Possible Values

BOOLINT64FLOAT64NUMERICBIGNUMERICSTRINGBYTESSTRUCTARRAYTIMESTAMPDATETIMEDATETIMEGEOGRAPHYJSONINTERVALRANGE

io.kestra.plugin.gcp.bigquery.models.ViewDefinition-Output

query string

viewUserDefinedFunctions array

SubType

io.kestra.plugin.gcp.bigquery.models.TimePartitioning-Output

expiration string

Format duration

field string

requirePartitionFilter boolean

type string

Possible Values

DAYHOURMONTHYEAR

io.kestra.plugin.gcp.bigquery.models.UserDefinedFunction-Output

content string

type string

Possible Values

INLINEFROM_URI

io.kestra.plugin.gcp.bigquery.models.ExternalTableDefinition-Output

autodetect boolean

compression string

formatType string

Possible Values

CSVJSONBIGTABLEDATASTORE_BACKUPAVROGOOGLE_SHEETSPARQUETORC

ignoreUnknownValues boolean

maxBadRecords integer

sourceUris array

SubType string

io.kestra.plugin.gcp.bigquery.models.StandardTableDefinition-Output

clustering array

SubType string

rangePartitioning RangePartitioning-Output

streamingBuffer StandardTableDefinition-StreamingBuffer

timePartitioning TimePartitioning-Output

​Create​Table

CreateTable