airbyte.SourceMicrosoftOnedrive

Coming soon!

Coming soon!

Coming soon!

Coming soon!

name string

The unique name of the resource.

args SourceMicrosoftOnedriveArgs

The arguments to resource properties.

opts CustomResourceOptions

Bag of options to control resource's behavior.

resource_name str

The unique name of the resource.

args SourceMicrosoftOnedriveArgs

The arguments to resource properties.

opts ResourceOptions

Bag of options to control resource's behavior.

ctx Context

Context object for the current deployment.

name string

The unique name of the resource.

args SourceMicrosoftOnedriveArgs

The arguments to resource properties.

opts ResourceOption

Bag of options to control resource's behavior.

name string

The unique name of the resource.

args SourceMicrosoftOnedriveArgs

The arguments to resource properties.

opts CustomResourceOptions

Bag of options to control resource's behavior.

name String

The unique name of the resource.

args SourceMicrosoftOnedriveArgs

The arguments to resource properties.

options CustomResourceOptions

Bag of options to control resource's behavior.

Configuration SourceMicrosoftOnedriveConfiguration

SourceMicrosoftOneDriveSpec class for Microsoft OneDrive Source Specification. This class combines the authentication details with additional configuration for the OneDrive API.

WorkspaceId string

DefinitionId string

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

Name string

Name of the source e.g. dev-mysql-instance.

SecretId string

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

Configuration SourceMicrosoftOnedriveConfigurationArgs

SourceMicrosoftOneDriveSpec class for Microsoft OneDrive Source Specification. This class combines the authentication details with additional configuration for the OneDrive API.

WorkspaceId string

DefinitionId string

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

Name string

Name of the source e.g. dev-mysql-instance.

SecretId string

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration SourceMicrosoftOnedriveConfiguration

SourceMicrosoftOneDriveSpec class for Microsoft OneDrive Source Specification. This class combines the authentication details with additional configuration for the OneDrive API.

workspaceId String

definitionId String

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name String

Name of the source e.g. dev-mysql-instance.

secretId String

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration SourceMicrosoftOnedriveConfiguration

SourceMicrosoftOneDriveSpec class for Microsoft OneDrive Source Specification. This class combines the authentication details with additional configuration for the OneDrive API.

workspaceId string

definitionId string

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name string

Name of the source e.g. dev-mysql-instance.

secretId string

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration SourceMicrosoftOnedriveConfigurationArgs

SourceMicrosoftOneDriveSpec class for Microsoft OneDrive Source Specification. This class combines the authentication details with additional configuration for the OneDrive API.

workspace_id str

definition_id str

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name str

Name of the source e.g. dev-mysql-instance.

secret_id str

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

configuration Property Map

SourceMicrosoftOneDriveSpec class for Microsoft OneDrive Source Specification. This class combines the authentication details with additional configuration for the OneDrive API.

workspaceId String

definitionId String

The UUID of the connector definition. One of configuration.sourceType or definitionId must be provided. Requires replacement if changed.

name String

Name of the source e.g. dev-mysql-instance.

secretId String

Optional secretID obtained through the public API OAuth redirect flow. Requires replacement if changed.

CreatedAt double

Id string

The provider-assigned unique ID for this managed resource.

SourceId string

SourceType string

CreatedAt float64

Id string

The provider-assigned unique ID for this managed resource.

SourceId string

SourceType string

createdAt Double

id String

The provider-assigned unique ID for this managed resource.

sourceId String

sourceType String

createdAt number

id string

The provider-assigned unique ID for this managed resource.

sourceId string

sourceType string

created_at float

id str

The provider-assigned unique ID for this managed resource.

source_id str

source_type str

createdAt Number

id String

The provider-assigned unique ID for this managed resource.

sourceId String

sourceType String

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

resource_name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

name

The unique name of the resulting resource.

id

The unique provider ID of the resource to lookup.

state

Any extra arguments used during the lookup.

opts

A bag of options that control this resource's behavior.

Credentials SourceMicrosoftOnedriveConfigurationCredentials

Credentials for connecting to the One Drive API

Streams List<SourceMicrosoftOnedriveConfigurationStream>

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

DriveName string

Name of the Microsoft OneDrive drive where the file(s) exist. Default: "OneDrive"

FolderPath string

Path to a specific folder within the drives to search for files. Leave empty to search all folders of the drives. This does not apply to shared items. Default: "."

SearchScope string

Specifies the location(s) to search for files. Valid options are 'ACCESSIBLEDRIVES' to search in the selected OneDrive drive, 'SHAREDITEMS' for shared items the user has access to, and 'ALL' to search both. Default: "ALL"; must be one of ["ACCESSIBLEDRIVES", "SHAREDITEMS", "ALL"]

StartDate string

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

Credentials SourceMicrosoftOnedriveConfigurationCredentials

Credentials for connecting to the One Drive API

Streams []SourceMicrosoftOnedriveConfigurationStream

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

DriveName string

Name of the Microsoft OneDrive drive where the file(s) exist. Default: "OneDrive"

FolderPath string

Path to a specific folder within the drives to search for files. Leave empty to search all folders of the drives. This does not apply to shared items. Default: "."

SearchScope string

Specifies the location(s) to search for files. Valid options are 'ACCESSIBLEDRIVES' to search in the selected OneDrive drive, 'SHAREDITEMS' for shared items the user has access to, and 'ALL' to search both. Default: "ALL"; must be one of ["ACCESSIBLEDRIVES", "SHAREDITEMS", "ALL"]

StartDate string

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

credentials SourceMicrosoftOnedriveConfigurationCredentials

Credentials for connecting to the One Drive API

streams List<SourceMicrosoftOnedriveConfigurationStream>

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

driveName String

Name of the Microsoft OneDrive drive where the file(s) exist. Default: "OneDrive"

folderPath String

Path to a specific folder within the drives to search for files. Leave empty to search all folders of the drives. This does not apply to shared items. Default: "."

searchScope String

Specifies the location(s) to search for files. Valid options are 'ACCESSIBLEDRIVES' to search in the selected OneDrive drive, 'SHAREDITEMS' for shared items the user has access to, and 'ALL' to search both. Default: "ALL"; must be one of ["ACCESSIBLEDRIVES", "SHAREDITEMS", "ALL"]

startDate String

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

credentials SourceMicrosoftOnedriveConfigurationCredentials

Credentials for connecting to the One Drive API

streams SourceMicrosoftOnedriveConfigurationStream[]

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

driveName string

Name of the Microsoft OneDrive drive where the file(s) exist. Default: "OneDrive"

folderPath string

Path to a specific folder within the drives to search for files. Leave empty to search all folders of the drives. This does not apply to shared items. Default: "."

searchScope string

Specifies the location(s) to search for files. Valid options are 'ACCESSIBLEDRIVES' to search in the selected OneDrive drive, 'SHAREDITEMS' for shared items the user has access to, and 'ALL' to search both. Default: "ALL"; must be one of ["ACCESSIBLEDRIVES", "SHAREDITEMS", "ALL"]

startDate string

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

credentials SourceMicrosoftOnedriveConfigurationCredentials

Credentials for connecting to the One Drive API

streams Sequence[SourceMicrosoftOnedriveConfigurationStream]

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

drive_name str

Name of the Microsoft OneDrive drive where the file(s) exist. Default: "OneDrive"

folder_path str

Path to a specific folder within the drives to search for files. Leave empty to search all folders of the drives. This does not apply to shared items. Default: "."

search_scope str

Specifies the location(s) to search for files. Valid options are 'ACCESSIBLEDRIVES' to search in the selected OneDrive drive, 'SHAREDITEMS' for shared items the user has access to, and 'ALL' to search both. Default: "ALL"; must be one of ["ACCESSIBLEDRIVES", "SHAREDITEMS", "ALL"]

start_date str

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

credentials Property Map

Credentials for connecting to the One Drive API

streams List<Property Map>

Each instance of this configuration defines a \n\nstream\n\n. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.

driveName String

Name of the Microsoft OneDrive drive where the file(s) exist. Default: "OneDrive"

folderPath String

Path to a specific folder within the drives to search for files. Leave empty to search all folders of the drives. This does not apply to shared items. Default: "."

searchScope String

Specifies the location(s) to search for files. Valid options are 'ACCESSIBLEDRIVES' to search in the selected OneDrive drive, 'SHAREDITEMS' for shared items the user has access to, and 'ALL' to search both. Default: "ALL"; must be one of ["ACCESSIBLEDRIVES", "SHAREDITEMS", "ALL"]

startDate String

UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

AuthenticateViaMicrosoftOAuth SourceMicrosoftOnedriveConfigurationCredentialsAuthenticateViaMicrosoftOAuth

OAuthCredentials class to hold authentication details for Microsoft OAuth authentication. This class uses pydantic for data validation and settings management.

ServiceKeyAuthentication SourceMicrosoftOnedriveConfigurationCredentialsServiceKeyAuthentication

ServiceCredentials class for service key authentication. This class is structured similarly to OAuthCredentials but for a different authentication method.

AuthenticateViaMicrosoftOAuth SourceMicrosoftOnedriveConfigurationCredentialsAuthenticateViaMicrosoftOAuth

OAuthCredentials class to hold authentication details for Microsoft OAuth authentication. This class uses pydantic for data validation and settings management.

ServiceKeyAuthentication SourceMicrosoftOnedriveConfigurationCredentialsServiceKeyAuthentication

ServiceCredentials class for service key authentication. This class is structured similarly to OAuthCredentials but for a different authentication method.

authenticateViaMicrosoftOAuth SourceMicrosoftOnedriveConfigurationCredentialsAuthenticateViaMicrosoftOAuth

OAuthCredentials class to hold authentication details for Microsoft OAuth authentication. This class uses pydantic for data validation and settings management.

serviceKeyAuthentication SourceMicrosoftOnedriveConfigurationCredentialsServiceKeyAuthentication

ServiceCredentials class for service key authentication. This class is structured similarly to OAuthCredentials but for a different authentication method.

authenticateViaMicrosoftOAuth SourceMicrosoftOnedriveConfigurationCredentialsAuthenticateViaMicrosoftOAuth

OAuthCredentials class to hold authentication details for Microsoft OAuth authentication. This class uses pydantic for data validation and settings management.

serviceKeyAuthentication SourceMicrosoftOnedriveConfigurationCredentialsServiceKeyAuthentication

ServiceCredentials class for service key authentication. This class is structured similarly to OAuthCredentials but for a different authentication method.

authenticate_via_microsoft_o_auth SourceMicrosoftOnedriveConfigurationCredentialsAuthenticateViaMicrosoftOAuth

OAuthCredentials class to hold authentication details for Microsoft OAuth authentication. This class uses pydantic for data validation and settings management.

service_key_authentication SourceMicrosoftOnedriveConfigurationCredentialsServiceKeyAuthentication

ServiceCredentials class for service key authentication. This class is structured similarly to OAuthCredentials but for a different authentication method.

authenticateViaMicrosoftOAuth Property Map

OAuthCredentials class to hold authentication details for Microsoft OAuth authentication. This class uses pydantic for data validation and settings management.

serviceKeyAuthentication Property Map

ServiceCredentials class for service key authentication. This class is structured similarly to OAuthCredentials but for a different authentication method.

ClientId string

Client ID of your Microsoft developer application

ClientSecret string

Client Secret of your Microsoft developer application

RefreshToken string

Refresh Token of your Microsoft developer application

TenantId string

Tenant ID of the Microsoft OneDrive user

ClientId string

Client ID of your Microsoft developer application

ClientSecret string

Client Secret of your Microsoft developer application

RefreshToken string

Refresh Token of your Microsoft developer application

TenantId string

Tenant ID of the Microsoft OneDrive user

clientId String

Client ID of your Microsoft developer application

clientSecret String

Client Secret of your Microsoft developer application

refreshToken String

Refresh Token of your Microsoft developer application

tenantId String

Tenant ID of the Microsoft OneDrive user

clientId string

Client ID of your Microsoft developer application

clientSecret string

Client Secret of your Microsoft developer application

refreshToken string

Refresh Token of your Microsoft developer application

tenantId string

Tenant ID of the Microsoft OneDrive user

client_id str

Client ID of your Microsoft developer application

client_secret str

Client Secret of your Microsoft developer application

refresh_token str

Refresh Token of your Microsoft developer application

tenant_id str

Tenant ID of the Microsoft OneDrive user

clientId String

Client ID of your Microsoft developer application

clientSecret String

Client Secret of your Microsoft developer application

refreshToken String

Refresh Token of your Microsoft developer application

tenantId String

Tenant ID of the Microsoft OneDrive user

ClientId string

Client ID of your Microsoft developer application

ClientSecret string

Client Secret of your Microsoft developer application

TenantId string

Tenant ID of the Microsoft OneDrive user

UserPrincipalName string

Special characters such as a period, comma, space, and the at sign (@) are converted to underscores (_). More details: https://learn.microsoft.com/en-us/sharepoint/list-onedrive-urls

ClientId string

Client ID of your Microsoft developer application

ClientSecret string

Client Secret of your Microsoft developer application

TenantId string

Tenant ID of the Microsoft OneDrive user

UserPrincipalName string

Special characters such as a period, comma, space, and the at sign (@) are converted to underscores (_). More details: https://learn.microsoft.com/en-us/sharepoint/list-onedrive-urls

clientId String

Client ID of your Microsoft developer application

clientSecret String

Client Secret of your Microsoft developer application

tenantId String

Tenant ID of the Microsoft OneDrive user

userPrincipalName String

Special characters such as a period, comma, space, and the at sign (@) are converted to underscores (_). More details: https://learn.microsoft.com/en-us/sharepoint/list-onedrive-urls

clientId string

Client ID of your Microsoft developer application

clientSecret string

Client Secret of your Microsoft developer application

tenantId string

Tenant ID of the Microsoft OneDrive user

userPrincipalName string

Special characters such as a period, comma, space, and the at sign (@) are converted to underscores (_). More details: https://learn.microsoft.com/en-us/sharepoint/list-onedrive-urls

client_id str

Client ID of your Microsoft developer application

client_secret str

Client Secret of your Microsoft developer application

tenant_id str

Tenant ID of the Microsoft OneDrive user

user_principal_name str

Special characters such as a period, comma, space, and the at sign (@) are converted to underscores (_). More details: https://learn.microsoft.com/en-us/sharepoint/list-onedrive-urls

clientId String

Client ID of your Microsoft developer application

clientSecret String

Client Secret of your Microsoft developer application

tenantId String

Tenant ID of the Microsoft OneDrive user

userPrincipalName String

Special characters such as a period, comma, space, and the at sign (@) are converted to underscores (_). More details: https://learn.microsoft.com/en-us/sharepoint/list-onedrive-urls

Format SourceMicrosoftOnedriveConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

Name string

The name of the stream.

DaysToSyncIfHistoryIsFull double

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

Globs List<string>

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

InputSchema string

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

Schemaless bool

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

ValidationPolicy string

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

Format SourceMicrosoftOnedriveConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

Name string

The name of the stream.

DaysToSyncIfHistoryIsFull float64

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

Globs []string

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

InputSchema string

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

Schemaless bool

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

ValidationPolicy string

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format SourceMicrosoftOnedriveConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name String

The name of the stream.

daysToSyncIfHistoryIsFull Double

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs List<String>

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

inputSchema String

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

schemaless Boolean

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validationPolicy String

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format SourceMicrosoftOnedriveConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name string

The name of the stream.

daysToSyncIfHistoryIsFull number

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs string[]

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

inputSchema string

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

schemaless boolean

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validationPolicy string

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format SourceMicrosoftOnedriveConfigurationStreamFormat

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name str

The name of the stream.

days_to_sync_if_history_is_full float

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs Sequence[str]

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

input_schema str

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

schemaless bool

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validation_policy str

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

format Property Map

The configuration options that are used to alter how to read incoming files that deviate from the standard formatting.

name String

The name of the stream.

daysToSyncIfHistoryIsFull Number

When the state history of the file store is full, syncs will only read files that were last modified in the provided day range. Default: 3

globs List<String>

The pattern used to specify which files should be selected from the file system. For more information on glob pattern matching look \n\nhere\n\n.

inputSchema String

The schema that will be used to validate records extracted from the file. This will override the stream schema that is auto-detected from incoming files.

schemaless Boolean

When enabled, syncs will not validate or structure records against the stream's schema. Default: false

validationPolicy String

The name of the validation policy that dictates sync behavior when a record does not adhere to the stream schema. Default: "Emit Record"; must be one of ["Emit Record", "Skip Record", "Wait for Discover"]

AvroFormat SourceMicrosoftOnedriveConfigurationStreamFormatAvroFormat

CsvFormat SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormat

JsonlFormat SourceMicrosoftOnedriveConfigurationStreamFormatJsonlFormat

ParquetFormat SourceMicrosoftOnedriveConfigurationStreamFormatParquetFormat

UnstructuredDocumentFormat SourceMicrosoftOnedriveConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

AvroFormat SourceMicrosoftOnedriveConfigurationStreamFormatAvroFormat

CsvFormat SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormat

JsonlFormat SourceMicrosoftOnedriveConfigurationStreamFormatJsonlFormat

ParquetFormat SourceMicrosoftOnedriveConfigurationStreamFormatParquetFormat

UnstructuredDocumentFormat SourceMicrosoftOnedriveConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avroFormat SourceMicrosoftOnedriveConfigurationStreamFormatAvroFormat

csvFormat SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormat

jsonlFormat SourceMicrosoftOnedriveConfigurationStreamFormatJsonlFormat

parquetFormat SourceMicrosoftOnedriveConfigurationStreamFormatParquetFormat

unstructuredDocumentFormat SourceMicrosoftOnedriveConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avroFormat SourceMicrosoftOnedriveConfigurationStreamFormatAvroFormat

csvFormat SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormat

jsonlFormat SourceMicrosoftOnedriveConfigurationStreamFormatJsonlFormat

parquetFormat SourceMicrosoftOnedriveConfigurationStreamFormatParquetFormat

unstructuredDocumentFormat SourceMicrosoftOnedriveConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avro_format SourceMicrosoftOnedriveConfigurationStreamFormatAvroFormat

csv_format SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormat

jsonl_format SourceMicrosoftOnedriveConfigurationStreamFormatJsonlFormat

parquet_format SourceMicrosoftOnedriveConfigurationStreamFormatParquetFormat

unstructured_document_format SourceMicrosoftOnedriveConfigurationStreamFormatUnstructuredDocumentFormat

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

avroFormat Property Map

csvFormat Property Map

jsonlFormat Property Map

parquetFormat Property Map

unstructuredDocumentFormat Property Map

Extract text from document formats (.pdf, .docx, .md, .pptx) and emit as one record per file.

DoubleAsString bool

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

DoubleAsString bool

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

doubleAsString Boolean

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

doubleAsString boolean

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

double_as_string bool

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

doubleAsString Boolean

Whether to convert double fields to strings. This is recommended if you have decimal numbers with a high degree of precision because there can be a loss precision when handling floating point numbers. Default: false

Delimiter string

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

DoubleQuote bool

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

Encoding string

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

EscapeChar string

The character used for escaping special characters. To disallow escaping, leave this field blank.

FalseValues List<string>

A set of case-sensitive strings that should be interpreted as false values.

HeaderDefinition SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

IgnoreErrorsOnFieldsMismatch bool

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

NullValues List<string>

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

QuoteChar string

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

SkipRowsAfterHeader double

The number of rows to skip after the header row. Default: 0

SkipRowsBeforeHeader double

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

StringsCanBeNull bool

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

TrueValues List<string>

A set of case-sensitive strings that should be interpreted as true values.

Delimiter string

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

DoubleQuote bool

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

Encoding string

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

EscapeChar string

The character used for escaping special characters. To disallow escaping, leave this field blank.

FalseValues []string

A set of case-sensitive strings that should be interpreted as false values.

HeaderDefinition SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

IgnoreErrorsOnFieldsMismatch bool

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

NullValues []string

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

QuoteChar string

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

SkipRowsAfterHeader float64

The number of rows to skip after the header row. Default: 0

SkipRowsBeforeHeader float64

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

StringsCanBeNull bool

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

TrueValues []string

A set of case-sensitive strings that should be interpreted as true values.

delimiter String

The character delimiting individual cells in the CSV data. This may only be a 1-character string. For tab-delimited data enter '\t'. Default: ","

doubleQuote Boolean

Whether two quotes in a quoted CSV value denote a single quote in the data. Default: true

encoding String

The character encoding of the CSV data. Leave blank to default to \n\nUTF8\n\n. See \n\nlist of python encodings\n\n for allowable options. Default: "utf8"

escapeChar String

The character used for escaping special characters. To disallow escaping, leave this field blank.

falseValues List<String>

A set of case-sensitive strings that should be interpreted as false values.

headerDefinition SourceMicrosoftOnedriveConfigurationStreamFormatCsvFormatHeaderDefinition

How headers will be defined. User Provided assumes the CSV does not have a header row and uses the headers provided and Autogenerated assumes the CSV does not have a header row and the CDK will generate headers using for f{i} where i is the index starting from 0. Else, the default behavior is to use the header from the CSV file. If a user wants to autogenerate or provide column names for a CSV having headers, they can skip rows.

ignoreErrorsOnFieldsMismatch Boolean

Whether to ignore errors that occur when the number of fields in the CSV does not match the number of columns in the schema. Default: false

nullValues List<String>

A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field.

quoteChar String

The character used for quoting CSV values. To disallow quoting, make this field blank. Default: """

skipRowsAfterHeader Double

The number of rows to skip after the header row. Default: 0

skipRowsBeforeHeader Double

The number of rows to skip before the header row. For example, if the header row is on the 3rd row, enter 2 in this field. Default: 0

stringsCanBeNull Boolean

Whether strings can be interpreted as null values. If true, strings that match the nullvalues set will be interpreted as null. If false, strings that match the nullvalues set will be interpreted as the string itself. Default: true

trueValues List<String>

A set of case-sensitive strings that should be interpreted as true values.