Skip to content

Commit

Permalink
reformat all meltanolabs sdk variants (meltano#1228)
Browse files Browse the repository at this point in the history
  • Loading branch information
pnadolny13 authored Apr 5, 2023
1 parent 7fe40b5 commit f8a4e11
Show file tree
Hide file tree
Showing 17 changed files with 443 additions and 442 deletions.
24 changes: 12 additions & 12 deletions _data/meltano/extractors/tap-circle-ci/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
capabilities:
- about
- catalog
- state
- discover
- about
- state
- stream-maps
description: CI/CD Platfrom
domain_url: https://circleci.com/
Expand All @@ -18,26 +18,26 @@ next_steps: ''
pip_url: git+https://github.com/MeltanoLabs/tap-circle-ci.git
repo: https://github.com/MeltanoLabs/tap-circle-ci
settings:
- description: The API base URL to use for requests. Default, https://circleci.com/api/v2.
kind: string
label: Base Url
name: base_url
- description: 'Organization slug in the form vcs-slug/org-name. Example: org-slug=gh/CircleCI-Public'
kind: string
label: Org Slug
name: org_slug
- description: Personal API Token you have generated that can be used to access the
CircleCI API
kind: password
label: Token
name: token
- description: 'Organization slug in the form vcs-slug/org-name. Example: org-slug=gh/CircleCI-Public'
kind: string
label: Org Slug
name: org_slug
- description: The API base URL to use for requests. Default, https://circleci.com/api/v2.
kind: string
label: Base Url
name: base_url
- description: User-Agent header
kind: string
label: User Agent
name: user_agent
settings_group_validation:
- - token
- org_slug
- - org_slug
- token
settings_preamble: ''
usage: ''
variant: meltanolabs
90 changes: 45 additions & 45 deletions _data/meltano/extractors/tap-cloudwatch/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
capabilities:
- about
- catalog
- state
- discover
- about
- stream-maps
- schema-flattening
- state
- stream-maps
description: AWS Application and Infrastructure Monitoring
domain_url: https://aws.amazon.com/cloudwatch/
executable: tap-cloudwatch
Expand All @@ -23,47 +23,28 @@ settings:
kind: password
label: AWS Access Key Id
name: aws_access_key_id
- description: The secret key for your AWS account.
kind: password
label: AWS Secret Access Key
name: aws_secret_access_key
- description: The session key for your AWS account. This is only needed when you
are using temporary credentials.
kind: password
label: AWS Session Token
name: aws_session_token
- description: The complete URL to use for the constructed client.
kind: string
label: AWS Endpoint Url
name: aws_endpoint_url
- description: The AWS credentials profile name to use. The profile must be configured
and accessible.
kind: string
label: AWS Profile
name: aws_profile
- description: The complete URL to use for the constructed client.
kind: string
label: AWS Endpoint Url
name: aws_endpoint_url
- description: 'The AWS region name (e.g. us-east-1) '
kind: string
label: AWS Region Name
name: aws_region_name
- description: The earliest record date to sync
kind: date_iso8601
label: Start Date
name: start_date
- description: The last record date to sync. This tap uses a 5 minute buffer to allow
Cloudwatch logs to arrive in full. If you request data from current time it will
automatically adjust your end_date to now - 5 mins.
kind: date_iso8601
label: End Date
name: end_date
- description: The log group on which to perform the query.
kind: string
label: Log Group Name
name: log_group_name
- description: The query string to use. For more information, see [CloudWatch Logs
Insights Query Syntax](https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_QuerySyntax.html).
kind: string
label: Query
name: query
- description: The secret key for your AWS account.
kind: password
label: AWS Secret Access Key
name: aws_secret_access_key
- description: The session key for your AWS account. This is only needed when you
are using temporary credentials.
kind: password
label: AWS Session Token
name: aws_session_token
- description: The size of the time window to query by, default 3,600 seconds (i.e.
1 hour). If the result set for a batch is greater than the max limit of 10,000
records then the tap will query the same window again where >= the most recent
Expand All @@ -76,15 +57,12 @@ settings:
kind: integer
label: Batch Increment S
name: batch_increment_s
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: The last record date to sync. This tap uses a 5 minute buffer to allow
Cloudwatch logs to arrive in full. If you request data from current time it will
automatically adjust your end_date to now - 5 mins.
kind: date_iso8601
label: End Date
name: end_date
- description: "'True' to enable schema flattening and automatically expand nested\
\ properties."
kind: boolean
Expand All @@ -94,10 +72,32 @@ settings:
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: The log group on which to perform the query.
kind: string
label: Log Group Name
name: log_group_name
- description: The query string to use. For more information, see [CloudWatch Logs
Insights Query Syntax](https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_QuerySyntax.html).
kind: string
label: Query
name: query
- description: The earliest record date to sync
kind: date_iso8601
label: Start Date
name: start_date
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation:
- - log_group_name
- start_date
- query
- start_date
settings_preamble: ''
usage: ''
variant: meltanolabs
46 changes: 23 additions & 23 deletions _data/meltano/extractors/tap-csv/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
capabilities:
- discover
- catalog
- discover
description: Generic data extractor of CSV (comma separated value) files
domain_url: https://en.wikipedia.org/wiki/Comma-separated_values
keywords:
Expand All @@ -14,6 +14,28 @@ namespace: tap_csv
pip_url: git+https://github.com/MeltanoLabs/tap-csv.git
repo: https://github.com/MeltanoLabs/tap-csv
settings:
- description: When True, add the metadata columns (`_sdc_source_file`, `_sdc_source_file_mtime`,
`_sdc_source_lineno`) to output.
kind: boolean
label: Add Metadata Columns
name: add_metadata_columns
- description: |
Project-relative path to JSON file holding array of objects as described under [Files](#files) - with `entity`, `path`, `keys`, and other optional keys:
```json
[
{
"entity": "<entity>",
"path": "<path>",
"keys": ["<key>"],
},
// ...
]
```
documentation: https://github.com/MeltanoLabs/tap-csv#settings
label: CSV Files Definition
name: csv_files_definition
placeholder: Ex. files-def.json
- description: |
Array of objects with `entity`, `path`, `keys`, and `encoding` [Optional] keys:
Expand All @@ -36,28 +58,6 @@ settings:
kind: array
label: Files
name: files
- description: |
Project-relative path to JSON file holding array of objects as described under [Files](#files) - with `entity`, `path`, `keys`, and other optional keys:
```json
[
{
"entity": "<entity>",
"path": "<path>",
"keys": ["<key>"],
},
// ...
]
```
documentation: https://github.com/MeltanoLabs/tap-csv#settings
label: CSV Files Definition
name: csv_files_definition
placeholder: Ex. files-def.json
- description: When True, add the metadata columns (`_sdc_source_file`, `_sdc_source_file_mtime`,
`_sdc_source_lineno`) to output.
kind: boolean
label: Add Metadata Columns
name: add_metadata_columns
settings_group_validation:
- - files
- - csv_files_definition
Expand Down
42 changes: 21 additions & 21 deletions _data/meltano/extractors/tap-dbt/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
capabilities:
- about
- catalog
- state
- discover
- about
- stream-maps
- schema-flattening
- state
- stream-maps
description: Analytics Engineering Platform
domain_url: https://www.getdbt.com/product/
keywords:
Expand All @@ -18,29 +18,17 @@ namespace: tap_dbt
pip_url: git+https://github.com/meltanolabs/tap-dbt.git
repo: https://github.com/meltanolabs/tap-dbt
settings:
- description: API key for the dbt Cloud API
kind: password
label: Api Key
name: api_key
- description: dbt Cloud account IDs
kind: array
label: Account Ids
name: account_ids
- description: API key for the dbt Cloud API
kind: password
label: Api Key
name: api_key
- description: Base URL for the dbt Cloud API
label: Base Url
name: base_url
- description: User-Agent to make requests with
label: User Agent
name: user_agent
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: "'True' to enable schema flattening and automatically expand nested\
\ properties."
kind: boolean
Expand All @@ -50,7 +38,19 @@ settings:
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
- description: User-Agent to make requests with
label: User Agent
name: user_agent
settings_group_validation:
- - api_key
- account_ids
- - account_ids
- api_key
variant: meltanolabs
32 changes: 16 additions & 16 deletions _data/meltano/extractors/tap-duckdb/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
capabilities:
- about
- catalog
- state
- discover
- about
- stream-maps
- schema-flattening
- state
- stream-maps
description: DuckDB is an in-process SQL OLAP database management system
domain_url: https://duckdb.org/
executable: tap-duckdb
Expand All @@ -20,19 +20,6 @@ next_steps: ''
pip_url: git+https://github.com/MeltanoLabs/tap-duckdb.git
repo: https://github.com/MeltanoLabs/tap-duckdb
settings:
- description: Path to .duckdb file
kind: string
label: Path
name: path
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: "'True' to enable schema flattening and automatically expand nested\
\ properties."
kind: boolean
Expand All @@ -42,6 +29,19 @@ settings:
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: Path to .duckdb file
kind: string
label: Path
name: path
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation:
- - path
settings_preamble: ''
Expand Down
Loading

0 comments on commit f8a4e11

Please sign in to comment.