Configuration
A single configuration file is needed. The config file should be placed in the catalog folder (e.g.,
/etc/trino/conf/catalog on EMR) and named tiledb.properties.Sample file contents:
connector.name=tiledb
# Set read buffer to 10M per attribute
read-buffer-size=10485760
The following parameters can be configured in the
tiledb.properties and are plugin-wide.Parameter | Default | Datatype | Description |
array-uris | "" | String | CSV list of arrays to preload metadata on |
read-buffer-size | 10485760 | Integer | Max read buffer size per attribute |
write-buffer-size | 10485760 | Integer | Max write buffer size per attribute |
aws-access-key-id | "" | String | AWS_ACCESS_KEY_ID for S3 access |
aws-secret-access-key | "" | String | AWS_SECRET_ACCESS_KEY for S3 access |
tiledb-config | "" | String | TileDB config parameters in key1=value1,key2=value2 form |
These can be set as follows:
SQL
set session tiledb.<param>=<value>
// E.g., set session tiledb.splits=10
Unset session parameters inherit the plugin configuration defaults. The list of session parameters is summarized below"
Name | Default | Datatype | Description |
read_buffer_size | Plugin | Integer | Max read buffer size per attribute |
write_buffer_size | Plugin | Integer | Max write buffer size per attribute |
aws_access_key_id | Plugin | String | AWS_ACCESS_KEY_ID for S3 access |
aws_secret_access_key | Plugin | String | AWS_SECRET_ACCESS_KEY for S3 access |
splits | -1 | Integer | Number of splits to use per query, -1 means splits will be equal to number of workers |
split_only_predicates | false | Boolean | Split only based on predicates pushed down from where clause |
enable_stats | false | Boolean | Enable collecting and dumping connector stats to Trino log |
tiledb_config | "" | String | TileDB config parameters in key1=value1,key2=value2 form |
These are set upon table creation as follows:
SQL
create table my_table(
...
) with (uri = '<array-uri>', type='SPARSE', cell_order='ROW_MAJOR`, ...);
Name | Description | Default | Possible Values | Required |
uri | Array URI | "" | * | Yes |
type | Array type | SPARSE | SPARSE, DENSE | No |
cell_order | Cell order | ROW_MAJOR | ROW_MAJOR, COL_MAJOR | No |
tile_order | Tile order | ROW_MAJOR | ROW_MAJOR, COL_MAJOR | No |
capacity | Tile capacity | 10000L | >0 | No |
These are set upon table creation as follows:
SQL
create table my_table(
dim0 bigint with (dimension=true, lower_bound=0, upper_bound=100, extent=10),
...
) with (uri = '<array-uri>', type = 'SPARSE');
Name | Description | Default | Possible Values | Required |
dimension | Column is a dimension | False | True, False | No |
lower_bound | Domain lower bound | 0L | Any Long Value | No |
upper_bound | Domain upper bound | Long.MAX_VALUE | Any Long Value | No |
extent | Tile extent | 10L | Any Long Value | No |
Last modified 4mo ago