Default Tabular Databases

Understanding Default Tabular Databases

When you create a new warehouse, Tabular automatically mounts 3 default databases into the warehouse:

  • Default
  • Examples
  • System

The Default database is empty. You can rename this database (although you do not have to) and populate it with any other data you wish. (You can rename a database after you have loaded data into it, but we don’t recommend doing so.) You can also modify the settings of any table you load into this database.

The Examples database comes with several Iceberg tables already mounted. Some of these contain sample (genuine) data; others have mock data. You can experiment with either as you wish. You don’t need to load data into the system before exploring.

The System database contains Iceberg tables pre-mounted with data specific to the region in which the warehouse resides. If you have warehouses in multiple regions, you will have system tables in each region. Further, system tables are the same organization-wide; they all contain data from all of the regions in which you’re working.

Note You can load new data only into the Default database. But you can run queries against the data in tables in the Example and the System databases.

Below are the schema fields for each of these system tables.

Catalog Events

Field NameTypeRequiredDescription
event_idstringOptionalUnique ID for this event.
event_tstimestamptzOptionalTimestamp of when the event occurred.
event_typestringOptionalEvent type name (e.g., CreateDatabase, UpdateTable, etc.).
tabular_servicebooleanOptionalTrue if the event was performed by a Tabular service.
member_idstringOptionalOrganization member ID within Tabular.
credentials_keystringOptionalKey part of credentials used.
warehouse_idstringOptionalTabular warehouse UUID.
warehouse_namestringOptionalName of the warehouse the event pertains to.
database_idstringOptionalTabular database UUID.
database_namestringOptionalName of the database the event pertains to.
table_reference_idstringOptionalTabular table reference UUID
table_namestringOptionalName of the table the event pertains to.
table_changeslistOptionalList of Iceberg MetadataUpdate class name changes if the event was an UpdateTable (e.g., AddSnapshot, AddSchema, etc.).

S3 Access Logs

Field NameTypeRequiredDescription
bucket_ownerstringOptionalAWS User ID of the Amazon S3 source bucket.
bucketstringOptionalName of the S3 bucket that the file is in.
request_tstimestamptzOptionalTimestamp at which the S3 request was received by AWS.
remote_ipstringOptionalApparent internet address of the requester.
requesterstringOptionalAWS User ID of the requester.
request_idstringOptionalUnique ID for each S3 request (generated by AWS).
operation_mechanismstringOptionalParsed from S3 Operation (MECHANISM.method.resource_type), e.g., REST.
operation_methodstringOptionalParsed from S3 Operation (mechanism.METHOD.resource_type), e.g., PUT.
operation_resource_typestringOptionalParsed from S3 Operation (mechanism.method.RESOURCE_TYPE), e.g., OBJECT.
keystringOptionalKey portion of the HTTP request message represented as an encoded URL.
request_uristringOptionalRequest URI part of the HTTP request message.
http_status_codeintRequiredHTTP status code of the response.
s3_error_codestringOptionalAmazon S3 error code.
bytes_sentlongOptionalNumber of response bytes sent, excluding HTTP protocol overhead.
object_sizelongOptionalTotal size of the S3 object.
total_timelongOptionalNumber of ms the request was in flight from the server's perspective.
turn_around_timelongOptionalNumber of ms that Amazon S3 spent processing your request.
referrerstringOptionalValue of the Referrer header if present.
user_agentstringOptionalValue of the HTTP User-Agent header.
version_idstringOptionalVersion ID of the request (generated by AWS).
host_idstringOptionalx-amz-id-2 or Amazon S3 extended request ID.
signature_versionstringOptionalVersion of the Amazon S3 bucket signature, SigV2 or SigV4.
cipher_suitestringOptionalSSL (Secure Sockets Layer) cipher used for an HTTPS request.
authentication_typestringOptionalQueryString for query strings, and AuthHeader for authentication headers.
s3_endpointstringOptionalAmazon S3 endpoint.
tls_versionstringOptionalTransport Layer Security (TLS) version that is used by the client.
arnstringOptionalAmazon Resource Name (ARN) of the access point of the request.
s3_request_link_idstringOptionalTabular generated UUID to link access log to sign request.
processed_tstimestamptzOptionalProcessing timestamp of this access log.
regionstringOptionalAWS region where the bucket resides.
warehouse_idstringOptionalTabular warehouse UUID (null if outside warehouse scope).
table_idstringOptionalTabular table UUID (null if outside table scope).
resource_typestringOptionalIceberg table file resource type DATA or METADATA (or null if outside table scope).
warehouse_namestringOptionalWarehouse name in Tabular.
database_namestringOptionalDatabase name for which the file in the S3 request belongs to.
table_namestringOptionalTable name for which the file in the S3 request belongs to.

S3 Inventory List

Field NameTypeRequiredDescription
processed_tstimestamptzYesProcessing timestamp of this inventory list.
regionstringYesAWS region where the bucket resides.
bucketstringYesName of the S3 bucket that the file is in.
warehouse_idstringOptionalTabular warehouse UUID (null if outside warehouse scope).
table_idstringOptionalTabular table UUID (null if outside table scope).
resource_typestringOptionalIceberg table file resource type DATA or METADATA (or null if outside table scope).
keystringOptionalS3 object key (i.e., everything past the bucket name in URI).
version_idstringOptionalS3 object version ID.
is_latestbooleanOptionalTrue if the S3 object is the current version of the object.
is_delete_markerbooleanOptionalTrue if the S3 object is a delete marker.
sizelongOptionalObject size in bytes.
last_modified_datetimestamptzOptionalTimestamp of object creation date or the last modified date, whichever is the latest.
e_tagstringOptionalHash of the S3 object.
storage_classstringOptionalS3 storage class used for storing the S3 object (see S3 storage classes for more info).
is_multipart_uploadedbooleanOptionalTrue if the S3 object was uploaded as a multipart upload.
replication_statusstringOptionalReplication status (PENDING, COMPLETED, FAILED, or REPLICA).
encryption_statusstringOptionalServer-side encryption status (NOT-SSE means no encryption).
object_lock_retain_until_datetimestamptzOptionalTimestamp of date until which the locked S3 object cannot be deleted.
object_lock_modestringOptionalGovernance or Compliance for S3 objects that are locked.
object_lock_legal_hold_statusstringOptionalOn if a legal hold has been applied to an S3 object.
intelligent_tiering_access_tierstringOptionalAccess tier of the S3 object if stored in Intelligent-Tiering.
bucket_key_statusstringOptionalIndicates whether the S3 object uses S3 Bucket Key for server-side encryption.
warehouse_namestringOptionalWarehouse name in Tabular.
database_namestringOptionalDatabase name for which the file in the S3 bucket belongs to.
table_namestringOptionalTable name for which the file in the S3 bucket belongs to.

Sign Events

Field NameTypeRequiredDescription
event_idstringOptionalUnique ID for this sign event.
event_tstimestamptzOptionalTimestamp of when the sign request occurred.
bucketstringOptionalName of the S3 bucket that the object is in.
regionstringOptionalAWS region where the bucket resides.
warehouse_idstringOptionalTabular warehouse UUID (null if outside warehouse scope).
table_idstringOptionalTabular table UUID (null if outside table scope).
tabular_servicebooleanOptionalTrue if sign event is part of an action/operation performed by a Tabular service.
member_idstringOptionalOrganization member ID within Tabular.
credentials_keystringOptionalKey part of warehouse credentials used.
token_idstringOptionalUnique ID from token used in this sign request.
session_idstringOptionalUnique ID for the session this sign request was part of.
methodstringOptionalS3 Operation method.
request_uristringOptionalRequest URI part of the HTTP request message.
resource_typestringOptionalIceberg table file resource type DATA or METADATA (or null if outside table scope).
user_agentstringOptionalValue of the HTTP User-Agent Header.
remote_ipstringOptionalApparent internet address of the requester.
signedbooleanOptionalTrue if the request was successfully signed, else false.
sign_errorstringOptionalException occurred during signing (null if signed = true).
s3_request_link_idstringOptionalUnique ID logged as part of the sign event and S3 request.
warehouse_namestringOptionalWarehouse name in Tabular.
database_namestringOptionalDatabase name for which the file in the S3 request belongs to.
table_namestringOptionalTable name for which the file in the S3 request belongs to.

Table Scan Events

Field NameTypeRequiredDescription
event_idstringOptionalUnique ID for this scan event.
event_tstimestamptzOptionalTimestamp of when the scan event occurred.
tabular_servicebooleanOptionalTrue if the table scan event is part of an action/operation performed by a Tabular service.
member_idstringOptionalOrganization member ID within Tabular.
credentials_keystringOptionalKey part of warehouse credentials used.
token_idstringOptionalUnique ID from token used to create this snapshot.
session_idstringOptionalUnique ID for the session this snapshot was a part of.
warehouse_idstringOptionalTabular warehouse UUID.
warehouse_namestringOptionalTabular warehouse name.
database_idstringOptionalTabular database UUID.
database_namestringOptionalTabular database name.
table_idstringOptionalTabular table UUID.
table_namestringOptionalTabular table name.
snapshot_cntlongOptionalNumber of snapshots in the table snapshot log.
snapshot_oldest_tstimestamptzOptionalTimestamp of the oldest snapshot in the snapshot log.
snapshot_idlongOptionalThe snapshot ID of the table at the time when the scan event occurred.
schema_idintOptionalNo description.
filterstringOptionalThe used expression filter.
filter_as_jsonstringOptionalThe used expression filter as a JSON string.
projected_field_idslistOptionalNo description.
projected_field_nameslistOptionalThe projected field names.
metadatamapOptionalAdditional metadata.
total_duration_nanoslongOptionalTotal scan planning duration in nanoseconds.
result_data_fileslongOptionalNumber of result data files.
result_delete_fileslongOptionalNumber of result delete files.
skipped_data_fileslongOptionalNumber of skipped data files.
skipped_delete_fileslongOptionalNumber of skipped delete files.
total_file_size_byteslongOptionalTotal size in bytes of all result data files.
total_delete_file_size_byteslongOptionalTotal size in bytes of all result delete files.
scanned_data_manifestslongOptionalNumber of scanned data manifests.
skipped_data_manifestslongOptionalNumber of skipped data manifests.
total_data_manifestslongOptionalTotal number of data manifests.
scanned_delete_manifestslongOptionalNumber of scanned delete manifests.
skipped_delete_manifestslongOptionalNumber of skipped delete manifests.
total_delete_manifestslongOptionalTotal number of delete manifests.
indexed_delete_fileslongOptionalTotal number of indexed delete files.
equality_delete_fileslongOptionalTotal number of equality delete files.
positional_delete_fileslongOptionalTotal number of positional delete files.

Table Snapshot Events

Field NameTypeRequiredDescription
event_idstringOptionalUnique ID for this table snapshot event.
event_tstimestamptzOptionalTimestamp of when the snapshot event occurred.
tabular_servicebooleanOptionalTrue if the table snapshot event is part of an action/operation performed by a Tabular service.
member_idstringOptionalOrganization member ID within Tabular.
credentials_keystringOptionalKey part of warehouse credentials used.
token_idstringOptionalUnique ID from token used to create this snapshot.
session_idstringOptionalUnique ID for the session this snapshot was a part of.
warehouse_idstringOptionalTabular warehouse UUID.
warehouse_namestringOptionalTabular warehouse name.
database_idstringOptionalTabular database UUID.
database_namestringOptionalTabular database name.
table_idstringOptionalTabular table UUID.
table_namestringOptionalTabular table name.
snapshot_cntlongOptionalNumber of snapshots in the table snapshot log.
snapshot_oldest_tstimestamptzOptionalTimestamp of the oldest snapshot in the snapshot log.
parent_snapshot_idlongOptionalID of the previous snapshot.
snapshot_idlongOptionalID of the snapshot for this operation/commit.
snapshot_seq_nbrlongOptionalThe sequence number of this snapshot (only relevant for v2 iceberg tables).
enginestructOptionalEngine-specific info coming through the snapshot summary.
operationstringOptionalType of operation for this snapshot/commit (e.g., append, replace, etc.).
added_data_fileslongOptionalNumber of data files added in this commit.
added_delete_fileslongOptionalNumber of delete files added in this commit.
added_eq_delete_fileslongOptionalNumber of equality delete files added in this commit.
added_pos_delete_fileslongOptionalNumber of position delete files added in this commit.
added_recordslongOptionalNumber of records added in this commit.
added_eq_deleteslongOptionalNumber of equality deletes added in this commit.
added_pos_deleteslongOptionalNumber of position deletes added in this commit.
added_file_sizeslongOptionalAdded file size for this commit.
deleted_data_fileslongOptionalNumber of data files deleted in this commit.
deleted_duplicate_fileslongOptionalNumber of duplicate files deleted in this commit.
deleted_recordslongOptionalNumber of records deleted in this commit.
removed_delete_fileslongOptionalNumber of delete files removed in this commit.
removed_eq_delete_fileslongOptionalNumber of equality delete files removed in this commit.
removed_pos_delete_fileslongOptionalNumber of position delete files removed in this commit.
removed_eq_deleteslongOptionalNumber of equality deletes removed in this commit.
removed_pos_deleteslongOptionalNumber of position deletes removed in this commit.
removed_file_sizeslongOptionalRemoved file size for this commit.
changed_partition_cntlongOptionalNumber of partitions that were affected in this commit.
partition_summarieslistOptionalList of snapshot data counts by partition.
total_data_fileslongOptionalTotal number of data files for the table as of this snapshot.
total_recordslongOptionalTotal number of records for the table as of this snapshot.
total_file_sizeslongOptionalTotal file size for the table as of this snapshot.
total_delete_fileslongOptionalTotal number of delete files for the table as of this snapshot.
total_eq_deleteslongOptionalTotal number of equality deletes for the table as of this snapshot.
total_pos_deleteslongOptionalTotal number of position deletes for the table as of this snapshot.