System Catalog
The system catalog exposes read-only virtual tables that contain metadata about the system.
- sys.active_operator_instances
- sys.association_rules_models
- sys.average_bb_sizes
- sys.average_column_sizes
- sys.channel_endpoint_parameters
- sys.clusters
- sys.columns
- sys.columns_compression_info
- sys.column_cardinalities
- sys.column_distributions
- sys.completed_queries
- sys.completed_operator_instances
- sys.compute_configurations
- sys.config
- sys.connectivity_pools
- sys.connectivity_pool_participants
- sys.databases
- sys.decision_tree_models
- sys.feedforward_network_models
- sys.function_signatures
- sys.gaussian_mixture_models
- sys.global_map_table_info
- sys.groups
- sys.group_roles
- sys.indexes
- sys.index_columns
- sys.k_means_models
- sys.k_nearest_neighbors_models
- sys.linear_combination_regression_models
- sys.linear_discriminant_analysis_models
- sys.locks
- sys.logistic_regression_models
- sys.lts_cluster_info
- sys.machine_learning_models
- sys.machine_learning_model_options
- sys.metric_levels
- sys.multiple_linear_regression_models
- sys.naive_bayes_models
- sys.network_interface_models
- sys.network_interface_usage_types
- sys.nodes
- sys.node_config
- sys.node_clusters
- sys.node_network_interfaces
- sys.node_status
- sys.nonlinear_regression_models
- sys.oidc_integrations
- sys.oidc_sessions
- sys.op_inst_debug_info
- sys.osn_acquisitions
- sys.pipelines
- sys.pipeline_files
- sys.pipeline_tables
- sys.pipeline_task_ids
- sys.polynomial_regression_models
- sys.principal_component_analysis_models
- sys.privileges
- sys.queries
- sys.reserved_words
- sys.result_cache
- sys.rights
- sys.roles
- sys.security_integrations
- sys.security_settings
- sys.segments
- sys.segments_compression_info
- sys.segment_group_transfers
- sys.segment_groups
- sys.segment_parts
- sys.segment_part_redundancy_info
- sys.service_classes
- sys.service_roles
- sys.service_role_status
- sys.service_role_channel_endpoints
- sys.sessions
- sys.simple_linear_regression_models
- sys.sql_messages
- sys.stats_files
- sys.storage_capacity
- sys.storage_device_metrics
- sys.storage_device_status
- sys.storage_scopes
- sys.storage_spaces
- sys.storage_used
- sys.stored_segments
- sys.subtasks
- sys.support_vector_machine_models
- sys.system_information
- sys.system_tables
- sys.system_table_columns
- sys.tables
- sys.table_cardinalities
- sys.tkt_table_clustering_column_indices
- sys.tkt_table_info
- sys.users
- sys.user_groups
- sys.user_roles
- sys.vector_autoregression_models
- sys.view_columns
- sys.views
- sys.vl_columns_compression_info
- Configuration
- Connectivity Pool Participants
- Connectivity Pools
- Databases
- Functions
- Machine Learning
- Monitoring
- Network
- Pipelines
- Procedures
- SQL Messages
- Security
- Security Integrations
- Statistics
- Storage
- System
- System Information
- User Management
- Workload Management
This table contains all configuration overrides applied on the system.
Column Name | Column Type | Column Description |
scope_type | CHAR | Type of the scope. |
scope_id | UUID | UUID of the storage scope where this override applies. |
key | CHAR | String that represents the configuration parameter. |
value | CHAR | Value for the configuration parameter key. |
This table contains the effective node configuration for all nodes in the system.
Column Name | Column Type | Column Description |
node_id | UUID | UUID of the node where this configuration exists (sys.nodes). |
key | CHAR | String that represents the configuration parameter. |
value | CHAR | Value for the configuration parameter key. |
This table contains the connectivity pool participants and their information.
Column Name | Column Type | Column Description |
id | UUID | UUID of the connectivity pool that contains the participant. |
node_id | UUID | UUID of the participant node. |
created_at | TIMESTAMP | Timestamp that indicates the creation of the connectivity pool participant. |
updated_at | TIMESTAMP | Timestamp that indicates the last update of the connectivity pool participant. |
listen_address | CHAR | Address where the participant node listens. |
listen_port | INT | Port number where the participant node listens. |
advertised_address | CHAR | Address that the participant node advertises to the client. |
advertised_port | INT | Optional port number that the participant node advertises to the client. |
This table contains the connectivity pools and their information (excluding participants).
Column Name | Column Type | Column Description |
id | UUID | UUID of the connectivity pool. |
name | CHAR | Name of the connectivity pool. |
created_at | TIMESTAMP | Timestamp that indicates the creation of the connectivity pool. |
updated_at | TIMESTAMP | Timestamp that indicates the last update of the connectivity pool. |
source_address | CHAR | Source address in CIDR notation for the connectivity pool. |
source_port | INT | Optional source port of the connectivity pool. |
priority | INT | Priority of the connectivity pool. |
This table contains all columns in each table in the system.
Column Name | Column Type | Column Description |
id | UUID | UUID of the column. |
name | CHAR | Name of the column. |
data_type | CHAR | Data type of the column (INT, CHAR, BOOLEAN, etc.). |
position | INT | Position of the column in its table. |
table_id | UUID | UUID of the table that contains this column (sys.tables). |
nullable | BOOLEAN | Specifies whether the values in this column can be NULL. |
default_expression | CHAR | Default value of this column when the value is unspecified. |
description | CHAR | Description of the column. |
ordinal | LONG | Ordinal of the column with respect to its table. |
gdc_type | CHAR | Type of GDC applied to this column. |
This table contains all databases defined in the system.
Column Name | Column Type | Column Description |
id | UUID | UUID of the database. |
name | CHAR | Name of the database. |
created_at | TIMESTAMP | Timestamp that specifies when the database was created. |
This table contains the global dictionary compression (GDC) details associated with each compressed column.
Column Name | Column Type | Column Description |
table_id | UUID | UUID of the table (sys.tables). |
column_id | UUID | UUID of the column (sys.columns). |
compressed_size | INT | Compressed column size (in bytes). |
max_count | LONG | Maximum amount of unique column values allowed in the column. |
current_count | LONG | Current amount of unique column values in the column. |
This table contains all indexes defined on tables.
Column Name | Column Type | Column Description |
id | UUID | UUID of the index. |
name | CHAR | Name of the index. |
index_type | CHAR | Type of the index. |
table_id | UUID | UUID of the table for the index (sys.tables). |
index_use | CHAR | Intended use for the index by the system. |
ngram_size | INT | Size of each N-gram (in bytes). |
enabled | BOOLEAN | Whether the index is enabled on this table. |
This table contains the index settings applied to each column.
Column Name | Column Type | Column Description |
index_id | UUID | UUID that represents the index (sys.indexes). |
column_id | UUID | UUID that represents the column (sys.columns). |
ordinal | INT | Ordinal of the column in the index structure. |
tuple_element | CHAR | Specifies the name of the component column that the index applies to if the index exists on a tuple column. |
ascending | BOOLEAN | Indicates whether the values in this column are built in ascending order. |
column_ordinal | LONG | Ordinal position of this column in the source table. |
This table contains all tables defined in the system.
Column Name | Column Type | Column Description |
id | UUID | UUID of the table (sys.tables). |
name | CHAR | Name of the table. |
schema | CHAR | Schema name in which the table resides. |
database_id | UUID | UUID of the database (sys.databases). |
storage_space_id | UUID | UUID of the storage space (sys.storage_spaces). |
maximum_segment_size_gib | INT | Maximum size of a segment for the table in GiB. |
description | CHAR | Detailed description of the table. |
streamloader_property_string | CHAR | Additional properties assigned to control the stream loading behavior for the table. |
created_at | TIMESTAMP | Timestamp that represents when the table was created. |
altered_at | TIMESTAMP | Timestamp that represents when the table's structure was last modified via DDL. |
This table contains the columns defined as part of a clustering index.
Column Name | Column Type | Column Description |
table_id | UUID | UUID of the table (sys.tables). |
column_id | UUID | UUID of the column (sys.columns). |
This table contains the columns that are defined as the time key on each user-defined table and the size of the time bucket in use.
Column Name | Column Type | Column Description |
table_id | UUID | UUID of the table (sys.tables). |
time_column_id | UUID | UUID of the column that represents the time column on the table (sys.columns). |
time_bucket_width | LONG | Time bucket width used to segment data in nanoseconds. |
This table contains all columns in each view in the system.
Column Name | Column Type | Column Description |
id | UUID | The UUID of the column. |
name | CHAR | The name of the column. |
data_type | CHAR | The data type of the column. |
view_id | UUID | The UUID of the view this column comes from. |
nullable | BOOLEAN | Whether or not this column is nullable. |
default_expression | CHAR | The default expression of this column, if it exists. |
ordinal | LONG | The ordinal of this column. |
This table contains all user-defined database views created on the system.
Column Name | Column Type | Column Description |
id | UUID | UUID of the view. |
name | CHAR | Name of the view. |
database_id | UUID | UUID of the database (sys.databases). |
schema | CHAR | Schema name where the view exists. |
query | CHAR | Query used to generate the view content. |
description | CHAR | Detailed description of the view. |
view_type | CHAR | Type of the view. |
global_dictionary_compression_table_id | UUID | UUID of the table with the GDC column (sys.tables). |
created_at | TIMESTAMP | Timestamp that represents the date and time for the creation of the view. |
updated_at | TIMESTAMP | Timestamp that represents the date and time for the last update of the view. |
This table contains the name of the snapshot table for an association rules model.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
num_arguments | INT | Number of arguments in the machine learning model data. |
table_name | CHAR | Name of the snapshot table. |
This table contains all model parameters for Decision Tree Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
case_statement | CHAR | The case statement that defines the decision tree. |
num_arguments | INT | Number of arguments in the machine learning model data. |
correctly_classified | DOUBLE | Percentage of training data that is correctly classified by the decision tree model. |
This table contains all model parameters for Feedforward Neural Network Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the feedforward network model. |
num_arguments | INT | Number of arguments in the machine learning model data. |
average_loss | DOUBLE | Average value of the loss function. |
This table contains all model parameters for Gaussian Mixture Models.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the Gaussian Mixture Model. |
num_distributions | INT | Number of distributions in the Gaussian Mixture Model. |
average_loss | DOUBLE | Average value of the loss function. |
This table contains all model parameters for K-Means Clustering Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
centroids | ARRAY(DOUBLE) | Values that represent the centroid values of each cluster. |
num_arguments | INT | Number of arguments in the machine learning model data. |
means | ARRAY(DOUBLE) | Means of each of the feature columns in the data. |
standard_deviations | ARRAY(DOUBLE) | Standard deviations of each of the feature columns in the data. |
This table contains the number of arguments and the target table for K-Nearest Neighbors Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
num_arguments | INT | Number of arguments in the machine learning model data. |
table_name | CHAR | Name of the target table for the K Nearest Neighbors (KNN) model. |
correctly_classified | DOUBLE | Percentage of training data that is correctly classified by the KNN model. |
means | ARRAY(DOUBLE) | Means of each of the feature columns in the data. |
standard_deviations | ARRAY(DOUBLE) | Standard deviations of each of the feature columns in the data. |
This table contains all model parameters for Linear Combination Regression Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of model coefficients associated with the regression. |
y_intercept | DOUBLE | y-intercept of the regression. |
coefficient_of_determination | DOUBLE | R^2 value of the regression, if calculated, otherwise NULL. |
num_arguments | INT | Number of arguments in the machine learning model data. |
rmse | DOUBLE | Root mean square error of the regression. |
adjusted_r2 | DOUBLE | Adjusted R^2 value of the regression. |
This table contains all model parameters for Linear Discriminant Analysis (LDA) Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the LDA model. |
num_features | INT | Number of features returned by the LDA model. |
importance | ARRAY(DOUBLE) | Importance of each of the output features that represent the data. |
This table contains all model parameters for Logistic Regression Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the logistic regression model. |
correctly_classified | DOUBLE | Percentage of training data that is correctly classified by the logistic regression. |
num_arguments | INT | Number of arguments in the machine learning model data. |
zero_case | CHAR | The case where the logistic regression uses a value of 0. |
one_case | CHAR | The case where the logistic regression uses a value of 1. |
classes | ARRAY(CHAR) | Target classes for the logistic regression. |
This table contains the machine learning models that are defined in the database.
Column Name | Column Type | Column Description |
id | UUID | UUID of the machine learning model. |
name | CHAR | Name of the machine learning model. |
schema | CHAR | Schema of the machine learning model. |
machine_learning_model_type | CHAR | Type of the machine learning model. |
database_id | UUID | UUID of the database that contains the machine learning model definition (sys.databases). |
on_select | CHAR | The SELECT SQL statement used to create this model. |
This table contains options defined for each machine learning model. The database stores these options as key-value pairs.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
machine_learning_model_key | CHAR | Machine learning model configuration option key. |
machine_learning_model_value | CHAR | Machine learning model configuration option value. |
This table contains the y-intercept and coefficient of determination values for the multiple linear regression machine learning models.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
y_intercept | DOUBLE | y-intercept of the regression. |
coefficient_of_determination | DOUBLE | R^2 value of the regression, if calculated, otherwise NULL. |
rmse | DOUBLE | Root mean square error of the regression. |
adjusted_r2 | DOUBLE | Adjusted R^2 value of the regression. |
slopes | ARRAY(DOUBLE) | Slopes for each variable in the regression. |
This table contains all model parameters for Naive Bayes Classification Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
num_arguments | INT | Number of arguments in the machine learning model data. |
result_probability_table | CHAR | Name of the internal result probability table. |
feature_result_matrix_table | CHAR | Name of the internal feature result matrix table. |
correctly_classified | DOUBLE | Percentage of training data that is correctly classified by the Naive Bayes model. |
This table contains all model parameters for Nonlinear Regression Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the nonlinear regression model. |
coefficient_of_determination | DOUBLE | R^2 value of the regression, if calculated, otherwise NULL. |
num_arguments | INT | Number of arguments in the machine learning model data. |
rmse | DOUBLE | Root mean square error of the regression. |
adjusted_r2 | DOUBLE | Adjusted R^2 value of the regression. |
This table contains all model parameters for Polynomial Regression Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of model coefficients associated with the polynomial regression model. |
y_intercept | DOUBLE | y-intercept of the regression. |
coefficient_of_determination | DOUBLE | R^2 value of the regression, if calculated, otherwise NULL. |
num_arguments | INT | Number of arguments in the machine learning model data. |
rmse | DOUBLE | Root mean square error of the regression. |
adjusted_r2 | DOUBLE | Adjusted R^2 value of the regression. |
This table contains all model parameters for Principal Component Analysis (PCA) Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the PCA model. |
num_features | INT | Number of features returned by the PCA model. |
importance | ARRAY(DOUBLE) | Importance of each of the output features that represents the data. |
means | ARRAY(DOUBLE) | Means of each of the feature columns in the data. |
standard_deviations | ARRAY(DOUBLE) | Standard deviations of each of the feature columns in the data. |
This table contains the slope, y-intercept, and coefficient of determination values for single linear regression machine learning models.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
slope | DOUBLE | Slope of the regression. |
y_intercept | DOUBLE | The y-intercept of the regression. |
coefficient_of_determination | DOUBLE | R^2 value of the regression, if calculated, otherwise NULL. |
rmse | DOUBLE | Root mean square error of the regression. |
adjusted_r2 | DOUBLE | Adjusted R^2 value of the regression. |
This table contains all model parameters for Support Vector Machine (SVM) Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the SVM model. |
correctly_classified | DOUBLE | Percentage of training data that is correctly classified by the SVM model. |
num_arguments | INT | Number of arguments in the machine learning model data. |
negative_case | CHAR | Case when the SVM model classifies data as negative. |
positive_case | CHAR | Case when the SVM model classifies data as positive. |
classes | ARRAY(CHAR) | Target classes for the SVM model. |
This table contains all model parameters for Vector Autoregression Models in the system.
Column Name | Column Type | Column Description |
machine_learning_model_id | UUID | UUID of the machine learning model (sys.machine_learning_models). |
coefficients | ARRAY(DOUBLE) | List of coefficients associated with the vector autoregression model. |
coefficient_of_determination | DOUBLE | R^2 value of the autoregression, if calculated, otherwise NULL. |
This table contains information about operator instances that are active in the database.
Column Name | Column Type | Column Description |
query_id | UUID | A unique identifier of the query this operator belongs to. |
operator_id | UUID | A unique identifier of the operator that finalized. |
node_id | UUID | The unique identifier of the node that stores the information about this operator. |
silo_id | LONG | The unique identifier of the silo that stores the information about this operator. |
core_id | LONG | The unique identifier of the vm core that stores the information about this operator. |
op_runtime_id | INT | Unique operator instance identifier that the system assigns at runtime. |
op_instance_type | CHAR | Name of the type for this operator instance. |
bloom_filtered_rows | INT | Rows filtered by Bloom filters. |
rows_received | INT | Number of rows fetched by the operator instance. |
rows_processed | INT | Number of rows processed by this operator instance during execution. |
rows_emitted | INT | Number of rows returned by the operator instance. |
blocks_emitted | INT | Number of data blocks returned by the operator instance. |
finalization_time | TIMESTAMP | Timestamp at which the operator completed all work |
first_block_receive_time | TIMESTAMP | Timestamp that specifies the receipt of the first data block. |
first_block_emitted_time | TIMESTAMP | Timestamp that specifies the return of the first data block. |
num_cycles | INT | The number of cycles that run on this operator instance. |
num_oom_cycles | INT | The number of run cycles that an operator received for processing out of memory issues. |
num_failed_oom_cycles | INT | Number of out of memory cycles received that failed to do any work. |
run_count | INT | Number of times that the scheduler has reviewed this operation and isRunnable is true. |
no_work_cycles | INT | Number of times that the read and write cycle executed and performed no work. |
backed_up_cycles | INT | Number of times a cycle stopped because a backup of the parent exists. |
leaf_branch_blocked_cycles | INT | Number of times a cycle stopped on a leaf operator because of multi-child scheduling heuristics. |
num_eof_cycles | INT | Number of end of file cycles received. |
normal_run_time_in_ms | DOUBLE | Time span in milliseconds of the normal run (no out of memory issues) for the operator instance. |
oom_run_time_in_ms | DOUBLE | Time span in milliseconds of the out of memory issue for the operator instance. |
dispatch_queue_time_in_ms | DOUBLE | Time span in milliseconds of the amount of time the operator instance spent processed non-work-cycle events |
max_hp_mem_usage | INT | Maximum heap memory usage by the operator instance. |
num_blocks_written | INT | Number of data blocks written into the memory. |
num_blocks_read | INT | Number of data blocks read from memory. |
num_fragments_written | INT | Number of written memory fragments. |
num_fragments_read | INT | Number of read memory fragments. |
cycles_over_1_sec | INT | Count of cycles that ran over 1 second for this operator instance. |
cycles_over_3_sec | INT | Count of cycles that ran over 3 seconds for this operator instance. |
long_dispatch_queue_events | INT | Count of dispatch queue events processed by the operator with a runtime over 0.5s |
mandatory_alloc_attempts | INT | Count of cycles where the scheduler enabled mandatory allocation. |
mandatory_alloc_success_count | INT | Count of cycles where the scheduler enabled mandatory allocation, and this operator broke an out-of-memory deadlock. |
max_num_pending_blocks | INT | Maximum number of pending blocks across all partitions during the lifetime of this operator |
This table contains information about queries that finished execution in the database.
Column Name | Column Type | Column Description |
query_id | UUID | A unique identifier of the query that ran. |
user | CHAR | The name of the user that executed the query. |
database_name | CHAR | The name of the database that runs this query. |
database_id | UUID | The unique identifier of the database this query ran in. |
sql | CHAR | The executed SQL statement. |
sql_text_length | LONG | The length of the SQL statement. |
referenced_tables | ARRAY(CHAR) | The tables and views referenced by the query. |
total_time | LONG | The total time in milliseconds the query took to run. This time includes generation_time, optimization_time, and execution_time. |
generation_time | LONG | The time in milliseconds it took to generate the query before any processing happened. |
optimization_time | LONG | The time in milliseconds the optimizer processed the query and built an optimized plan for the query. |
execution_time | LONG | Time in milliseconds the query was executed by the database on the LTS nodes to return the query result. |
timestamp_start | LONG | A UNIX® timestamp that represents the point in time when the query entered the system. |
time_start | CHAR | An ISO 8601 representation in milliseconds of the timestamp_start value. |
parsing_time | LONG | The time in milliseconds the query was parsing. |
validation_time | LONG | The time in milliseconds the query was validating. |
plangen_time | LONG | The time in milliseconds the query plan was being generated. |
queue_time | LONG | The time in milliseconds the query was queued in the system before any processing happened. |
timestamp_optimization_start | LONG | A UNIX timestamp that represents the point in time when optimization of the query started. |
time_optimization_start | CHAR | An ISO 8601 representation in milliseconds of the timestamp_optimization_start value. |
timestamp_execution_start | LONG | A UNIX timestamp that represents the point in time when execution of the query started. |
time_execution_start | CHAR | An ISO 8601 representation in milliseconds of the timestamp_execution_start value. |
tree_probe_time | LONG | The time in milliseconds taken by the VM tree probe during query execution. |
vm_initialization_time | LONG | Time in milliseconds the query was initializing on all participating nodes during execution. |
timestamp_first_byte_sent | LONG | A UNIX timestamp that represents the point in time when the first byte of the result set from the query was returned to the application. |
time_first_byte_sent | CHAR | An ISO 8601 representation in milliseconds of the timestamp_first_byte_sent value. |
timestamp_complete | LONG | A UNIX timestamp that represents the point in time when the execution of the query completed from the client's perspective. |
time_complete | CHAR | An ISO 8601 representation in milliseconds of the timestamp_complete value. |
timestamp_execution_complete | LONG | A UNIX timestamp that represents the point in time when the internal execution of the query completed. |
time_execution_complete | CHAR | An ISO 8601 representation in milliseconds of the timestamp_execution_complete value. |
awaiting_client_eof_fetch_time | LONG | A UNIX timestamp that represents the difference between when the client fetched the eof for the query and when the eof was queued internally. |
rows_returned | LONG | The number of rows returned by the query. |
bytes_returned | LONG | The number of bytes returned by the query. |
rows_inserted | LONG | The number of rows that the query inserts. This value is NULL when the database does not insert any rows. The value is 0 when the database does not identify any rows to insert from a CREATE TABLE AS SELECT or INSERT AS SELECT SQL statement. |
rows_deleted | LONG | The number of rows that the query deletes. This value is NULL when the database does not delete any rows. The value is 0 when the database does not identify any rows to delete from a DELETE FROM TABLE SQL statement. |
update_subquery_execution_time | LONG | The time in milliseconds taken by the virtual machine (VM) to execute a subquery that identifies the rows for insertion or deletion. This value is NULL when you execute a SQL statement that is not one of these statements: CREATE TABLE AS SELECT, INSERT AS SELECT, or DELETE FROM TABLE. |
transferred_bytes_per_second | LONG | The transfer rate in bytes per second for the result set of the query. |
code | INT | The SQL code returned at the end of the query. |
state | CHAR | The SQL state returned at the end of the query. |
reason | CHAR | A message associated with the SQL code and SQL state. |
initial_priority | DOUBLE | Priority based on the service class, session, and query-level limits. |
initial_effective_priority | DOUBLE | initial_priority adjusted for total cost and memory usage. |
final_effective_priority | DOUBLE | Final dynamically adjusted priority. |
cost_estimate | DOUBLE | The cost estimate of the optimizer. |
concurrency_service_class_name | CHAR | Name of the service class this query executes in. |
concurrency_service_class_id | UUID | The unique identifier of the service class used for the query. |
priority_adjust_factor | DOUBLE | The percentage amount by which the database adjusts the priority. |
priority_adjust_time | INT | How frequently the database adjusts the priority during query execution. |
cached_query | BOOLEAN | Flag that indicates whether the result was returned from the result set cache. |
resultset_cached | BOOLEAN | Flag that indicates whether the result of the query was stored in the result set cache. |
temp_disk_consumed | LONG | Flag that indicates how much temporary disk space was used by the query. |
protocol_version | CHAR | The version of the client-server protocol for this connection. |
driver_version | CHAR | The version of the client driver. |
client_ip | CHAR | The IP address of the client that executed the query. |
client_name | CHAR | The name of the client that executed the query. |
client_session_id | CHAR | The session id of the client that executed the query. |
num_client_threads | INT | The maximum number of client threads determined by the server. |
node_id | UUID | The unique identifier of the node that stores the information about this query. |
participating_nodes | ARRAY(VARCHAR) | The nodes that participated in the execution of this query. |
ocient_db_version | CHAR | The Ocient database version used to run this query. |
ocient_db_commit | CHAR | The Ocient database git commit used to run this query. |
ocient_db_dirtied_commit | CHAR | The dirtied Ocient database git commit used to run this query. |
max_temp_disk_usage | INT | The maximum temporary disk usage for this query, expressed as a percentage. |
max_elapsed_time | INT | The maximum elapsed time for this query, in seconds. |
max_rows_returned | LONG | The maximum number of rows this query can return. |
num_root_operator_instances | INT | The number of created root operator instances. |
approx_system_peak_vm_node_heap_mem_bytes | LONG | The max observed heap memory in use during execution on a single non-SQL vm node. The memory in use is not necessarily associated with this query. |
approx_system_peak_vm_cluster_heap_mem_bytes | LONG | The max observed heap memory in use during execution totaled across all non-SQL vm nodes. The memory in use is not necessarily associated with this query. |
approx_system_peak_vm_node_huge_mem_bytes | LONG | The max observed huge page memory in use during execution on a single non-SQL vm node. The memory in use is not necessarily associated with this query. |
approx_system_peak_vm_cluster_huge_mem_bytes | LONG | The max observed huge page memory in use during execution totaled across all non-SQL vm nodes. The memory in use is not necessarily associated with this query. |
approx_system_peak_sql_node_heap_mem_bytes | LONG | The max observed heap memory in use during execution on the SQL Node. The memory in use is not necessarily associated with this query. |
approx_system_peak_sql_node_huge_mem_bytes | LONG | The max observed huge page memory in use during execution on the SQL Node. The memory in use is not necessarily associated with this query. |
This table contains information about operator instances that have finalized in the database.
Column Name | Column Type | Column Description |
query_id | UUID | A unique identifier of the query this operator belongs to. |
operator_id | UUID | A unique identifier of the operator that finalized. |
node_id | UUID | The unique identifier of the node that stores the information about this operator. |
silo_id | LONG | The unique identifier of the silo that stores the information about this operator. |
core_id | LONG | The unique identifier of the vm core that stores the information about this operator. |
op_runtime_id | INT | Unique operator instance identifier that the system assigns at runtime. |
op_instance_type | CHAR | Name of the type for this operator instance. |
bloom_filtered_rows | INT | Rows filtered by Bloom filters. |
rows_received | INT | Number of rows fetched by the operator instance. |
rows_processed | INT | Number of rows processed by this operator instance during execution. |
rows_emitted | INT | Number of rows returned by the operator instance. |
blocks_emitted | INT | Number of data blocks returned by the operator instance. |
finalization_time | TIMESTAMP | Timestamp at which the operator completed all work |
first_block_receive_time | TIMESTAMP | Timestamp that specifies the receipt of the first data block. |
first_block_emitted_time | TIMESTAMP | Timestamp that specifies the return of the first data block. |
num_cycles | INT | The number of cycles that run on this operator instance. |
num_oom_cycles | INT | The number of run cycles that an operator received for processing out-of-memory issues. |
num_failed_oom_cycles | INT | Number of out of memory cycles received that failed to do any work. |
run_count | INT | Number of times that the scheduler has reviewed this operation and isRunnable is true. |
no_work_cycles | INT | Number of times that the read and write cycle executed and performed no work. |
backed_up_cycles | INT | Number of times a cycle stopped because a backup of the parent exists. |
leaf_branch_blocked_cycles | INT | Number of times a cycle stopped on a leaf operator because of multi-child scheduling heuristics. |
num_eof_cycles | INT | Number of end of file cycles received. |
normal_run_time_in_ms | DOUBLE | Time span in milliseconds of the normal run (no out-of-memory issues) for the operator instance. |
oom_run_time_in_ms | DOUBLE | Time span in milliseconds of the out of memory issue for the operator instance. |
dispatch_queue_time_in_ms | DOUBLE | Time span in milliseconds of the amount of time the operator instance spent processed non-work-cycle events |
max_hp_mem_usage | INT | Maximum heap memory usage by the operator instance. |
num_blocks_written | INT | Number of data blocks written into the memory. |
num_blocks_read | INT | Number of data blocks read from memory. |
num_fragments_written | INT | Number of written memory fragments. |
num_fragments_read | INT | Number of read memory fragments. |
cycles_over_1_sec | INT | Count of cycles that ran over 1 second for this operator instance. |
cycles_over_3_sec | INT | Count of cycles that ran over 3 seconds for this operator instance. |
long_dispatch_queue_events | INT | Count of dispatch queue events processed by the operator with a runtime over 0.5s |
mandatory_alloc_attempts | INT | Count of cycles where the scheduler enabled mandatory allocation. |
mandatory_alloc_success_count | INT | Count of cycles where the scheduler enabled mandatory allocation, and this operator broke an out-of-memory deadlock. |
max_num_pending_blocks | INT | Maximum number of pending blocks across all partitions during the lifetime of this operator. |
This table contains settings for metric levels.
Column Name | Column Type | Column Description |
match | CHAR | Metric name match. |
match_type | CHAR | The type of match for the name of the metric. |
level | CHAR | Metric level. |
node_id | UUID | The unique node identifier for this setting. This setting might be NULL for system-wide metrics. |
This table contains the status of nodes in the system and the core node monitoring metrics.
Column Name | Column Type | Column Description |
node_id | UUID | The UUID of the node. |
operational_status | CHAR | The operational status of the node. Values are ACTIVE, STARTING, STOPPING, ERROR, UNKNOWN, or UNREACHABLE. |
loadavg_1 | DOUBLE | Average load on the node over the last 1 minute. Represents the average number of processes in the system run queue. |
loadavg_5 | DOUBLE | Average load on the node over the last 5 minutes. Represents the average number of processes in the system run queue. |
loadavg_15 | DOUBLE | Average load on the node over the last 15 minutes. Represents the average number of processes in the system run queue. |
max_rss | LONG | Maximum resident set size (RSS) of the process on the node in bytes. |
heap | LONG | Heap memory allocated on the node in bytes. |
software_start | TIMESTAMP | Timestamp for the last start of the Ocient software on the node. |
system_start | TIMESTAMP | Timestamp for the last start of the node hardware. |
op inst debug info test table
Column Name | Column Type | Column Description |
operator_id | UUID | The UUID of the operator |
node_id | UUID | The unique identifier of the node that stores the information about this operator. |
silo_id | LONG | The unique identifier of the silo that stores the information about this operator. |
vm_core_id | LONG | The unique identifier of the vm core that stores the information about this operator. |
runtime_id | INT | The process-wide unique identifier of this operator instance. |
key | CHAR | debugInfo key |
value | CHAR | debugInfo value |
op_inst_type | CHAR | Type of the operator Instance |
client IDs for osn acquisitions
Column Name | Column Type | Column Description |
node_id | UUID | The UUID of the node |
client_id | UUID | The query ID of the osn acquisition |
osn | LONG | The osn locked |
acquisition_time | TIMESTAMP | Timestamp that represents when the osn was acquired. |
This table contains information about queries that the database is currently executing.
Column Name | Column Type | Column Description |
query_id | UUID | A unique identifier of the query that is currently running. |
user | CHAR | The name of the user that executes the query. |
database_name | CHAR | The name of the database that runs this query. |
database_id | UUID | A unique identifier of the database this query is running in. |
status | CHAR | One of these three states represents the current state of the query: QUEUED (Query is not yet executing), PAUSED (Query is not actively processing but ready to begin), RUNNING (Query is being processed). |
sql | CHAR | The SQL statement that is executing. |
sql_text_length | LONG | The length of the SQL statement. |
referenced_tables | ARRAY(CHAR) | The tables and views referenced by the query. |
total_time | LONG | The total time in milliseconds the query has run. This time includes generation_time, optimization_time, and execution_time. |
generation_time | LONG | The time in milliseconds the query was generated or is still generating. This number might increase if generation is in progress. |
optimization_time | LONG | The time in milliseconds the optimizer processed or is still processing the query. This number might be 0 if optimization of the query has not started yet. This number might increase if optimization is in progress. |
execution_time | LONG | Time in milliseconds the query executes. This number might be 0 if execution of the query has not started yet. This number might increase if execution of the query is still in progress. |
timestamp_start | LONG | A UNIX timestamp that represents the point in time when the query entered the system. |
time_start | CHAR | An ISO 8601 representation in milliseconds of the timestamp_start value. |
parsing_time | LONG | Time in milliseconds the query was parsing or is still parsing. This number might be 0 if parsing of the query has not started yet. This number might increase if the query is still parsing. |
validation_time | LONG | Time in milliseconds the query was validating or is still being validated. This number might be 0 if validation of the query has not started yet. This number might increase if the query is still validating. |
plangen_time | LONG | Time in milliseconds the query plan was being generated or is still generating. This number might be 0 if generation of the query plan has not started yet. This number might increase if the query plan is still generating. |
queue_time | LONG | Time in milliseconds the query was queued or is still queuing. This number might be 0 if queuing of the query has not started yet. This number might increase if the query is still in the queue. |
timestamp_optimization_start | LONG | A UNIX timestamp that represents the point in time when optimization of the query started. This value might be 0 if optimization has not started yet. |
time_optimization_start | CHAR | An ISO 8601 representation in milliseconds of the timestamp_optimization_start value. |
timestamp_execution_start | LONG | A UNIX timestamp that represents the point in time when execution of the query started. This value might be 0 if execution of the query has not started yet. |
time_execution_start | CHAR | An ISO 8601 representation in milliseconds of the timestamp_execution_start value. |
tree_probe_time | LONG | Time in milliseconds the query was in the VM tree probe stage during execution. This number might be 0 if VM tree probe has not started yet. This number might increase if the probe is still happening. |
vm_initialization_time | LONG | Time in milliseconds the query was initializing on all participating nodes during execution. This number might be 0 if the VM has not begin initializing the query for execution yet. |
timestamp_first_byte_sent | LONG | A UNIX timestamp that represents the point in time when the first byte of the result set from the query was returned to the application. This value might be 0 if execution of the query has not started yet or no bytes have been transferred yet. |
time_first_byte_sent | CHAR | An ISO 8601 representation in milliseconds of the timestamp_first_byte_sent value. |
rows_returned | LONG | The number of rows returned by the query. This value might be 0 if no rows have been transferred so far. |
bytes_returned | LONG | The number of bytes returned by the query. This value might be 0 if no rows have been transferred so far. |
rows_inserted | LONG | The number of rows that the query inserts. This value is NULL when the database does not insert any rows. The value is 0 when the database does not identify any rows to insert from a CREATE TABLE AS SELECT or INSERT AS SELECT SQL statement. |
rows_deleted | LONG | The number of rows that the query deletes. This value is NULL when the database does not delete any rows. The value is 0 when the database does not identify any rows to delete from a DELETE FROM TABLE SQL statement. |
update_subquery_execution_time | LONG | The time in milliseconds taken by the VM to execute a subquery that identifies the rows for insertion and deletion. This value is NULL when you execute a SQL statement that is not one of these statements: CREATE TABLE AS SELECT, INSERT AS SELECT, or DELETE FROM TABLE. |
initial_priority | DOUBLE | Priority based on the service class, session, and query level limits. |
initial_effective_priority | DOUBLE | initial_priority adjusted for total cost and memory usage. |
effective_priority | DOUBLE | Current dynamically adjusted priority. |
estimated_time | INT | The estimate of the optimizer for the time in milliseconds to process the query. |
estimated_result_rows | LONG | The estimate of the optimizer for the number of rows in the result set. |
estimated_result_size | LONG | The estimate of the optimizer for the size of the result set in bytes. |
concurrency_service_class_name | CHAR | Name of the service class this query executes in. |
concurrency_service_class_id | UUID | The unique identifier of the service class used for the query. |
priority_adjust_factor | DOUBLE | The percentage amount by which the database adjusts the priority. |
priority_adjust_time | INT | How frequently the database adjusts the priority during query execution. |
cached_query | BOOLEAN | Flag that indicates whether the result is returned from the result set cache. |
server_ip | IPV4 | The IP address of the SQL node that executed the query. |
protocol_version | CHAR | The version of the client-server protocol for this connection. |
driver_version | CHAR | The version of the client driver. |
client_ip | CHAR | The IP address of the client that executed the query. |
client_name | CHAR | The name of the client that executed the query. |
client_session_id | CHAR | The session id of the client that executed the query. |
num_client_threads | INT | The maximum number of client threads determined by the server. |
node_id | UUID | The unique identifier of the node that provided the information about this query. |
participating_nodes | ARRAY(VARCHAR) | The nodes that are currently known to be participating in the execution of this query. If the query is not in the RUNNING state, this list might not include all nodes that participate. |
max_temp_disk_usage | INT | The maximum temporary disk usage for this query, expressed as a percentage. |
max_elapsed_time | INT | The maximum elapsed time for this query, in seconds. |
max_rows_returned | LONG | The maximum number of rows this query can return. |
num_root_operator_instances | INT | The number of created root operator instances. |
approx_system_peak_vm_node_heap_mem_bytes | LONG | The max observed heap memory in use during execution on a single non-SQL vm node. The memory in use is not necessarily associated with this query. |
approx_system_peak_vm_cluster_heap_mem_bytes | LONG | The max observed heap memory in use during execution totaled across all non-sql vm nodes. The memory in use is not necessarily associated with this query. |
approx_system_peak_vm_node_huge_mem_bytes | LONG | The max observed huge page memory in use during execution on a single non-SQL vm node. The memory in use is not necessarily associated with this query. |
approx_system_peak_vm_cluster_huge_mem_bytes | LONG | The max observed huge page memory in use during execution totaled across all non-SQL vm nodes. The memory in use is not necessarily associated with this query. |
approx_system_peak_sql_node_heap_mem_bytes | LONG | The max observed heap memory in use during execution on the sql node. The memory in use is not necessarily associated with this query. |
approx_system_peak_sql_node_huge_mem_bytes | LONG | The max observed huge page memory in use during execution on the sql node. The memory in use is not necessarily associated with this query. |
This table contains queries that have cached results in the system.
Column Name | Column Type | Column Description |
node_id | UUID | The UUID of the node that holds the cache results. |
query_id | UUID | The UUID of the query. |
database_id | UUID | The database of the query. |
service_class_id | UUID | The UUID of the service class of the query. |
timestamp | LONG | The timestamp in seconds after the UNIX epoch when the result set entered the cache. |
time | CHAR | The human-readable time when the result set entered the cache. |
time_remaining | LONG | The amount of time remaining in seconds before the cached result set expires. |
referenced_tables | ARRAY(CHAR) | All referenced tables in this query. |
This table contains the status of each service role on the system.
Column Name | Column Type | Column Description |
node_id | UUID | The UUID of the node. |
service_role_id | UUID | The UUID of the service role. References sys.service_roles. |
service_role_name | CHAR | The human-readable name of the service role on the node. |
status | CHAR | The current status of the role on this node. |
This table contains monitoring metrics collected on each storage device that is controlled by Ocient.
Column Name | Column Type | Column Description |
id | CHAR | Unique and persistent serial number of the drive. This serial number is not a UUID. |
key | CHAR | Name of the measured statistic on the drive. |
value | CHAR | Value of the named statistic on the drive. |
transient | BOOLEAN | When the value is true, the value indicates that it is transient in nature and is reset when the node is restarted. |