Documentation Index
Fetch the complete documentation index at: https://docs.ocient.com/llms.txt
Use this file to discover all available pages before exploring further.
27.0
Release Highlights- Data Pipeline Loading —
- Added the new ALTER PIPELINE SQL statement for schema evolution. You can now modify the SELECT clause of a data pipeline for columns, filters, and transformations without recreating the pipeline.
- Machine Learning Model Updates —
- Added ensemble models with the Bagging, Boosting, and Stacking models. For details, see Ensemble Models.
- Data Pipeline Loading —
- Added the
line_numbermetadata key for loading the line number of the file. For details, see Load Metadata and File-Based Partitioned Data in Data Pipelines. - Added these extract options for delimited formats and CSV:
- STRIP_FIELD_QUOTES
- STRIP_ARRAY_ELEMENT_QUOTES
- TRIM_ARRAY_ELEMENTS
- For details, see Delimited and CSV Extract Options.
- Added the
- Machine Learning Model Updates —
- Added the regression version of the Decision Tree model. For details, see Regression Tree.
- Added
featureSubsetStrategyandmaxCellsToFetchoptions to the Random Forest model. For details, see Random Forest.
- Data Storage —
- Added the
DRAIN PAGESSQL statement to manually migrate data from pages to segments. For details, see the DRAIN PAGES statement. - Added the
NOINDEXoption for time bucket clauses inCREATE TABLEstatements. This option prevents a from impacting storage ordering. For details, see TimeKeys and Clustering Keys. - Added the
ALTER SYSTEM SET DEFAULT STORAGESPACESQL statement to enable default storage spaces for tables. For details, see the ALTER SYSTEM SET DEFAULT STORAGESPACE statement. - Added the
ALTER CLUSTER ADD STORAGESPACEandALTER CLUSTER REMOVE STORAGESPACESQL statements to link storage spaces to clusters. For details, see the ALTER CLUSTER ADD STORAGESPACE and ALTER CLUSTER REMOVE STORAGESPACE statements.
- Added the
- CREATE TASK syntax —
- Added the
LOCATIONandOPTIONSkeywords to theCREATE TASKSQL statement for easier task creation. For details, see Distributed Tasks.
- Added the
- Aggregate Functions —
- Added these functions to assess the performance of machine learning models:
ACCURACY_SCORECOEFFICIENT_OF_DETERMINATIONCONFUSION_MATRIXF1_SCOREMEAN_ABSOLUTE_ERRORMEAN_ABSOLUTE_PERCENTAGE_ERRORPRECISION_SCORERECALL_SCOREROC_AUC_SCORE- For details, see Aggregate Functions.
- Added these functions to assess the performance of machine learning models:
- Scalar Data Conversion Functions —
- Updated the
BOOLEANfunction to accept new string and numeric values for casting. For details, see Scalar Data Conversion Functions.
- Updated the
- Default Expressions —
- Expanded valid column defaults from exclusively literals to any constant, deterministic expression that the system casts to the target column. For details, see Column Constraint.
- Values Expressions
- You can now use value expressions with the
VALUESkeyword in theFROMclause. For details, see the FROM clause syntax.
- You can now use value expressions with the
- System Catalog Column Additions —
target_rows_per_cycleandapplied_dynamic_filter_statsin thesys.active_operator_instancessystem catalog tabledefault_schemain thesys.completed_queriessystem catalog tablebegin_timestampandend_timestampcolumns in thesys.segmentssystem catalog tablebegin_timestampandend_timestampcolumns in thesys.segment_groupssystem catalog tablescope_prefix_len,transaction_timeout,creation_timestamp, andlast_activity_timestampin thesys.storage_scopessystem catalog tabledefault_schemain thesys.queriessystem catalog tablepassword_days_remainingcolumn in thesys.userssystem catalog table- For details, see System Catalog.
- The System now supports non-literal expressions (e.g., arithmetic and deterministic functions) with the
DEFAULTkeyword to specify a default value. The system validates default values and ensures consistent casting. For example, you must now specify a TIMESTAMP default value asTIMESTAMP DEFAULT 0orTIMESTAMP DEFAULT '1970-01-01 00:00:00.00000000'.
26.1
Release Highlights- Data Pipeline Loading —
- The System now loads data in the format. For details, see Load Avro Data. The new
FORMAT avroextract options are in the syntax of the CREATE PIPELINE SQL statement.
- The System now loads data in the format. For details, see Load Avro Data. The new
- Array Functions —
- Added the ARRAY_CAT_DISTINCT and ARRAY_DISTINCT array functions for concatenation and deduplication, respectively.
- Added the ARRAY_CONCAT_AGG sorted aggregate function for concatenation.
- Index Types —
- Added the
ZONE_MAPindex type to store the range of values present in a segment for the indexed column, enabling queries to skip over entire segments with no rows matching a compatible filter. For details, see the ZONE_MAP Index Type.
- Added the
- HTTP Query API —
- Added the Ocient HTTP Query API endpoint library to enable execution of SQL statements.
- Integration —
- Added the connector for integrating the Ocient System with Looker Studio. For details, see Looker Connector.
- Data Pipeline Loading Changes —
- The Ocient System now loads data from sources. The new source options are in the syntax of the CREATE PIPELINE SQL statement. For details, see Data Pipeline Load of JSON Data from HDFS.
- The Ocient System can now load data from HDFS. For the source syntax and options, see the CREATE PIPELINE SQL statement. For the tutorial, see Data Pipeline Load of JSON Data from HDFS.
- The data pipeline loading functionality supports the
TO_CHARfunction for convertingVARBINARYtypes. For details, see Character Data Transformation Functions. - Updated the
METADATAfunction with:- New
keymetadata key to specify the bytes of the Kafka key for the record. For details, see Load Metadata and File-Based Partitioned Data in Data Pipelines. - New
METADATA('hive_partition',search_string)syntax for retrieving a value from a key-value pair in the filename metadata using naming standards with a filter set in the file path.
- New
- Added the
NUM_FOOTER_LINESoption for delimited and CSV formats to skip lines for the footer of the file. For details, see Delimited and CSV Extract Options. - The file-based source
START_TIMESTAMPandEND_TIMESTAMPoptions have been removed for data pipelines.
- General SQL Syntax —
- Added the
TAGkeyword to add a tag to the SQL query. For details, see the TAG syntax.
- Added the
- Table Retention Policies —
- Added functionality to add retention policies to table definition statements. For details, see Table Retention Policies.
- Schema Database Object —
- Added the schema database object and its corresponding privileges. For details, see Data Control Language (DCL) Statement Reference.
- You can create, modify, and remove a schema by using the
CREATE SCHEMA,ALTER SCHEMA RENAME, andDROP SCHEMASQL statements, respectively. For details, see Schemas.
- Cross-Database SSO Authentication —
- Enabled SSO-authenticated users to access multiple databases using a single identity provider configuration. For details, see Set Up Cross-Database SSO Integration.
- Added the CURRENT_GROUPS function that returns the fully qualified names of groups in the database.
- Query Privileges —
- Added the VIEW QUERIES, VIEW REDACTED QUERIES, and CANCEL QUERIES privileges in the database. For details, see Data Control Language (DCL) Statement Reference.
- System and Database Privileges —
- Added the DELETE privilege to the system and database objects. For details, see Data Control Language (DCL) Statement Reference.
- Machine Learning Model Updates —
- Added
featureArrayoption to all models except Simple Linear Regression, Vector Autoregression, Association Rules, and Feedforward Neural Network models. - Added the
normalizeoption. - Added new options
bootstrapandmaxChildThreadsto the Random Forest model. - Added new options
learningRate,numEpochs,miniBatchSize,gradientClipThreshold, andfiniteDifferenceH. These options replacepopSize,initialIterations,subsequentIterations,momentum,gravity,lossFuncNumSamples,numGAAttempts,maxLineSearchIterations,minLineSearchStepSize, andconsistentSampleoptions for Nonlinear Regression, Logistic Regression, Support Vector Machine, and Feedforward Neural Network models. - Added new models Gradient Boosted Trees and Regression Tree.
- Added
- Data Type Updates —
- Array and tuples without specified data types, such as
ARRAY[],ARRAY[NULL], andTUPLE(NULL, NULL), are now valid expressions. The Ocient System treats these types asCHAR[]for arrays andTUPLE<<CHAR,CHAR>>(NULL, NULL)for tuples.
- Array and tuples without specified data types, such as
- System Catalog Table Changes —
- The
sys.pipeline_filestable no longer contains thestream_source_idcolumn. The table now contains thefile_indexcolumn. - The
sys.columnstable has these new columns:system— Boolean value that specifies whether the column is internaltype_hint— expected type of the column
- With k-nearest neighbors models, the
machine_learning_modelstable returns theK_NEAREST_NEIGHBORSvalue for themachine_learning_model_typecolumn. - All authenticated users can now view these tables:
sys.nodessys.service_rolessys.node_statussys.channel_endpoint_parameters
- The
encryptedcolumn has been removed from thesys.channel_endpoint_parameterstable.
- The
- Decimal values use rounding instead of truncation when you cast types from DECIMAL or STRING to a lower precision and scale.
- The system automatically grants the DELETE privilege to the creator of database and schema objects for objects created in version 26.1 and later.
26.0
Internal updates only.25.5
Version Compatibility- The
||operator behavior has changed. If you specify a NULL value for concatenation, then the result is NULL.
25.2
Features- Data Pipeline Changes —
- Added the
WHEREfilter keyword to theSELECTSQL statement in theCREATE PIPELINEstatement. For details, see CREATE PIPELINE. - Added new
HEADERSS3 source option for theCREATE PIPELINESQL statement to define the headers to send with every request. - Added the
MODEoption to thePREVIEW PIPELINESQL statement. This option indicates whether to perform a validation of thePREVIEW PIPELINEstatement. For details, see PREVIEW PIPELINE. - Added the
streamloader.extractorEngineParameters.configurationOption.filesystem.access.directoriesconfiguration setting to denote where you can load server file system data. For details, see Configuration Settings for Data Pipelines. - Updated the
METADATAfunction with a new metadata key and syntax. For details, see Load Metadata and File-Based Partitioned Data in Data Pipelines:- The
source_record_idmetadata key indicates a unique source row identifier that is generated by the Ocient System during loading. - New
METADATA('hive_partition',search_string)syntax that uses a search string as a key for searching the filename metadata to return the value from the key-value pair as a string.
- The
- Added these transformation functions. For details, see Transform Data in Data Pipelines:
IF— Evaluate an expression fortrueorfalse.CASE WHEN— Return a result value based on whether an expression istrue.ELEMENT_AT— Returns the element value of the array or tuple at the specified index.MAP_KEYS— Returns the keys in the specified JSON string.MAP_VALUES— Returns the values in the specified JSON string.REDUCE— Applies a merge function to a starting value and all elements in the array, and then reduces the array to a single value.
- Added the
- System Catalog Table Changes —
- Added Boolean parameter
scopes_on_refreshto thesys.oidc_integrationssystem catalog table to include or not include scopes when submitting a refresh token request.
- Added Boolean parameter
25.1
Features- New data pipeline transformation function
ARRAY_CONTAINSdetermines whether an array contains the specified value, including NULLs. - System Catalog Table Changes —
- The
record_numbercolumn of thesys.pipeline_errorssystem catalog table is now the index, which starts at 1, of the processed record relative to the source file (or partition) where the record was extracted. - The
record_offsetcolumn of thesys.pipeline_errorsis now the offset of 1 for the processed record relative to the start of the source file for files with contiguous records, -1 for files with non-contiguous records (i.e., ), and the Kafka offset for Kafka loads.
- The
25.0
Release Highlights- Load Data into the System — The new way to load data into the Ocient System is to use Data Pipeline functionality. This functionality supports loading data from multiple formats such as CSV, JSON, and . Data pipelines support data transformation during the load. You can load multiple data formats, including geospatial data. This functionality supports these new syntaxes:
CREATE PIPELINESQL statement to create a data pipeline.DROP PIPELINEstatement to remove a data pipeline.PREVIEW PIPELINEstatement to view the results of a data load before creating the data pipeline.START PIPELINEstatement to start the execution of the data load.STOP PIPELINEstatement to stop the execution of the data load.ALTER PIPELINE RENAMEstatement to rename a data pipeline.EXPORT PIPELINEstatement to return theCREATE PIPELINESQL statement used to create the specified data pipeline.CREATE OR REPLACE PIPELINE FUNCTIONstatement to define your own data pipeline function for loading data.DROP PIPELINE FUNCTIONstatement to remove the data pipeline function.- For details, see Load Data and Data Pipelines.
- Runtime Environment — The Ocient System installation requires 21, where the
openjdk-21-jre-headlesspackage is recommended. - Persistent Data — Data persists in the system storage space of the Ocient System in system catalog tables such as the
sys.completed_queriestable. For details, see Storage Space Settings. - Default Compression Scheme — The default compression scheme for variable-length columns is
NONE. - Set more granular privileges for database and system objects. For details, see Object-Type Level Privileges Management and Data Control Language (DCL) Statement Reference.
- The
SHOW SYSTEM TABLESSQL statement displays the system catalog tables. - System Catalog Table Changes —
information_schema.tableshas a columntable_typewith two new types:SYSTEM TABLEfor system catalog tables andSYSTEM VIEWfor information schema tables.BASE TABLEandVIEWstill exist for user-defined tables and views.sys.system_tableshas new columns:schema,type, anddescription.sys.segment_groupshas the newdepthandvisibilitycolumns.sys.stored_segmentshas the newabnormal_placementcolumn.sys.completed_queriescontains persistent data. The system experiences a small loading delay between completing the execution of a SQL query and when the corresponding results appear in the table.- The definition for the
sys.queriestable has been updated to remove these columns:time_starttime_optimization_starttime_execution_starttime_first_byte_sent
- The definition for the
sys.queriestable has been updated to change the data type of these columns fromLONGtoTIMESTAMP:timestamp_starttimestamp_optimization_starttimestamp_execution_starttimestamp_first_byte_sent
- The definition for the
sys.lockstable has been updated for these columns:- Renamed
createTimetocreate_time. - Renamed
lastRefreshTimetolast_refresh_time. - Renamed
priortyIdtopriority_id.
- Renamed
- Updated column descriptions for these tables:
sys.segment_directoriessys.addendum_directoriessys.segment_groupssys.segment_partssys.segmentssys.stored_segmentssys.service_role_status
- Updated the data type for the
segment_group_idscolumn in thesys.segment_group_transferstable fromARRAY(LONG)toARRAY(CHAR)because segment group identifiers are unsigned. - Renamed the
service_roles_idcolumn in thesys.service_role_channel_endpointtable toservice_role_idto align with the naming in thesys.service_role_statustable.
sys.built_in_viewshas been removed. The built-in views have been removed fromsys.built_in_views,sys.views, andinformation_schema.views. The view information now appears in thesys.system_tablessystem catalog table.information_schema.viewsincludes user-defined views and only information schema views.sys.viewsno longer has aview_typecolumn.
24.0
Release Highlights- Better SQL Errors: Improved error messages for poorly constructed SQL queries.
- Enhance Build Metadata: Updated package file names and build information for clarity.
- Improved Tracing: Enabled using the
TRACEkeyword in SQL queries to profile query performance. For details, see the TRACE keyword. - Large Blobstore Support: Enabled more than 2TiB of data to spill per disk for high-density drive situations.
- Large Drive Support: Added support for drives up to 15.36TB in size per node.
- Rebalance System: Added the
REBALANCEtask, which enables optimization of query efficiency by transferring data around the system until nodes are roughly balanced in terms of data volume per node. For details, see Rebalance System. - System Storage Space: Added support for multiple storage spaces and enabled the creation of a system storage space for internal Ocient System data.
- Workload Management Usability:
- Added support for assigning service classes to queries based on query text. For details, see the CREATE SERVICE CLASS SQL statement.
- Added support for changing the priority for queries. For details, see the ALTER QUERY SQL statement.
- [DB-19266]: Network Configuration —
- All nodes must now belong to a connectivity pool. Manage connectivity pools using these new SQL statements. For details, see CONNECTIVITY POOL.
CREATE CONNECTIVITY_POOLto create a connectivity pool.DROP CONNECTIVITY_POOLto drop a connectivity pool.ALTER CONNECTIVITY_POOL SETto set the metadata of a connectivity pool.ALTER CONNECTIVITY_POOL RENAME TOto rename a connectivity pool.ALTER CONNECTIVITY_POOL ADD PARTICIPANTSto add nodes to a connectivity pool.ALTER CONNECTIVITY_POOL DROP PARTICIPANTSto remove nodes from a connectivity pool.
- The
ALTER NODE SET ADDRESSSQL statement changes the internal IP address for a node. For details, see ALTER NODE SET ADDRESS. - You can now configure the network of an Ocient System. For details, see Manage the Network Configuration of an Ocient System.
- Redirects now occur only within connectivity pools. When you upgrade an Ocient System, you must first configure a connectivity pool.
- All nodes must now belong to a connectivity pool. Manage connectivity pools using these new SQL statements. For details, see CONNECTIVITY POOL.
- [DB-28986]: System Catalog Table Updates —
- Renamed
client_versiontoprotocol_versionin thesys.queriesandsys.completed_queriessystem catalog tables. - Added
driver_versioncolumn to thesys.queriesandsys.completed_queriestables.
- Renamed
- [DB-29788]: Regular Expression Functions —
- Added new functions that use regular expression search patterns. The new functions are:
- The
bootstrap.confno longer supportshighspeedAddressas an advanced system configuration option. For other options, see Node Bootstrapping Reference. - The default behavior for the
UNNESTfunction no longer uses theNULL_INPUTclause for a multi-itemSELECTlist. If you would like to utilize the default behavior from version 23.0 and prior, you may do so by changingALTER SYSTEM ALTER CONFIG SET sql.unnestLegacySelectListBehavior = 'true'.
- Removed
COMPRESSION LZ4from the compression options. This compression scheme remains in use as part ofCOMPRESSION DYNAMICfor variable-length columns. - Removed the table-valued function
REPLACEMENT_JOIN. For creating compressed lookup tables, see Global Dictionary Compression. - Particle swarm optimization functionality has been removed from the Ocient System.
- ODBC connection has been removed from the Ocient System.
23.0
Release Highlights- All machine learning functionality is available to use. For details, see Machine Learning Model Functions and Machine Learning in Ocient to get started.
- Delete Syntax: Enabled the deletion of individual rows in the database.
- Integrations: Added drivers and support for the following third-party applications:
- DBeaver
- [DB-13607]: Delete Syntax — Added the SQL DELETE statement syntax that enables the deletion of individual rows in the database.
- [DB-18020]: Large Geospatial Types — Increased the size of
LINESTRINGandPOLYGONgeospatial data types to 512 MB. For details, see Load Geospatial Data. - [DB-19048]: Geospatial Index — Added the SPATIAL index type for indexing geospatial data. For details, see SPATIAL Index Type.
- [DB-18280]: Connectors Refresh — Added integration with DBeaver and . For details, see DBeaver Integration and Tableau Integration.
- [DB-20412]: Multi-Cluster Loading and Cluster of Clusters — Added support for loading and working with multiple clusters. For details, see Multiple Storage Clusters for Loading Data.
- [DB-21609]: Machine Learning Model Updates —
- Added the Gaussian Mixture Model.
- Added the Association Rules Model.
- Added the Linear Discriminant Analysis Model.
- Large Geospatial Types are not backwards compatible with earlier releases. For details, see Version Compatibility.
- The database data control language (DCL) denotes user role privileges to remove data using the
DELETEkeyword instead ofTRUNCATE.
22.0
Release Highlights- HyperLogLog (HLL): Added HLL sketch functionality.
- Information Schema: Added the
information_schemaschema that shows system metadata. - Integrations: Added drivers and support for the following third-party applications:
- SQLAlchemy
- Superset®
- [DB-13603]: Information Schema — Added the information_schema schema that shows system metadata in an accessible format.
- [DB-20484]: Superset Integration — Merged sqlalchemy-ocient driver into Superset repository, allowing Superset to support database connections.
- [DB-20484]: SQLAlchemy Integration — Published sqlalchemy-ocient driver to PyPI.
- [DB-21011]: EXCEPT Clause — Added EXCEPT clause so that SELECT * queries can explicitly omit columns from results.
- [DB-21769]: Metabase Integration — Added Ocient as a Metabase partner driver, allowing Metabase to access Ocient databases out-of-the-box.
- [DB-23030]: JDBC Packaging — Removed OpenJump dependency from ocient-jdbc4.
- [DB-23175]: Time Zone Adjustment Support — Added various improvements to time zone functionality, including:
- Support for daylight savings adjustment based on time zone.
- Added time zone functions CONVERT_UTC_TIMESTAMP_TO LOCAL and CONVERT_LOCAL_TIMESTAMP_TO_UTC. For more information, see Time Zone Functions.
- Enhanced performance for time zone conversion.
- [DB-23177]: Push-Down Aggregation to the I/O Layer — Under certain conditions, the system pushes aggregation to the I/O operator for better efficiency and performance.
- [DB-23299]: HLL Sketch Functionality — Added support for variable log2k HLL sketch algorithm and associated functions. For details, see the HLL Functions page.
- [DB-23745]: Implement Evacuate Node — Evacuate node is a tool to move all segments off of a node in a system that is overprovisioned to the other nodes in the cluster. This tool is useful when you replace drives or a node.
- [DB-19888]: Machine Learning Model Updates —
- The Ocient System scopes machine learning models to schemas. The system assigns the
pre_v22_mlmodelschema to any model you created prior to version 22.0. - The
sys.multiple_linear_regression_slopessystem catalog table has been removed. - Rename machine learning models using ALTER MLMODEL.
- New DDL commands:
- CREATE OR REPLACE
- REFRESH
- EXPORT
- For details about the new syntaxes, see Machine Learning Model Functions.
- The Ocient System scopes machine learning models to schemas. The system assigns the
- [LAT-1469]: Manual Configuration of LAT Endpoints — Enabled manual configuration of LAT endpoints for OAuth with .
- [LAT-1475]: Enablement of Stopping Load Processing During Error Condition — Added default behavior to stop processing during file loading in the event of an unrecoverable error when the system extracts records from a file. For details, see continue_on_unrecoverable_error.
- [LAT-1476]: Enablement of LAT Service in Installation — Enabled LAT Service in
systemdby default upon installation completion. This update reflects a change in the default behavior during installation. - [LAT-1477]: LAT Version for Metrics — Exposed
lat_versionin the metrics. - [LAT-1557]: Support for Loading Multiple S3 Buckets — Added LAT functionality to load data from multiple S3 buckets simultaneously within the same pipeline.
- Information Schema — Views created prior to Version 22.0 do not have column data appearing in the information_schema. You can drop and recreate these views to populate column data.
- LAT — Version 3.0.0 and greater is only compatible with Version 22.0 and greater of the Ocient system. For details, see Version Compatibility.
21.0
Release Highlights The Ocient System now supports the following operating systems:- 20.04
- Debian 11
- RHEL 8
- Whole column compression: Added Zstandard (ZSTD) compression for fixed and variable length columns.
- Check system configuration: Added
precheckandpostcheckcommands to check system configuration before and after installation. - Workload management dynamic priority: Enabled the adjustment of the query priority dynamically at the session, service class, and query levels.
- Ability to quiesce node: Added process for graceful node shutdown.
- [DB-18636]: ZSTD Compression - Added a new whole-column compression scheme (ZSTD) that can be enabled for fixed and variable length columns.
- [DB-18990]: Improved Stats Storage And Usage - Various improvements have been added to speed up the fetching of statistics by the optimizer and ensure it gets up-to-date statistics. These changes primarily center around probability density functions being stored as pre-aggregated stats files instead of on a per-segment basis.
- [DB-20190]: Distributed Tasks - Added
check_disktask type and new vtablessys.subtasks,sys.tasks, andsys.rebuild_tasksfor monitoring tasks. RemoveCHECK DATAcommand. - [DB-19117]: Metadata - Added
participating_nodesto thesys.queriesandsys.completed_queriesvirtual tables. - [DB-18633]: Graceful Node Shutdown - Added quiesce process for graceful node shutdown.
- [DB-18061]: LCK Deprecation - Added new disk data format that is smaller and also improves performance of some index based queries.
- [DB-19414]: Range Query Improvement - Improved performance of range queries by utilizing the inverted secondary index.
- [DB-20168]: Geospatial Function Expansion - Added these geospatial scalar functions.
- Measurement Functions
- ST_ANGLE
- ST_DISTANCESPHERE
- ST_DISTANCESPHEROID
- ST_LENGTH2D
- ST_HAUSDORFFDISTANCE
- Analytic and Property Functions
- ST_DIMENSION
- ST_GEOHASH
- ST_SRID
- ST_ISPOLYGONCW
- ST_ISPOLYGONCCW
- To String and Binary Functions
- ST_ASWKT
- ST_ASWKB
- ST_ASEWKT
- Geography Simplification Function
- ST_SIMPLIFY
- Constructor Functions
- ST_POINTFROMGEOHASH
- ST_GEOGPOINT
- ST_MAKEPOLYGONORIENTED
- ST_POINT_FROMEWKT
- ST_LINESTRING_FROMEWKT
- ST_POLYGON_FROMEWKT
- ST_MAKEENVELOPE
- Additionally, you can construct ST_POLYGON types directly from a POINT[] without going through an intermediate ST_LINESTRING.
- Measurement Functions
- ANALYSIS
- AUTOREGRESSION
- BAYES
- CANCEL
- COMPONENT
- DECISION
- DISABLE
- DISABLE_STATS_FILE_UPDATES
- ENABLE
- FEEDFORWARD
- INSERT
- KMEANS
- KNN
- LOGISTIC
- MACHINE
- MOVE
- NAIVE
- NETWORK
- NONLINEAR
- PRINCIPAL
- REPLACE
- SOURCE
- SUPPORT
- TREE
- VECTOR
- ZSTD
20.0
Release Highlights- CREATE TABLE AS SELECT SQL Statement: Extract, load, and transform (ELT) workflow functionality to extract data and load it into a new database table by using the query results from a SELECT SQL statement. The tables you create using the CREATE TABLE AS SELECT SQL statement have some indexing limitations in version 20.0. For details, see the “About Create Table As Select (CTAS)” section of the Ocient user documentation.
- INSERT INTO SQL Statement: ELT workflow functionality to extract data and insert it into an existing database table using the INSERT INTO SQL statement.
- N-gram Indexes: Full index on VARCHAR, VARCHAR arrays, and VARCHAR tuple components for efficient queries using the LIKE SQL statement.
- Large VARCHAR [DB-16142]: Support VARCHAR columns up to 1GB in size.
- Ocient Simulator: An instance of the Ocient system for data loading and functional testing.
- Single Sign-On (SSO): Authenticate access to Ocient through an external SSO server and assign SSO users to groups in Ocient.
- average_bb_sizes
- linear_combination_regression_models
- node_config
- node_status
- sso_connections
- storage_device_status
- hugepage_configurations
- memory_module_models
- node_memory_modules
- oidc_integrations
- oidc_sessions
- polynomial_regression_models
- security_integrations
- sessions
19.0
Features- [DB-14527] - Adaptive Water Mark Feature - Indexer Node dynamically increase and reduce batch size without manual tuning
- [DB-14656] - Added a rest endpoint to expose a node’s configuration parameters (:9090/v1/configparams)
- [DB-15123] - Expose cluster total storage space and storage usage through virtual tables
- [DB-15515] - Add support for expr::dtype cast notation
- [DB-16289] - Remove the web ui and YAML service role configuration
- [DB-16904] - Allow any predicate type to be used in conjunction with the values in arrays
- [DB-17889] - Improve ability to continue data loading when a foundation node is down
- [DB-18393] - Leverage hyperthreading in query execution
- In v19 the service role configuration previously set through the web UI has been replaced by the ALTER … ALTER ROLE/CONFIG … DDL command. The web UI is still available in v19, but will be removed in a subsequent release. The ALTER … ALTER ROLE/CONFIG … command should be used to change system configuration, rather than the web UI. Please reference the Upgrade Ocient Software section of the user documentation for details.
- [DB-12747] - Add support for lateral joins.
- [DB-13924] - Add support for multi-column subqueries.
- [DB-14990] - Add support for native right joins.
- [DB-15996] - Add support for array_to_string function.
- [DB-16231] - Improve GIS function performance and introduce expanded support for GIS functions. Please refer to the User Documentation for details.
- [DB-17037] - Add new scalar functions and operators added for GIS types (POINT, LINESTRING, and POLYGON). Please refer to the User Documentation for details.
- [DB-17892] - Add support for right lateral joins.
- [DB-16061] - Secondary indexes can now be created on VARCHAR and VARCHAR[] columns. Please refer to the User Documentation for details.
18.0
Features- [DB-17635] - Remove query log properties timestamp_optimizationcomplete and time_optimizationcomplete and add new properties timestamp_optimizationstart and time_optimizationstart
- [DB-16567] - Make error messages more clear for queries with GroupBy missing
- [DB-17316] - Change array_length(empty array) to return 0
- [DB-16417] - Allow for integral types for integer field is GIS functions
- [DB-16200] - Make Explains more convenient for the user.
- [DB-16092] - Distributed Result Set Caching
- [DB-15623] - Add support for rebuilding individual nodes via DDL
- [DB-15375] - ALTER CLUSTER ADD PARTICIPANTS DDL
- [DB-14720] - Provide a way to kill long running optimizations
- [DB-14017] - Support for CLI command history across sessions
17.0
Features- [DB-12888] - Add support for array values larger than 128 KB. The new maximum value of an array is 512 MB.
16.0
Features- [DB-10329] - Add support for full disk encryption of Opal drives. Disk encryption will be automatically enabled when Opal support is detected.
14.0
Features- [DB-14159] - Default hex values for binary or varbinary columns must contain a leading 0x
13.0
Features- [DB-14330] - Remove last dependencies on PostgreSQL from the database
12.0
Features- [DB-13334] - Add support for zip unnest, which unnests multiple arrays in parallel
11.0
Features- [DB-12887] - Add support for the array of tuples. Users can create array columns containing tuple SQL types. Please refer to the User Documentation for the latest information on supported data types.
- [DB-12885] - Add support for unnest(), which expands array elements from input array columns out to individual output rows
10.0
Features- [DB-12394] - Added support for running on CentOS 8.
9.0
Features- [DB-13162] - Added support for Tasks to the System Catalog
- [DB-10332] - Implemented access controls on system and database-level objects. Improved users, groups, and added new roles within Ocient.
- [DB-12829] - Optionally enforce encrypted connections for JDBC and ODBC.
8.0
Features- [DB-10330] - External Network Security. SSL/TLS support in ODBC and JDBC, SSL support for the web interface.
7.0
Features- [DB-10921] - Adds support for multi-dimensional arrays and the ability to do joins, windows, sorts and aggregations that involve arrays.
- [DB-10927] - Adds support for global dictionary compression (GDC) on VARCHAR array columns and the ability to do replacement joins.
- [DB-10282] - Adds support for DROP COLUMN DDL to remove columns from a table.
- [DB-11472] - Adds support for skipping failed rows for CSV loading up to some specified threshold.
6.0
Features- [DB-9707] - Scriptable Bulk Load Essentials: Allows users to create translations and launch bulk load tasks via DDL
- [DB-10479] - Adds support for Tableau through Ocient’s JDBC Custom Connector. Users can find Ocient’s connector and the installation instructions on Tableau’s extension gallery. Please refer to Tableau for more inforamation.
5.0
Features- [DB-9477] - Adds support for the array data type. Users can create single-dimensional array columns from any other supported data type. Please refer to the User Documentation for the latest information on supported data types.
- [DB-9656] - Add column support. The engine now supports the add column DDL statement with the ability to add columns to an existing table. Existing data that was loaded without the new column uses the configured default values when queried. Please refer to User Documentation for information on the DDL syntax and default values.
4.0
Features- [DB-6386] - Availability of the storage engine, allowing queries to run with a node or drive failure
- [DB-6588] - Bulk loading of CSV files from HDFS or an S3 endpoint
- [DB-7221] - Delta compression in the TKT engine for timestamp columns
- [DB-7623] - Virtual tables to retrieve information from the storage cluster state
- [DB-7247] - OS Upgrade functionality
- [DB-6125] - AWS initial support
- [DB-6383] - Data Definition Language (DDL) operations
- [DB-6940] - All system configuration in the System Catalog
- [DB-6362] - Stats Virtual Tables
- [DB-7098] - External Window Operator support
- [DB-7497] - List Running Tasks Page
- [DB-7097] - Segment Group Deletion
- [DB-7139] - Cancel Query and Cancel Task support
- Numerous stability and performance improvements

