System Administration
...
Install an Ocient System
Installation Reference
Ocient System Sizing
The System must be the proper size for your data and query requirements. Follow these steps to determine the size of your Ocient System. Contact Ocient to aid with the Ocient System calculations, established configuration, and node quantities.
- Gather the uncompressed size of your current database or data and its format. If your data resides in a database, determine the compression ratio of the data. Further, consider whether your data is streaming or file-based. For streaming or time series data, investigate the level of data granularity (for example, minute, hour, or day).
- Calculate the quantity of data (in Gbps or the number of rows in a specific unit of time) that you plan to load into the Ocient System and at what cadence (for example, continuous loading or specific schedule). Describe the latency you expect between the data creation and when data reaches the destination. As you consider the quantity, determine the percent of NULL data. Also, think about the retention period required for the data.
- Determine the level (small, medium, or large) of data transformation in the data pipeline loading process. See whether you require any user-defined transformations. Investigate whether your transformations are done programmatically or using SQL. After the initial data load, see if you require more transformations, such as cubes or views.
- Investigate the types of queries you plan to execute (for example, simple filters, complex aggregation or sorting, complex joins, or transformation). In addition, review your query workload (number of queries in a specific unit of time) and how many queries you expect to execute in parallel. Consider any objectives you have for system readiness to execute queries.
- Calculate the compressed data volume. Consider your compression requirements for the stored data (for example, Global Dictionary Compression).
- Add index, statistics, working space, and parity size to the compressed data volume.
- Use the established storage space configuration in the Ocient System for data nodes, parity nodes, and the number of clusters.
- Using the known size and level of transformation in loading, determine the total number of cores, memory, and storage for your requirements.
- Calculate the number of SQL Nodes, Loader Nodes, Foundation Nodes, Metadata Nodes, and supporting nodes. Ocient personnel assist with this step.
The number of specific nodes determines the size of the Ocient System. After you have the latter numbers, then you can purchase, install, and configure the system.