Statistics Monitoring

the {{ocienthyperscaledatawarehouse}} maintains many internal statistics you can access the statistics on each node in the database using a rest interface that listens on port 9090 by default for the endpoints, see system information rest endpoints docid\ r kngib6smibxnwafdiq explore the statistics using a command such as curl curl http //oc1 lts0 9090/v1/stats the resulting statistics return in json format this excerpt shows only a partial list of the results \[{ { "name" "localstorageservice device\[sdm00001a616] spacefree", "node" "oc1 lts0", "time" 1591737983812323, "units" "bytes", "value" 356599726080 }, { "name" "localstorageservice device\[sdm00001a616] spacefreepct", "node" "oc1 lts0", "time" 1591737983812323, "units" "none", "value" 4631469015491373042 }, { "name" "localstorageservice device\[sdm00001a616] spacetotal", "node" "oc1 lts0", "time" 1591737983812323, "units" "bytes", "value" 800149299200 } }] because each node can produce a very large number of statistics, the rest interface supports wildcard filtering return statistics that match the regular expression ^localstorageservice using this curl command curl g data urlencode 'filter=^localstorageservice ' http //oc1 lts0 9090/v1/stats the resulting subset of statistics returns in json format \[ { "name" "localstorageservice device segmenttableentries", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 1, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device spacefree", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 0, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device spacefreepct", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 0 000000, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device spacetotal", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 2139074560, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device status", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 10, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device segmenttableentries", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 1, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device spacefree", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 0, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device spacefreepct", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 0 000000, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device spacetotal", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 2139074560, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" }, { "name" "localstorageservice device status", "time" "1684931806764193", "timestamp" "2023 05 24t12 36 46 764z", "node" "sql0", "value" 10, "device" "4568d611 9ea9 4f65 d0z9 8gg5bb220750" } ] the specific set of statistics is subject to change retrieve statistics using telegraf {{telegraf}} is a commonly used monitoring tool this example shows the configuration file for telegraf that gathers statistics from a database node where the statistic name includes localstorageservice ; read formatted metrics from one or more http endpoints \[\[inputs http]] interval = "30s" urls = \[ "http //oc1 lts0 9090/v1/stats?filter=localstorageservice" ] ; http method method = "get" data format = "json" json name key = "name" json time key = "time" json time format = "unix us" json timezone = "america/chicago" tag keys = \[ "node", "silo", "core" ] \[inputs http tags] source = "rolehostd" related links install an ocient system docid\ qhvyfg5eqo7rz8ssuvk1p