Documentation Index
Fetch the complete documentation index at: https://docs.ocient.com/llms.txt
Use this file to discover all available pages before exploring further.
Data Pipelines are now the preferred method for loading data into the System. For details, see Load Data. To bootstrap UDT development, contact Ocient Support.
UDT Interface
A UDT is implemented as a JMESPath Java Function. A Function is comprised of three elements:
- name - the function’s name determines how it can be called in a user pipeline e.g.,
negate
- arguments - what inputs the function expects to be called with
- body - the function’s implementation, including return value
UDT names must be globally unique. LAT validates UDT names on startup to ensure that no two UDT names collide with each other and that no UDT name collides with an LAT builtin transformation.
This example function demonstrates these concepts:
// negate(number) - takes an input number and changes its sign
// function name - derived from the class name, NegateFunction -> negate
public class NegateFunction extends BaseFunction {
public NegateFunction() {
super(
// function arguments; this function takes exactly one argument of type number
ArgumentConstraints.typeOf(JmesPathType.NUMBER));
}
// function body
protected <T> T callFunction(Adapter<T> runtime, List<FunctionArgument<T>> arguments) {
double original = runtime.toNumber(arguments.get(0).value()).doubleValue();
return runtime.createNumber(original * -1);
}
}
UDT Packaging
One or more UDTs can be packaged in a jar file for consumption by LAT. In addition to the UDT implementations themselves, the jar file must contain a services file containing a mapping of all the UDTs the jar should expose for use by LAT. This service file must be located at META-INF/services/io.burt.jmespath.function.Function in the resulting jar, and its contents should be as follows:
com.ocient.myudt.NegateFunction
The file at the path META-INF/services/io.burt.jmespath.function.Function should include the fully qualified name of one or more UDTs contained within this jar to be used by LAT. Each UDT should be specified on its own line in the file.
Dependencies
If the UDT has dependencies on third party libraries, those libraries must be packaged in the same jar file. This is commonly referred to as a “fat jar”, “uber jar”, or “jar with dependencies.” Instructions for building such a jar file with Maven™ can be found here.
UDT Deployment
LAT can be configured to search for UDT jars in a particular directory. See LAT Source Configuration for details. LAT can read multiple UDTs across multiple jar files.
On startup, LAT will read all available UDTs into its configuration. To update the set of UDTs available to LAT, such as to add an additional UDT jar, a process restart is required.
Ingest Data with Legacy LAT Reference
