TensorFlow Serving

Provide access to TensorFlow Serving model servers to run inference with TensorFlow saved models remotely

What’s inside

TensorFlow Serving component, URI syntax: tensorflow-serving:api

Please refer to the above links for usage and configuration details.

Maven coordinates

<dependency>
    <groupId>org.apache.camel.springboot</groupId>
    <artifactId>camel-tensorflow-serving-starter</artifactId>
</dependency>

Spring Boot Auto-Configuration

The starter supports 10 options, which are listed below.

Name	Description	Default	Type
camel.component.tensorflow-serving.autowired-enabled	Whether autowiring is enabled. This is used for automatic autowiring options (the option must be marked as autowired) by looking up in the registry to find if there is a single instance of matching type, which then gets configured on the component. This can be used for automatic configuring JDBC data sources, JMS connection factories, AWS Clients, etc.	true	Boolean
camel.component.tensorflow-serving.configuration	The configuration. The option is a org.apache.camel.component.tensorflow.serving.TensorFlowServingConfiguration type.		TensorFlowServingConfiguration
camel.component.tensorflow-serving.credentials	The credentials of the client. The option is a io.grpc.ChannelCredentials type.		ChannelCredentials
camel.component.tensorflow-serving.enabled	Whether to enable auto configuration of the tensorflow-serving component. This is enabled by default.		Boolean
camel.component.tensorflow-serving.lazy-start-producer	Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel’s routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing.	false	Boolean
camel.component.tensorflow-serving.model-name	Required servable name.		String
camel.component.tensorflow-serving.model-version	Optional choice of which version of the model to use. Use this specific version number.		Long
camel.component.tensorflow-serving.model-version-label	Optional choice of which version of the model to use. Use the version associated with the given label.		String
camel.component.tensorflow-serving.signature-name	A named signature to evaluate. If unspecified, the default signature will be used.		String
camel.component.tensorflow-serving.target	The target URI of the client. See: https://grpc.github.io/grpc-java/javadoc/io/grpc/Grpc.html#newChannelBuilder%28java.lang.String,io.grpc.ChannelCredentials%29	localhost:8500	String

Name

Description

Default

Type

camel.component.tensorflow-serving.autowired-enabled

Whether autowiring is enabled. This is used for automatic autowiring options (the option must be marked as autowired) by looking up in the registry to find if there is a single instance of matching type, which then gets configured on the component. This can be used for automatic configuring JDBC data sources, JMS connection factories, AWS Clients, etc.

true

Boolean

camel.component.tensorflow-serving.configuration

The configuration. The option is a org.apache.camel.component.tensorflow.serving.TensorFlowServingConfiguration type.

TensorFlowServingConfiguration

camel.component.tensorflow-serving.credentials

The credentials of the client. The option is a io.grpc.ChannelCredentials type.

ChannelCredentials

camel.component.tensorflow-serving.enabled

Whether to enable auto configuration of the tensorflow-serving component. This is enabled by default.

Boolean

camel.component.tensorflow-serving.lazy-start-producer

Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel’s routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing.

false

Boolean

camel.component.tensorflow-serving.model-name

Required servable name.

String

camel.component.tensorflow-serving.model-version

Optional choice of which version of the model to use. Use this specific version number.

Long

camel.component.tensorflow-serving.model-version-label

Optional choice of which version of the model to use. Use the version associated with the given label.

String

camel.component.tensorflow-serving.signature-name

A named signature to evaluate. If unspecified, the default signature will be used.

String

camel.component.tensorflow-serving.target

The target URI of the client. See: https://grpc.github.io/grpc-java/javadoc/io/grpc/Grpc.html#newChannelBuilder%28java.lang.String,io.grpc.ChannelCredentials%29

localhost:8500

String