KServe

Provide access to AI model servers with the KServe standard to run inference with remote models

What’s inside

KServe component, URI syntax: kserve:api

Please refer to the above links for usage and configuration details.

Maven coordinates

<dependency>
    <groupId>org.apache.camel.springboot</groupId>
    <artifactId>camel-kserve-starter</artifactId>
</dependency>

Spring Boot Auto-Configuration

The starter supports 10 options, which are listed below.

Name	Description	Default	Type
camel.component.kserve.autowired-enabled	Whether autowiring is enabled. This is used for automatic autowiring options (the option must be marked as autowired) by looking up in the registry to find if there is a single instance of matching type, which then gets configured on the component. This can be used for automatic configuring JDBC data sources, JMS connection factories, AWS Clients, etc.	true	Boolean
camel.component.kserve.configuration	The configuration. The option is a org.apache.camel.component.kserve.KServeConfiguration type.		KServeConfiguration
camel.component.kserve.credentials	The credentials of the client. The option is a io.grpc.ChannelCredentials type.		ChannelCredentials
camel.component.kserve.enabled	Whether to enable auto configuration of the kserve component. This is enabled by default.		Boolean
camel.component.kserve.health-check-consumer-enabled	Used for enabling or disabling all consumer based health checks from this component	true	Boolean
camel.component.kserve.health-check-producer-enabled	Used for enabling or disabling all producer based health checks from this component. Notice: Camel has by default disabled all producer based health-checks. You can turn on producer checks globally by setting camel.health.producersEnabled=true.	true	Boolean
camel.component.kserve.lazy-start-producer	Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel’s routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing.	false	Boolean
camel.component.kserve.model-name	The name of the model used for inference.		String
camel.component.kserve.model-version	The version of the model used for inference.		String
camel.component.kserve.target	The target URI of the client. See: https://grpc.github.io/grpc-java/javadoc/io/grpc/Grpc.html#newChannelBuilder%28java.lang.String,io.grpc.ChannelCredentials%29	localhost:8001	String

Name

Description

Default

Type

camel.component.kserve.autowired-enabled

Whether autowiring is enabled. This is used for automatic autowiring options (the option must be marked as autowired) by looking up in the registry to find if there is a single instance of matching type, which then gets configured on the component. This can be used for automatic configuring JDBC data sources, JMS connection factories, AWS Clients, etc.

true

Boolean

camel.component.kserve.configuration

The configuration. The option is a org.apache.camel.component.kserve.KServeConfiguration type.

KServeConfiguration

camel.component.kserve.credentials

The credentials of the client. The option is a io.grpc.ChannelCredentials type.

ChannelCredentials

camel.component.kserve.enabled

Whether to enable auto configuration of the kserve component. This is enabled by default.

Boolean

camel.component.kserve.health-check-consumer-enabled

Used for enabling or disabling all consumer based health checks from this component

true

Boolean

camel.component.kserve.health-check-producer-enabled

Used for enabling or disabling all producer based health checks from this component. Notice: Camel has by default disabled all producer based health-checks. You can turn on producer checks globally by setting camel.health.producersEnabled=true.

true

Boolean

camel.component.kserve.lazy-start-producer

Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel’s routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing.

false

Boolean

camel.component.kserve.model-name

The name of the model used for inference.

String

camel.component.kserve.model-version

The version of the model used for inference.

String

camel.component.kserve.target

The target URI of the client. See: https://grpc.github.io/grpc-java/javadoc/io/grpc/Grpc.html#newChannelBuilder%28java.lang.String,io.grpc.ChannelCredentials%29

localhost:8001

String