Package ai.djl.huggingface.translator

Class TextEmbeddingTranslator

java.lang.Object

ai.djl.huggingface.translator.TextEmbeddingTranslator

All Implemented Interfaces:

ai.djl.translate.PostProcessor<float[]>, ai.djl.translate.PreProcessor<String>, ai.djl.translate.Translator<String,float[]>

public class TextEmbeddingTranslator
extends Object
implements ai.djl.translate.Translator<String,float[]>

The translator for Huggingface text embedding model.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	TextEmbeddingTranslator.Builder	The builder for token classification translator.

Method Summary

Modifier and Type	Method	Description
static TextEmbeddingTranslator.Builder	builder(HuggingFaceTokenizer tokenizer)	Creates a builder to build a TextEmbeddingTranslator.
static TextEmbeddingTranslator.Builder	builder(HuggingFaceTokenizer tokenizer, Map<String,?> arguments)	Creates a builder to build a TextEmbeddingTranslator.
ai.djl.translate.Batchifier	getBatchifier()
ai.djl.ndarray.NDList	processInput(ai.djl.translate.TranslatorContext ctx, String input)
float[]	processOutput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList list)
TextEmbeddingBatchTranslator	toBatchTranslator(ai.djl.translate.Batchifier batchifier)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.djl.translate.Translator

getExpansions, prepare, toBatchTranslator

Method Details

getBatchifier

public ai.djl.translate.Batchifier getBatchifier()

Specified by:

getBatchifier in interface ai.djl.translate.Translator<String,float[]>

processInput

public ai.djl.ndarray.NDList processInput(ai.djl.translate.TranslatorContext ctx,
 String input)

Specified by:

processInput in interface ai.djl.translate.PreProcessor<String>

processOutput

public float[] processOutput(ai.djl.translate.TranslatorContext ctx,
 ai.djl.ndarray.NDList list)

Specified by:

processOutput in interface ai.djl.translate.PostProcessor<float[]>

toBatchTranslator

public TextEmbeddingBatchTranslator toBatchTranslator(ai.djl.translate.Batchifier batchifier)

Specified by:

toBatchTranslator in interface ai.djl.translate.Translator<String,float[]>

builder

public static TextEmbeddingTranslator.Builder builder(HuggingFaceTokenizer tokenizer)

Creates a builder to build a TextEmbeddingTranslator.

Parameters:

tokenizer - the tokenizer

Returns:

a new builder

builder

public static TextEmbeddingTranslator.Builder builder(HuggingFaceTokenizer tokenizer,
 Map<String,?> arguments)

Creates a builder to build a TextEmbeddingTranslator.

Parameters:

tokenizer - the tokenizer

arguments - the models' arguments

Returns:

a new builder