LuceneStandardTokenizer Class

Package:
com.azure.search.documents.indexes.models
Maven Artifact:
com.azure:azure-search-documents:12.0.0

public final class LuceneStandardTokenizer
extends LexicalTokenizer

Breaks text following the Unicode Text Segmentation rules. This tokenizer is implemented using Apache Lucene.

Constructor Summary

Constructor Description
LuceneStandardTokenizer(String name)

Creates an instance of LuceneStandardTokenizer class.

Method Summary

Modifier and Type Method and Description
static LuceneStandardTokenizer fromJson(JsonReader jsonReader)

Reads an instance of LuceneStandardTokenizer from the JsonReader.
Integer getMaxTokenLength()

Get the maxTokenLength property: The maximum token length.
String getOdataType()

Get the odataType property: The discriminator for derived types.
LuceneStandardTokenizer setMaxTokenLength(Integer maxTokenLength)

Set the maxTokenLength property: The maximum token length.
JsonWriter toJson(JsonWriter jsonWriter)

Methods inherited from LexicalTokenizer

fromJson getName getOdataType toJson

Methods inherited from java.lang.Object

clone equals finalize getClass hashCode notify notifyAll toString wait wait wait

Constructor Details

LuceneStandardTokenizer

public LuceneStandardTokenizer(String name)

Creates an instance of LuceneStandardTokenizer class.

Parameters:

name - the name value to set.

Method Details

fromJson

public static LuceneStandardTokenizer fromJson(JsonReader jsonReader)

Reads an instance of LuceneStandardTokenizer from the JsonReader.

Parameters:

jsonReader - The JsonReader being read.

Returns:

An instance of LuceneStandardTokenizer if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.

Throws:

IOException

 - If the deserialized JSON object was missing any required properties.

getMaxTokenLength

public Integer getMaxTokenLength()

Get the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split.

Returns:

the maxTokenLength value.

getOdataType

public String getOdataType()

Get the odataType property: The discriminator for derived types.

Overrides:

LuceneStandardTokenizer.getOdataType()

Returns:

the odataType value.

setMaxTokenLength

public LuceneStandardTokenizer setMaxTokenLength(Integer maxTokenLength)

Set the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split.

Parameters:

maxTokenLength - the maxTokenLength value to set.

Returns:

the LuceneStandardTokenizer object itself.

toJson

public JsonWriter toJson(JsonWriter jsonWriter)

Overrides:

LuceneStandardTokenizer.toJson(JsonWriter jsonWriter)

Parameters:

jsonWriter

Throws:

Applies to