Tokenizer

This file contains the tokenizer for the application.

Type Aliases

IpadicFeatures

type IpadicFeatures = kuromoji.IpadicFeatures;

Defined in: src/services/tokenizer.ts:6

---

KuromojiTokenizer

type KuromojiTokenizer = kuromoji.Tokenizer<IpadicFeatures>;

Defined in: src/services/tokenizer.ts:7

Functions

getTokenizer()

function getTokenizer(): Promise<KuromojiTokenizer>;

Defined in: src/services/tokenizer.ts:25

Gets the Kurmoji tokenizer with the DICT_PATH constant set

Returns

Promise\<KuromojiTokenizer>

A promise that resolves to the tokenizer.