tokenizer
Subject: DATA / Computer programming
| Language | Term |
|---|
| Arabic - AR | مقطع وحدات اللغة |
| DE - German | Tokenizer |
| EN - English | tokenizer |
| ES - Spanish | segmentador |
| FR - French | segmenteur |
| JA - Japanese | トークナイザ |
| KO - Korean | 토크나이저 |
| PT - Portuguese | tokenizador |
| RU - Russian | токенизатор |
| ZH - Chinese | 分词器 |