AI article

Why SQLite FTS5's default tokenizer drops your Japanese substrings (and the one-line fix)

FTS5's unicode61 tokenizer silently fails on CJK substring queries. Switching to trigram tokenization fixes it — here's the whole change, plus the two-layer...

Dev.to | Jun 9, 2026 | Omochi

Read the original article

More AI news