what i've learned today

Mongo nGram vs edgeGram

Core Structural Difference

To see how they differ, let’s break down the word "mongo" using a minimum gram size of 2 and maximum of 4:

TokenizerStrategy / BehaviorGenerated Tokens for "mongo"
edgeGramLeft-Edge Anchored: Keeps the cursor at the zero position (start of the word) and builds out."mo", "mon", "mong"
nGramSliding Window: Moves character by character across the entire word, grabbing every combination."mo", "mon", "mong", "on", "ong", "ng", "go"

Linked from

Nothing links here yet.

← all notes