fix: add missing pre-tokenizer type for GPT-2 BPE models#508
Open
raphaelbgr wants to merge 1 commit into
Open
Microsoft GitHub Policy Service / license/cla
succeeded
Mar 23, 2026 in 0s
All CLA requirements met.
This check verifies that the author has agreed to a CLA with Microsoft.
Loading