Function gf::pivot::tokenizer::call_tokenizer

pub fn call_tokenizer<'a>(
    tokenizer: Tokenizer<'a>, 
    input: &mut BitSlice<'_>
) -> Option<Vec<AggregateValue<'a>>>

🟢 Call a tokenizer.

If you need multiple calls of the same tokenizer, use TokenizerInstance instead.