genai.text.tokenization package¶ Modules containing functionalities related to text tokenization Submodules¶ genai.text.tokenization.tokenization_service module BaseConfig BaseConfig.create_execution_options CreateExecutionOptions CreateExecutionOptions.batch_size CreateExecutionOptions.callback CreateExecutionOptions.concurrency_limit CreateExecutionOptions.ordered CreateExecutionOptions.rate_limit_options CreateExecutionOptions.throw_on_error TokenizationService TokenizationService.Config TokenizationService.create()