NL-FM-Toolkit
Getting Started:
Introduction
Installation
Training a Tokenizer from Scratch
Creating Model Configuration File
Training a Masked Language Model from Scratch
Training a Causal Language Model from Scratch
Training a Sequence Labeler
Training a Sequence Classifier
Scripts
Modules
NL-FM-Toolkit
Overview: module code
All modules for which code is available
create_config
run_clm
run_mlm
run_seq
run_tc
tokenize_corpus
train_tokenizer