Continued Pre-training

Further training an FM on large amounts of unlabeled domain data to build domain knowledge.

Useful for teaching a model the vocabulary of a specialized field.

Related terms