How to train my own model with other checkpoints?

[ryangawei]

Hi,

First, thank you for the excellent work.

I want to train my own model with the SPECTER's objective, e.g. starting with huggingface's bert-base-uncased instead of SciBERT. If possible, what should I do?

Thanks!