How to use Ayou/chinese_mobile_bert with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="Ayou/chinese_mobile_bert")
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("Ayou/chinese_mobile_bert") model = AutoModelForMaskedLM.from_pretrained("Ayou/chinese_mobile_bert")
在2.5亿的中文语料上，进行mobie_bert进行预训练。在单卡-A100下迭代100万 steps,训练15天。
