check point, parameter size missmatch

[KyungHyunLim]

I have a problem when model load.
I did't change anything in config what downloaded on hugging-face.

torch.Size([128256, 1024]) from checkpoint, the shape in current model is torch.Size([128256, 4096])

transformers = 4.53.1

[Luoyingfeng8]

I have a problem when model load. I did't change anything in config what downloaded on hugging-face.

torch.Size([128256, 1024]) from checkpoint, the shape in current model is torch.Size([128256, 4096])

transformers = 4.53.1

We implemented and tested our code using transformers==4.39.2.
To ensure compatibility, we strongly recommend using this version.