Pickle error when generating from a mistral model trained with unsloth

[kendrickb-nvidia]

Priority Level

Medium (Annoying but has workaround)

Describe the bug

Training succeeds, but generation fails with:

Can't pickle <class 'transformers.models.mistral.configuration_mistral.MistralConfig'>: it's not the same object as transformers.models.mistral.configuration_mistral.MistralConfig

Steps/Code to reproduce bug

Use mistralai/Mistral-7B-Instruct-v0.3 with use_unsloth=True

Expected behavior

Training with unsloth succeeds. Or if unsloth cannot work with mistral, throws a clear error message before training.

Additional context

No response

[nina-xu]

this is no longer the case since upgrading vllm and unsloth #342