In order for us to enable users to run their finetuned models that are LlamaCPP compatible, we need to add this compatibility in our class structure.