Has anyone quantized chandra?

[furquanh]

Hi,

I was wondering if there is a FP8 version of chandra? Is there a performance degradation between BF16 vs FP8?

Thanks

[2abet]

Check out noctrex on Huggingface. https://huggingface.co/noctrex/Chandra-OCR-GGUF