Optimized to run on 8Gb vram without OOM, Dynamic quantization [Do not Merge]#76
Open
nalexand wants to merge 2 commits into
Open
Optimized to run on 8Gb vram without OOM, Dynamic quantization [Do not Merge]#76nalexand wants to merge 2 commits into
nalexand wants to merge 2 commits into
