Running MACaQ on an M4 with 16GB RAM: Estimated 29 minutes just for finishing. Standard IQ4_XS takes 77 seconds

The Huawei research team has released the quantization tool "MACaQ" as open source. On r/LocalLLaMA, it has become a hot ...