23 Zonghang Li / prima.cpp

prima.cpp: Fast 30-70B LLM Inference on Heterogeneous and Low-Resource Home Clusters