Sounds amazing. I hope it gets incorporated into llama.cpp and candle at some po...

		ilaksh on Dec 20, 2023 \| parent \| context \| favorite \| on: LLM in a Flash: Efficient LLM Inference with Limit... Sounds amazing. I hope it gets incorporated into llama.cpp and candle at some point.