llm-fit

Which LLMs this machine can actually run, and how fast. Reads the hardware, does the memory and bandwidth arithmetic, and recommends a model, a quantization and a runtime — with an estimate of how…