Tag: 1Bit
Microsoft’s Inference Framework Brings 1-Bit Massive Language Fashions to Native Units
On October 17, 2024, Microsoft introduced BitNet.cpp, an inference framework designed to run 1-bit quantized Massive Language Fashions (LLMs). BitNet.cpp is a major progress...
