OrcaBonsai-27B-Uncensored
Runtime behavioral ablation for compressed large language models
Visit OrcaBonsai-27B-Uncensored ↗
link: rel="ugc noopener"
OrcaBonsai-27B-Uncensored applies runtime behavioral ablation techniques to compressed LLMs, specifically targeting Ternary Bonsai 2 27B. The approach modifies model behavior at runtime without requiring weight modification or re-quantization, offering a practical method for adapting compressed language models.
Developed by the OrcaRouter team, this tool addresses the challenge of maintaining or improving performance in quantized and compressed models through post-hoc behavioral techniques rather than retraining or re-quantization procedures.
Discussion