S
Single-File GGUF Inference
Run GGUF models directly in your browser with WebAssembly
Visit Single-File GGUF Inference ↗
link: rel="ugc noopener"
A work-in-progress WebAssembly-based tool for single-file GGUF model inference. Enables running quantized language models client-side without external servers. Currently functional with ongoing development and refinement.
Designed for developers exploring local model execution in web environments. The project is open for modification and community contribution, with core inference capabilities implemented.
Discussion