Submit
Submit

Related

SmoothQuant

SmoothQuant is an award‑winning quantization method enabling smooth INT8 inference for LLMs and vision models with minimal accuracy loss.

  • 25
  • 546

Ollama

Ollama enables local LLM serving with simple model files, GPU acceleration, model management, and an OpenAI-compatible API for apps.

  • 26
  • 90

OpenLLM

OpenLLM by BentoML enables serving and managing open-source large language models with streamlined deployment workflows.

  • 43
  • 882

🤖 Help GenAIFolks discover smarter tools ✨

Submit
About

Explore 🤖 the AI stack transforming productivity and innovation.
GenAIFolks Tools curates top AI apps, APIs, and frameworks — making it easy for builders, coders, and founders to find the right solution fast. 💡

💬 Got an AI product or partnership idea? Let’s connect at genaifolks.com/contact

Navigation
Follow