Login
Login Register

Related

Hugging Face Optimum

Optimum provides model optimization pipelines for ONNX Runtime, TensorRT, and OpenVINO, accelerating inference across hardware platforms.

  • 46
  • 820

Modal

Modal hosts LLM inference using serverless GPU functions, allowing developers to deploy custom models without managing infrastructure.

  • 14
  • 935

DeepSpeed Inference

DeepSpeed Inference provides optimizations like DeepFusion, tensor slicing, and kernel fusion for ultra-fast distributed LLM inference.

  • 41
  • 883

🤖 Help GenAIFolks discover smarter tools ✨

Submit
About

Explore 🤖 the AI stack transforming productivity and innovation.
GenAIFolks Tools curates top AI apps, APIs, and frameworks — making it easy for builders, coders, and founders to find the right solution fast. 💡

💬 Got an AI product or partnership idea? Let’s connect at genaifolks.com/contact

Navigation
Follow