EveryDev.ai
Subscribe
Home
Tools

5,901+ AI tools

  • Featured
  • Gems
  • Trending
  • New
  • Rate tools
  • Compare
  • Arena
Categories
  • Agents2972
  • Coding2248
  • Infrastructure1067
  • Projects818
  • MCP794
  • Research744
  • Analytics565
  • Marketing527
  • Design488
  • Testing476
  • Data442
  • Security412
  • Integration288
  • Communication284
  • Prompts283
  • Extensions238
  • Voice213
  • DevOps190
  • Commerce183
  • Web128
  • Learning123
  • Finance44
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Tools
    3. LlamaFactory
    LlamaFactory icon

    LlamaFactory

    AI Infrastructure
    Featured

    Open-source framework for fine-tuning 100+ large language models and vision-language models through a zero-code CLI and web UI.

    Visit Website

    At a Glance

    Pricing
    Open Source

    Self-hosted LlamaFactory core released under the Apache License 2.0.

    Engagement

    Available On

    Windows
    macOS
    Linux
    Web
    API

    Resources

    WebsiteDocsGitHubllms.txt

    Topics

    AI InfrastructureAI Development LibrariesModel Management

    Alternatives

    OpenRLHFverlHugging Face
    Developer
    Prism ShadowCentralEst. 2025

    Listed Nov 2026

    About LlamaFactory

    LlamaFactory is an open-source training and fine-tuning platform for large language models and vision-language models, maintained under the GitHub handle hiyouga. It lets users fine-tune more than a hundred pretrained models locally through a command-line interface or the LLaMA Board web UI, without writing training code. The latest listed release is v0.9.5, published 2026-05-30.

    What It Is

    LlamaFactory is a unified fine-tuning framework. Users prepare a dataset, choose a model and training method in a YAML config or the web UI, and run training, inference, evaluation, and export. The documentation lists supported model families including LLaMA, LLaVA, Mistral, Mixtral-MoE, Qwen, Gemma, DeepSeek, GLM, and Phi.

    Training Methods and Efficiency

    Supported approaches include continued pre-training, supervised fine-tuning, reward modeling, PPO, DPO, KTO, ORPO, and SimPO. Precision and parameter-efficiency options include 16-bit full tuning, freeze tuning, LoRA, and 2- to 8-bit QLoRA via AQLM, AWQ, GPTQ, LLM.int8, HQQ, and EETQ. It also documents optimizers and tricks such as GaLore, BAdam, APOLLO, Adam-mini, Muon, OFT, DoRA, LoRA+, PiSSA, FlashAttention-2, Unsloth, and Liger Kernel. Distributed training is documented with DDP, DeepSpeed, FSDP, FSDP2, and Ray, plus a Megatron-core backend.

    Workflow and Outputs

    The quickstart uses llamafactory-cli train, chat, and export to run LoRA fine-tuning, inference, and adapter merging. Models can be served through an OpenAI-style API with vLLM or SGLang workers. Experiments can be tracked with LlamaBoard, TensorBoard, Weights & Biases, MLflow, or SwanLab. Models and datasets can be downloaded from Hugging Face, ModelScope, or Modelers Hub.

    Hardware and Deployment Options

    Installation is available from source, via Docker images for CUDA, Ascend NPU, and AMD ROCm, and with Windows-specific guidance. The README gives estimated memory requirements by method and model size, and documents Ascend NPU support.

    LlamaFactory - 1

    Community Discussions

    Be the first to start a conversation about LlamaFactory

    Share your experience with LlamaFactory, ask questions, or help others learn from your insights.

    Pricing

    OPEN SOURCE

    Open Source

    Self-hosted LlamaFactory core released under the Apache License 2.0.

    • Apache License 2.0 (OSI-approved)
    • Zero-code CLI and Web UI for fine-tuning 100+ LLMs and VLMs
    • Run locally; user supplies own compute

    Capabilities

    Key Features

    • Zero-code CLI and LLaMA Board web UI for fine-tuning
    • Support for 100+ LLMs and vision-language models
    • Pre-training, SFT, reward modeling, PPO, DPO, KTO, ORPO, and SimPO
    • Full, freeze, LoRA, and QLoRA tuning with 2-8 bit quantization
    • Advanced optimizers such as GaLore, BAdam, APOLLO, Muon, and OFT
    • Acceleration via FlashAttention-2, Unsloth, and Liger Kernel
    • Distributed training with DeepSpeed, FSDP, and Ray
    • OpenAI-style API serving with vLLM or SGLang
    • LoRA merging and model export
    • Experiment monitoring with TensorBoard, W&B, MLflow, and SwanLab
    • Multimodal tasks including image, video, and audio understanding
    • Ascend NPU and AMD ROCm support

    Integrations

    Hugging Face
    ModelScope
    Modelers Hub
    vLLM
    SGLang
    DeepSpeed
    Weights & Biases
    SwanLab
    TensorBoard
    MLflow
    Gradio
    Docker
    Ollama
    Unsloth
    FlashAttention-2
    API Available
    View Docs

    Ratings & Reviews

    No ratings yet

    Be the first to rate LlamaFactory and help others make informed decisions.

    Rate other tools you’ve used

    Developer

    Prism Shadow

    Prism Shadow builds PenguinHarness, an open-source AI agent harness for constructing and recursively self-improving agents. The team is led by Yaowei Zheng, author of LlamaFactory, and operates as the PrismShadow AI Team on GitHub. The project is licensed under Apache-2.0 and targets developers who want locally deployed, cost-efficient agentic AI without vendor lock-in.

    Founded 2025
    19 Keppel Road, Singapore
    50 employees
    Read more about Prism Shadow
    WebsiteGitHubX / Twitter
    2 tools in directory

    Similar Tools

    OpenRLHF icon

    OpenRLHF

    Open-source RLHF and agentic reinforcement learning framework for LLMs and VLMs built on Ray, vLLM and DeepSpeed.

    verl icon

    verl

    Open-source RL training library for large language models implementing the HybridFlow framework, with support for PPO, GRPO and multiple training and rollout backends.

    Hugging Face icon

    Hugging Face

    The AI community platform for collaborating on machine learning models, datasets, and applications, with over 2 million models and 500k datasets hosted.

    Browse all tools

    Related Topics

    AI Infrastructure

    Infrastructure designed for deploying and running AI models.

    595 tools

    AI Development Libraries

    Programming libraries and frameworks that provide machine learning capabilities, model integration, and AI functionality for developers.

    578 tools

    Model Management

    Tools for managing, versioning, and deploying AI models.

    147 tools
    Browse all topics
    Back to all toolsSuggest an edit
    ratings
    discussions