Skip to content

A beginner's guide to Local AI with Inkling, Qwen, and Unsloth

We have AI at home! Set up your own free personal ChatGPT on your PC with Unsloth and Inkling or Qwen. It's private, and the whole house can use it.

By Jerry James ·

NVIDIA GeForce RTX 5090 Founders Edition, close on its two fans, against a green background of white blueprint line drawings.
  • local LLM
  • local AI
  • self-hosted LLM
  • Unsloth Desktop
  • Unsloth Studio
  • LM Studio
  • Qwen3.8-27B
  • Inkling 2 Mini
  • Inkling-2-Mini
  • Inkling 2 Small
  • Thinking Machines Lab
  • GGUF
  • UD-Q4_K_XL
  • quantization
  • VRAM
  • context window
  • RTX 5090
  • LAN access
  • Windows
  • MLX
  • Apple Silicon
  • unified memory
  • Gemma 4
  • gpt-oss-20b
  • Qwen3-Coder-30B
  • Qwen3.6-35B
  • RTX PRO 4500 Blackwell
  • Mac Studio
  • DGX Spark
  • VRAM calculator
  • personal ChatGPT
  • private ChatGPT
  • ChatGPT alternative
  • Claude alternative