Home › Model Serving › Self-hosted AI Starter Kit

Self-hosted AI Starter Kit - AI Model Serving Tool

Overview

An open-source Docker Compose template that sets up a local AI and low-code development environment. Curated by n8n, it integrates n8n, Ollama, Qdrant, and PostgreSQL for secure, self-hosted AI workflows.

Key Features

  • Docker Compose template to orchestrate local AI and supporting services
  • Integrated self-hosted n8n low-code automation platform
  • Ollama integration for running local large language models
  • Qdrant vector database for embeddings and similarity search
  • PostgreSQL for structured data and workflow persistence
  • Curated by n8n with ready-to-use service wiring

Ideal Use Cases

  • Local AI prototyping and testing with self-hosted components
  • Private, on-premise AI workflows avoiding external cloud services
  • Low-code automation connecting local LLMs to databases and services
  • Evaluate and compare local LLMs without external API calls

Getting Started

  • Clone the GitHub repository to your machine
  • Install Docker and Docker Compose if not already present
  • Copy or review the provided docker-compose.yml and environment files
  • Adjust environment variables for database and model paths as needed
  • Start services with docker-compose up -d and monitor logs
  • Access n8n UI and other service endpoints locally

Pricing

No pricing disclosed; project is an open-source GitHub template.

Key Information

  • Category: Model Serving
  • Type: AI Model Serving Tool
Visit Official Website

Related Tools

Replicate

A platform that allows users to run, host, and share AI models via an API, supporting a variety of generative tasks.
Hugging Face

A robust AI platform where the machine learning community collaborates on models, datasets, and applications.
Hugging Face Spaces

A platform for hosting machine learning demo apps with support for GPU acceleration, Docker, and custom Python environments.
HUGS

Optimized, zero‐configuration inference microservices from Hugging Face designed to simplify and accelerate the deployment of open AI models via an OpenAI‐compatible API.
OpenVINO

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference across various platforms. It supports models trained with popular frameworks and enhances performance for deep learning tasks in computer vision, automatic speech recognition, and natural language processing.
Hugging Face Hub

The official Python client for the Hugging Face Hub, allowing users to interact with pre-trained models and datasets, manage repositories, and run inference on deployed models.