shop.antonnovikov.com / private-llm
Private LLM on your own server
Some data cannot be sent to an outside API: contracts, customer records, source code. I size the hardware, then deploy an open-weights language model on your own server or a rented GPU, with an OpenAI-compatible API, access control, monitoring and a written update procedure. The data stays with you, and you pay for the hardware, not for every request.
What is included
- GPU sizing report: which model fits which hardware, measured speed in tokens per second, and a cost comparison of buying versus renting
- Deployment as code in your repository (Docker Compose or Helm), so the whole setup can be rebuilt with one command
- An OpenAI-compatible API behind TLS with authentication: tools and SDKs that speak the OpenAI API work after changing the base URL
- Logs, health checks and a basic dashboard: GPU load, memory, latency and tokens per second
- A written update and rollback procedure for the model, the serving software and the GPU drivers
- Handover: source code and a short operations guide
Calculator
Request
To send a request, log in or create an account: you will see its status and can write to me in one thread. Your chosen options are kept.
Other services
- AI assistant for support and salesfrom $920 A chat assistant that answers customers from your knowledge, on your site or in messengers.
- Knowledge base search and Q&A (RAG)from $1,840 Ask questions in plain language, get answers with sources from your documents.
- AI workflow automationfrom $710 Routine work done by n8n or Python workflows with LLM steps: sort, summarise, draft, route.
- AI Telegram botfrom $1,050 A Telegram bot that chats, reads files and photos, remembers context and does things for users.