Free On-Prem AI tools
102 templates, calculators, worksheets and reference tables. Each runs in your browser and exports to PDF, Excel, Word or CSV.
Calculators and simulators
On-Prem LLM Total Cost of Ownership Calculator
Model the full multi-year cost of running LLMs on your own hardware, including GPU capex, power, cooling, support contracts, and operations staffing.
GPU Sizing Calculator for LLM Inference
Work out how many GPUs you need to serve a given open-weight model to your user base, based on memory footprint and token throughput.
On-Prem vs Cloud AI Cost Comparison Calculator
Compare your projected cloud LLM API bill against an amortized on-prem GPU deployment and find the breakeven month.
Self-Hosted LLM Hardware Estimator
Estimate the VRAM footprint, GPU count, and hardware budget required to self-host an open-weight LLM with your concurrency and context needs.
LLM API vs Self-Hosted Cost Calculator
Model your API bill from requests and token mix, compare it against an all-in self-hosted monthly cost, and see monthly and annual savings.
RAG Infrastructure Sizing Calculator
Estimate vector storage, node RAM, generation GPUs, and monthly infrastructure cost for a retrieval-augmented generation deployment over your document corpus.
On-Prem AI ROI Calculator
Turn hours saved per employee into annual net benefit, payback months, and 3-year ROI for an on-prem AI investment.
LLM Token Cost Calculator
Turn request volume, prompt length, and per-million token pricing into a defensible monthly and annual LLM budget, including the effect of prompt caching.
AI Data Center Power and Cooling Calculator
Convert GPU count and class into facility electrical load, required cooling capacity, and annual energy cost before you commit to an on-prem AI build.
Model Context Window Planner
Allocate a fixed context window across system prompt, retrieved chunks, conversation history, and reserved output, then see exactly how much retrieval headroom is left.
AI Inference Latency Calculator
Estimate decode throughput, time to first token, and end-to-end response time for a self-hosted model from GPU memory bandwidth, parameter count, and quantization.
GPU Cluster Utilization Calculator
Turn GPU capital, amortization, and operating cost into an effective cost per productive GPU hour, and find the utilization threshold where owning beats renting.
Private RAG Corpus Sizing Calculator
Estimate chunk counts, vector index storage, raw text volume, and embedding compute time before you build a private retrieval system over your document estate.
Llama 4 Hardware Requirements Calculator
Estimate VRAM, GPU count, and capital cost to run Llama 4 Scout or Maverick on your own hardware, accounting for full mixture-of-experts weight loading and KV cache growth.
Qwen3 Deployment Sizing Calculator
Size VRAM, GPU count, and capital cost across the Qwen3 family, from the 235B-A22B mixture-of-experts flagship down to the dense 8B model.
DeepSeek R1 GPU Requirements Calculator
Estimate the GPU count and capital cost required to self-host DeepSeek R1, a 671B-parameter mixture-of-experts reasoning model with only 37B active per token.
DeepSeek V3 Serving Cost Calculator
Turn DeepSeek V3's GPU footprint and your monthly token volume into an amortized cost per million tokens, so you can compare self-hosting against API pricing on equal terms.
Mistral Large On-Prem Sizing Calculator
Estimate VRAM, GPU count, and capital cost to self-host Mistral Large's 123B dense parameter model, with predictable memory scaling and no MoE routing complexity.
Gemma 3 Deployment Calculator
Size VRAM, GPU count, and capital cost across the Gemma 3 family, from the 1B edge model to the 27B flagship, with sliding-window attention keeping KV cache low.
gpt-oss Hardware Sizing Calculator
Size VRAM, GPU count, and capital cost for OpenAI's Apache 2.0 licensed gpt-oss-20b or gpt-oss-120b, both natively quantized to MXFP4 for single-GPU deployment.
Kimi K2 Deployment Cost Calculator
Estimate the multi-GPU cluster cost required to self-host Kimi K2, a roughly 1 trillion parameter mixture-of-experts model with only 32B active per token.
GLM-4.5 On-Prem Sizing Calculator
Size VRAM, GPU count, and capital cost for GLM-4.5 or the smaller GLM-4.5-Air, both mixture-of-experts models tuned for agentic and coding workloads.
Llama 3.3 70B Inference Calculator
Size VRAM, GPU count, and capital cost to self-host Llama 3.3 70B, a dense model that remains the default starting point for enterprise on-prem AI in 2026.
LoRA Fine-Tuning Cost Calculator
Turn model size, dataset tokens, epochs, and rank into a GPU-hour and dollar estimate for a LoRA fine-tuning run on rented or owned hardware.
QLoRA vs Full Fine-Tuning Cost Calculator
See the GPU memory footprint, GPU-hour requirement, and dollar cost gap between QLoRA and full fine-tuning for the same model size and dataset.
Fine-Tuning Dataset Size Estimator
Estimate the number of training examples, total tokens, and human curation hours needed for a fine-tuning dataset based on task complexity and quality bar.
DPO Alignment Training Cost Calculator
Estimate compute cost and preference-pair collection cost for a DPO alignment pass that follows supervised fine-tuning.
Model Distillation Savings Calculator
Compare the ongoing cost of calling a large teacher model API against the one-time cost of distilling and self-hosting a small student model.
Continued Pretraining Cost Calculator
Estimate GPU-hours and cost for continued pretraining a base model on a large domain corpus before instruction fine-tuning.
Fine-Tuning GPU-Hours Estimator
Estimate GPU-hours for LoRA, QLoRA, and full fine-tuning on the same model size and dataset, so you can compare method tradeoffs before choosing.
Synthetic Training Data Cost Calculator
Model generator token cost plus human filtering and review labor to produce a synthetic fine-tuning dataset, compared against pure human authorship.
vLLM Throughput Estimator
Estimate aggregate tokens-per-second throughput for a vLLM deployment from model size, GPU class, and batch depth, accounting for continuous batching gains.
LLM Quantization Memory Savings Calculator
Compare FP16, FP8, and INT4 memory footprints for any model size and see how many fewer GPUs quantization requires to serve it.
KV Cache Memory Calculator
Calculate KV cache memory per sequence and per batch from model architecture and context length, then see how many concurrent sequences your GPU can hold.
Concurrent Users Per GPU Calculator
Estimate how many connected users one GPU can support, accounting for both VRAM limits and throughput limits, plus the fact that most users are not actively streaming at any given moment.
LLM Inference Cost Per Million Tokens Calculator
Convert GPU hourly cost, cluster throughput, and real-world utilization into a defensible self-hosted cost per million tokens, exposing what idle GPU time actually costs you.
LLM Latency Budget Planner
Break total response time into time-to-first-token, generation time, and network overhead, then see your exact margin or shortfall against a target SLA.
Multi-GPU Tensor Parallelism Calculator
Model how tensor-parallel throughput actually scales across multiple GPUs, accounting for interconnect overhead that keeps scaling sub-linear.
LLM Serving Capacity Planner
Convert a peak concurrent user target directly into a required GPU count with redundancy, then see the daily token and response capacity that hardware delivers.
Speculative Decoding Speedup Calculator
Model the real decode speedup speculative decoding delivers from your draft model's acceptance rate, proposal depth, and per-step overhead.
Embedding Model Serving Cost Calculator
Estimate the GPU hours and dollar cost to embed your daily document volume, factoring in embedding model size, batching efficiency, and re-indexing overhead.
RAG Chunking Strategy Calculator
Turn corpus size, chunk length, and overlap into a concrete chunk count, embedding cost, and vector storage footprint before you build the ingestion pipeline.
Vector Database Sizing Calculator
Convert vector count, embedding dimensions, and precision into a real storage footprint, including index overhead and replica factor, before you pick a vector database.
Document Ingestion Pipeline Estimator
Estimate total pipeline time from document count, OCR share, and embedding throughput, so ingestion timelines stop being a guess in the project plan.
Hybrid Search Cost Calculator
Estimate the monthly infrastructure cost of running vector search and keyword search together, including an optional reranker, based on your node counts and query volume.
RAG Context Window Budget Calculator
Allocate your context window across system prompt, retrieved chunks, and conversation history, then see window utilization and the real cost of every RAG query.
GPU Server Buy vs Rent Calculator
Turn GPU price, power cost, and cloud hourly rates into an annual owned-versus-rented comparison, plus the utilization rate at which buying starts to win.
GPU Cluster Buildout Cost Calculator
Turn GPU count and class into a full cluster budget covering server chassis, networking fabric, power and cooling capex, and install, with a true cost per GPU.
Multi-Node Training Efficiency Calculator
Estimate effective training throughput as you scale across nodes, accounting for interconnect quality and the efficiency decay that comes with every additional node.
CPU-Only LLM Inference Feasibility Calculator
Estimate realistic tokens per second for CPU-only inference from model size, quantization, and system RAM bandwidth, and see whether it clears your target throughput.
GPU Colocation vs Onsite Calculator
Compare paying monthly colocation rack fees against building out your own facility, with total cost over your planning horizon and a payback period in months.
AI Server Rack Power Budget Calculator
Convert GPUs per rack, TDP, host overhead, and facility PUE into a real rack power budget with redundancy, then check it against your available circuit capacity.
AI Hardware Refresh Planner
Weigh your current GPU fleet's remaining book value against the cost of refreshing to a newer generation, factoring in performance-per-watt gains and power savings.
PII Redaction Pipeline Cost Calculator
Estimate the monthly compute cost, human review hours, and total spend of a PII redaction pipeline from document volume, PII density, NER throughput, and reviewer rate.
Reasoning Model Cost Overhead Calculator
Model the extra output tokens that reasoning and extended thinking modes consume, and see the real monthly cost delta versus routing only the traffic that needs it.
Whisper Speech-to-Text Deployment Calculator
Convert monthly audio volume and GPU class into the real-time throughput and monthly cost of self-hosting Whisper, compared against a cloud speech-to-text API.
Image Generation On-Prem Cost Calculator
Convert monthly image volume, generation steps, and GPU class into the true cost of self-hosting FLUX or SDXL, compared against a cloud image generation API.
Code Model Deployment Sizing Calculator
Convert developer headcount and completion volume into the GPU capacity and monthly cost required to self-host a code completion model at acceptable latency.
LLM Evaluation Budget Calculator
Model the recurring cost of running an LLM-as-judge evaluation suite plus human review sampling, so quality gates get a real budget line instead of an afterthought.
Enterprise Token Usage Estimator
Convert user count, session frequency, and use case type into a realistic monthly and annual token consumption and cost projection before a company-wide rollout.
Model Upgrade Migration Effort Calculator
Estimate the engineering hours and cost required to re-test prompts, re-run evaluations, and update integration points when you migrate to a new model version.
Private AI Total Cost of Ownership Calculator
Model the full 3-year cost of an on-prem AI deployment, including amortized hardware, power, staff time, and support, against comparable API spend.
AI Capex vs Opex Calculator
Compare the 3-year total cost of owning GPU hardware and operations staff against paying for the same workload through API or SaaS subscriptions.
AI Investment Payback Calculator
Turn upfront AI investment, ongoing run cost, and expected savings or revenue into a ramp-adjusted payback period and 3-year net value figure.
Cloud Repatriation Savings Calculator
Estimate monthly savings and breakeven timeline for repatriating steady state cloud workloads to owned hardware, factoring amortization, colo, and staffing.
Server Consolidation Savings Calculator
Estimate how many physical hosts you can eliminate through higher VM density, and the resulting power, licensing, and avoided refresh capex savings.
Hybrid Cloud Cost Comparison Calculator
Model total monthly and annual cost of a hybrid cloud architecture based on your real on-prem and cloud workload split, interconnect, and management overhead.
On-Prem GPU Sizing Calculator for ERP AI
Work out how much GPU memory and how many cards you need to serve an open-weight model to your ERP users on-prem.
ChatGPT vs On-Prem LLM TCO Calculator
Compare yearly cost of a hosted LLM API with a self-hosted GPU server for the same workload and find the break-even volume.
LLM Model Routing Cost Savings Calculator
Work out blended cost per request when a router sends most traffic to a small model and escalates failures to a large one.
AI Agent Stack Availability and Downtime Calculator
Multiply component availabilities in an ERP AI stack into end-to-end uptime and hours of downtime per year, and see what a second GPU node buys.
LLM Gateway Queueing Delay Calculator
Use queueing theory to see how request wait times explode as an inference service approaches full utilization.
On-Prem Document AI GPU Throughput Calculator
Size GPUs for on-prem document extraction from daily pages, seconds per page, operating hours and utilization.
Checklists
On-Prem AI Deployment Checklist
A 30-point pre-deployment checklist covering use cases, hardware, security, model operations, and rollout for self-hosted enterprise LLMs.
On-Prem AI Security Hardening Checklist
A practical control checklist for securing self-hosted language models, covering model provenance, network isolation, data governance, host hardening, and audit readiness.
Enterprise RAG Security Checklist
A practical control checklist covering entitlement-aware retrieval, corpus data governance, query security, model integrity, and audit for enterprise RAG systems.
GPU Procurement Checklist
A practical checklist covering budget and vendor selection, lead time and logistics, facility readiness, technical validation, and contract terms before you place a GPU order.
Air-Gapped LLM Deployment Checklist
A practical control checklist for deploying and maintaining large language models in a fully air-gapped environment, from initial staging through ongoing patching and drift detection.
LLM Security Hardening Checklist
A practical control checklist for hardening LLM applications against prompt injection, insecure output handling, supply chain risk, and excessive agency, organized around the OWASP LLM Top 10.
AI Model License Compliance Checklist
A practical control checklist for tracking open-weight model license obligations, from commercial use restrictions and attribution requirements to fine-tuned derivative model terms.
AI Audit Trail Readiness Checklist
A practical control checklist for building AI audit trails that satisfy compliance assessors, covering request-level logging, log integrity, identity evidence, and model lineage.
AI Incident Response Readiness Checklist
A practical readiness checklist for AI-specific incident response, covering detection, playbooks by incident type, escalation roles, containment, and post-incident reporting.
Assessments
Air-Gapped AI Readiness Assessment
A 10-question assessment that scores how prepared your organization is to deploy and operate LLMs inside an air-gapped or classified enclave.
Open-Weight Model Selector
A 10-question assessment that matches your hardware budget, workload complexity, and operational maturity to the right open-weight model size class.
LLM Evaluation Readiness Assessment
Score your organization across ten dimensions of LLM evaluation maturity, from golden datasets and regression gates to human review and production monitoring.
AI Model Selection Assessment
Score ten decision factors - data sensitivity, task complexity, volume, latency, and internal capability - to see whether a self-hosted open-weight model fits your workload.
Sovereign AI Readiness Assessment
Score your organization across eleven dimensions of sovereign AI readiness, from data residency and model provenance to cleared personnel and air-gapped operations.
Fine-Tuning Readiness Assessment
Score your organization across nine dimensions of fine-tuning readiness, from data quality and evaluation discipline to infrastructure and ownership.
Fine-Tuning vs Prompt Engineering Assessment
Score your use case across eight dimensions to determine whether fine-tuning, better prompt engineering, or retrieval is the right lever to pull.
RAG vs Fine-Tuning Decision Assessment
Answer 8 questions about knowledge volatility, citation needs, data availability, and team capability to find whether RAG, fine-tuning, or a hybrid fits your project.
RAG Accuracy Readiness Assessment
Score your retrieval-augmented generation system across eight dimensions that actually predict production accuracy, from chunking strategy to groundedness verification.
GraphRAG Complexity Assessment
Score your use case across eight factors, query pattern, graph maintenance overhead, and team expertise, to find out whether GraphRAG earns its added complexity over standard RAG.
NVIDIA GPU Selector for LLM Workloads
Score your workload across model size, concurrency, latency, budget, and facility power to get a recommended GPU tier from RTX-class to multi-node B200 clusters.
Edge AI Deployment Readiness Assessment
Score your organization across eight dimensions of edge AI readiness, from hardware validation and update strategy to connectivity resilience and fleet monitoring.
AI Data Sovereignty Risk Assessment
Score your organization across eight dimensions of AI data sovereignty risk, from inference location and encryption key custody to subprocessor visibility and audit readiness.
Shadow AI Exposure Assessment
Score your organization across eight dimensions of shadow AI risk, from detection capability and policy coverage to what has already been pasted into public tools.
Prompt Injection Risk Assessment
Score your AI agents and RAG systems across eight dimensions of prompt injection risk, from untrusted content ingestion to the real-world actions a hijacked model can take.
Small Language Model Fit Assessment
Answer eight questions about task complexity, volume, latency, data sensitivity, and cost to see whether a small language model can replace your frontier model spend.
Multimodal AI Use Case Assessment
Score your use case across modality mix, volume, data control, and team maturity to decide between a managed multimodal API and a dedicated on-prem pipeline.
Frontier vs Open Model Gap Assessment
Score your use case across reasoning complexity, data control, cost pressure, and customization needs to see whether a large open model closes the gap to a frontier model for you.
Datacenter Exit Readiness Assessment
Answer 8 questions to score your organization's readiness to exit a data center or colo lease, and get a gap-specific action plan.