JobBOSS Classic AI Assistant Sizing and Value Calculator
This calculator estimates what a private AI assistant on JobBOSS Classic needs in GPUs and index storage, and what it might be worth in saved time. Enter your usage and assumptions; the formulas are stated so IT and finance can check them.
Your numbers
Licensed or named JobBOSS classic users who could use the assistant.
Includes retrieved rows or document chunks placed in the prompt.
Wall time per question under load; used for concurrency.
Batched throughput of your model on your GPU. Measure with your own model; this is an assumption.
Depreciation, power, space and support, or rental rate.
Your results
Planning estimate only. Tokens per second per GPU depends on model, quantization, context length and serving settings; measure your own. Time-saved figures are assumptions to be validated in a pilot.
Monthly value and GPU cost vs named users
Sweeps Named users from 10 to 300, holding your other inputs fixed.
Validate these numbers with a pilot
Netray can measure real throughput and time saved on your JobBOSS Classic data. Optional; the calculator is free without it.
Optional. The tool and every export work without this. No spam.
How to use it
Start with named users and the share active on a typical day, then estimate questions per active user. Set average prompt plus answer tokens high enough to include retrieved rows or document chunks, since those dominate. Enter the tokens per second your chosen model achieves on your GPU; if you do not know it, run a short benchmark in vLLM or Ollama.
- Defaults reflect a typical JobBOSS classic site
- Change one input at a time
- Use the chart to see how cost and value scale with users
The formulas
Questions per day equals users times active share times questions per user. Peak concurrency is the busiest-hour questions divided by 3600 times seconds per answer. GPUs equal peak tokens per second divided by tokens per second per GPU, rounded up, with one spare added to cost. Index size assumes about 2 chunks per page at 6 KB each. Hours saved use 21 working days per month.
- Concurrency = (questions per hour / 3600) x seconds per answer
- GPUs = ceil(peak tokens per second / GPU throughput)
- Value = hours saved x loaded hourly cost
Reading the results
If net monthly benefit is negative, either usage is too low for the hardware or the time-saved assumption is optimistic. Small deployments often fit on one GPU, so the spare GPU doubles the cost; a smaller model or shared hardware can change the answer. Treat payback as directional and confirm minutes saved by timing a few real tasks in a pilot.
Common mistakes
Sizing on named users instead of concurrency overstates GPUs. Ignoring retrieved context understates tokens. Counting every minute saved as cash overstates value; time saved only becomes money if it is redeployed.
- Assuming all saved time is cashable
- Using vendor peak throughput instead of measured throughput
- Forgetting redundancy and maintenance
- Forgetting document volume when sizing storage
Frequently Asked Questions
How is the GPU count calculated?
Peak tokens per second needed in the busiest hour, divided by the aggregate tokens per second one GPU delivers with batching, rounded up to at least one. Measure throughput with your own model; the default is an assumption.
Why is a spare GPU included in cost?
A single GPU is a single point of failure for the assistant. The cost line adds one spare so you see a redundant design; remove it mentally if you accept downtime or run a smaller pilot.
Is the value figure real savings?
It is the loaded cost of time saved. It becomes cash only if the time is redeployed or avoids hiring or overtime. Validate minutes saved per question with a pilot.
How accurate is the index size?
It is a rough estimate based on about 6 KB per chunk and 2 chunks per page. Embedding dimension, chunking and metadata change it, but for most deployments it is within a factor of two.
Netray can run a short pilot on your own JobBOSS classic data to replace these assumptions with measured numbers. Ask for a review of your sizing if you want a second opinion.
Related Tools
JobBOSS Classic Private AI Layer Blueprint Generator
Fill in your version, database, hosting and use cases to get an architecture plan for a private, on-prem AI assistant on JobBOSS Classic, ready to share with IT and security.
On-Prem AIPrivate AI Total Cost of Ownership Calculator
Model the full 3-year cost of an on-prem AI deployment, including amortized hardware, power, staff time, and support, against comparable API spend.
On-Prem AIQAD EE AI Assistant Sizing and Value Calculator
Estimate peak concurrency, GPU count, index size, hours saved and payback for a private AI assistant on QAD EE.
More On-Prem AI tools
See all- On-Prem LLM Total Cost of Ownership Calculator
- GPU Sizing Calculator for LLM Inference
- On-Prem vs Cloud AI Cost Comparison Calculator
- Self-Hosted LLM Hardware Estimator
- Air-Gapped AI Readiness Assessment
- LLM API vs Self-Hosted Cost Calculator
- RAG Infrastructure Sizing Calculator
- Open-Weight Model Selector
- On-Prem AI ROI Calculator
Keep exploring
Free tools
- JobBOSS Classic Private AI Layer Blueprint GeneratorFill in your version, database, hosting and use cases to get an architecture plan for a private, on-prem AI assistant on JobBOSS Classic, ready to share with IT and security.
- E2 Shop System AI Assistant Sizing and Value CalculatorEstimate peak concurrency, GPU count, index size, hours saved and payback for a private AI assistant on E2 Shop System.
- QAD EE AI Assistant Sizing and Value CalculatorEstimate peak concurrency, GPU count, index size, hours saved and payback for a private AI assistant on QAD EE.
ERP fixes and how-tos
- How to Add a Private AI Layer to Classic JobBOSS On-PremHow to add a private on-prem AI assistant to classic JobBOSS: read-only SQL Server access, job and operation data, permissions, GPU sizing and rollout.
- JobBOSS 2 vs JobBOSS: Differences, Versions and How to UpdateJobBOSS2 versus classic JobBOSS: what changed, how to find your version, and how to update or upgrade an existing installation safely.
- JobBOSS Public API: What Integration Options Exist for JobBOSS and JobBOSS2What integration options JobBOSS and JobBOSS2 offer: direct SQL, import tools, SDK or API access and partner connectors, with ways to link CAD, quoting and accounting.
Integrations
- How to add an AI chatbot to ECI JobBOSS2Add an AI chatbot to JobBOSS2 for staff and customers: grounded in job, PO and inventory data, role-aware, and able to run on-prem with open-weight models.
- How to add AI agents to ECI JobBOSS2How to add AI agents to ECI JobBOSS2: a read-first tool layer over the SQL Server data and API, agents for quotes, late jobs and POs, with human approval on writes.