mirror of https://github.com/ghostfolio/ghostfolio
Priyanka Punukollu
1 month ago
1 changed files with 178 additions and 0 deletions
@ -0,0 +1,178 @@ |
|||
# AI Cost Analysis |
|||
|
|||
## Model Used |
|||
|
|||
**Claude claude-sonnet-4-5** (`claude-sonnet-4-5-20251001`) |
|||
|
|||
--- |
|||
|
|||
## Per-Request Cost Breakdown |
|||
|
|||
### Token Assumptions |
|||
|
|||
| Component | Tokens | Notes | |
|||
| ---------------------------------- | ---------- | --------------------------------------------- | |
|||
| System prompt | ~800 | Tool registry + citation rules + instructions | |
|||
| Conversation history (avg 3 turns) | ~200 | Rolled-up prior messages | |
|||
| User message | ~100 | Average query length | |
|||
| Tool call result | ~300 | Structured JSON from tool | |
|||
| **Total input** | **~1,200** | | |
|||
| Response generation | **~400** | Typical financial explanation | |
|||
|
|||
### Claude Sonnet Pricing |
|||
|
|||
| Token Type | Rate | Cost per Request | |
|||
| ------------------- | ------------------ | ------------------------------- | |
|||
| Input | $3.00 / 1M tokens | 1,200 × $0.000003 = **$0.0036** | |
|||
| Output | $15.00 / 1M tokens | 400 × $0.000015 = **$0.006** | |
|||
| **Total per query** | | **$0.0096 ≈ $0.01** | |
|||
|
|||
--- |
|||
|
|||
## Development & Testing Costs |
|||
|
|||
### Development Estimate |
|||
|
|||
| Activity | Queries | Cost | |
|||
| ------------------------------------------- | ---------- | -------- | |
|||
| Agent prototyping (classify, route, format) | ~500 | ~$5.00 | |
|||
| Tool development + debugging | ~600 | ~$6.00 | |
|||
| Eval suite creation + validation | ~400 | ~$4.00 | |
|||
| UI integration + end-to-end testing | ~300 | ~$3.00 | |
|||
| Deployment + final polish | ~200 | ~$2.00 | |
|||
| **Total estimated development** | **~2,000** | **~$20** | |
|||
|
|||
### Infrastructure Costs (Development) |
|||
|
|||
| Service | Cost | |
|||
| ------------------------ | ------------------------------- | |
|||
| LangSmith | Free tier (10,000 traces/month) | |
|||
| Railway deployment | Free tier (sufficient for MVP) | |
|||
| **Total infrastructure** | **$0** | |
|||
|
|||
### Total Development Cost |
|||
|
|||
**~$20** (API calls only) |
|||
|
|||
--- |
|||
|
|||
## Production Cost Projections |
|||
|
|||
### Assumptions |
|||
|
|||
- 5 queries per user per day (realistic for a personal finance assistant) |
|||
- 1,600 tokens average per query (input + output with tool call overhead) |
|||
- 1.2× multiplier for tool call metadata overhead |
|||
- Effective cost per query: **$0.012** (after overhead) |
|||
|
|||
### Scale Projections |
|||
|
|||
| Scale | Monthly Users | Daily Queries | Monthly Queries | Monthly API Cost | |
|||
| ---------- | ------------- | ------------- | --------------- | ---------------- | |
|||
| Starter | 100 | 500 | 15,000 | **~$18** | |
|||
| Growth | 1,000 | 5,000 | 150,000 | **~$180** | |
|||
| Scale | 10,000 | 50,000 | 1,500,000 | **~$1,800** | |
|||
| Enterprise | 100,000 | 500,000 | 15,000,000 | **~$18,000** | |
|||
|
|||
### Cost Per Feature |
|||
|
|||
| Feature | Avg Input Tokens | Avg Output Tokens | Cost/Query | |
|||
| ---------------------------- | ---------------- | ----------------- | ----------- | |
|||
| Portfolio analysis | 1,000 | 400 | ~$0.009 | |
|||
| Property tracking (CRUD) | 600 | 200 | ~$0.005 | |
|||
| Strategy simulation | 1,400 | 600 | ~$0.013 | |
|||
| Life decision advisor | 1,600 | 800 | ~$0.016 | |
|||
| Wealth gap visualizer | 900 | 300 | ~$0.008 | |
|||
| Relocation runway | 1,200 | 500 | ~$0.011 | |
|||
| Family planner | 1,100 | 450 | ~$0.010 | |
|||
| **Average across all tools** | **1,114** | **464** | **~$0.010** | |
|||
|
|||
--- |
|||
|
|||
## Cost Optimization Strategies |
|||
|
|||
### 1. Query-Level Caching (saves ~30%) |
|||
|
|||
Common queries like "Austin market data", "Federal Reserve benchmarks", and "What is my portfolio?" |
|||
can be cached with a 24-hour TTL. This reduces repeat Claude API calls for identical inputs. |
|||
|
|||
- Estimated savings at 1,000 users: ~$54/month |
|||
- Implementation: Redis or simple in-memory LRU cache |
|||
|
|||
### 2. Model Tiering (saves ~70% on classification) |
|||
|
|||
Use Claude Haiku for the classify_node (~10x cheaper than Sonnet) and reserve Sonnet only for |
|||
the format_node where response quality matters. |
|||
|
|||
- Classification cost with Haiku: ~$0.0003/request (vs $0.003 with Sonnet) |
|||
- Saves: $0.0027 per request × 15,000/month = ~$40/month at Starter tier |
|||
|
|||
### 3. Conversation Compaction (saves ~20%) |
|||
|
|||
Summarize conversation history older than 3 turns instead of sending raw messages. |
|||
This reduces input tokens for multi-turn conversations from ~800 to ~200. |
|||
|
|||
- Savings: 600 tokens × $0.000003 × 15,000/month ≈ $27/month at Starter |
|||
|
|||
### 4. Tool Result Truncation (saves ~10%) |
|||
|
|||
Real estate listings and portfolio data can be pre-summarized before LLM formatting. |
|||
Reduces average output from 400 to 300 tokens for data-heavy responses. |
|||
|
|||
### Combined Optimization Impact |
|||
|
|||
At 1,000 users/month, implementing all 4 strategies reduces cost from ~$180 to ~$85/month — |
|||
a **53% reduction**. |
|||
|
|||
--- |
|||
|
|||
## Break-Even Analysis |
|||
|
|||
### SaaS Pricing Model |
|||
|
|||
| Subscription Price | Monthly Cost at 1,000 users | Gross Margin | |
|||
| ------------------ | --------------------------- | -------------------------------- | |
|||
| $9.99/month | $180 API + $0 infra | **55%** (with optimization: 91%) | |
|||
| $14.99/month | $180 API + $0 infra | **70%** (with optimization: 94%) | |
|||
| $19.99/month | $180 API + $0 infra | **78%** (with optimization: 96%) | |
|||
|
|||
At **$15/month** subscription and 150 queries/month per user: |
|||
|
|||
- Revenue per user: $15.00 |
|||
- API cost per user: $0.18 (150 × $0.012) |
|||
- Gross margin: **98.8%** before infrastructure and support |
|||
|
|||
### When to Pay for Infrastructure |
|||
|
|||
| Milestone | Infrastructure Needed | Estimated Monthly Cost | |
|||
| --------------- | ------------------------------------ | ---------------------- | |
|||
| 0–500 users | Railway free tier + LangSmith free | $0 | |
|||
| 500–5,000 users | Railway $5 + LangSmith Developer $39 | $44/month | |
|||
| 5,000+ users | Railway Pro $20 + LangSmith Plus $99 | $119/month | |
|||
|
|||
--- |
|||
|
|||
## Observability Cost |
|||
|
|||
| Tool | Plan | Cost | |
|||
| ---------------------- | -------------------------- | ------------ | |
|||
| LangSmith | Free (10,000 traces/month) | $0 | |
|||
| Railway | Free tier | $0 | |
|||
| **Total at MVP scale** | | **$0/month** | |
|||
|
|||
LangSmith free tier covers ~333 traced requests/day — sufficient for beta testing and |
|||
submission demo. Production would require the Developer plan at $39/month. |
|||
|
|||
--- |
|||
|
|||
## Summary |
|||
|
|||
| Phase | Monthly Cost | |
|||
| -------------------------------- | ------------- | |
|||
| Development (one-time) | ~$20 total | |
|||
| MVP (100 users) | ~$2 API | |
|||
| Early stage (1,000 users) | ~$18–$180 API | |
|||
| Growth (10,000 users, optimized) | ~$900 API | |
|||
| Infrastructure at scale | ~$120/month | |
|||
|
|||
The model is **profitable from day one** at any subscription price above $1/month per user. |
|||
Loading…
Reference in new issue