Initial: Mesh-Configs vom 03.09.2026 01:23
This commit is contained in:
@@ -0,0 +1,60 @@
|
||||
# Modell-Auswahl Konfiguration
|
||||
|
||||
## Global
|
||||
|
||||
```yaml
|
||||
min_context_tokens: 64000
|
||||
max_auto_escalation_factor: 5 # ab 5x Kosten -> "Ferrari-Sprung", braucht manual_override
|
||||
min_distinct_model_families: 3 # Mindest-Diversität
|
||||
max_retries_per_task: 3
|
||||
default_hard_stop_eur_per_day: 1.0 # 1€/Tag/Agent hartes Limit
|
||||
on_budget_exceeded: postpone_to_next_day
|
||||
basic_questions_fallback: vps_ollama
|
||||
```
|
||||
|
||||
## Agents & Eskalationsleitern
|
||||
|
||||
### agent_a (Master — Linux, Allround)
|
||||
- Standard: `nvidia/nemotron-3-super` (1x)
|
||||
- Eskalation: `nvidia/nemotron-3-ultra` (3x)
|
||||
- Tags: linux_system, allround, orchestration
|
||||
- Budget: 1€/Tag
|
||||
|
||||
### agent_b (Worker — Code, Logik, DB)
|
||||
- Standard: `deepseek/deepseek-flash` (1x)
|
||||
- Eskalation: `deepseek/deepseek-pro` (3x)
|
||||
- Tags: code, logic, database
|
||||
|
||||
### switch_hermes (Cockpit — Prompt/Code)
|
||||
- Standard: `openrouter/free` (0x)
|
||||
- Eskalation: `qwen/qwen3-coder:free` (0x)
|
||||
- Tags: homebrew_code, prompt_generation
|
||||
|
||||
### laptop_hermes (Worker — Dokumente/HTML)
|
||||
- Standard: `google/gemini-flash` (1x)
|
||||
- Eskalation: `anthropic/claude-sonnet` (4x)
|
||||
- manual_override: ✅ erlaubt
|
||||
- Tags: document_generation, html_css_js
|
||||
|
||||
### agent_xyz (Worker — JS/DB-Queries)
|
||||
- Standard: `qwen/qwen2.5-7b` (1x)
|
||||
- Eskalation: `deepseek/deepseek-flash` (2x)
|
||||
- Tags: javascript, database_query
|
||||
|
||||
## Lokaler Fallback (VPS-Ollama)
|
||||
|
||||
```yaml
|
||||
local_fallback:
|
||||
model: "deepseek-r1:7b" # 128k Kontext, Thinking
|
||||
min_context_tokens: 64000
|
||||
allowed_for_task_tags: [document_generation, javascript, database_query]
|
||||
# NICHT erlaubt für: homebrew_code (zu fehleranfällig bei 7B)
|
||||
```
|
||||
|
||||
## Prinzipien
|
||||
|
||||
- Kosten ~99% Gewicht, Zeit egal
|
||||
- Proportionaler Aufstieg erlaubt, kein Ferrari-Sprung (>5x)
|
||||
- Budget erschöpft → postpone + lokaler Ollama-Fallback
|
||||
- Diversität: min 3 verschiedene Modell-Familien
|
||||
- Max 3 Retries pro Task, dann pausieren
|
||||
@@ -0,0 +1,23 @@
|
||||
# Lokale Modelle — Vergleichstabelle für VPS (16GB RAM)
|
||||
|
||||
## Thinking-Modelle (Chain-of-Thought/Reasoning)
|
||||
|
||||
| Modell | Größe | Kontext | RAM-Bedarf | Läuft auf VPS? | Empfehlung |
|
||||
|--------|-------|---------|------------|----------------|------------|
|
||||
| **deepseek-r1:7b** | 4.7 GB | 128k | ~6-7 GB | ✅ | **Sweet Spot** — aktiv |
|
||||
| **deepseek-r1:14b** | 9.0 GB | 128k | ~11-12 GB | ⚠️ knapp | geladen, ungetestet |
|
||||
| **deepseek-r1:32b** | ~20 GB | 128k | ~24 GB | ❌ | zu groß |
|
||||
| **qwq:32b** | ~20 GB | 128k | ~24 GB | ❌ | zu groß |
|
||||
|
||||
## Ohne Thinking
|
||||
|
||||
| Modell | Größe | Kontext | RAM-Bedarf | Läuft? |
|
||||
|--------|-------|---------|------------|--------|
|
||||
| **phi-4:14b** | ~9 GB | 16k | ~11 GB | ⚠️ (nur 16k Kontext) |
|
||||
| **qwen2.5:7b** | ~4.7 GB | 32k | ~6 GB | ✅ (kein Thinking) |
|
||||
| **llama3.1:8b** | ~4.9 GB | 8k | ~6 GB | ✅ (nur 8k, kein Thinking) |
|
||||
|
||||
## Faustregel
|
||||
- **16GB RAM VPS:** max 7B-14B Modelle (14B belegt ~75% RAM)
|
||||
- **RTX 2060 6GB:** max 7B (Q4_K_M ~4.5GB VRAM)
|
||||
- **ARM64 (Switch Lite):** max 3B-8B (CPU-Inference)
|
||||
Reference in New Issue
Block a user