The harness sets the bill: why the same model costs more in some agents
New coding-agent benchmarks show one model scoring and costing very differently across agent harnesses. What that means for evaluating AI coding tools.
3 min read
Blog tag
#Evaluation
Measuring model and agent quality: benchmarks, evals and their limits.
Small open-weight models as coding sub-agents: reading the Mellum2.1 release
JetBrains released Mellum2.1, a 12B open-weight model built for coding sub-agents. What it claims, what to verify, and where small models fit.
Browse by tag
- #Security (55)
- #Agents (41)
- #AI coding tools (38)
- #LLM costs (23)
- #MCP (16)
- #Evaluation (14)
- #Observability (12)
- #Compliance (11)
- #Enterprise (9)
- #Platform engineering (9)
- #Data privacy (8)
- #DevOps (7)
- #Model routing (7)
- #Open-weight models (7)
- #Research (7)
- #Tutorials (6)
- #Code review (4)
- #Developer productivity (4)
- #Guardrails (4)
- #Networking (4)
- #OpenTelemetry (4)
- #Budgets (3)
- #Prompt engineering (3)
- #Self-hosting (3)
- #MCP gateway (2)
- #Release notes (2)
- #Skills (1)
- #Testing (1)