Infrastructure Q&A agent over MCP
Hallucinations traced to the tool layer · tool catalog in context cut in half
What was built
An agent you ask about infrastructure in plain words. LLM with tool-calling over MCP servers for inventory and monitoring, answers in a bot. I ran 15 test questions, checking each answer against the database. Six held up. Not the model: narrow query schema, no honest counting, step limits choking it. All tool layer. That's where it got fixed. The catalog is resent every iteration, so I halved it. In production. No demand yet.
Stack
MCPLLM tool-callingPythonTelegram Bot APIDockerGitLab CI
Other work
- Single source of truth for infrastructure
- 2FA / SSO for mail on Keycloak + ANGIE
- Enterprise infrastructure from scratch
- Managed corporate access client
- Internal certificate authority with ACME
- Report access gateway on directory groups
- Workplace self-service: software and VDI
- Active Directory hygiene: GPO repair
- Active Directory modernization
- Zabbix + Grafana and automation
- Office-to-DC networking
- Virtualization and vCenter
- Distributed Veeam and DRP
- Multi-agent workflow for solo development
- LLM call analysis and BI/CRM pipeline