Building an enterprise AI gateway on Amazon Bedrock
A design guide to an enterprise AI gateway on Amazon Bedrock: EU-only inference profiles, SCP enforcement, Guardrails PII filtering and model routing.
Writing
Field notes on AI platform architecture
Design guides from real platforms: what to build, in what order, and what it costs you.
Enterprise AI platform architecture: a reference guide to the five layers
A reference architecture for an enterprise AI platform: AI gateway, retrieval, agent actions, evaluation and identity, and the order to build them in.
Human-in-the-loop agent actions over MCP: idempotency, audit and replayable decisions
A design guide to governed agent actions over MCP: versioned tool manifests, human validation on writes, idempotency, decision logs and OAuth2 Token Exchange.
LLM evaluation in CI: golden sets, DeepEval and Langfuse
How to evaluate LLM applications in CI: build golden sets, choose metrics, gate releases with DeepEval and trace production with Langfuse.
RAG that cites its sources or declines: pgvector, hybrid search and Row-Level Security
How to build RAG that cites its sources or declines to answer, on PostgreSQL with pgvector, HNSW, hybrid search, reranking and Row-Level Security.
Last updated:
Got an AI project stuck between demo and production?
Tell me what you are building. After a first conversation you will know whether I can help and what I would do first.
+33 6 02 73 49 22 me@osmanrami.fr