GenAI Engineer at Arm
- Architected the Arm MCP Server in Python + FastMCP so IDE agents discover and chain migration workflows — developer onboarding time down 60%.
- Standardized MCP + JSON-RPC tool calling across GitHub Copilot, Claude Code, Kiro CLI and Gemini CLI, compressing migration analysis and refactoring for Graviton, Axion and Cobalt 100.
- Built a containerized Milvus RAG knowledge base over Arm docs with LlamaIndex orchestration and LangSmith tracing — LLM code hallucinations down 85% at lower prompt-token cost.
- Curated 12K instruction pairs from Arm docs and Neo4j graph triples and fine-tuned Llama 3 8B via LoRA (rank 16) — domain accuracy 52% → 70% on a held-out 200-query benchmark.
- Benchmarked BGE-large, E5-large and text-embedding-3, then fine-tuned the selected bi-encoder with contrastive learning on hard negatives mined from failed retrievals — Recall@5 +15 points over baseline.
- Added Cohere Rerank via Amazon Bedrock as a second stage over hybrid BM25 + dense retrieval, tuning chunk size and overlap for code-heavy docs — higher top-3 precision and fewer tokens per query for ~100ms added latency.
- Orchestrated multi-agent workflows on GPT-5 and Claude via Bedrock with LangChain + LangGraph, served open-source models on vLLM for low-latency inference, and delegated agent roles through CrewAI and AutoGen.
- Built Tesseract OCR pipelines to fold multi-format internal docs into the vector store, with Python jobs regenerating Milvus embeddings on every documentation update at zero user-facing downtime.
- Embedded AWS Copilot CLI and Terraform into the retrieval layer behind guardrails, policy models and audit trails so autonomous agents emit only least-privilege IAM infrastructure.
- LLVM-MCA accelerated assembly-level benchmarking 4×; sysreport and Arm Performix exposed as callable AI functions replaced 6 hours of manual telemetry with real-time profiling.
- Shipped offline/online eval harnesses plus a CI pipeline running regression tests and prompt-version A/B comparisons before every release, with production observability on EKS and ECS tracking SLOs, agent health and telemetry.

