👋 Hi there, I'm Arbit

I'm a founder and engineer building AI agent infrastructure at Arklex, focused on simulation, evaluation, and orchestration systems for production AI agents.

Previously built distributed systems and ML infrastructure at scale. Research background in conversational AI, dialogue systems, and NLP.

🛠 Tech Stack

Here are some of the tools and technologies I work with:

🚀 Selected Projects

⛵ ArkSim - Agent Simulation & Evaluation Framework

Open-source framework for testing AI agents before they go live. Simulates realistic multi-turn conversations between LLM-powered users and your agent, then evaluates performance across built-in and custom metrics. Works with any agent that exposes a Chat Completions API or A2A protocol endpoint. Includes 7 built-in evaluation metrics, custom metric support, parallel execution, and interactive HTML reports.

Tech: Python, FastAPI, OpenAI, Anthropic, Pydantic, Jinja2 🔗 GitHub Repo

🤖 Agent-First Organization - Production Agent Framework

Framework for building production AI systems with an agent-first architecture. Provides the orchestration layer for deploying and managing AI agents at scale, with built-in support for multi-agent coordination, tool calling, and conversation management. 690+ stars on GitHub.

Tech: Python, LangGraph, FastAPI, OpenAI 🔗 GitHub Repo

🧠 Tokenwise - Intelligent LLM Task Planner

LLM task planner that decomposes complex tasks into subtasks, routes each to the optimal model based on capability and cost, and enforces token budgets. Helps teams manage LLM spend while maximizing output quality.

Tech: Python, OpenAI 🔗 GitHub Repo

🌱 Background

• 🏗️ Founded Arklex, building AI agent testing and orchestration infrastructure
• ⚙️ Built and scaled distributed systems, ML pipelines, and cloud infrastructure across multiple startups
• 📚 Research in conversational AI, dialogue evaluation, and multi-turn dialogue systems
• 🌍 Open-source contributor in ML infrastructure and observability (Arctic Code Vault Contributor)

📫 Let's Connect

Thanks for stopping by! Check out my pinned projects below. 👇