Sr. AI/ML Developer - MSP Owner

@ 2T Consulting
2T Consulting2tconsulting.com

Sr. AI/ML Developer - MSP Owner

St. Peters, California
Posted today

About the job

A tech company specializing in AI/ML solutions, focusing on developing advanced LLM-powered agents, pipelines, and AI features to serve field technicians in real-time environments.

Requirements

  • 10+ years Python development
  • 2+ years LLM development
  • Experience with RAG pipelines
  • Familiar with OpenAI APIs
  • Async Python and FastAPI

Qualifications

  • Strong system design skills
  • Experience with microservices
  • Knowledge of distributed systems
  • Proficiency in Git and Docker
  • Experience in prompt engineering

Full job description

We are looking for a skilled AI/ML Developer to join our agentic platform team on a contractual basis. You will design, develop, and deploy LLM-powered agents and pipelines that directly serve field technicians in production. You will work closely with the platform architect and contribute to the core multi-agent orchestration system.

Required Skills & Experience
  • 10+ years of software development with strong Python expertise in production environments.
  • 2+ years of hands-on LLM development (LangChain, LangGraph, or equivalent frameworks)
  • RAG pipeline experience - embeddings, vector search, re-ranking,answer generation
  • LLM APIs - OpenAI Chat Completions, Responses API, streaming, tool calling
  • Async Python - asyncio, FastAPI
  • Prompt engineering - system prompts, few-shot, structured JSON output
  • Circuit breaker patterns, retry logic, resilient service design
  • PostgreSQL and async ORMs (SQLAlchemy async / Alembic)
  • Git, CI/CD, Docker, Kubernetes basics
  • Strong system design skills - microservices, distributed systems, API design
Key Responsibilities:
  • Design and develop LLM-powered agents using LangGraph and LangChain frameworks
  • Build and enhance multi-agent orchestration pipelines with conditional routing, state management, and error recovery
  • Develop RAG pipelines with hybrid search (semantic + keyword), re-ranking, and Reciprocal Rank Fusion
  • Implement tool-calling agents with parallel API execution, sequential enrichment chains, and summarization
  • Build real-time streaming capabilities (WebSocket / SSE) for conversational AI
  • Integrate with Azure OpenAI APIs with circuit breaker patterns and fallback chains
  • Implement prompt engineering and dynamic prompt management (DB-backed with in-memory caching)
  • Design and implement multi-modal AI features (image analysis with vision models)
  • Write production-quality Python code with error handling, logging, observability, and unit tests
  • Participate in code reviews, architecture discussions, and sprint delivery
Show full description