AI Engineer / Agentic and Generative AI-3
Role summary
The AI Engineer will be responsible for the day-to-day operations of agentic and generative AI solutions, including maintaining and enhancing LLM/chatbot agents, refining routing, and driving model retraining. This role involves partnering with ML Engineering for production support, designing prompts, agent policies, and tool integrations, and building evaluation frameworks. Collaboration with Data Engineering is key for data sourcing and governance. The engineer will build end-to-end workflows for AI use cases, integrating with various systems and channels. Experience in regulated Financial Services environments with conversational or Voice AI solutions is highly desirable. Strong Python/TypeScript skills and a focus on operational excellence are required.
Morristown, New Jersey 07960 Posted April 6th, 2026
Looking for more job opportunities? Click here!
Job Type: Full Time
Job Category: IT
Job Description
Job Title : AI Engineer - Agentic and Generative AI
Location : Morristown, NJ (Onsite)
Fulltime
Key responsibilities:
Own day to day operations for agentic and generative AI solutions: maintain and enhance LLM/chatbot agents, refine routing and handoff patterns, and drive regular model re training and calibration cycles.
Partner with ML Engineering to provide L2/L3 production support for AI agents—triage incidents, perform root cause analysis, and implement fixes and hot patches within MLOps guardrails.
Design and implement high quality prompts, agent policies, and tool integrations; optimize intents, guardrails, and safety filters; build offline/online evaluation frameworks (A/B testing, regression suites, human in the loop reviews).
Collaborate with Data Engineering to source, curate, and govern training and evaluation datasets; operationalize SharePoint Snowflake/DataRobot pipelines for repeatable, production grade data flows.
Demonstrated proficiency with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, or similar) and retrieval augmented generation (RAG) patterns.
Build and iterate end to end workflows for generative and agentic AI use cases, including integration with upstream systems, APIs, and downstream channels (web, mobile, contact center, voice).
Experience delivering agentic/RAG, conversational AI, or Voice AI solutions in regulated Financial Services environments, with exposure to customer experience journeys, credit risk/underwriting workflows, or fraud/collections processes.
Exhibit strong attention to detail, ownership, and operational excellence in how AI agents are designed, monitored, and improved over time.
Required Experience: 2 - 3 Years of Experience
Required Skills:
2+ years of experience building production AI/ML applications or agents.
Strong experience with LLM frameworks (langchain/langgraph, or similar) for building agent-based applications.
Strong experience with state management (short-term and long-term memory).
Experience designing and implementing evaluation frameworks for AI applications (LLM-as-judge, deterministic evaluators).
Strong prompt engineering skills with experience in optimization, externalization, and A/B testing.
Experience with vector stores, RAG patterns, and knowledge organization.
Experience with MCP/tool integration, API design, and error handling patterns.
Strong Python and/or TypeScript development skills with production-grade code quality
Nice to have:
Microsoft Copilot Experience.
Solution Engineer/Architect Certifications.
UiPath Experience (RPA and Agentic AI capabilities).
Required Skills
SENIOR EMAIL SECURITY ENGINEER