LLM Application Engineer Mid · Full-time · Remote / Hybrid

You will engineer production applications around language models, implementing tool use, streaming interfaces, and validation schemas.

As an LLM Application Engineer at TheWebVale, you will build applications powered by large language models for client teams. You will develop AI customer support assistants, contract summarization portals, and intelligent workflow assistants for legal firms, coaching businesses, and software teams. You will work in close coordination with frontend developers and backend architects throughout our two-to-three week delivery cycles. You will ensure models adhere strictly to business schemas, handle edge cases gracefully, and stream responses with low latency.

LLM Application Engineer

• Python
• TypeScript
• OpenAI API
• FastAPI
• Vercel AI SDK
• Pydantic
• Git
• REST APIs

Responsibilities

Your day to day.

6 things, one at a time. Keep scrolling.

• Develop production-grade software applications driven by commercial and open-source LLMs.
• Implement function-calling tools that allow models to query client databases and APIs safely.
• Build streaming response handlers with Server-Sent Events for fluid chat interfaces.
• Design Pydantic and Zod validation schemas to enforce strict JSON structure from models.
• Implement token budgeting and conversation truncation algorithms for long chat threads.
• Write comprehensive automated tests to evaluate model reliability across diverse inputs.

Requirements

6 things, one at a time. Keep scrolling.

• Possess 2–4 years of software development experience with focused LLM application work.
• Demonstrate advanced proficiency in Python or TypeScript with asynchronous programming.
• Show extensive hands-on experience with OpenAI, Anthropic, or Gemini API tool-calling.
• Understand prompt formatting, system instructions, few-shot examples, and temperature tuning.
• Exhibit disciplined Git habits, unit testing practices, and clean code documentation.
• Communicate technical constraints and mitigation strategies clearly to client managers.

What you get

• Remote-first, with a Bhopal studio for hybrid days
• Real client products across many industries
• Direct work with the founder and senior team
• Learning and tooling support
• Your work featured in our public portfolio

How we hire

• Intro chat

A short call about what you want to work on and how you like to work.

• Work review

Walk us through projects, code or designs you are proud of.

• Paid task

A small paid task or pairing session, so both sides see the fit.