AI Assistant JustAsk Your AI App Industries How it works Case studies Pricing Help Careers Sign in Build my AI assistant free
Dashboard AI Assistants Team assistant Knowledge library Team Profile Help
Theme
AI Engineering

LLM Applications Engineer

Ship the features customers see: streaming answers, suggested questions, lead capture and booking flows that work reliably in the widget on any website.

Location
Surry Hills, NSW
Work
Hybrid or work from home (Australia)
Type
Full-time
Level
Mid-level

About the role

You'll work where the model meets the product. That means the prompts, structured outputs and streaming that turn a model's reply into an answer, three follow-up questions, a booking card or a captured lead, rendered smoothly in a widget that runs on thousands of different websites. You'll care about the details: what happens when a reply comes back empty, when a visitor writes in Vietnamese, or when the network drops halfway through a sentence.

What you'll do

  • Build and improve chat features end to end, from the prompt and server stream to the widget UI
  • Design structured outputs (hidden trailers, JSON schemas) that the product can rely on every time
  • Handle the edge cases: refusals, empty replies, model fallbacks and partial streams
  • Work with Customer Relations to turn real support tickets into fixes and features
  • Write tests and small evals for every prompt you change

What you'll bring

  • 3+ years as a software engineer, with at least one LLM feature in production
  • Solid JavaScript and one server language (C# preferred, others welcome)
  • Experience with streaming responses (SSE, NDJSON or similar)
  • Good product instincts and empathy for small-business owners

Nice to have

  • Shadow DOM or embeddable widget experience
  • Experience with Gemini, OpenAI or open-weight model APIs
  • Accessibility know-how

How we work

You'll be part of a small team based in our Surry Hills office, L1 457 Elizabeth Street, Surry Hills, NSW 2010, Australia. Come in when it helps and work from home when it doesn't: the role is open to people anywhere in Australia. We agree on outcomes and a few shared hours, then trust you with the rest.

Apply for this role

LLM Applications Engineer · Surry Hills, NSW · hybrid or work from home

CV (PDF or Word, up to 8 MB)
All open roles

More open roles

See all 14 roles
AI Engineering Hiring now

Senior AI Engineer, Retrieval & RAG

Own the retrieval layer every owns.ai answer stands on: hybrid search, chunking, ranking and the evaluations that prove each change made answers better.

  • Surry Hills, NSW
  • Hybrid · Work from home
  • Full-time
  • Senior
Posted 29 SepView role
AI Engineering

Graduate AI Engineer (2027 intake)

Start your career shipping real AI features to thousands of businesses, with a mentor, a structured first year and code in production from your first month.

  • Surry Hills, NSW
  • Hybrid · Work from home
  • Full-time
  • Graduate
Posted 7 OctView role
AI Engineering

Applied AI Engineer, Conversational Agents & Bookings

Teach assistants to get things done: book appointments, take call-backs and send jobs to Jobber, ServiceM8, Housecall Pro and simPRO without a human in the loop.

  • Surry Hills, NSW
  • Hybrid · Work from home
  • Full-time
  • Mid-level
Posted 6 OctView role