JobLarper
JobLarperCompaniesOtter.ai › Senior Software Engineer, AI Agent & LLM

Senior Software Engineer, AI Agent & LLM

Otter.ai — Artificial Intelligence (AI) · Business/Productivity Software · Cloud platforms(PaaS)

Seattle, Washington, United States Senior+ Posted Jul 22, 2026
PythonC++AI/LLMML

About the role

The Opportunity

We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and infrastructure, including retrieval augmented generation (RAG), semantic search using embeddings, text indexing and retrieval, query understanding, various ranking algorithms etc.. In your crucial role, you'll be responsible for managing every aspect of our sophisticated enterprise search system, spearheading the design, development, and optimization of search system accuracy and performance.

Your Impact

Design, develop, and oversee our enterprise search infrastructure, employing a mix of vector databases, full-text search engine, and relational database techniques.

Understand the user's information needs by developing deep learning-based NLP algorithms to analyze, reformulate and suggest search queries effectively.

Design, implement, and deploy various ranking algorithms to deliver the most relevant results with the best user experience.

Evaluate and optimize algorithm accuracy by focusing on key metrics..

Constantly track and analyze end-to-end system performance, leading improvement initiatives as required.

Stay informed about the latest industry developments and emerging technologies, aligning our search system with, or advancing it beyond, the industry benchmarks.

We're looking for someone who

Holds a Masters degree in Computer Science, or a relevant field, PhD a plus.

5+ years of experience in search, recommendation or question answering systems.

In-depth knowledge of relevance measurement, tuning, and modeling.

Engineering experience with large language models and RAG systems.

Expertise in Python and/or C++.

Exceptional problem-solving capabilities coupled with meticulous attention to detail.

Outstanding communication skills to explain complex concepts convincingly to non-technical team members.

Abilities to contribute individually while functioning effectively as part of a team.

Familiarity with embedding-based search systems will be considered a major advantage.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.

Accessibility & Accommodations

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $185,000 to $230,000 USD per year

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package. #LI-Remote

What the index says about this role

  • First seen by JobLarper — Aug 2, 2026, 6 days ago. Older postings collect hundreds of applicants — a tailored résumé matters more the longer a role has been live.
  • No pay range in our index for this listing. Across 1,685 indexed Software Engineer roles in US that do publish one, the middle half sits between $185k and $285k, median $225k — JobLarper's read of the market, not a figure from Otter.ai.
  • What Software Engineer roles ask for — across 10,230 indexed openings: REST/APIs (46%), Backend (42%), Cloud (38%), Python (38%), Go (25%). This posting names Python, AI/LLM, ML.
  • Otter.ai is hiring actively — 23 open roles indexed.

Derived from the 27,000 roles JobLarper indexes daily from official company boards — not from the job description above.

⚡ JobLarper watched this role appear on Otter.ai's official board on Jul 22, 2026. Sign up free to get alerted minutes after roles like this go live, and tailor your real résumé to the exact description — nothing invented.

More open roles at Otter.ai

All 23 open roles at Otter.ai →

Similar Software Engineer roles at other companies