resume

download pdf ↓

Nicholas Yeager

Tucson, Arizona · (760) 996-7075 · yeag123@gmail.com · LinkedIn · GitHub

Professional Summary

AI Solutions Architect who designs and ships production AI systems, with a focus on agent evaluation, observability, and LLM integration. Builds AI-driven pharmaceutical solutions at ScriptSave and independently built RuleMetric, a platform for measuring changes to AI coding-agent instructions. More than a decade of software engineering and cross-functional delivery across healthcare, finance, and startups. Former Co-Founder & CTO of Outlast (AngelPad). Earned Microsoft Certified: Azure AI Engineer Associate (Aug 2025).

Selected product: RuleMetric captures AI coding sessions and compares prompt, rule, and memory changes against a baseline, reporting quality, cost, and latency to help developers decide what to keep.

Selected AI Product

Independently designed, built, and shipped RuleMetric, owning architecture, product roadmap, and delivery.

RuleMetric — evaluation and observability for AI coding agents

rulemetric.com

TypeScript/Node monorepo · API, dashboard, eval worker · public npm CLI: @rulemetric/cli

  • Built session-capture integrations for Claude Code, Codex, Cursor, and GitHub Copilot, turning coding-session evidence into proposed instruction and workflow changes.
  • Designed controlled evaluations that compare a proposed change with a baseline using the same harness, model, tasks, and grading approach, reporting quality, cost, latency, sample size, and uncertainty.
  • Shipped a TypeScript/Node platform spanning an API, dashboard, background evaluation worker, and public npm CLI, with hosted and local deployment options.

Work Experience

AI Solutions Architect

Feb 2026 - Present

ScriptSave · Tucson, Arizona

  • Spearheading the architectural design and deployment of AI-driven pharmaceutical solutions.
  • Integrating advanced LLM workflows and Azure AI services to enhance product capabilities.

Senior Software Engineer

Feb 2023 - Feb 2026

ScriptSave · Tucson, Arizona

  • Implemented modern project management methods and frameworks to drive team alignment and efficiency.
  • Deployed multiple new products using modern APIs.

Software Engineer

Jan 2022 - Jan 2023

Alicat Scientific · Tucson, Arizona

  • Modernized a legacy backend and frontend system.
  • Introduced deployment workflows that reduced downtime and errors in a legacy environment.
  • Developed a custom CI solution to automate integrations and accelerate release cycles.
  • Implemented thorough testing and raised coverage for a large CRM platform.

Software Engineer

Apr 2021 - Dec 2021

USAA (Contract) · Phoenix, Arizona

  • Rebuilt core frontend components for their umbrella insurance application.
  • Established updated testing and deployment workflows to improve release consistency.

Additional Experience

Software Engineer (contract) · Delta Thermal Inc 2024
Senior Software Engineer · ScriptSave WellRx Jun 2020 - Jan 2021
Senior Architect · overlandbound.com Jan - Jun 2020
Co-Founder & CTO · Outlast (formerly Quoteapro) Nov 2017 - Sep 2019
Senior Software Engineer · Outlast Sep 2019 - Jan 2020
Founder & Partner · Rincon Strategies Jun 2015 - Nov 2017
Developer / Project Manager · Elegant Thought May 2012 - Apr 2015

Education

Bachelor of Arts in Political Science and Government

University of Arizona · Tucson, Arizona

AngelPad · Seed-stage startup accelerator (2017–2018)

Skills

Leadership: Team leadership, Cross-functional collaboration, Public speaking
AI & Cloud: Agent evaluation, Controlled experiments, LLM observability, Azure AI Services, LLM integration, Prompt engineering
Backend: .NET Core, Laravel, Node.js, Phoenix, Flask
Frontend: ReactJS, React Native, Blazor
Languages: Python, PHP, TypeScript, JavaScript, Objective-C, Ruby, HTML, CSS, SQL, C#

Hobbies

Pickleball Coach