Skip to main content

Search Jobs

Explore your options nationwide.

Software Engineer

San Francisco, CA

Posted: 12/02/2025 Job Number: 3496933 Pay Rate: 200000/year - 250000/year

Job Description


Why should you be interested?

A startup looking to improve LLMs is seeking a software engineer to join their new team. This role is part of a small team backed by Andreessen Horowitz with 7-figure funding. This is a ground floor role at a rapid growth startup. Passive candidates who are employed and curious to hear are more than welcome to have a “no-commitment” conversation with our Recruiting team about why this could be an exciting career opportunity.




Compensation: $200,000–$250,000 base salary + competitive equity




Location: Onsite, San Francisco (5 days/week)

A fast-growing AI infrastructure company is building a next-generation Context OS for AI agents and is looking for a software engineer to help drive the performance, reliability, and intelligence of its core optimization systems. This role sits at the intersection of systems engineering, inference-time optimization, AI agent tooling, and large-scale data processing.

You will own one or more of the company’s context optimizers as well as parts of the broader optimization harness. Your work will have a direct impact on customer experience, product reliability, and revenue generation by improving how AI models handle context, latency, and real-world workloads.




Why This Role Is Unique

You may enjoy this opportunity if you:
  • Like designing self-improving systems and working with automatic hill-climbing techniques
  • Find A/B testing on live traffic energizing (the team believes real customers are the best evaluation signal)
  • Care deeply about latency and celebrate shaving off even 10ms
  • Want to influence how the industry thinks about inference-time optimizations for LLMs
  • Are excited to work on a system that dynamically optimizes context entropy to reduce degradation in transformer models as context windows grow
  • Want to help customers overcome LLM brittleness and failure modes as they scale AI features to production
  • Are motivated by working on difficult, high-leverage problems with fast-growing ARR, strong backing (Tier 1 investors), and adoption among some of the fastest-growing AI companies




What You’ll Work On
  • Own and evolve core context optimization systems and the surrounding harness
  • Build and refine pipelines that automatically improve model performance and reduce latency
  • Run live A/B tests to verify improvements and observe real-world model behavior
  • Work with large data systems to support experimentation and optimizer development
  • Collaborate closely with product, infra, and ML teams to push the boundaries of what’s possible at inference time
  • Contribute to a fast, experimental, and highly technical engineering culture




What You Bring



  • Pragmatic, elegant engineering style with strong fundamentals
  • Demonstrated “spike”: noteworthy achievement at a prior company, early impact at a startup, exceptional academic background, or similar standout experience
  • Comfortable learning quickly and navigating ambiguity
  • Experienced with AI agents and modern agent patterns
  • 2+ years of backend-leaning engineering experience (services, APIs, data pipelines, etc.)
  • Experience in early-stage startup environments (Seed/Series A preferred)
  • Alternatively: experience on high-slope, experimental or infra-heavy teams within larger tech companies, combined with some early-stage exposure
  • Familiarity with large-scale data tools (e.g., PySpark, Databricks)
  • Previously built AI agents
  • Strong proficiency in TypeScript
  • Highly coachable with strong raw learning capacity
  • Clear evidence of passion for coding (projects, hackathons, open-source work), especially for early-career candidates
  • Driven, dedicated, and excited to build in a rapidly evolving space

Meet Your Recruiter

Eric Lindgren
Senior Recruiter 

Eric first learned how to find top-quality candidates and conduct effective interviews while still in school in 2008. In all his jobs since, he used that knowledge to help the company hire. In 2018, Eric became a full-time recruiter, mainly working on roles in the industrial and skilled trades industries. Since then, he has hired candidates from all industry sectors and walks of life.

Eric joined Rainier Recruiting in 2021, working from his home in the beautiful Willamette Valley in Oregon. Outside work, Eric enjoys playing tabletop games and spending time with his wife and two boys. Eric is one of the few Rainier Recruiting employees with a cat rather than a dog. His cat, Pirate, enjoys sitting on the keyboard while Eric tries to write emails. Pirate is especially fond of the letter rrrr.

Apply Online
Apply with LinkedIn Apply with Facebook

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

About San Francisco, CA

Ready to take your career to new heights? Explore job opportunities around the bustling city of San Francisco, California. Known for its vibrant tech scene, picturesque views of the Golden Gate Bridge, diverse culinary offerings like the famous clam chowder in sourdough bread bowls at Fisherman's Wharf, and the artistic vibe of the iconic street art at Clarion Alley. Work-life balance flourishes with easy access to outdoor adventures like hiking in Muir Woods, catching a Giants game at Oracle Park, or browsing through the exhibits at the San Francisco Museum of Modern Art. Join us in San Francisco and discover the endless possibilities this innovative and charming city has to offer.