LiteLLM – Rust Engineer (Founding Rust Engineer)
Role: Rust Engineer https://jobs.ashbyhq.com/litellm/3f326076-7415-46a1-921e-8a1b1d6ee2b6
Salary
- Up to $260,000 base
- 0.1–0.3% equity
Benefits
- Comprehensive Medical, Dental & Vision
- 401(k) with company match
- Breakfast, lunch, dinner and coffee provided daily
- Onsite perks and collaborative engineering environment
Location
- Onsite - San Francisco (North Beach)
- 5 days/week in office
- ~60 hour/week culture (weekend work optional but common)
Reporting Into
- Ishaan (CTO & Co-Founder)
- Extremely high visibility role working directly with company leadership
The Sell (Company)
- LiteLLM is one of the fastest-growing AI infrastructure companies, generating approximately $15M ARR with strong month-over-month growth.
- Trusted by companies including NVIDIA, Adobe, OpenAI, Netflix, and NASA.
- LiteLLM powers one of the world's most widely adopted AI gateways, allowing developers to seamlessly route requests across 100+ LLM providers through a single API.
- The company is making a major architectural investment by migrating its core platform from Python to Rust, creating a rare opportunity to define the technical direction of the engineering organization.
- Ideal opportunity for engineers looking for significant ownership, technical influence, and visible impact.
Engineering Culture
- Lean engineering team of approximately 6 engineers
- Mix of senior engineers from companies including Amazon, Cisco and Scale AI alongside a few junior engineers
- Fast-paced, high ownership environment
- Engineers are expected to work closely with leadership and move quickly
- Customer empathy is highly valued—engineers regularly think about user experience and product impact
- This is the company's first dedicated Rust hire, making this engineer the internal Rust subject matter expert
The Role
- Pure Individual Contributor position
- Own the migration of LiteLLM's core platform from Python to Rust
- Define Rust best practices and help establish the company's long-term Rust engineering culture
- Partner directly with the CTO on architectural decisions
- Optimize latency, throughput and overall gateway performance
- Help shape future Rust hiring as the company expands
Technical Requirements
- 3–5+ years of professional software engineering experience
- 1–3+ years of production Rust experience
- Strong systems programming fundamentals
- Experience improving latency, throughput and application performance
- Experience building scalable backend or distributed systems
- Ability to complete technical interviews and coding exercises without AI assistance
Nice-to-Haves
- Previous language migration experience (especially Go → Rust or Python → Rust)
- AI infrastructure experience
- Customer-facing engineering experience
- Strong academic background (CMU, MIT, Georgia Tech, etc.)
- Senior or Staff-level ownership experience
Ideal Backgrounds
- Amazon
- Cloudflare
- Uber
- Dropbox
- Stripe
- Scale AI
- Perplexity
- Cognition
Crypto backgrounds are welcomed if candidates have strong systems and performance engineering experience.
Screening Priorities
The top priorities are:
- Strong Rust fundamentals
- Performance engineering (latency, throughput, systems optimization)
- Customer obsession
Helpful screening questions:
- What product have you worked on that customers loved?
- What feedback did customers have?
- Have you optimized systems for latency or throughput?
- Have you led or contributed to a language migration?
- Can you comfortably code in Rust without AI assistance?
Interview Process
1. LHi Recruiter Screen
- Background
- Rust experience
- Performance engineering
- Motivation
2. Intro with CTO
- Technical background
- Product ownership
- Culture fit
3. Technical Interview
- Rust coding exercise
- Whiteboarding
- System design
- Must complete coding without AI
4. Final Onsite
- Meet engineering team
- Leadership discussions
- Final evaluation
Hiring Notes
- Mission-critical hire
- Highest engineering priority for the company
- Looking to hire immediately
- Target start by end of July
- 24–48 hour interview turnaround
- Company expects to hire approximately 8 engineers per month
Senior IAM Security Engineer
Salary - £110-120k + 10% Bonus + Benefits
Location – Fully Remote
Newly created role within a major UK Brand who are looking for a Senior Security Engineer to build on and expand their IAM and Authentication capability.
First and foremost, they need a Senior level Security Engineer with experience working in cloud-native (AWS) infrastructure environments, building out CI/CD pipelines, deploying infrastructure/policy-as-code, with a breadth of experience across various cyber disciplines.
But crucially within this role, they are looking for someone who can build and run their global IAM capabilities that secure their environments both internally and externally. You will be responsible for designing IAM policy and governance, introducing policy-as-code as well and integrating IAM with the wider CI/CD pipelines, infrastructure-as-code and cloud native services; working with the wider Engineering departments to ensure IAM security is built in from the start.
This is an incredibly rare and exciting opportunity to join one of the most advanced Security Engineering departments and take ownership of one of its most pivotal Security service lines, with freedom and financial backing to introduce novel concepts.
Key Responsibilities
- Build out, operate and lead the global IAM capabilities that secure their environments.
- Lead on the automation of IAM policy and governance through policy-as-code; covering identity standards and audit/attestation workflows.
- Integrate IAM with the wider cloud-native security services, building it into the CI/CD pipelines and infrastructure-as-code.
- Work with wider Engineering departments to ensure IAM is embedded into company-wide development projects and a productive priority, not hindrance.
Key Requirements
- Minimum 5 years’ experience in a technical security engineering role, with at least 2 focused on Identity & Access Management (IAM)
- Experience operating in cloud-native (AWS) environments building out and operating IAM functions.
- Hands-on, practical experience automating IAM Governance and Policy through policy-as-code and integrating into wider Infrastructure-as-code and CI/CD pipelines.
- Familiarity with a range of IAM tools and concepts – particularly AWS associated tooling and technology.
- Track record and ability to interact with wider Security and Engineering departments to ensure IAM and Security are built in at development stage as a priority, rather than after-thought.
Senior Cloud SecOps Engineer
Salary - £110-130k + 30-50% Bonus + Benefits
Location – London (required in office 3 days per week)
I’m currently working with one of the most innovative, tech-driven Investment Management firms who are looking to bring in a Senior Cloud SecOps Engineer. They are rebuilding their entire SecOps function from the ground up, meaning there is a blank canvas to build out a best-in-class, cloud-native SecOps capability.
Working alongside and reporting directly into the Head of SecOps, you will be responsible for understanding their current SecOps estate, ‘lifting and shifting’ what’s good, and completely ripping up and re-writing what’s not; in turn creating a lean but incredibly efficient cloud-based SecOps function.
You will effectively act as the technical bridge between the internal SOC function and the wider Platform Engineering capability – ensuring their cyber monitoring, detection and response capabilities are aligned to their wider cloud strategy and fully secure.
The ability to read and write code will be essential as well as significant experience working in cloud environments, with an in-depth knowledge of the associated cloud security tooling/concepts – Infrastructure as Code (Terraform), Containers (Kubernetes), Continuous Integration and Delivery (Gitlab)
This is genuinely an incredible opportunity to join the most established organization within this industry and have a blank canvas to build out their SecOps capability from the ground up; with freedom to build and innovate as you see fit and genuinely impact a truly elite Investment Management firms enterprise estate.
Responsibilities
- Build out a cloud-native, scalable SecOps capability capable of defending against cyber threat actors.
- Take ownership of and consistently develop the SecOps monitoring, detection and response tooling; automating and fine-tuning wherever possible, whilst adopting and configuring into the cloud infrastructure.
- Work closely with internal SOC and Platform teams to ensure the cloud based SecOps capability aligns with Platform Engineering cloud strategy.
- Report to and influence senior stakeholders across the organization, translating technical concepts into relevant associated risks
Requirements
- Experience building and developing scalable security monitoring and detection tooling using open source tooling in public cloud environments.
- Depth of knowledge and experience working in hybrid cloud environments – AWS / Azure in particular
- Strong proficiency in coding/scripting/development languages (this will be tested)
- Deep knowledge of cloud security tooling/concepts – Infrastructure as Code (Terraform), Containers (Kubernetes), Continuous Integration and Delivery (Gitlab)
- Prior experience working with/within MSSPs and an understanding of how to maximise their functionality (not essential, just a bonus)
- Ability to work with and influence wider teams and stakeholders across the business
If you’re an experienced Cloud SecOps Engineer looking to join an organisation which will provide you the platform and freedom to build and develop freedom a cloud-native SecOps capability from the ground up, whilst working alongside and learning from one of the most respected leadership teams within this space, then click apply or get in touch directly with your up to date CV - j.dale@lawrenceharvey.com
Senior Cloud Security Engineer
Location – Fully Remote (from within the UK)
Salary - £110-120k + Bonus + Benefits
Newly created role for a highly technical, hands-on Senior Cloud Security Engineer to join a major UK Brand undergoing a major security transformation.
Reporting into the Global Head of Cloud Security and working alongside a team of some of the most talented Security Engineers, you will be responsible for building and running defensive security controls for highly available cloud-native infrastructure.
For this particular role, they need someone who is a genuine Engineer who can build secure CI/CD pipelines, build and deploy multi-cluster Kubernetes and containers environments, deploy Infrastructure-as-Code in Terraform, and script/code in Python.
Key Responsibilities:
- Build and maintain defensive security controls in cloud-native (AWS) environments.
- Build out and secure CI/CD pipelines.
- Build out and secure multi-cluster container (Kubernetes) environments.
- Deploy Infrastructure-as-Code where possible to automate security processes and controls.
- Work closely with wider platform, application and research engineering teams to advise on building, maintaining and expanding security controls.
Key Requirements:
- 5+ years’ experience working in cloud security dedicated roles (AWS preferred).
- In-depth knowledge of:
- Securing CI/CD pipelines
- Deploying Infrastructure-as-Code (Terraform)
- Container security (Kubernetes)
- Scripting/Coding knowledge (Python)
- Securing AWS hosted environments
- Ability to interact with and influence both technical and non-technical stakeholders across the organization; championing security as an enabler rather than a blocker for different teams.
- Senior Machine Learning Engineers needed for high growth tech company
- Austin, TX – must be willing to work in office 4 days a week
- High competitive salary + equity + strong benefits
Senior Machine Learning Engineer
We're partnering with a fast-growing technology company that's building machine learning systems at significant scale to solve complex real-world challenges. Their platform processes billions of transactions annually and uses advanced AI to power intelligent decision-making for millions of end users.
As a Senior Machine Learning Engineer, you'll work at the intersection of machine learning and software engineering, collaborating closely with product and engineering teams to design, build and deploy production-grade ML models that directly influence business outcomes.
Compensation
- Total compensation: $335k–$400k
- Base salary: $210k–$260k
- Equity package included
- Comprehensive benefits
What you'll do
- Partner with product managers and engineers to translate business problems into scalable machine learning solutions.
- Design, develop and deploy production-ready machine learning models across areas such as ranking, prediction, optimisation, forecasting and recommendation.
- Build robust data pipelines, engineer high-quality features and integrate models into scalable production infrastructure.
- Monitor model performance, detect drift and continuously improve model accuracy through retraining and experimentation.
- Write clean, well-tested, production-quality code and contribute to engineering best practices across testing, reliability and performance.
- Research emerging machine learning techniques, prototype new approaches and validate ideas through offline and online experimentation.
What we're looking for
- PhD or Master's degree in Computer Science, Statistics, Mathematics or a related quantitative discipline (or equivalent industry experience).
- Strong background in machine learning and software engineering with experience delivering production ML systems.
- Expertise in one or more of the following areas:
- Recommender systems
- Bayesian machine learning
- Multi-task learning
- Meta-learning
- Ranking, prediction or optimisation models
- At least 3 years of experience building end-to-end machine learning systems, including training, deployment, serving and monitoring.
- Experience with modern ML infrastructure such as TensorFlow, Kubeflow (or similar) and feature stores is highly desirable.
- Familiarity with large-scale deep learning architectures used for recommendation or ranking systems is a plus.
Working arrangements
- Hybrid working model with four days per week in the office and one day working remotely.
This is an opportunity to join a highly technical engineering team where machine learning sits at the core of the product. You'll have the chance to work on challenging problems at scale, collaborate with experienced engineers and researchers, and see your work make a measurable impact.
- Senior Software Engineers needed for high growth tech company
- Backend Engineering / Platform Engineering Focused
- Austin, TX – must be willing to work in office 4 days a week
- High competitive salary + equity + strong benefits
Senior Software Engineer
We're partnering with a high-growth technology company that builds large-scale distributed systems powering billions of transactions each year. They are looking for experienced Software Engineers who enjoy solving complex engineering problems at scale and building highly reliable backend platforms.
This is an opportunity to join a world-class engineering team where you'll have ownership of critical systems, influence technical direction, and work on infrastructure that operates under demanding performance and reliability requirements.
Compensation
- Total compensation: $335k–$400k
- Base salary: $210k–$260k
- Equity package included
- Comprehensive benefits
What you'll do
- Design, build, deploy and maintain highly scalable backend services operating in high-throughput, low-latency environments.
- Write clean, maintainable production code using technologies such as Go, Java, Scala, C#, or TypeScript.
- Investigate production issues, optimise system performance and improve the reliability and scalability of distributed services.
- Drive architectural improvements and contribute to technical design decisions across core platform systems.
- Explore AI-assisted development tools and automation to improve engineering productivity and software delivery.
- Mentor engineers, contribute to technical best practices and help shape engineering standards.
- Collaborate closely with cross-functional teams to deliver solutions aligned with business priorities.
- Take ownership of services throughout their lifecycle, including deployment, monitoring and operational support.
What we're looking for
- Bachelor's degree in Computer Science or a related discipline (or equivalent commercial experience).
- 4+ years of experience building and operating production-grade distributed systems.
- Strong software engineering fundamentals with experience in one or more of Go, Java, Scala, C#, or TypeScript.
- Experience working with cloud platforms, containerisation technologies and CI/CD pipelines.
- Excellent troubleshooting, analytical and problem-solving skills.
- Comfortable taking ownership of systems in production, including monitoring, incident response and continuous improvement.
Experience in one or more of the following areas would be advantageous:
- High-performance distributed systems and scalable backend services.
- Data platforms and streaming technologies.
- MLOps and infrastructure supporting machine learning workloads.
- Site Reliability Engineering (SRE), observability and platform reliability.
- Developer platforms, SDKs or frontend infrastructure.
Working arrangements
- Hybrid working model with four days per week in the office and one day working remotely.
Why join?
- Competitive salary and meaningful equity.
- Comprehensive healthcare and retirement benefits.
- Generous wellness and professional development allowances.
- Collaborative engineering culture with significant technical ownership.
- Opportunity to solve challenging distributed systems problems using modern technologies at exceptional scale.


Unsure of your next step? Reach out.
At Lawrence Harvey, we recognise that navigating the job market can be daunting. Whether you're an experienced professional seeking a fresh challenge or starting your career, our team of dedicated tech recruitment specialists are here to assist you. With our vast network of industry contacts and thorough understanding of the tech landscape, we can offer guidance and support to help you discover the ideal opportunity.