Job Overview:
Arm’s Productivity Engineering (PE) team is looking for a forward-thinking Staff AI/ML Engineer to help design, develop and scale up production-grade applications powered by large language models (LLMs). This role focuses on hands-on technical innovation, with a strong emphasis on building scalable and impactful AI systems for real-world engineering challenges.
If you thrive on building systems that push the boundaries of what’s possible with LLMs and you want to be part of a team that’s redefining the way engineering is done, we’d love to hear from you!
About the Team
The PE AI & Engineering Excellence team is Arm’s engine for AI-driven productivity. Our mission is to enhance engineering efficiency through automation, intelligence, and innovation. We work across a broad range of problems in Arm across hardware and software, and we drive engineering excellence and efficiency through the deployment of AI into existing workflows.
Responsibilities:
- Build AI applications that integrate LLM capabilities into engineering workflows, from interactive agents to intelligent automation tools.
- Architect, implement, and maintain scalable LLM systems suitable for large-scale, multi-user environments.
- Build production ready, high quality AI/ML products; produce clean code and contribute to internal methodologies for prompt engineering, evaluation, and LLM usage patterns.
- Tune prompts, pipelines, and infrastructure to ensure robust behaviour, low latency, and cost-efficient inference.
- Apply software engineering practices to AI codebases, ensuring maintainability, testing, continuous integration and delivery.
- Collaborate with HW design, SW engineering, and verification teams to understand real-world problems and co-develop AI solutions.
- Experiment with new tools, models, and techniques to keep Arm at the forefront of AI productivity engineering.
Required Skills and Experience :
- BS, MS, or PhD or equivalent experience in Computer Science, Machine Learning, Engineering, or a related field.
- Production experience building LLM-powered applications and integrating them into larger systems.
- Hands-on expertise tuning and optimising LLM + ML driven applications.
- Proficiency in Python and common ML/AI libraries; comfortable with full-stack system design from prototyping to production deployment.
- Familiarity with one or more LLM stacks (OpenAI, Hugging Face Transformers, LangChain etc)
- Experience with model serving frameworks and scalable deployment strategies
- Experience with containerisation and orchestration
“Nice To Have” Skills and Experience :
- Exposure to hardware design or verification processes (e.g., RTL, formal verification, simulation workflows).
- Familiarity with vector search, retrieval-augmented generation (RAG), or multi-agent orchestration.
In Return:
At Arm, you’ll work on AI challenges with practical impact across a global organization. You’ll join a collaborative team that values deep technical insight, clean engineering and creative problem-solving. Your contributions will influence how thousands of engineers at Arm design and verify the next generation of computing platforms—smarter, faster, and at scale.
#LI-EK1
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.