Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

IBM

AI Foundations - Software Engineer

IBM

Published 27 Mar 2026
Cambridge, MA, USA
Full Time

Share this job

Role Highlights

Languages used

Python

Key skills

Deep Learning
API
Distributed Systems
Data Processing
System Design
Software Systems
Research
AI
Cloud
LLMs
Reliability
RAG
Visualization
Machine Learning
Interfaces
Infrastructure

Tools, Libraries and Frameworks

IOS
IBM
Git
PyTorch

Description

\\\\Introduction\\\\ At IBM Research, we are the innovation engine of IBM. Exploring whats next in computing and shaping the technologies the world will rely on tomorrow. From advancing AI and hybrid cloud to pioneering practical quantum computing, we anticipate challenges and unlock new opportunities for clients, partners, and society. Working in Research means joining a team that accelerates discovery at the intersection of high-performance computing, AI, quantum, and cloud. Youll collaborate with leading scientists, engineers, and visionaries to push boundaries and turn ideas into reality. With a culture built on curiosity, creativity, and collaboration, IBM Research offers the opportunity to grow your career while contributing to breakthroughs that transform industries and change the world. \\\\Your role and responsibilities\\\\ \\\ Design, develop, and maintain demo systems and software prototypes that implement algorithms developed by research scientists in LLM reliability and trustworthiness \\\ Translate cutting-edge research (e.g., hallucination detection, uncertainty estimation, RAG pipelines, fine-tuning methods) into scalable, well-engineered software systems \\\ Build end-to-end pipelines integrating large language models, data processing, and evaluation frameworks \\\ Develop user-facing demos, APIs, or visualization tools to showcase research outcomes and system capabilities \\\ Collaborate closely with researchers to iterate on implementations, validate performance, and ensure fidelity between research ideas and deployed systems \\\ Optimize system performance, reliability, and usability for experimental and demonstration purposes \\\\Required technical and professional expertise\\\\ \\\ Strong software engineering skills in Python, with experience building production-quality or research-oriented ML systems \\\ Proficiency in PyTorch and familiarity with implementing and integrating deep learning models \\\ Understanding of large language models and Transformer-based architectures at a practical implementation level \\\ Experience with software system design, modular codebases, and version control (e.g., Git) \\\ Ability to translate research concepts into robust, maintainable code \\\\Preferred technical and professional experience\\\\ \\\ Experience building or deploying applications involving large language models (e.g., RAG systems, chat interfaces, evaluation pipelines) \\\ Familiarity with ML system infrastructure (e.g., APIs, distributed systems, cloud platforms) \\\ Experience developing interactive demos, dashboards, or visualization tools \\\ Prior collaboration with research teams or experience implementing research prototypes \\\ Exposure to topics such as uncertainty estimation, hallucination detection, or LLM evaluation frameworks IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Required Qualifications and Skills

The role requires strong software engineering skills in Python, with experience in building production-quality or research-oriented ML systems. Proficiency in PyTorch and familiarity with implementing and integrating deep learning models are necessary. A practical implementation understanding of large language models and Transformer-based architectures is also required. Experience with software system design, modular codebases, and version control systems like Git is essential. The ability to translate research concepts into robust, maintainable code is a key qualification.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

IBM

Size

305978

Website

ibm.com

HQ

Armonk, New York, US

Public/Private

Public Company

Description

IBM infuses core business operations with intelligence, from machine learning to generative AI, to make organizations more responsive, productive, and resilient. It helps clients put AI into action now, creating real value with trust, speed, and confidence across various areas like digital labor, IT automation, and security. The ability to utilize all data is critical, as AI's effectiveness is dependent on the quality of data fueling it, with IBM's AI, and data platform aiming to scale and accelerate AI's impact with trusted data. IBM's hybrid cloud platform offers a comprehensive approach to development, security, and operations across hybrid environments, laying a flexible foundation for leveraging data wherever it resides.

Share

Share this job

Related jobs

Prompt Engineering
API
Rest
LLMs
Brazil
Full Time
Machine Learning
ML Ops
Integrations
CICD
Germany
Full Time
Data Engineer
Deep Learning
NLP
Data Governance
Hyderabad, India
Full Time