About the role#
This internship focuses on AI-native distributed systems within the IBM Research department. You will contribute to the industrial research lifecycle by formulating new ideas, building prototype systems, and evaluating performance at scale. The goal is to demonstrate real-world impact and publish findings in scientific venues.
What you'll do#
- Explore and advance aspects of AI-native distributed computing.
- Design, develop, and optimize software platforms for LLMs and agents.
- Create principles, methodologies, and frameworks for AI-native software development.
- Research high-performance distributed inference for LLMs.
- Build frameworks, tools, and infrastructure for the end-to-end AI lifecycle.
- Prototype networking solutions and techniques for future AI systems.
- Evaluate solutions based on performance, scalability, and resiliency.
What you'll need#
- Currently pursuing an MS or PhD in Computer Science, Engineering, or a related field.
- Focus on artificial intelligence, systems, networking, or software development.
- Background in artificial intelligence and machine learning, specifically deep learning or agentic patterns.
- Strong software development skills with proficiency in Python, Go, C++, or Rust.
- Experience with containerization tools like Docker or Kubernetes.
- Understanding of LLM technology, including distributed inference and vLLM.
- Experience designing and implementing distributed systems.
- Familiarity with cloud or data center networking, Software-Defined Networking, network virtualization, or Linux networking.
- Research and development experience in AI platforms.
Location & details#
- Location: Yorktown Heights, New York, United States.
- Work Modality: On-site.
- Employment Type: Full-time internship.
- Term: Rolling.
About IBM
IBM provides IT services and consulting to a global client base. The company develops technology solutions across areas such as cloud computing, security, analytics, and infrastructure. It operates as a public organization with more than 10,001 employees. The corporate headquarters are located in Armonk, New York.
How to get in at IBM
Applying early at IBM gives you a measurable advantage because recruiters review applications as they arrive. Intern Insider sends an instant alert the moment a role matching your target is published, so you can submit your materials before the pile grows. Being among the first candidates seen helps you stand out in a large applicant pool. You can also improve your response rates by reaching out to the recruiters behind the roles directly. Intern Insider surfaces the specific contacts for IBM positions so you can ask about the role or a referral. This direct approach often works better than sending your resume into a queue.


