AI Frameworks Software Engineer - vLLM

Job Details:

Job Description: 

The candidate designs, develops, and optimizes for AI frameworks including vLLM/PyTorch and contribute to external upstream opensource projects. Implements various distributed algorithms such as model/data parallel frameworks, parameter servers, dataflow based asynchronous data communication in machine learning, and/or deep learning frameworks. Transforms computational graph representation of neural network model, and develops machine learning and/or deep learning primitives in mathematical libraries. Profiles distributed deep learning models to identify performance bottlenecks and proposes solutions across individual component teams. Optimizes code for various computing hardware backends, and interacts with machine learning and/or deep learning researchers, and utilizing experience with machine learning and/or deep learning frameworks.

Qualifications:

The candidate should possess at least a Master degree of Computer Science (or related BS/MS degree in Computer field) or a bachelor degree with at least 2 years of experience.
The candidate should have following qualifications:
Language and fundamental skill:
Candidate should be solid on at least one of the following language and familiar with at least two

• Python
• C/C++
• Assembly language

It will be a plus to be familiar with the knowledge of below domains

• Computer architecture
• Compiler
• OS and language runtime environment

Machine learning: candidate should have experience in at least one of the following fields

• Experience in deep learning frameworks such as PyTorch, vLLM.
• Familiar with transformer and popular transformer-based large language model architecture
• Have improved model performance for one of the frameworks is a plus
• Have enabled finetune or inference on one of the frameworks is a plus
• Have knowledge on the communication, distributed inference or training is a plus
• Have used existing model to improve state-of-art of empirical problem is a plus

Technical/problem solving

• Excellent development and debugging skills (system level language such as C, C++ and assembly preferred)
• Proven track record of analyzing and solving complex technical problems
• Proven track record of deliver result in time with planned release cycle
• Good understanding and excellent hands-on engineering capability of quality control in software development life cycle
• Excellent written and oral communication skills and be able to clearly communicate technical details and concepts

  Job Type:

  College Grad

  Shift:

  Shift 1 (China)

  Primary Location: 

  PRC, Shanghai

  Additional Locations:

  Business group:

  The Sales and Marketing Group (SMG) leverages the product portfolio to drive Intel's revenue growth and market expansion, blending strategic initiatives with dynamic sales efforts to capture and retain customers. SMG is responsible for empowering the sales force with tools and insights needed to close deals and build lasting customer relationships. Sales analytics and market research ensure strategies are both targeted and impactful. In SMG, disciplined execution, creativity, and ambition are celebrated, providing ample opportunities for career advancement and skill development.

  Posting Statement:

  All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

  Position of Trust

  N/A

  Work Model for this Role

  This role will require an on-site presence. * Job posting details (such as work model, location or time type) are subject to change.