Home
/
Comprehensive
/
Software Engineer, Torch-TensorRT Inference
Software Engineer, Torch-TensorRT Inference-March 2024
Santa Clara
Mar 17, 2025
ABOUT NVIDIA
NVIDIA is a computing platform company, innovating at the intersection of graphics, HPC, and AI.
10,000+ employees
Technology
VIEW COMPANY PROFILE >>
About Software Engineer, Torch-TensorRT Inference

  We are looking for outstanding Software Engineers for Torch-TensorRT Inference framework! As a member of our Torch-TensorRT Engineering team, you will use groundbreaking NVIDIA deep learning model inference software libraries for deployment on NVIDIA's hardware architecture. You will develop a deep learning compiler and optimize DNN graphs in lower precision using NVIDIA TensorRT!

  We work on innovative vision and language models to ensure they are accelerated by Torch-TensorRT. In addition, we contribute to our open-source library and have opportunities to present our work at conferences.

  What you will be doing:

  Develop components of Torch-TensorRT, NVIDIA's SDK for high-performance deep learning inference along with PyTorch

  Use C++, Python and CUDA to build graph parsers, converters, compiler, and tools for effective deployment of trained deep learning models.

  Work with cross-collaborative teams of deep learning software engineers and GPU architects to innovate across applications like autonomous driving, NLP, and computer vision.

  What we need to see:

  A BS, MS or PhD in Computer Architecture, Computer Science, Electrical Engineering or related field or equivalent experience

  5+ years of work related experience in software development or Machine learning or high-performance computing

  2+ years of experience in developing or using deep learning frameworks (e.g., PyTorch, TensorFlow, ONNX, etc.)

  Strong C++ programming skills including debugging, performance analysis, test design, and optimizations.

  Strong understanding of build/release systems, CI/CD, and experience with solutions like Gitlab, Github, etc.

  Ways to stand out from the crowd:

  Familiarity with sophisticated C++11/C++14 language features and CUDA kernel programming.

  Experience working in an open-source and software development on Windows.

  Strong time-management and organization skills for coordinating multiple initiatives, priorities and implementations of new technology and products into very complex projects.

  The base salary range is 116,000 USD - 270,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

  You will also be eligible for equity and benefits (https://www.nvidia.com/en-us/benefits/) . NVIDIA accepts applications on an ongoing basis.

  NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  NVIDIA is a Learning Machine

  NVIDIA pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI and the metaverse is transforming the world's largest industries and profoundly impacting society.

  Learn more about NVIDIA .

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
CYBERSECURITY ADMINISTRATOR II - 36000010 1
CYBERSECURITY ADMINISTRATOR II - 36000010 1 Date: Jan 23, 2024 Location: TALLAHASSEE, FL, US, 32301 The State Personnel System is an E-Verify employer. For more information click on our E-Verify Webs
PROJECT OFFICER, INTEGRATED ANALYTICS
Req #: 230345 Department: INSTITUTE FOR HEALTH METRICS & EVALUATIONS (IHME) Job Location Detail: Office is located in Seattle; position is eligible to work fully remote within the U.S. (excluding
Principal Product Marketing Manager
Job Description Qualifications: Must have a minimum of 8 years of healthcare experience in Product Marketing Strong background in creating core messaging for products Strong customer adoption backgro
Diesel Technician Apprentice
Req ID: 430256 Address: 1533 E 162nd St South Holland, IL, 60473 Welcome to Love’s! * * Where People are the Heart of Our Success * * Diesel Technician Apprentice - Truck Care At Love’s, our values g
Technical Principal Program Manager-JoinOCI-Ns2
Job Description Job Description At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a complementary team of fellow creators and inventors. We act with the speed
Retail Store Customer Service Specialist
This is position is essential to the success of our retail stores. Customer Service Specialists work closely with wholesale and retail customers to determine their needs, answer their questions about
Systems Configuration Specialist
Taking care of people is at the heart of everything we do, and we start by taking care of you, our valued colleague. A career at Sedgwick means experiencing our culture of caring. It means having fle
Vice President Finance, Enterprise Operations
About Lumen Lumen connects the world. We are igniting business growth by connecting people, data and applications – quickly, securely, and effortlessly. Together, we are building a culture and compan
Network Developer 3
Job Description The Oracle DDOS team is the front line defense for all DDoS threats world-wide, against the Oracle Cloud Infrastructure (OCI), customers and services. Our architecture must be highly
Senior Medical Financial Risk Evaluation Professional
Become a part of our caring community and help us put health first The Senior Medical/Financial Risk Evaluation Professional is responsible for supporting the development, implementation and monitori
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved