Hungry, Humble, Honest, with Heart.
The Opportunity
If you are interested in building enterprise-ready LLM services from scratch, then we are interested in talking to you. The successful candidate for this role should have demonstrated experience in building large language models and deploy the LLM’s on Enterprise grade distributed systems. You will be part of our dynamic and innovative SaaS Engineering organization here at Nutanix.
Your Role
Build data pipelines for training and fine-tuning LLMs
Experience in data engineering
Perform supervised fine-tuning and instruction-tuning of open-source Generative AI models such as LLaMA-2 for a variety of downstream tasks such as Question Answering
Setup inference endpoints and MLOPs workflow for iterative model performance tuning
Submit to industry-standard benchmarking organisations such as MLCommons
Experience in RAG (retrieval augmented generation)
Set up the LangChain pipeline, including prompt engineering and parsing
Develop custom pre-trained LLMs based on internal data
Collaborate with internal teams for data engineering and building custom models and optimisations
Having expertise in KubeFlow or MLflow is good to have.
What You Will Bring
Ph.D. or M.S. or Bachelor's degree in Computer Science, Electrical Engineering, Statistics, Applied Mathematics, or related fields
3-6 years of industry experience in large-scale ML model development.
NLP and LLM model development experience is a strong plus.
Expert in Python, especially in AI/ML libraries such as PyTorch, TensorFlow, Sklearn, LLM tools such as Spacy, and data engineering tools such as Pandas, Numpy, Spark
Hands-on MLOps skills such as feature engineering, data formatting, deployment, monitoring
In-depth knowledge of deep learning learning algorithms, especially for NLP and LLM
Familiarity with open-source LLM ecosystems such as Hugging Face and LangChain
Proficient in at least one of the system-level languages such as C/C++, Java, Golang and Data Structures and Algorithms for improving computational efficiency
Demonstrated track record of prior open source contribution is a significant plus
We're an Equal Opportunity Employer Nutanix is an Equal Employment Opportunity and (in the U.S.) an Affirmative Action employer. Qualified applicants are considered for employment opportunities without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, protected veteran status, disability status or any other category protected by applicable law. We hire and promote individuals solely on the basis of qualifications for the job to be filled. We strive to foster an inclusive working environment that enables all our Nutants to be themselves and to do great work in a safe and welcoming environment, free of unlawful discrimination, intimidation or harassment. As part of this commitment, we will ensure that persons with disabilities are provided reasonable accommodations. If you need a reasonable accommodation, please let us know by contacting [email protected].