Home
/
Data and Analytics
/
Key Data Engineer (Python / Scala / Azure)
Key Data Engineer (Python / Scala / Azure)-April 2024
Ogre
Apr 3, 2025
ABOUT EPAM SYSTEMS
EPAM is a leading global provider of product development and software engineering solutions.
10,000+ employees
Consulting, Technology
VIEW COMPANY PROFILE >>
About Key Data Engineer (Python / Scala / Azure)

  Description

  We are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions.

  What You'll Do Build and maintain secure and compliant production data processing pipelines by using different tools and techniques (cloud services, Python/Scala) Ensure that data pipelines and stores are high-performing, efficient, organized, and reliable, given business requirements and constraints Design, implement, monitor and optimize data platforms to meet the data pipeline needs Responsible for data-related implementation tasks: provisioning data storage services, ingesting streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks and accessing external data sources Design and operationalize large-scale enterprise data solutions and applications using one or more Azure data and analytics services Implement data solutions that use the following Azure services: Azure Cosmos DB, Azure Synapse Analytics, Azure Data Factory, Azure Stream Analytics, Azure Databricks, Azure Blob storage, Microsoft Purview, etc Integrate, transform and consolidate data from various structured and unstructured data systems into a structure suitable for building analytics solutions Design and implement data engineering, ingestion and curation functions on Azure cloud using Azure native or custom programming Create data transformation and loading workflows What You Have

  Experience in Data Platforms and Azure's PaaS offerings (Synapse, Purview, ADF, Databricks, Azure Data Lake Storage) Competency in Azure: Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, SQL Database, SQL Managed Instance, Stream Analytics, Cosmos DB, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, ARM Templates Proficiency in data processing languages such as SQL, Java, Python or Scala Strong notions of security best practices (e.g., using Azure Key Vault, IAM, RBAC, Monitor, etc.) Understanding the data through exploration and experience with data retention, validation, visualization, preparation, matching, fragmentation, segmentation and enhancement processes Familiarity with Azure Networking concepts Certifications Preferred: "DP-203: Data Engineering on Microsoft Azure" and "DP-900: Microsoft Azure Data Fundamentals" We Offer Salary range 3800-6200 EUR gross, based on your experience and interview results Outstanding career development roadmap to accelerate your journey Engineering community of 59,250+ industry's top professionals Certification and mentoring programs, training, and unlimited access to LinkedIn Learning Innovative solutions delivery to the world's industry leaders Regular assessments and salary reviews Bonuses for participating in the referral program Flexible schedule and opportunity to work remotely from any place in Latvia Friendly team and enjoyable working environment Relocation within offices in 50+ countries with throughout support for you and your family Four trust days a year (sick leave without a medical certificate) High-quality medical services in terms of corporate health insurance About EPAM We are a team of 59,250+ technologists, strategists, and designers in 50+ countries. EPAMers help leading brands transform their business through our engineering expertise, design thinking, and business consulting. We foster creativity and unconventional ways of doing things welcoming like-minded professionals. Our newly opened office in Latvia is growing fast and offering myriad challenges for you to explore

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
2024 Summer Intern: Associate Data Scientist - Customer Operations
The Spectrum Internship Experience Who is Spectrum? We are a Connectivity Company. We connect our customers to superior communications and entertainment products with the highest quality service. As
Caseworker- Future Opportunities
Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on t
Staff Data Scientist - (AI/ML Team), Bangalore
Every great story has a new beginning, and yours starts here. Welcome to Warner Bros. Discovery... the stuff dreams are made of. Who We Are... When we say, the stuff dreams are made of, we're not jus
Digital Technology Intern
Job Description Summary IT Project Specialist to support digital innovation, emerging technology and China cyber security due diligence. Provide support and engage in innovation & data analytics
Ingénieur support technique (H/F)
Job Description Summary Job Description Notre entreprise Au sein de GE Power Conversion (environ 3000 personnes dans le monde dont 900 en France), nous mettons en pratique les techniques et les systè
IT Business Analyst - Product Services & Management Analyst
Job Description Analyzes, verifies, tracks and recommends for Project, Product and Solution implementation and maintenance. Liaises between various agile teams and project teams. Recommends and deliv
F-35 Contracts Manager 2
At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generations to come. Our pioneering and in
2024 Summer Intern: Assoc Data Insights Analyst - Customer Operations
The Spectrum Internship Experience Who is Spectrum? We are a Connectivity Company. We connect our customers to superior communications and entertainment products with the highest quality service. As
Technology Analyst - Azure Data Engineer
Infosys is seeking a Azure Data Engineer . This position will interface with key stakeholders and apply technical proficiency across different stages of the Software Development Life Cycle including
Operador Logístico
Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on t
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved