Home
/
Comprehensive
/
Senior Data Engineer
Senior Data Engineer-April 2024
Houston
Apr 19, 2025
About Senior Data Engineer

  Entity:

  Production & Operations

  Job Family Group:

  IT&S Group

  Job Summary:

  Grade H

  Responsible for supporting the delivery of business analysis and consulting processes and procedures for the defined specialism using sound technical capabilities, building and maintaining effective working relationships, ensuring relevant standards are defined and maintained, and supporting delivery of process and system improvements. Specialisms: Business Analysis; Data Management and Data Science; Digital Innovation.

  Job Description:

  Key Accountabilities

  Define approved patterns for data workflow, pipelines, security guidelines, policies, and procedures.

  Document the guidelines, policies, and procedures on the Digital Hub for Squad members to leverage.

  Engage in Pilot and Proof of Concepts as new platform features are released, or new data integration/ingestion use cases arise from Squad members.

  Provide oversight to ensure that Squad members are following the approved data patterns and best practices.

  Provide Data Engineering certification approval for Squad members.

  Evaluate, compare, and recommend new Data Platform enhancements, tools, and features.

  Partner and provide guidance to Squads on technical direction and approved integration patterns.

  Present recommendations for changes to the Data Platforms to the Architecture Review Board for approval.

  Ensure stable Data Platform infrastructure.

  Comfortable operating as an individual contributor and using influence and expertise to aid in the transformation of the organization.

  Knowledgeable of industry trends and best practices and staying current on new technology as it comes to market.

  Participation on the Data Platform Guild.

  Essential Experience

  5-7+ years of Data Engineering experience

  5-7+ years of relevant work experience in IT/Data and/or Analytics space

  Experience with cloud platforms, AWS preferred

  Experience in any cloud data warehouse, Snowflake preferred

  Experience with replication tools, Fivetran/LDP(prev. HVR) preferred

  Experience with transformation tools, dbt and ADF preferred

  Experience with programming languages, python preferred

  Experience with REST APIs for data ingestion

  Knowledge/Experience with Terraform, deploying IAC through CICD

  Strong understanding of ETL/ELT processing with large data stores

  Experience designing and delivering large scale, 24-7, mission-critical data pipelines and features using modern big data architectures

  Knowledge of stream processing services such as Kafka, AWS Kinesis, Apache Storm, Azure Event Grid, AWS Event Bridge, nice to have

  Demonstrated experience working in large-scale data environments which includes continuous and batch processing

  Experience working with JSON formats in Snowflake, preferred

  Strong data modeling skills

  Strong SQL skills, with attention to detail

  Enforcement of Data Mesh architecture

  Ability to aid in tuning and performance recommendations for poor performing SQL queries and/or python scripts

  Experience with CI/CD pipeline management/configuration

  Experience with Azure DevOps repositories, git experience

  Ability to work with multiple external teams and accomplish shared goals by building consensus

  Knowledge of Data Virtualization tools, preferred Denodo

  Strong communication (written/verbal) and collaboration skills

  Consulting, negotiation, and relationship skills

  Problem solving skills

  Enthusiastic, high-energy individual, self-motivated, people-oriented, and self-directed

  Must be an articulate and persuasive leader who can communicate concepts to technical & non-technical colleagues

  Must be able to maintain focus on achieving results, whilst being patient and pragmatic

  Desirable Criteria & Qualifications

  Experience working in a development role on an Agile team

  Experience with monitoring and troubleshooting cloud infrastructure

  Knowledge of Snowflake configuration, administration, and setup best practices (security, external stores, cloning, etc)

  Desire to continually learn outside of a classroom environment, and successfully apply learnings

  Demonstrated willingness to both teach others and learn new techniques

  Compensation

  We offer a reward and wellbeing package to enable your work to fit with your life. These can include, but not limited to, access to health, vision and dental insurance, flexible working schedule, paid time off policy, discretionary annual bonus program, long-term incentive program, and a generous 401K matching program. How much do we pay (Base)? $135,000 - $175,000

  *Note that the pay range listed for this position is a good faith and reasonable estimate of the range of possible base compensation at the time of posting.

  Travel Requirement

  Up to 10% travel should be expected with this role

  Relocation Assistance:

  This role is not eligible for relocation

  Remote Type:

  This position is a hybrid of office/remote working

  Skills:

  Business Acumen, Commercial acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms, Data visualization and interpretation, Digital Security, Extract, transform and load, Problem Solving

  Legal Disclaimer:

  We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with disabilities may request a reasonable accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an accommodation related to the recruitment process, please contact us to request accommodations.

  If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Lead Surveyor
Requisition ID: 274069Relocation Authorized: International - Camp Telework Type: Full-Time Office/Project Work Location: Sharma Company Overview:Since 1898, we have helped customers complete more tha
Cook
Job Purpose:Serves meals by reviewing recipes; assembling, combining, and cooking ingredients; maintaining equipment, inventory, and a sanitary kitchen.We are a small to medium childcare center. Ther
OCONUS A&P Mechanic (Based In Clovis, NM)
Relocation $$$ Provided! Opportunity to travel the USA and Overseas supporting active U.S. military missions as a civilian employee! Overview: Aerotek Aviation is seeking A&P Mechanics to perform
General Farmworker/Irrigation Worker
This job was posted by https://idahoworks.gov : For more information,please see: https://idahoworks.gov/jobs/2154576 Dates of need are 3/118/2024-11/15/2024 This order is for work in Paul,Idaho area.
JW - Instructor Fitness
Job Number 24012425 Job Category Golf, Fitness, & Entertainment Location JW Marriott Cancun Resort & Spa, Blvd. Kukulcan, Km 14.5, Lote 40-A, Zona Hotelera, Cancun, Quintana Roo, Mexico Sched
Principal Member of Technical Staff
Job Description The Oracle Cloud Infrastructure (OCI) team can provide you the opportunity to build and operate a suite of massive scale, integrated cloud services in a broadly distributed, multi-ten
Seconda Governante Superv.Housekeeping The St.Regis Venice
Job Number 24012598 Job Category Housekeeping & Laundry Location The St. Regis Venice, San Marco 2159, Venice, Benatky, Italy Schedule Full-Time Located Remotely? N Relocation? N Position Type No
Specialist - Outreach-Fixed Term
Position SummaryThe Michigan State University (MSU) Center for Regional Food Systems within the Department of Community Sustainability is seeking a full-time Michigan Food and Farm Network Specialist
Customer Success Manager
Job Description Summary Job Description We are the makers of possible BD is one of the largest global medical technology companies in the world. Advancing the world of health™ is our Purpose, and it’
ANIMAL CONTROL OFFICER
DEADLINE TO APPLY: FEBRUARY 2, 2024 SALARY: MINIMUM $25,537.00 (possibly higher depending on experience) Role and Responsibilities This is a field and office work in the enforcement of the Jackson Co
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved