Home
/
Comprehensive
/
Sr. Data Engineer
Sr. Data Engineer-January 2024
Atlanta
Jan 14, 2025
ABOUT INSIGHT GLOBAL
Insight Global provides top talent and staffing solutions that help job seekers find careers in healthcare, finance, IT and government.
1,001 - 5,000 employees
Consulting, Technology
VIEW COMPANY PROFILE >>
About Sr. Data Engineer

  Job Description

  This telecom mogul is looking for skilled data engineers to add on to their data ingestion team for the build out of their new Integrated Data Warehouse. In this role, you will be responsible for reviewing and analyzing user stories, High level Solution Designs, source systems, Source to Target Mappings, and then developing code to ingest the data into various database platforms and services. Once Ingested, you will be responsible for ensuring the accuracy of the data per the requirements, then developing scripts to load the data from the DB/Data Lakes into the staging area. After that is complete, you will develop scripts to extract, transform, and load, the data into the core tables as per the logic in the source to target mapping documents. Then develop scripts to import the data from the core table. From there, you will then develop QA test scenarios and perform QA testing, including but not limited to functional, End to End, and data validation testing. You will oversee the production deployments and support the AppOps team during the deployment, data loads, troubleshooting, as well as regular production break fixes activates, as needed. As part of this DevOps role, you will participate in daily standups, will share regular project status with the DevOps Track lead and Scrum Master, as well as management and stakeholders.

  Skills and Requirements

  Experience with ETL

  Azure Databricks + ADF

  Spark, Scala, or Python

  SQL

  Enterprise Level Experience

  Requirement Analysis Review and Analyze user stories.

  Experience with Python for Automation

  Experience with Shell Scripting

  Review HLSD with solution architects.

  Analyzing source systems, Data modelling and source to target mappings (S2TM) and creating relevant artifacts as needed.

  Data Ingestion and Processing -- Analyze various sources and develop the code to ingest the data into Hadoop Data Lake.

  Data Cleansing - Ensure accuracy and completeness of the data and if required cleanup the data as per the need.

  Dispatch / Export- Develop scripts to load the data from Hadoop data lake into the destination staging area.

  Core Loads -- Develop the scripts to extract, transform and load (ETL) data into the Core tables as per the logic laid out in the source to target mapping (S2TM) document.

  Import -- Develop scripts to import the data from core tables into Hadoop Data Lake.

  Develop QA Test scenarios/cases as needed, and perform QA testing including but not limited to functional, End to End and data validation testing.

  Production deployment.

  Support AppOps team during deployment, data loads and troubleshooting, as well as during regular Production Break Fix Activities, as needed.

  Participate in daily standups, and share regular project status to DevOps Track Lead and/or DevOps Scrum Master, T-Mobile Project Manager, T-Mobile Manager and/or other stakeholders as needed.

  CICD Support as needed.

  Any other relevant analysis, design, development, and application support activities assigned to the team members from time to time. - Experience or strong understanding with Snowflake (DB) null

  We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Part Time Sales Associate 2950
Company Description As the global leader in health and wellness innovation since 1935, GNC motivates people to reach their goals with the most trusted and exciting selection of products in the indust
Maintenance Technician
...
Benefits Manager
The best thing about this role Are you looking to make a difference by improving the health of our patients? Here you will find an innovative culture that is patient-focused and dedicated to making a
Cybersecurity Vulnerability Analyst
The QA Resource Analyst (Cybersecurity Analyst) will be focused on addressing client-specific needs. It is focused on addressing requests made by the client while maintaining a strong security postur
Instructional Designer (Talent Pool - Contract) - R3421_46719133901_6-7278
This job was posted by https://illinoisjoblink.illinois.gov : For moreinformation, please see:https://illinoisjoblink.illinois.gov/jobs/11607429 Job Description Who We Are Chegg Skills/Thinkful is a
Senior Sales Associate - Keyholder
Create a healthier, brighter future for pets, pet parents and people!If you want to make a real difference, create an exciting career path, feel welcome to be your whole self and nurture your wellbei
Laboratory Analyst I - Eurofins Environment Testing - Phoenix, AZ - 743999959684435-2643
...
Teacher Certification Assessment Scorer - NY
The Evaluation Systems group of Pearson is recruiting permanently or professionally certified New York State teachers and recent retirees to score the constructed response component of the New York S
Restaurant Host - Bazille - Alderwood Mall
...
R&T Nondestructive & Dimensional Inspection First Level Manager
Overview Spirit AeroSystems designs and builds aerostructures for both commercial and defense customers. With headquarters in Wichita, Kansas, Spirit operates sites in the U.S., U.K., France and Mala
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved