Home
/
Comprehensive
/
Big Data Engineers (Airflow, Python, Spark)
Big Data Engineers (Airflow, Python, Spark)-February 2024
Bangalore
Feb 28, 2025
ABOUT NIELSEN
We’re in tune with what the world is watching, buying, and everything in between. If you can think of it, we’re measuring it.
10,000+ employees
Client Services
VIEW COMPANY PROFILE >>
About Big Data Engineers (Airflow, Python, Spark)

  At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.

  About the Role

  You’ll be working within an international group of teams which span from the US till India. This group is responsible for building our Audience Builder application and components which is part of Nielsen’s Advanced Audiences in the Nielsen ONE product suite. Your specific team will be responsible to build data pipelines, services and UIs to support our complex entitlement needs for our current and future web applications.

  As a Software Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases. Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.

  Responsibilities

  Work closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needs.

  Write both unit and integration tests, and develop automation tools for daily tasks.

  Develop high quality, well documented, and efficient code.

  Manage and optimize scalable pipelines in the cloud.

  Optimize internal and external applications for performance and scalability.

  Develop automated tests to ensure business needs are met, and write unit, integration, or data quality tests.

  Communicate regularly with stakeholders, project managers, quality assurance teams, and other developers regarding progress on long-term technology roadmap.

  Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives.

  Key Skills (Domain Expertise)

  2+ years of experience as a software/data engineer.

  Bachelor’s degree in Computer Science, MIS, or Engineering.

  Technical SKills

  Experience with database systems, with knowledge of SQL and NoSQL stores (e.g. MySQL, Oracle, MongoDB, Couchbase, etc.)

  Experience developing sophisticated data driven software platforms.

  Experience with relational databases and/or analytical data stores (e.g., Spark, Presto, Pandas).

  Experience delivering, supporting enterprise software.

  Experience with cloud service technologies, ex: AWS.

  Experience with container technologies, ex: Docker.

  Experience with source control systems, ex: GIT.

  Information visualization.

  "Big data" systems and analysis.

  Experience with data warehouses or data lakes.

  Mindset and Attributes

  Strong communication skills with ability to communicate complex technical concepts and align organization on decisions.

  Sound problem-solving skills with the ability to quickly process complex information and present it clearly and simply.

  Utilizes team collaboration to create innovative solutions efficiently.

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
PROGRAM ANALYST
Summary Click on Learn more about this agency button below to view Eligibilities being considered and other IMPORTANT information. The primary purpose of this position is to serve as Eighteenth Air F
Sr. Technical Account Manager
About Us Automation Anywhere is the leader in intelligent automation solutions that put AI to work across every aspect of an organization. The company’s Automation Success Platform is infused with ge
Facility Supply Chain Coordinator
Description Hourly Wage Estimate: $19.53 - $27.35 / hour Learn more about the benefits offered ( https://careers.hcahealthcare.com/pages/employee-benefits-and-rewards ) for this job. The estimate dis
Senior Project Manager
Senior Project Manager (26094) Minneapolis, MN | Temp to Perm Job Description Fulcrum Consulting, an LRS company is seeking a Senior Project Manager for a contract to hire position with our client in
Leasing
We are currently seeking a Leasing Consultant! Leasing Consultants act as the community's sales representative by greeting clients, presenting the features and benefits of their community, and proper
Banquet Cook I PM
Additional Information Evening Shift Job Number 24010166 Job Category Food and Beverage & Culinary Location JW Marriott Washington DC, 1331 Pennsylvania Avenue NW, Washington, District of Columbi
Senior Technical Marketing Engineer (Browser Security)
Our Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is
Staff Accountant
About Us Alert Holdings Group LLC has built a reputation as a full-service life and safety provider of the highest quality products and services since 1962. With offices on Oahu, Maui, Big Island and
Gas Pipeline Engineer - Mid Level (Hybrid)
Job Description: Summary:The person in this position will manage and perform engineering tasks for gas and oil pipeline projects that typically include station upgrades, relocation and protection of
Guest Relation Manager
Description: Overview: We are seeking a dynamic and customer-focused individual to join our team as a Guest Relations Manager. In this role, you will play a pivotal role in ensuring an exceptional gu
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved