Home
/
Comprehensive
/
Hadoop Developer
Hadoop Developer-March 2024
Chicago
Mar 17, 2025
ABOUT INSIGHT GLOBAL
Insight Global provides top talent and staffing solutions that help job seekers find careers in healthcare, finance, IT and government.
1,001 - 5,000 employees
Consulting, Technology
VIEW COMPANY PROFILE >>
About Hadoop Developer

  Job Description

  Insight Global is seeking Hadoop Developers for one of our largest financial clients to sit hybrid in one of the BOA hubs. These Big Data Platform Developer/Engineers will be helping to build new data pipelines, identifying existing data gaps, and providing automated solutions to deliver advanced analytical capabilities and enriched data to applications that are supporting the operations team. Resources will support 2024 projects within the Data & Engineering Analytics team.

    Logging and Monitoring Implement a cyber security Logging & Monitoring strategy that will Standardize Infrastructure/Apps/Sec. logs used by GIS. Signals Intelligence Automated ETL and enrichment to mitigate and pro-actively identify and profile adversary behavior, infrastructure, tradecraft and capability, at scale, speed and depth not currently available with existing infrastructure and computational power.

  Skills and Requirements

  Strong SQL Skills one or more of MySQL, HIVE, Impala, SPARK SQL

  Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml

  Experience working with SPARK Structured steaming preferred

  Experience working with Hadoop/Big Data and Distributed Systems

  Experience working with admin/prod support/debugging

  Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.

  Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few

  Performance tuning experience with spark /MapReduce and/or SQL jobs

  Experience and proficiency with Linux operating system is a must

  Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines

  Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle

  Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.

  Experience working with Jenkins and Jar management

  Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets

  Ability to comprehend customer requests and provide the correct solution

  Strong analytical mind to help take on complicated problems

  Desire to resolve issues and dive into potential issues

  Ability to adapt and continue to learn new technologies is important · Experience working with SPARK Structured steaming

   · Performance tuning experience with spark /MapReduce or SQL jobs

   · Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines

   · Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle

   · Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.

   · Experience working with Jenkins and Jar management

  Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets null

  We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Delivery Analyst - TAOps Admin & Reporting
Job Responsibilities: Providing operational and administrative support with regards to the HR records and personal data of the employees of our clients, Managing employee personal data in the system,
Union Diesel Mechanic
A Union Diesel Mechanic will work under the supervision of a Leadman or Journeyman Mechanic. The apprentice shall be put on work commonly known as Journeyman Mechanic’s work so that at the end of the
Equipment Manager
[Cattail Crossing is a 27 hole municipal golf course located in the lakes region of South Dakota. Watertown is a destination city for the sportsman right in the heart of some of the best fishing and
Chief Information Security Officer
Overview Overview: The Chief Information Security Officer (CISO) is responsible for establishing and maintaining a corporate-wide information security management program to ensure that information as
Retail Reset Merchandiser
Job Posting CROSSMARK is seeking an energetic, creative individual to execute a variety of merchandise and product services at major retailers near you. Enjoy a part-time schedule while learning abou
OCCUPATIONAL THERAPIST II - PD
Overview St. John’s Regional Medical Center located in Oxnard California is a recognized as a Top 250 Hospital in the Nation and as one of America’s 100 Best Hospitals for Cardiac Care by Healthgrade
Medical Director, Launch
WelbeHealth’s PACE (All-Inclusive Care for the Elderly) program provides seniors with the opportunity to continue living in their homes and in their communities. Our innovative and comprehensive rang
Family Medicine Physician Opportunity in Alaska
Description PeaceHealth demonstrates their dedication to provider wellness through: A dedicated Clinician Well-being program that includes: Vendor relationships that provide free coaching, counseling
Surgical Tech - Cert
Req Number 98691 Job Description Assists nursing personnel in giving quality care to patients in the Operating Room. Job Responsibility Performs duties and responsibilities of a 'scrub' person under
Area Supervisor
Our values start with our people, join a team that values you! We are the nation’s largest off-price retailer with over 2,000 stores, and a strong track record of success and growth. Our focus has al
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved