Home
/
Comprehensive
/
Hadoop Developer
Hadoop Developer-March 2024
Chicago
Mar 18, 2025
ABOUT INSIGHT GLOBAL
Insight Global provides top talent and staffing solutions that help job seekers find careers in healthcare, finance, IT and government.
1,001 - 5,000 employees
Consulting, Technology
VIEW COMPANY PROFILE >>
About Hadoop Developer

  Job Description

  Insight Global is seeking Hadoop Developers for one of our largest financial clients to sit hybrid in one of the BOA hubs. These Big Data Platform Developer/Engineers will be helping to build new data pipelines, identifying existing data gaps, and providing automated solutions to deliver advanced analytical capabilities and enriched data to applications that are supporting the operations team. Resources will support 2024 projects within the Data & Engineering Analytics team.

    Logging and Monitoring Implement a cyber security Logging & Monitoring strategy that will Standardize Infrastructure/Apps/Sec. logs used by GIS. Signals Intelligence Automated ETL and enrichment to mitigate and pro-actively identify and profile adversary behavior, infrastructure, tradecraft and capability, at scale, speed and depth not currently available with existing infrastructure and computational power.

  Skills and Requirements

  Strong SQL Skills one or more of MySQL, HIVE, Impala, SPARK SQL

  Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml

  Experience working with SPARK Structured steaming preferred

  Experience working with Hadoop/Big Data and Distributed Systems

  Experience working with admin/prod support/debugging

  Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.

  Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few

  Performance tuning experience with spark /MapReduce and/or SQL jobs

  Experience and proficiency with Linux operating system is a must

  Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines

  Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle

  Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.

  Experience working with Jenkins and Jar management

  Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets

  Ability to comprehend customer requests and provide the correct solution

  Strong analytical mind to help take on complicated problems

  Desire to resolve issues and dive into potential issues

  Ability to adapt and continue to learn new technologies is important · Experience working with SPARK Structured steaming

   · Performance tuning experience with spark /MapReduce or SQL jobs

   · Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines

   · Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle

   · Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.

   · Experience working with Jenkins and Jar management

  Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets null

  We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Class A CDL Owner Operator - Talladega, AL
Do you own your own truck and flatbed? Do you want to join a great team where we value you and your work? Precision Strip, Inc., the nation's leading toll processor in the metals industry, is seeking
Senior Systems Engineer (PKI)
Who We Are: NetCentrics proudly holds a distinguished position as a leader in cybersecurity, cloud, digital transformation, and mission support. With an esteemed clientele that includes the DoD, DHS,
Accessibility Projects Specialist
Accessibility Projects Specialist Job ID: 5601 Business Unit: MTA Headquarters Location: New York, NY, United States Regular/Temporary: Regular Department: Chief Accessibility Officer Date Posted: Ja
Lead Medical Technologist
Lead Medical Technologist - APPLY TODAY! Description: Must have a NY State Medical Technologist license or Medical Laboratory Science degree. Hematology testing. Will perform routine CBC, platelet co
Environmental Funding Grant Consultant - Remote
Our People & Places Solutions business – reinforces our drive to improve the lives of people everywhere and epitomizes the why of what we do – the tremendous positive impact and value our solutio
Staff RN - NICU C4A
Staff RN - NICU C4ARequisition ID2024-48031CategoryNursingOverview0.9 FTE, 36 hr./wk. Nights, 7p- 7a. Every other weekend & rotating holiday requirementNon-Exempt. Benefits EligibleMinimum hourly
RN I New Graduate, 4C Medical, Full Time, 7p-7a
Work Shift: Please see job description for details. Time Type: Full time Department: CC013330 4C Medical Summary: Provides basic professional nursing care that is safe and effective and focused on th
Management Trainee Program (On-Site: Indianapolis)
Are you someone who never rests on their laurels, always strives to go above and beyond, and is committed to keeping your PROMISES? Do you appreciate a company culture that is open, fosters work-life
Security Officer
Overview Founded as a faith-based hospital in 1931 by the Sisters of Charity of the Incarnate Word Dignity Health – St. Bernardine Medical Center is a 342-bed acute care nonprofit hospital located in
Flex Merchandiser
Flex Merchandiser Date Posted: 01/02/2024 Apply Employee Type:Part Time Location:Ellenton, FL Pay Rate:13 Date Posted: 01/02/2024 Job ID: 120543 Job Description Retail Merchandisers Needed! Earn $13
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved