Hadoop Data Engineer Job at E-IT Professionals Corp, Scottsdale, AZ

K3M4TTlRemhUcDZMNTdiWWVRN2JWaEZFdWc9PQ==
  • E-IT Professionals Corp
  • Scottsdale, AZ

Job Description

Role : Hadoop Data Engineer

Location : Scottsdale AZ (100%)

Hire Type : Contract

Key Responsibilities

Design develop and maintain scalable data processing applications using Java (8 or above) and Spring Boot.

Build and optimize big data pipelines using Spark and Scala for large-scale data processing.

Develop and consume RESTful web services for data integration and platform interoperability.

Implement and manage batch and streaming data pipelines using Spark Streaming and Kafka.

Write optimized Hive queries and SQL focusing on performance and scalability.

Work on distributed data platforms leveraging Hadoop ecosystem components.

Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

Ensure code quality through reviews version control and CI/CD best practices.

Troubleshoot and resolve performance scalability and data reliability issues.

Required Skills & Qualifications

8 12 years of hands-on experience in Java (version 8 or above).

Strong expertise in Spring Boot framework.

Excellent proficiency in Apache Spark and Scala.

Strong experience with Hive SQL optimization Hadoop and Kafka.

Solid understanding of RESTful web services.

Experience with version control systems such as Git / GitLab.

Hands-on experience with build tools like Maven and/or Gradle.

Strong understanding of distributed systems and big data architecture.

Experience with streaming frameworks such as Spark Streaming and Kafka Streams.

Experience working in large-scale enterprise data platforms.

Exposure to performance tuning and capacity planning for big data systems.

Knowledge of DevOps or CI/CD pipelines is a plus.

Job Tags

Full time, Contract work

Similar Jobs

Rise8

Customer Success Manager - Veterans Affairs Job at Rise8

 ...a Customer Success Manager who has a passion for working with federal agency customers, in particular the U.S. Department of Veterans Affairs. You will be part of the leadership team for a large organization with multiple delivery functions and high complexity. A... 

Rita's Italian Ice and Frozen Custard of Mableton

Treat Team Member Job at Rita's Italian Ice and Frozen Custard of Mableton

 ...Rita's of Mableton is looking for part-time Treat Team members! This position offers a positive, fun work environment with advancement...  ...were looking for you! You must: Be at least 15 years old Have a positive, can-do attitude Be a team... 

Hiring Healthcare Heroes

Neurosurgeon J-038216 Job at Hiring Healthcare Heroes

 ...Are you an accomplished neurosurgeon eager to make a meaningful impact on patient outcomes? Join our prestigious private practice network under a prominent hospital system in Northern Florida , where your expertise will profoundly enhance lives. Why Choose Our Neuroscience... 

Truck with Jed Logistics

Truck Driver / CDL-A / OTR / 21 Days Out Job at Truck with Jed Logistics

 ...Hiring immediately for Class A Driver! Bold Safe Trucking is a top employer of CDL Truck Drivers across the country. In addition to a great starting...  ...or Mexico Requirements: ~9 months of verifiable OTR/Regional dry vantractor-trailer experience in the past 2years... 

OCC Road House & Museum, LLC

Parking Attendant Job at OCC Road House & Museum, LLC

**Job Title:** Parking Attendant **Job Summary:** We are seeking a reliable Parking Attendant to join our team. The ideal candidate will manage the flow of vehicles in our parking facility. As a Parking Attendant, you will be responsible for ensuring the safety and organization...