Big Data Engineer

2 months ago

Phoenix, United States Zensar Technologies Full time

Job Summary:

We are seeking a skilled and motivated Software Developer with a focus on Big Data Engineering to join our dynamic team. In this role, you will work with cutting-edge technologies in the Hadoop Ecosystem to develop, maintain, and optimize large-scale data processing systems. As part of our engineering team, you will be responsible for building robust data pipelines, ensuring data quality, and integrating big data solutions into our systems.

Key Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Hadoop, Spark, and related technologies to process and analyze large datasets.
  • Big Data Systems: Work with Hadoop Ecosystem tools such as HDFS, Hive, HBase, and Pig to manage and optimize data storage, retrieval, and processing.
  • ETL Design and Implementation: Build and optimize Extract, Transform, Load (ETL) workflows for high-volume data integration from various sources.
  • Performance Optimization: Analyze and tune the performance of large-scale data processing workflows and jobs in a distributed computing environment.
  • Collaboration: Collaborate with cross-functional teams, including Data Scientists, Analysts, and Product Managers, to gather requirements and deliver optimal data solutions.
  • Data Quality & Security: Ensure data integrity, quality, and security by implementing robust validation checks, monitoring, and logging mechanisms.
  • Innovation: Stay updated with the latest trends in Big Data technologies and continuously improve processes and systems with innovative solutions.

Required Skills & Qualifications:

  • Experience: experience working with Big Data technologies, particularly within the Hadoop Ecosystem (HDFS, Hive, Spark, HBase, Pig, Flume, etc.).
  • Programming Skills: Strong programming experience in Java, Scala, or Python for data processing.
  • Big Data Tools: Hands-on experience with Apache Spark, Hive, HBase, YARN, MapReduce, Kafka, and Flume.
  • ETL Frameworks: Experience in building ETL pipelines and working with tools like Apache Nifi, Talend, or similar.
  • Data Modeling & Warehousing: Knowledge of data warehousing, data modeling, and SQL (experience with NoSQL databases is a plus).
  • Cloud Experience: Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform and big data services like EMR, DataProc, etc.
  • Data Integration: Experience integrating data from multiple sources and working with structured and unstructured data.
  • Version Control & CI/CD: Familiarity with version control tools like Git and continuous integration/continuous deployment practices.
  • Problem-Solving & Analytical Skills: Strong troubleshooting skills and ability to work on complex data problems in a fast-paced environment.

Preferred Skills & Qualifications:

  • Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
  • Experience working with Apache Kafka for real-time data streaming.
  • Understanding of machine learning concepts and integrating them into data pipelines (preferred but not required).

Education:

  • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field. Master’s degree is a plus.

  • Big Data Engineer

    4 months ago

    Phoenix, United States iSoftTek Solutions Inc Full time

    Job Title: Big Data Engineer Job Location: Phoenix, AZ Job Type: Contract Job Description: iSoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team. In this role, you will be responsible for developing and maintaining big data solutions and frameworks. You will work closely with cross-functional teams to design, implement, and optimize...

  • Big Data Engineer

    2 months ago

    Phoenix, United States iSoftTek Solutions Inc Full time

    Job Title: Big Data Engineer Job Location: Phoenix, AZ Job Type: Contract Job Description: iSoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team. In this role, you will be responsible for developing and maintaining big data solutions and frameworks. You will work closely with cross-functional teams to design, implement, and optimize...

  • Big Data Engineer

    10 hours ago

    Phoenix, United States iSoftTek Solutions Inc Full time

    Job DescriptionJob DescriptionJob Title: Big Data EngineerJob Location: Phoenix, AZJob Type: ContractJob Description:iSoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team. In this role, you will be responsible for developing and maintaining big data solutions and frameworks. You will work closely with cross-functional teams to...

  • Big Data Engineer

    1 month ago

    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description:At Diverse Lynx LLC, we're seeking a skilled Big Data Engineer to join our team. As a key member of our data science team, you'll be responsible for developing and maintaining data pipelines using Big Data processes. Your focus will be on ingesting, storing, processing, and analyzing large datasets to uncover valuable insights. You'll work...

  • Big Data Engineer

    1 month ago

    Phoenix, United States SysMind Tech Full time

    Role : Big Data Engineer Location : Phoenix, AZ Job Description : Responsibilities : Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms using Hadoop components like: HBase, Hive, Pig, Oozie and Apache Spark Components such as Spark SQL and Spark Core Hands on experience in Hadoop...

  • Big Data engineer

    2 months ago

    Phoenix, United States Diverse Lynx Full time

    Role: Big Data engineer Location: Phoenix,AZ Experience: 8+ Year Duration: 12+ Months Essential Skills: Desirable Skills: Must have good experience working in large scale application development using Big Data ecosystem - Hadoop (HDFS, MapReduce, Yarn), Hive, Kafka. -- Should have hands on experience using Spark, Sacal & Spark SQL.-- Hands-on experience...

  • Big Data Engineer Expert

    3 weeks ago

    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description:We are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC in Phoenix, AZ. This is a full-time position requiring 8+ years of experience in large-scale application development using the Big Data ecosystem, including Hadoop (HDFS, MapReduce, Yarn), Hive, and Kafka.Responsibilities:Design, develop, and maintain...

  • Big data Engineer

    4 months ago

    Phoenix, United States Syntricate Technologies Full time

    Required Skills: Big Data Engineer with mapreduce , spark , hive , sql skillset Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). ...

  • Big data Engineer

    2 months ago

    Phoenix, United States Syntricate Technologies Full time

    Required Skills: Big Data Engineer with mapreduce , spark , hive , sql skillset Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). ...

  • Big Data Engineer

    1 month ago

    Phoenix, United States Omega Hires Full time

    Job Title: Big Data Engineer Location: Phoenix AZ/ New York City, NY Duration: Long Term Contract Job Description: - 8+ years of experience in Big Data, Java, Spark, Hive, and MapReduce. - Strong experience PL/SQL with Unix/Linux and shell scripting. - Familiarity with distributed systems and large-scale data processing. - Strong problem-solving and...

  • Big Data Engineer

    2 months ago

    Phoenix, United States Omega Hires Full time

    Job Title: Big Data Engineer Location: Phoenix AZ/ New York City, NY Duration: Long Term ContractJob Description: - 8+ years of experience in Big Data, Java, Spark, Hive, and MapReduce. - Strong experience PL/SQL with Unix/Linux and shell scripting. - Familiarity with distributed systems and large-scale data processing. - Strong problem-solving and debugging...

  • Cloud Big Data Engineer

    2 weeks ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    We're looking for a talented Cloud Big Data Engineer to join our team at Syntricate Technologies. This contract position is based in Phoenix, AZ and offers a unique opportunity to work with cutting-edge technologies like MapReduce, Spark, and Hive.ResponsibilitiesAs a Cloud Big Data Engineer, you will be responsible for designing, implementing, and...

  • Big Data Systems Engineer

    3 weeks ago

    Phoenix, Arizona, United States Saxon Global Full time

    Saxon Global is seeking a Big Data Systems Engineer to join our team in Phoenix. This is a mid to senior level position requiring 5 years of experience.About the JobAs a Big Data Systems Engineer, you will be responsible for designing and implementing scalable data systems using various programming languages (Java/Python) and tools. You will work with big...

  • Big Data Solutions Engineer

    2 weeks ago

    Phoenix, Arizona, United States iSoftTek Solutions Inc Full time

    Job OverviewWe are looking for a highly skilled Big Data Engineer to work with our cross-functional teams to design, implement, and optimize data processing and analytics systems.The successful candidate will have 3+ years of experience as a Big Data Engineer and strong knowledge of programming languages such as Java, Scala, or Python.They will also have...

  • Big Data Engineering Specialist

    3 weeks ago

    Phoenix, Arizona, United States iSoftTek Solutions Inc Full time

    Estimated Salary:$120,000 - $160,000 per year, depending on experience.Job Description:We are looking for a skilled Big Data Engineer to develop and maintain big data solutions and frameworks. In this role, you will work closely with cross-functional teams to design, implement, and optimize data processing and analytics systems using Hadoop, Spark, and other...

  • Big Data Engineering Expert

    1 week ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    We are seeking an experienced Big Data Engineer to join our team at Syntricate Technologies. This is a contract position based in Phoenix, AZ.Job DescriptionIn this role, you will work with our team to design and develop big data solutions using technologies like MapReduce, Spark, Hive, and SQL. You will also be responsible for hands-on expertise with...

  • Big Data Engineer

    2 months ago

    Phoenix, United States Diverse Lynx Full time

    Role name: Developer Role Description: Big Data Engineer with mapreduce , spark , hive , sql skillset"Expert in SQL and Data warehousing concepts.Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is mustStrong Hands on experience with one or more programming languages (...

  • Big Data Engineer

    2 weeks ago

    Phoenix, Arizona, United States RIT Solutions, Inc. Full time

    About RIT Solutions, Inc.RIT Solutions, Inc. is a leader in data-driven innovation, and we're looking for a talented Data Engineer to join our team.Job Overview:Job Title: Data EngineerLocation: Phoenix (3 days)Estimated Salary: $140,000 - $190,000 per yearWe're seeking an experienced Data Engineer to lead the design, development, and maintenance of our data...

  • Big Data Engineer Lead

    4 weeks ago

    Phoenix, Arizona, United States eTek IT Services, Inc. Full time

    eTek IT Services, Inc. is seeking an experienced Big Data Engineer to join our team in Phoenix, AZ.Job OverviewThe successful candidate will have 3-4 years of hands-on experience with Spark/Scala and Hive, as well as a strong understanding of big data querying tools.We are looking for someone who can work collaboratively with our team to build and enhance...

  • Junior Big Data Engineer

    2 months ago

    Phoenix, United States Saxon Global Full time

    We will not consider any relocation options! We are looking for a candidate that is already local to the Phoenix, AZ area. Data Engineer role Looking for candidates with Google Cloud Platform experience and Java experience. Spark and scala experience are preferred. SQL experience is preferred. Looking for a Junior Software Engineer with strong analytical...