Big Data Developer

4 weeks ago


Phoenix, United States Quest IT Solutions Inc Full time

Title : Big Data Engineer

Location :Phoenix AZ

Job description:

Software development experience and leading teams of engineers and scrum teams

3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)

Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data

Experience in UNIX shell scripting

Additional Good to have requirements:

Solid Datawarehousing concepts

Knowledge of Financial reporting ecosystem will be a plus

Experience with Data Visualization tools like Tableau, SiSense, Looker

Expert on Distributed ecosystem

Hands-on experience with programming using Python/Scala

Expert on Hadoop and Spark Architecture and its working principle

Ability to design and develop optimized Data pipelines for batch and real time data processing

Should have experience in analysis, design, development, testing, and implementation of system applications

Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows

Aptitude for learning and applying programming concepts.

Ability to effectively communicate with internal and external business partners. Preferred Qualifications:

Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be preferred

2+ years of experience in designing and building solutions using Kafka streams or queues

Experience with GitHub and leveraging CI/CD pipelines

Experience with NoSQL i.e., HBase, Couchbase, MongoDB


  • Big Data Developer

    2 weeks ago


    Phoenix, United States Lorven Technologies, Inc. Full time

    Role : Big Data Developer Location: Phoenix, AZ Job Type: Contract (W2 Only) Job Details 6-8 years of big data technologies or data platform architecture experience with deep technology expertise in the following: Spark, Python/Pyspark, Hadoop, Hive, Scala Experience in service architecture and development experience with high performance and scalability...

  • Big Data Developer

    2 weeks ago


    Phoenix, United States Syntricate Technologies Inc Full time

    Job Title BigData Work Location Phoenix, Az Relevant Experience(in yrs) 6-8 Years Technical/Functional Skills Hive & Spark Architecture including Spark Core, Spark SQL, Data Frames. Experience Required 6-8 Years Roles & Responsibilities Build data systems and pipelines on cloud...

  • Big Data Developer

    3 weeks ago


    Phoenix, United States Quest IT Solutions Inc Full time

    Title : Big Data EngineerLocation :Phoenix AZJob description:Software development experience and leading teams of engineers and scrum teams3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge...

  • Big Data Developer

    1 week ago


    Phoenix, United States Quest IT Solutions Inc Full time

    Title : Big Data EngineerLocation :Phoenix AZJob description:Software development experience and leading teams of engineers and scrum teams3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge...

  • Big Data Developer

    1 month ago


    Phoenix, United States Quest IT Solutions Inc Full time

    Title : Big Data EngineerLocation :Phoenix AZJob description:Software development experience and leading teams of engineers and scrum teams3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge...

  • Big Data Engineer

    7 days ago


    Phoenix, United States Diverse Lynx Full time

    Please share the relevant profiles (BigData with GCP exp) as per JD. Detailed JD below: Big Data Engineer: Phoenix,US Big Data Engineer with ETL - Big Data / Data Warehousing "Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (Google Cloud) GCP certification will be very good to have. Strong Hands on...

  • Big Data Engineer

    2 weeks ago


    Phoenix, United States TechDigital Corporation Full time

    This role requires a seasoned developer having 8+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem esp. Spark and handling massive data sets. The role also required to optimize existing machine learning jobs and other related processes. Broader responsibilities includes but no limited to...

  • Big Data Engineer

    24 hours ago


    Phoenix, United States TechDigital Corporation Full time

    This role requires a seasoned developer having 8+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem esp. Spark and handling massive data sets. The role also required to optimize existing machine learning jobs and other related processes. Broader responsibilities includes but no limited to...

  • Big Data Tester

    24 hours ago


    Phoenix, United States Nucleusteq Full time

    The Big data tester JD. Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experience Experience in a variety of test automation tools (Robot Framework, Selenium) Script development using scripting languages. Primarily in Unix, Python, and SQL Knowledge of Big Data Technologies Experience using...

  • Big Data Tester

    2 days ago


    Phoenix, United States Nucleusteq Full time

    The Big data tester JD. Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experience Experience in a variety of test automation tools (Robot Framework, Selenium) Script development using scripting languages. Primarily in Unix, Python, and SQL Knowledge of Big Data Technologies Experience using...

  • Big Data Tester

    2 months ago


    Phoenix, United States NucleusTeq Full time

    The Big data tester JD. Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experience Experience in a variety of test automation tools (Robot Framework, Selenium) Script development using scripting languages. Primarily in Unix, Python, and SQL Knowledge of Big Data Technologies Experience using...

  • Big Data Engineer

    7 days ago


    Phoenix, United States Syntricate Technologies Inc Full time

    Job Role - Big Data Engineer Job Type - Full Time Employment Location - Phoenix, AZ or New York Experience Required - 6+ Years Responsibilities : Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms using Hadoop components like: HBase, Hive, Pig, Oozie and Apache Spark...

  • Big Data Tester

    2 months ago


    Phoenix, Arizona, United States NucleusTeq Full time

    The Big data tester JD.Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experienceExperience in a variety of test automation tools (Robot Framework, Selenium)Script development using scripting languages. Primarily in Unix, Python, and SQLKnowledge of Big Data TechnologiesExperience using SDLC, QE...

  • Big Data with GCP

    1 month ago


    Phoenix, United States Tata Consultancy Services Full time

    JobTitle Big data with GCP RelevantExperience(inyrs) 8yrs WorkLocation (State, City and Zip) Phoenix, New york Technical/FunctionalSkills Bigdata with GCP Roles& Responsibilities Big Data Engineer with ETL - Big Data / Data Warehousing "Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP,Azure, AWS). GCP...


  • Phoenix, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionBig data exposure with GCP Phoenix, AZ Big data with GCPRoles & Responsibilities Big Data Engineer with mapreduce , spark , hive , sql skillset "Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is...

  • Big Data Tester

    2 months ago


    Phoenix, United States NucleusTeq Full time

    Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experience Experience in a variety of test automation tools (Robot Framework, Selenium) Script development using scripting languages. Primarily in Unix, Python, and SQL Knowledge of Big Data Technologies Experience using SDLC, QE and DevOps tools...

  • Big Data Tester

    2 months ago


    Phoenix, Arizona, United States NucleusTeq Full time

    Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experienceExperience in a variety of test automation tools (Robot Framework, Selenium)Script development using scripting languages. Primarily in Unix, Python, and SQLKnowledge of Big Data TechnologiesExperience using SDLC, QE and DevOps tools (JIRA,...

  • Big Data Tester

    15 hours ago


    Phoenix, Arizona, United States NucleusTeq Full time

    Degree in Computer Science or equivalent with 5+ years of related experience and 3+ years of people management experienceExperience in a variety of test automation tools (Robot Framework, Selenium)Script development using scripting languages. Primarily in Unix, Python, and SQLKnowledge of Big Data TechnologiesExperience using SDLC, QE and DevOps tools (JIRA,...


  • Phoenix, United States JobRialto Full time

    Job Description: Looking for a Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible. Required Skills/Qualifications:...

  • Big Data Engineer

    6 days ago


    Phoenix, United States Saxon Global Full time

    Candidates should have one or more of the skills below. Experienced in managing, designing, performance tuning relational and non-relational databases. Experience working in Hadoop ecosystem, distributed system architecture HBase, HDFS, Map-reduce programing model, Hive, PIG etc. Experienced in data-warehousing , requirement-driven data modeling,...