Big Data Developer

1 day ago


Phoenix, United States Tata Consultancy Services Full time

Position- Big Data Developer

Location- Phoenix, AZ

Fulltime

Relevant Experience(in yrs) 3 - 7 years

Technical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCP

Responsibilities

  • Develop and maintain data pipelines using BigData processes
  • Focus on ingesting, storing, processing, and analyzing large datasets
  • Work closely with data science team to implement data analytics pipelines.
  • Help define data governance policies and support data-versioning processes.
  • Maintain security and data privacy, working closely with data protection officer.
  • Analyze vast number of data stores to uncover insights
  • Enhancing data collection procedures to include all relevant information for developing analytic systems.
  • Processing, cleansing, and validating the integrity of data to be used for analysis.
  • Analyzing large amounts of information to find patterns and solutions.
  • Developing prediction systems and machine learning algorithms
  • Presenting results in a clear manner.
  • Propose solutions and strategies to tackle business challenges
  • Collaborate with Business and IT teams.

Required skills and qualifications:

  • Bache Degree in Engineering or Computer Science or equivalent OR Master in Computer Applications or equivalent.
  • 10+ years of software development experience and leading teams of engineers and scrum teams
  • 5+ years of hands-on experience of working with Informatica, Oracle
  • Solid Datawarehousing concepts
  • Knowledge of Financial reporting ecosystem will be a plus
  • 5+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be a addon
  • Expert on Distributed ecosystem
  • Hands-on experience with programming using Core Java or Python/Scala
  • Expert on Hadoop and Spark Architecture and its working principle
  • Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes),
  • optimizing joins while processing huge amount of data
  • Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing
  • Should have experience in analysis, design, development, testing, and implementation of system applications
  • Demonstrated ability to develop and document technical and functional specifications and analyze software and system

Thanks & Regards,

Disha Ranjan

Talent Acquisition Group-North America

Tata Consultancy Services Limited

Mailto: disha.ranjan@


  • Big Data Developer

    1 week ago


    Phoenix, United States Tech One IT Full time

    Job Summary:We are looking for an experienced Senior Big Data Engineer with at least 6+ years of hands-on experience in Big Data technologies, specifically Apache Spark, CouchDB, and Google Cloud Platform (GCP). This role is ideal for a highly skilled individual who thrives in a dynamic environment and is passionate about developing scalable,...

  • Big Data Developer

    1 week ago


    Phoenix, United States Tech One IT Full time

    Job Summary:We are looking for an experienced Senior Big Data Engineer with at least 6+ years of hands-on experience in Big Data technologies, specifically Apache Spark, CouchDB, and Google Cloud Platform (GCP). This role is ideal for a highly skilled individual who thrives in a dynamic environment and is passionate about developing scalable,...

  • Big Data Developer

    3 weeks ago


    phoenix, United States Tata Consultancy Services Full time

    Position- Big Data DeveloperLocation- Phoenix, AZFulltime Relevant Experience(in yrs) 3 – 7 yearsTechnical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCPResponsibilitiesDevelop and maintain data pipelines using BigData processesFocus on ingesting, storing, processing, and analyzing large datasetsWork closely with data science team to...

  • Big Data Developer

    3 weeks ago


    phoenix, United States Tata Consultancy Services Full time

    Position- Big Data DeveloperLocation- Phoenix, AZFulltime Relevant Experience(in yrs) 3 – 7 yearsTechnical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCPResponsibilitiesDevelop and maintain data pipelines using BigData processesFocus on ingesting, storing, processing, and analyzing large datasetsWork closely with data science team to...

  • Big Data Developer

    3 weeks ago


    Phoenix, United States Tata Consultancy Services Full time

    Position- Big Data DeveloperLocation- Phoenix, AZFulltime Relevant Experience(in yrs) 3 – 7 yearsTechnical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCPResponsibilitiesDevelop and maintain data pipelines using BigData processesFocus on ingesting, storing, processing, and analyzing large datasetsWork closely with data science team to...

  • Big Data Developer

    3 weeks ago


    Phoenix, AZ, United States CoreAi Consulting Full time

    Role DescriptionThis is a full-time on-site role for a Big Data Developer at CoreAi Consulting. The Big Data Developer will be responsible for data engineering, ETL processes, big data management, data warehousing, and software development tasks.QualificationsMust have 5+ experience working in large scale application development using Big Data...

  • Big Data Developer

    7 days ago


    Phoenix, United States Group Nine LLC Full time

    Position Details Requirement Role Big Data Developer Location Phoenix, AZ Type of Hire - Contract/ C2H Contract Duration Long Term Contract Number of Interviews 2 In person interviews Yes/No No Client Interview Yes/No Yes Position requirements Phoenix, AZ Job Description Relevant Experience: 10+ Years Required Skills: Responsible for designing Data...


  • Phoenix, United States Resource Informatics Group Full time

    Job Title: Java/Big Data Developer Locations: Phoenix, AZ (5 days onsite) Duration: Long Term Description: • Hands on knowledge in Java, Spring boot, Python, Tableau, Power BI, BigQuery, Apache Spark, etc • Experience in designing and architecting applications in data privacy space • Ability to perform POC's on new tech stack as well as third-party...

  • Big Data Engineer

    2 weeks ago


    Phoenix, United States iSoftTek Solutions Inc Full time

    Job Title: Big Data Engineer Job Location: Phoenix, AZ Job Type: Contract Job Description: iSoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team. In this role, you will be responsible for developing and maintaining big data solutions and frameworks. You will work closely with cross-functional teams to design, implement, and optimize...

  • Big Data engineer

    2 weeks ago


    Phoenix, United States Diverse Lynx Full time

    Role: Big Data engineer Location: Phoenix,AZ Experience: 8+ Year Duration: 12+ Months Essential Skills: Desirable Skills: Must have good experience working in large scale application development using Big Data ecosystem - Hadoop (HDFS, MapReduce, Yarn), Hive, Kafka. -- Should have hands on experience using Spark, Sacal & Spark SQL.-- Hands-on experience...

  • Big Data Engineer

    2 weeks ago


    phoenix, United States Zensar Technologies Full time

    Job Summary:We are seeking a skilled and motivated Software Developer with a focus on Big Data Engineering to join our dynamic team. In this role, you will work with cutting-edge technologies in the Hadoop Ecosystem to develop, maintain, and optimize large-scale data processing systems. As part of our engineering team, you will be responsible for building...

  • Big Data Engineer

    2 weeks ago


    Phoenix, United States Zensar Technologies Full time

    Job Summary:We are seeking a skilled and motivated Software Developer with a focus on Big Data Engineering to join our dynamic team. In this role, you will work with cutting-edge technologies in the Hadoop Ecosystem to develop, maintain, and optimize large-scale data processing systems. As part of our engineering team, you will be responsible for building...

  • Big data Engineer

    2 weeks ago


    Phoenix, United States Syntricate Technologies Full time

    Required Skills: Big Data Engineer with mapreduce , spark , hive , sql skillset Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). ...

  • Big Data Engineer

    2 weeks ago


    Phoenix, United States Diverse Lynx Full time

    Role name: Developer Role Description: Big Data Engineer with mapreduce , spark , hive , sql skillset"Expert in SQL and Data warehousing concepts.Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is mustStrong Hands on experience with one or more programming languages (...


  • phoenix, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...


  • Phoenix, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...


  • phoenix, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...


  • Phoenix, United States Saxon Global Full time

    We will not consider any relocation options! We are looking for a candidate that is already local to the Phoenix, AZ area. Data Engineer role Looking for candidates with Google Cloud Platform experience and Java experience. Spark and scala experience are preferred. SQL experience is preferred. Looking for a Junior Software Engineer with strong analytical...

  • Big Data Engineer

    5 months ago


    Phoenix, United States Lorven Technologies Full time

    Hi, Our client is looking Big Data Engineer  for Long term  project in Multi Location (USA)  below is the detailed requirements. Job Title: Big Data Engineer Location: Multi Location (USA) Duration: Contract / Full-Time Primary Skill: AWS Cloud Python programming and AWS services (EC2, RDS, S3, Lambda, . Airflow DAG Python...


  • phoenix, United States Tech One IT Full time

    Job Summary:We are looking for an experienced Senior Big Data Engineer with at least 6+ years of hands-on experience in Big Data technologies, specifically Apache Spark, CouchDB, and Google Cloud Platform (GCP). This role is ideal for a highly skilled individual who thrives in a dynamic environment and is passionate about developing scalable,...