Big Data Developer

3 weeks ago

phoenix, United States Tata Consultancy Services Full time

Position- Big Data Developer

Location- Phoenix, AZ

Fulltime

Relevant Experience(in yrs) 3 – 7 years

Technical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCP


Responsibilities

  • Develop and maintain data pipelines using BigData processes
  • Focus on ingesting, storing, processing, and analyzing large datasets
  • Work closely with data science team to implement data analytics pipelines.
  • Help define data governance policies and support data-versioning processes.
  • Maintain security and data privacy, working closely with data protection officer.
  • Analyze vast number of data stores to uncover insights
  • Enhancing data collection procedures to include all relevant information for developing analytic systems.
  • Processing, cleansing, and validating the integrity of data to be used for analysis.
  • Analyzing large amounts of information to find patterns and solutions.
  • Developing prediction systems and machine learning algorithms
  • Presenting results in a clear manner.
  • Propose solutions and strategies to tackle business challenges
  • Collaborate with Business and IT teams.

Required skills and qualifications:

  • Bache Degree in Engineering or Computer Science or equivalent OR Master in Computer Applications or equivalent.
  • 10+ years of software development experience and leading teams of engineers and scrum teams
  • 5+ years of hands-on experience of working with Informatica, Oracle
  • Solid Datawarehousing concepts
  • Knowledge of Financial reporting ecosystem will be a plus
  • 5+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be a addon
  • Expert on Distributed ecosystem
  • Hands-on experience with programming using Core Java or Python/Scala
  • Expert on Hadoop and Spark Architecture and its working principle
  • Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes),
  • optimizing joins while processing huge amount of data
  • Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing
  • Should have experience in analysis, design, development, testing, and implementation of system applications
  • Demonstrated ability to develop and document technical and functional specifications and analyze software and system





Thanks & Regards,

Disha Ranjan

Talent Acquisition Group-North America

Tata Consultancy Services Limited

Mailto: disha.ranjan@tcs.com

  • Big Data Developer

    4 weeks ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    Big Data DeveloperJob Summary:We are seeking a highly skilled Big Data Developer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with Pyspark, Python, and handling database operations in Cassandra and Postgres.Key Responsibilities:Design, develop, and deploy big data solutions using Pyspark and...

  • Big Data Developer

    4 weeks ago

    Phoenix, Arizona, United States Group Nine LLC Full time

    Job Description:Group Nine LLC is seeking a highly skilled Big Data Developer to join our Loyalty Technology team. As a key member of our team, you will be responsible for designing and developing data engineering solutions on big data ecosystems, developing custom applications, and modifying existing applications to meet the changing business requirements...

  • Big Data Developer

    5 days ago

    Phoenix, United States Tech One IT Full time

    Job Summary:We are looking for an experienced Senior Big Data Engineer with at least 6+ years of hands-on experience in Big Data technologies, specifically Apache Spark, CouchDB, and Google Cloud Platform (GCP). This role is ideal for a highly skilled individual who thrives in a dynamic environment and is passionate about developing scalable,...

  • Big Data Developer

    5 days ago

    Phoenix, United States Tech One IT Full time

    Job Summary:We are looking for an experienced Senior Big Data Engineer with at least 6+ years of hands-on experience in Big Data technologies, specifically Apache Spark, CouchDB, and Google Cloud Platform (GCP). This role is ideal for a highly skilled individual who thrives in a dynamic environment and is passionate about developing scalable,...

  • Big Data Developer

    3 weeks ago

    phoenix, United States Tata Consultancy Services Full time

    Position- Big Data DeveloperLocation- Phoenix, AZFulltime Relevant Experience(in yrs) 3 – 7 yearsTechnical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCPResponsibilitiesDevelop and maintain data pipelines using BigData processesFocus on ingesting, storing, processing, and analyzing large datasetsWork closely with data science team to...

  • Big Data Developer

    3 weeks ago

    Phoenix, United States Tata Consultancy Services Full time

    Position- Big Data DeveloperLocation- Phoenix, AZFulltime Relevant Experience(in yrs) 3 – 7 yearsTechnical/Functional Skills Big Data /Hadoop , SPARK , Python , Strong SQL ,GCPResponsibilitiesDevelop and maintain data pipelines using BigData processesFocus on ingesting, storing, processing, and analyzing large datasetsWork closely with data science team to...

  • Big Data Developer

    2 weeks ago

    Phoenix, AZ, United States CoreAi Consulting Full time

    Role DescriptionThis is a full-time on-site role for a Big Data Developer at CoreAi Consulting. The Big Data Developer will be responsible for data engineering, ETL processes, big data management, data warehousing, and software development tasks.QualificationsMust have 5+ experience working in large scale application development using Big Data...

  • Big Data Developer

    4 days ago

    Phoenix, United States Group Nine LLC Full time

    Position Details Requirement Role Big Data Developer Location Phoenix, AZ Type of Hire - Contract/ C2H Contract Duration Long Term Contract Number of Interviews 2 In person interviews Yes/No No Client Interview Yes/No Yes Position requirements Phoenix, AZ Job Description Relevant Experience: 10+ Years Required Skills: Responsible for designing Data...

  • Java/Big Data Developer

    4 days ago

    Phoenix, United States Resource Informatics Group Full time

    Job Title: Java/Big Data Developer Locations: Phoenix, AZ (5 days onsite) Duration: Long Term Description: • Hands on knowledge in Java, Spring boot, Python, Tableau, Power BI, BigQuery, Apache Spark, etc • Experience in designing and architecting applications in data privacy space • Ability to perform POC's on new tech stack as well as third-party...

  • Big Data Engineer

    4 weeks ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with large-scale application development using the Big Data ecosystem, including Hadoop, Hive, Kafka, Spark, Scala, and Snowflake utilities.Key...

  • Big Data Engineer

    2 weeks ago

    Phoenix, United States iSoftTek Solutions Inc Full time

    Job Title: Big Data Engineer Job Location: Phoenix, AZ Job Type: Contract Job Description: iSoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team. In this role, you will be responsible for developing and maintaining big data solutions and frameworks. You will work closely with cross-functional teams to design, implement, and optimize...

  • Big Data Engineer

    4 weeks ago

    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description:At Diverse Lynx LLC, we are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have expertise in Big Data and Hadoop ecosystems, with a strong focus on MapR. Additionally, they will have hands-on experience with programming languages such as Python and Java, as well as application design and software...

  • Big Data Engineer

    1 month ago

    Phoenix, Arizona, United States Group Nine LLC Full time

    Job Description:As a Big Data Developer at Group Nine LLC, you will be responsible for designing and developing data engineering solutions on big data ecosystems. You will work closely with the SRE team to provide post-implementation and ongoing support. Your key responsibilities will include developing and designing software applications, assessing and...

  • Big Data Engineer

    4 weeks ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with large-scale application development using the Big Data ecosystem, including Hadoop, Hive, and Kafka.Key Responsibilities:Design and develop scalable data...

  • Big Data Developer with GCP Expertise

    4 weeks ago

    Phoenix, Arizona, United States Centraprise Full time

    Job Title: Big Data Developer with GCP ExpertiseJob Description:As a Big Data Developer with GCP expertise, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Google Cloud Platform. You will work with a team of experienced professionals to deliver high-quality solutions that meet the needs of our...

  • Big Data Engineer

    4 weeks ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have expertise in MapReduce, Spark, Hive, and SQL, with a strong background in data warehousing and analytics.Key Responsibilities:Design and develop big data applications using Spark, Hive, and...

  • Big Data engineer

    2 weeks ago

    Phoenix, United States Diverse Lynx Full time

    Role: Big Data engineer Location: Phoenix,AZ Experience: 8+ Year Duration: 12+ Months Essential Skills: Desirable Skills: Must have good experience working in large scale application development using Big Data ecosystem - Hadoop (HDFS, MapReduce, Yarn), Hive, Kafka. -- Should have hands on experience using Spark, Sacal & Spark SQL.-- Hands-on experience...

  • Big Data Engineer

    2 weeks ago

    phoenix, United States Zensar Technologies Full time

    Job Summary:We are seeking a skilled and motivated Software Developer with a focus on Big Data Engineering to join our dynamic team. In this role, you will work with cutting-edge technologies in the Hadoop Ecosystem to develop, maintain, and optimize large-scale data processing systems. As part of our engineering team, you will be responsible for building...

  • Big Data Engineer

    2 weeks ago

    Phoenix, United States Zensar Technologies Full time

    Job Summary:We are seeking a skilled and motivated Software Developer with a focus on Big Data Engineering to join our dynamic team. In this role, you will work with cutting-edge technologies in the Hadoop Ecosystem to develop, maintain, and optimize large-scale data processing systems. As part of our engineering team, you will be responsible for building...

  • Big Data Engineer

    4 weeks ago

    Phoenix, Arizona, United States Diverse Lynx Full time

    Data Governance and Analytics ExpertiseWe are seeking a highly skilled Data Governance and Analytics Expertise professional to join our team at Diverse Lynx LLC. As a key member of our data science team, you will be responsible for developing and maintaining data pipelines using Big Data processes.Key Responsibilities:Develop and maintain data pipelines...