Big Data Engineer

18 hours ago


Plano, Texas, United States Randstad Full time

Job Summary:

We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in Hadoop and Kafka, with expertise in developing and implementing scalable data pipelines.

Key Responsibilities:

  • Analyze and design scalable data pipelines using Hadoop and Kafka
  • Develop and implement data processing solutions using Python and Spark
  • Collaborate with cross-functional teams to integrate data into business applications
  • Design and implement data governance and security policies
  • Stay up-to-date with industry trends and emerging technologies

Requirements:

  • 10+ years of experience in Big Data engineering
  • Deep expertise in Hadoop and Kafka
  • Strong programming skills in Python and Spark
  • Experience with data governance and security policies
  • Excellent communication and collaboration skills

Desired Skills:

  • Experience with Trino and Apache Flink
  • Knowledge of data warehousing and data marts

Location:

Plano, Texas

Job Type:

Contract

Salary:

$ per hour

Work Hours:

8am to 5pm

Education:

Bachelor's degree in Computer Science or related field

Responsibilities:

  • Analyze current Hadoop-based Master Data Management platform
  • Design a scalable platform based on streaming data pipelines
  • Reengineer traditional database systems and stored procedures
  • Develop and implement solutions using Confluent Kafka
  • Expert experience in developing and implementing solutions using Spark and Spark SQL
  • Expert level skills for evaluating, developing, and performance tuning existing HIVE Managed Tables and PySpark implementation
  • Experience with shell scripting
  • Apache Phoenix and HBase design, implementation, and tuning

Qualifications:

  • Minimum 10 years of experience
  • Bachelor's degree in Computer Science or related field
  • Strong programming skills in Python and Spark
  • Experience with data governance and security policies

Skills:

  • Hadoop
  • Kafka
  • Python
  • ETL

Equal Opportunity Employer:

Randstad Digital is an equal opportunity employer and welcomes people of all abilities. If you require a reasonable accommodation to make your application or interview experience a great one, please contact us.

We offer a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).


  • Big Data Engineer

    2 weeks ago


    Plano, Texas, United States Innova Solutions Full time

    Job Title: Big Data EngineerInnova Solutions is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using cutting-edge technologies such as Hadoop, Java, and Python.Key Responsibilities:Design and develop data processing...

  • Big Data Engineer

    4 weeks ago


    Plano, Texas, United States Innova Solutions Full time

    Job Title: Big Data EngineerInnova Solutions is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop data processing pipelines using Hadoop, Java, and Python.Work with large data sets,...

  • Big Data Engineer

    2 days ago


    Plano, Texas, United States Donato Technologies, Inc Full time

    Job Title: Big Data EngineerDonato Technologies, Inc. is seeking a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and deploying large-scale data processing systems.Key Responsibilities:Design and develop Spring boot applicationsImplement microservices design patterns and best...

  • Big Data Engineer

    2 days ago


    Plano, Texas, United States Photon Full time

    Job SummaryPhoton is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key ResponsibilitiesDesign and implement data processing pipelines using Hadoop and SparkDevelop and maintain...

  • Big Data Engineer

    1 week ago


    Plano, Texas, United States Innova Solutions Full time

    Job Title: Big Data EngineerInnova Solutions is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Hadoop, Java, and PythonDevelop and...


  • Plano, Texas, United States Syntricate Technologies Full time

    Big Data Java AWS EngineerAt Syntricate Technologies, we are seeking a highly skilled Big Data Java AWS Engineer to join our team. The ideal candidate will have a strong background in Java, experience with big data processing, and expertise in AWS technologies. This is a unique opportunity to work on a new platform for Credit Card data, building a new...


  • Plano, Texas, United States STIAOS Technologies Full time

    We are seeking a highly skilled Sr. Big Data Engineer to join our team at STIAOS Technologies. The ideal candidate will have a strong background in data warehousing and data lake architecture, with expertise in Spark, Python, and Snowflake. Experience with Hadoop is a plus.Key Responsibilities:Design and implement scalable data pipelines using Spark and...

  • Data Engineer

    6 days ago


    Plano, Texas, United States Mindteck Full time

    Data Engineer - Cloud and Big Data ExpertAt Mindteck, we're seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using cloud-based technologies such as AWS. You will work closely with our technical and business teams to identify...


  • Plano, Texas, United States Randstad Full time

    Job SummaryWe are seeking a highly skilled Hadoop and Kafka engineer to join our team. The ideal candidate will have a strong background in developing and implementing big data solutions using Hadoop and Kafka.Key Responsibilities:Analyze and design scalable big data pipelines using Hadoop and KafkaDevelop and implement data processing solutions using Spark...


  • Plano, Texas, United States Pyramid Consulting, Inc Full time

    Job Title: Big Data Solutions ArchitectPyramid Consulting, Inc. is seeking a highly skilled Big Data Solutions Architect to join our team. As a key member of our team, you will be responsible for designing and implementing large-scale Big Data solutions for our clients in the Banking and Financial Industry.Key Responsibilities:Design and develop Big Data...


  • Plano, Texas, United States Infinity Consulting Solutions Full time

    Job Title: Big Data Java DeveloperWe are seeking a highly skilled Big Data Java Developer to join our team at Infinity Consulting Solutions. As a key member of our agile team, you will play a critical role in enhancing, building, and delivering data collection, storage, access, and analytics in a secure, stable, and scalable way.Responsibilities:Design,...


  • Plano, Texas, United States Pyramid Consulting, Inc. Full time

    Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled Big Data Solutions Architect to join our team at Pyramid Consulting, Inc. This is a 12+ months contract opportunity with long-term potential and is located in a hybrid work environment.Job Summary:The successful candidate will have a strong background in Big Data and Analytics, with...

  • Big Data Engineer

    1 day ago


    Plano, Texas, United States HexaQuEST Global, Inc. Full time

    Job SummaryAt HexaQuEST Global, Inc., we are seeking a highly skilled Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop and related technologies.Key Responsibilities• Develop and maintain large-scale data...


  • Plano, Texas, United States Infinity Consulting Solutions Full time

    Job Title: Big Data Java DeveloperWe are seeking a highly skilled Big Data Java Developer to join our team at Infinity Consulting Solutions. As a key member of our agile team, you will play a critical role in enhancing, building, and delivering data collection, storage, access, and analytics in a secure, stable, and scalable way.Responsibilities:Design,...


  • Plano, Texas, United States Infinity Consulting Solutions Full time

    Job Title: Big Data Java DeveloperWe are seeking a highly skilled Big Data Java Developer to join our team at Infinity Consulting Solutions. As a key member of our agile team, you will play a critical role in enhancing, building, and delivering data collection, storage, access, and analytics in a secure, stable, and scalable way.Responsibilities:Execute...


  • Plano, Texas, United States Mitchell Martin Full time

    Job SummaryWe are seeking a highly skilled Senior Quality Assurance Engineer with expertise in Big Data to join our team at Mitchell Martin.Key ResponsibilitiesEnsure software development meets functional, non-functional, and compliance requirements.Lead small efforts and contribute to good software testing practices.Develop and maintain test automation...


  • Plano, Texas, United States Pyramid Consulting, Inc Full time

    Job Title: Big Data Quality Assurance SpecialistJob Summary: We are seeking a highly skilled Big Data Quality Assurance Specialist to join our team at Pyramid Consulting, Inc. The ideal candidate will have a strong background in data quality engineering, with experience in test automation and data validation.Key Responsibilities:Design and implement data...

  • Senior Data Engineer

    1 month ago


    Plano, Texas, United States NTT DATA Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team in Plano, Texas. As a Senior Data Engineer, you will be responsible for designing and implementing tailored data solutions to meet customer needs and use cases.Key Responsibilities:Design and implement data solutions using a dynamically evolving technical...


  • Plano, Texas, United States NTT DATA Full time

    Job Title: Data Visualization EngineerWe are seeking a skilled Data Visualization Engineer to join our team at NTT DATA. As a Data Visualization Engineer, you will play a crucial role in transforming complex data into clear, engaging, and actionable visual representations that help stakeholders understand key insights, identify trends, and make informed...


  • Plano, Texas, United States Pyramid Consulting Full time

    Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled Big Data Solutions Architect to join our team at Pyramid Consulting, Inc. The ideal candidate will have a strong background in designing and implementing large-scale data architectures, as well as experience with Hadoop and other industry big data frameworks.Key Responsibilities:* Design...