Big Data Engineer
18 hours ago
Job Summary:
We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in Hadoop and Kafka, with expertise in developing and implementing scalable data pipelines.
Key Responsibilities:
- Analyze and design scalable data pipelines using Hadoop and Kafka
- Develop and implement data processing solutions using Python and Spark
- Collaborate with cross-functional teams to integrate data into business applications
- Design and implement data governance and security policies
- Stay up-to-date with industry trends and emerging technologies
Requirements:
- 10+ years of experience in Big Data engineering
- Deep expertise in Hadoop and Kafka
- Strong programming skills in Python and Spark
- Experience with data governance and security policies
- Excellent communication and collaboration skills
Desired Skills:
- Experience with Trino and Apache Flink
- Knowledge of data warehousing and data marts
Location:
Plano, Texas
Job Type:
Contract
Salary:
$ per hour
Work Hours:
8am to 5pm
Education:
Bachelor's degree in Computer Science or related field
Responsibilities:
- Analyze current Hadoop-based Master Data Management platform
- Design a scalable platform based on streaming data pipelines
- Reengineer traditional database systems and stored procedures
- Develop and implement solutions using Confluent Kafka
- Expert experience in developing and implementing solutions using Spark and Spark SQL
- Expert level skills for evaluating, developing, and performance tuning existing HIVE Managed Tables and PySpark implementation
- Experience with shell scripting
- Apache Phoenix and HBase design, implementation, and tuning
Qualifications:
- Minimum 10 years of experience
- Bachelor's degree in Computer Science or related field
- Strong programming skills in Python and Spark
- Experience with data governance and security policies
Skills:
- Hadoop
- Kafka
- Python
- ETL
Equal Opportunity Employer:
Randstad Digital is an equal opportunity employer and welcomes people of all abilities. If you require a reasonable accommodation to make your application or interview experience a great one, please contact us.
We offer a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
-
Big Data Engineer
2 weeks ago
Plano, Texas, United States Innova Solutions Full timeJob Title: Big Data EngineerInnova Solutions is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using cutting-edge technologies such as Hadoop, Java, and Python.Key Responsibilities:Design and develop data processing...
-
Big Data Engineer
4 weeks ago
Plano, Texas, United States Innova Solutions Full timeJob Title: Big Data EngineerInnova Solutions is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop data processing pipelines using Hadoop, Java, and Python.Work with large data sets,...
-
Big Data Engineer
2 days ago
Plano, Texas, United States Donato Technologies, Inc Full timeJob Title: Big Data EngineerDonato Technologies, Inc. is seeking a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and deploying large-scale data processing systems.Key Responsibilities:Design and develop Spring boot applicationsImplement microservices design patterns and best...
-
Big Data Engineer
2 days ago
Plano, Texas, United States Photon Full timeJob SummaryPhoton is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key ResponsibilitiesDesign and implement data processing pipelines using Hadoop and SparkDevelop and maintain...
-
Big Data Engineer
1 week ago
Plano, Texas, United States Innova Solutions Full timeJob Title: Big Data EngineerInnova Solutions is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Hadoop, Java, and PythonDevelop and...
-
Big Data Java AWS Engineer
5 days ago
Plano, Texas, United States Syntricate Technologies Full timeBig Data Java AWS EngineerAt Syntricate Technologies, we are seeking a highly skilled Big Data Java AWS Engineer to join our team. The ideal candidate will have a strong background in Java, experience with big data processing, and expertise in AWS technologies. This is a unique opportunity to work on a new platform for Credit Card data, building a new...
-
Senior Big Data Engineer
1 week ago
Plano, Texas, United States STIAOS Technologies Full timeWe are seeking a highly skilled Sr. Big Data Engineer to join our team at STIAOS Technologies. The ideal candidate will have a strong background in data warehousing and data lake architecture, with expertise in Spark, Python, and Snowflake. Experience with Hadoop is a plus.Key Responsibilities:Design and implement scalable data pipelines using Spark and...
-
Data Engineer
6 days ago
Plano, Texas, United States Mindteck Full timeData Engineer - Cloud and Big Data ExpertAt Mindteck, we're seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using cloud-based technologies such as AWS. You will work closely with our technical and business teams to identify...
-
Big Data Hadoop/Kafka Engineer
7 days ago
Plano, Texas, United States Randstad Full timeJob SummaryWe are seeking a highly skilled Hadoop and Kafka engineer to join our team. The ideal candidate will have a strong background in developing and implementing big data solutions using Hadoop and Kafka.Key Responsibilities:Analyze and design scalable big data pipelines using Hadoop and KafkaDevelop and implement data processing solutions using Spark...
-
Big Data Solutions Architect
1 week ago
Plano, Texas, United States Pyramid Consulting, Inc Full timeJob Title: Big Data Solutions ArchitectPyramid Consulting, Inc. is seeking a highly skilled Big Data Solutions Architect to join our team. As a key member of our team, you will be responsible for designing and implementing large-scale Big Data solutions for our clients in the Banking and Financial Industry.Key Responsibilities:Design and develop Big Data...
-
Big Data Java Developer
3 weeks ago
Plano, Texas, United States Infinity Consulting Solutions Full timeJob Title: Big Data Java DeveloperWe are seeking a highly skilled Big Data Java Developer to join our team at Infinity Consulting Solutions. As a key member of our agile team, you will play a critical role in enhancing, building, and delivering data collection, storage, access, and analytics in a secure, stable, and scalable way.Responsibilities:Design,...
-
Big Data Solutions Architect
2 weeks ago
Plano, Texas, United States Pyramid Consulting, Inc. Full timeJob Title: Big Data Solutions ArchitectWe are seeking a highly skilled Big Data Solutions Architect to join our team at Pyramid Consulting, Inc. This is a 12+ months contract opportunity with long-term potential and is located in a hybrid work environment.Job Summary:The successful candidate will have a strong background in Big Data and Analytics, with...
-
Big Data Engineer
1 day ago
Plano, Texas, United States HexaQuEST Global, Inc. Full timeJob SummaryAt HexaQuEST Global, Inc., we are seeking a highly skilled Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop and related technologies.Key Responsibilities• Develop and maintain large-scale data...
-
Big Data Java Developer
1 week ago
Plano, Texas, United States Infinity Consulting Solutions Full timeJob Title: Big Data Java DeveloperWe are seeking a highly skilled Big Data Java Developer to join our team at Infinity Consulting Solutions. As a key member of our agile team, you will play a critical role in enhancing, building, and delivering data collection, storage, access, and analytics in a secure, stable, and scalable way.Responsibilities:Design,...
-
Big Data Java Developer
3 weeks ago
Plano, Texas, United States Infinity Consulting Solutions Full timeJob Title: Big Data Java DeveloperWe are seeking a highly skilled Big Data Java Developer to join our team at Infinity Consulting Solutions. As a key member of our agile team, you will play a critical role in enhancing, building, and delivering data collection, storage, access, and analytics in a secure, stable, and scalable way.Responsibilities:Execute...
-
Plano, Texas, United States Mitchell Martin Full timeJob SummaryWe are seeking a highly skilled Senior Quality Assurance Engineer with expertise in Big Data to join our team at Mitchell Martin.Key ResponsibilitiesEnsure software development meets functional, non-functional, and compliance requirements.Lead small efforts and contribute to good software testing practices.Develop and maintain test automation...
-
Big Data Quality Assurance Specialist
2 days ago
Plano, Texas, United States Pyramid Consulting, Inc Full timeJob Title: Big Data Quality Assurance SpecialistJob Summary: We are seeking a highly skilled Big Data Quality Assurance Specialist to join our team at Pyramid Consulting, Inc. The ideal candidate will have a strong background in data quality engineering, with experience in test automation and data validation.Key Responsibilities:Design and implement data...
-
Senior Data Engineer
1 month ago
Plano, Texas, United States NTT DATA Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team in Plano, Texas. As a Senior Data Engineer, you will be responsible for designing and implementing tailored data solutions to meet customer needs and use cases.Key Responsibilities:Design and implement data solutions using a dynamically evolving technical...
-
Data Visualization Engineer
3 weeks ago
Plano, Texas, United States NTT DATA Full timeJob Title: Data Visualization EngineerWe are seeking a skilled Data Visualization Engineer to join our team at NTT DATA. As a Data Visualization Engineer, you will play a crucial role in transforming complex data into clear, engaging, and actionable visual representations that help stakeholders understand key insights, identify trends, and make informed...
-
Big Data Solutions Architect
1 day ago
Plano, Texas, United States Pyramid Consulting Full timeJob Title: Big Data Solutions ArchitectWe are seeking a highly skilled Big Data Solutions Architect to join our team at Pyramid Consulting, Inc. The ideal candidate will have a strong background in designing and implementing large-scale data architectures, as well as experience with Hadoop and other industry big data frameworks.Key Responsibilities:* Design...