Big Data Engineer
4 months ago
Hi,
Our client is looking Big Data Engineer for Long term project in Multi Location (USA) below is the detailed requirements.
Job Title: Big Data Engineer
Location: Multi Location (USA)
Duration: Contract / Full-Time
Primary Skill:
AWS Cloud Python programming and AWS services (EC2, RDS, S3, Lambda, . Airflow DAG Python to support data operations. Integrate various internal and external data sources (including SharePoint, One Drive, One Note, Understanding of CI/CD tools and practices.Job Description:
Using AWS cloud services. Develop and maintain automated data pipelines, ensuring data accuracy and efficient processing using Airflow DAG. Write high-quality, maintainable code in Python to support data operations. Integrate various internal and external data sources (including SharePoint, One Drive, One Note, to create a unified data platform. Build tools for document ingestion, dynamic file previewing, and tabular data extraction. Manage graph database systems and support large text corpus management. Implement security controls to maintain data integrity and compliance. Use Large Language Models for keyword extraction and data analysis to gain insights.Requirements
Proven experience with Python programming and AWS services (EC2, RDS, S3, Lambda, . Proficient in managing and orchestrating workflows with Airflow. Solid understanding of CI/CD tools and practices. Demonstrated experience with data engineering and familiarity with graph database management. Expertise in data processing, corpus management, and keyword extraction. Strong problem-solving abilities, attention to detail, and organizational skills. Excellent communication and teamwork skills to collaborate with cross-functional teams.-
Big Data Engineer
1 week ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a key member of our engineering team, you will be responsible for designing, developing, and implementing large-scale Big Data solutions using Hadoop, Spark, and other related technologies.Key Responsibilities:Design and develop...
-
Big Data Engineer
2 weeks ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies such as MapReduce, Spark, and Hadoop.Key Responsibilities:Design and develop scalable data...
-
Big Data Engineer
2 weeks ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and other Big Data technologies.Key Responsibilities:Design and develop scalable data...
-
Big Data Engineer
3 weeks ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies such as MapReduce, Spark, and Hadoop.Key Responsibilities:Design and develop scalable data...
-
Big Data Engineer
1 week ago
Phoenix, Arizona, United States Amaze Systems Inc Full timeJob Title: Big Data DeveloperLocation: Phoenix, AZJob Type: Full-timeAbout the RoleWe are seeking a highly skilled Big Data Developer to join our team at Amaze Systems Inc. As a Big Data Developer, you will be responsible for designing and developing data engineering solutions on big data ecosystems, developing custom applications, and modifying existing...
-
Big Data Engineer
1 month ago
Phoenix, Arizona, United States eTek IT Services, Inc. Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at eTek IT Services, Inc. in Phoenix, AZ. The ideal candidate will have hands-on experience with Spark, Scala, and Hive, as well as a strong understanding of Big Data querying tools.Key Responsibilities:Design and develop scalable Big Data applications using Spark...
-
Big Data Engineer
3 weeks ago
Phoenix, Arizona, United States Lorven Technologies Full timeJob Title: Big Data EngineerJob Summary:Lorven Technologies is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and...
-
Big Data Engineer
7 days ago
Phoenix, Arizona, United States Group Nine LLC Full timeJob Description:As a Big Data Developer at Group Nine LLC, you will be responsible for designing and developing data engineering solutions on big data ecosystems. You will work closely with the SRE team to provide post-implementation and ongoing support. Your key responsibilities will include developing and designing software applications, assessing and...
-
Big Data Engineer
2 days ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with large-scale application development using the Big Data ecosystem, including Hadoop, Hive, Kafka, Spark, Scala, and Snowflake utilities.Key...
-
Big Data Engineer
2 weeks ago
Phoenix, Arizona, United States SysMind Tech Full timeJob Title: Big Data EngineerAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at SysMind Tech. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop technologies.Key Responsibilities:• Minimum 6 years of experience in Big Data Hadoop...
-
Big Data Engineer
3 days ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with large-scale application development using the Big Data ecosystem, including Hadoop, Hive, and Kafka.Key Responsibilities:Design and develop scalable data...
-
Big Data Engineer
3 days ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have expertise in MapReduce, Spark, Hive, and SQL, with a strong background in data warehousing and analytics.Key Responsibilities:Design and develop big data applications using Spark, Hive, and...
-
Big Data Engineer
1 week ago
Phoenix, Arizona, United States Diverse Lynx Full timeJob Title: Big Data EngineerLocation: RemoteDuration: 12+ MonthsExperience: 8+ YearsEssential Skills:Hands-on experience with Hadoop (HDFS, MapReduce, Yarn), Hive, and KafkaProficiency in Spark, Scala, and Spark SQLExperience with Snowflake utilities, SnowSQL, SnowPipe, and Big Data modeling techniques using PythonRole Description:As a Big Data Engineer, you...
-
Big Data Engineer
2 weeks ago
Phoenix, Arizona, United States SysMind Tech Full time{"title": "Big Data Engineer", "description": "Job DescriptionAs a Big Data Engineer at SysMind Tech, you will be responsible for designing and developing large-scale data processing systems, handling complex data sets, and ensuring the smooth operation of our data infrastructure.You will work closely with our SRE team to ensure the reliability and...
-
Big Data Engineer
1 week ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies Inc. The ideal candidate will have expertise in designing and developing large-scale data processing systems using Hadoop and Spark.Key Responsibilities:Design and implement data processing pipelines using MapReduce and SparkDevelop and...
-
Big Data Engineer
6 days ago
Phoenix, Arizona, United States BS Technologies Inc. Full timeJob Opportunity: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at BS Technologies Inc.Key Responsibilities:Conduct face-to-face client interviews in Phoenix, AZDevelop and maintain big data solutionsCollaborate with cross-functional teams to drive business outcomesRequirements:Local to Phoenix, AZExperience with big data...
-
Big Data Engineer
7 days ago
Phoenix, Arizona, United States Diverse Lynx Full timeJob Title: Big Data EngineerRole Overview:Diverse Lynx LLC is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key Responsibilities: Design and develop data processing pipelines using...
-
Big Data Engineer
1 month ago
Phoenix, Arizona, United States Lorven Technologies Full timeHi, we're Lorven Technologies, and we're looking for a skilled Big Data Engineer to join our team.Job Title: Big Data EngineerLocation: Multi Location (USA)Duration: Contract / Full-TimePrimary Skills:AWS CloudPython programming and AWS services (EC2, RDS, S3, Lambda,.Airflow DAGPython to support data operations.Integrate various internal and external data...
-
Big Data Engineer
3 weeks ago
Phoenix, Arizona, United States Syntricate Technologies Full timeJob DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies.Key Responsibilities:Design and develop scalable big data architectures using Hadoop and Spark.Implement data warehousing solutions on public cloud platforms (GCP, Azure, AWS).Develop and maintain ETL pipelines using SQL and data warehousing...
-
Big Data Engineer
3 days ago
Phoenix, Arizona, United States Diverse Lynx Full timeJob Description:At Diverse Lynx LLC, we are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have expertise in Big Data and Hadoop ecosystems, with a strong focus on MapR. Additionally, they will have hands-on experience with programming languages such as Python and Java, as well as application design and software...