Big Data Engineer

4 months ago


Phoenix, United States Lorven Technologies Full time

Hi,

Our client is looking Big Data Engineer  for Long term  project in Multi Location (USA)  below is the detailed requirements.

Job Title: Big Data Engineer

Location: Multi Location (USA)

Duration: Contract / Full-Time

Primary Skill:

AWS Cloud Python programming and AWS services (EC2, RDS, S3, Lambda, . Airflow DAG Python to support data operations. Integrate various internal and external data sources (including SharePoint, One Drive, One Note, Understanding of CI/CD tools and practices.

Job Description:

Using AWS cloud services. Develop and maintain automated data pipelines, ensuring data accuracy and efficient processing using Airflow DAG. Write high-quality, maintainable code in Python to support data operations. Integrate various internal and external data sources (including SharePoint, One Drive, One Note, to create a unified data platform. Build tools for document ingestion, dynamic file previewing, and tabular data extraction. Manage graph database systems and support large text corpus management. Implement security controls to maintain data integrity and compliance. Use Large Language Models for keyword extraction and data analysis to gain insights.

Requirements

Proven experience with Python programming and AWS services (EC2, RDS, S3, Lambda, . Proficient in managing and orchestrating workflows with Airflow. Solid understanding of CI/CD tools and practices. Demonstrated experience with data engineering and familiarity with graph database management. Expertise in data processing, corpus management, and keyword extraction. Strong problem-solving abilities, attention to detail, and organizational skills. Excellent communication and teamwork skills to collaborate with cross-functional teams.
  • Big Data Engineer

    1 week ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a key member of our engineering team, you will be responsible for designing, developing, and implementing large-scale Big Data solutions using Hadoop, Spark, and other related technologies.Key Responsibilities:Design and develop...

  • Big Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies such as MapReduce, Spark, and Hadoop.Key Responsibilities:Design and develop scalable data...

  • Big Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and other Big Data technologies.Key Responsibilities:Design and develop scalable data...

  • Big Data Engineer

    3 weeks ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies such as MapReduce, Spark, and Hadoop.Key Responsibilities:Design and develop scalable data...

  • Big Data Engineer

    1 week ago


    Phoenix, Arizona, United States Amaze Systems Inc Full time

    Job Title: Big Data DeveloperLocation: Phoenix, AZJob Type: Full-timeAbout the RoleWe are seeking a highly skilled Big Data Developer to join our team at Amaze Systems Inc. As a Big Data Developer, you will be responsible for designing and developing data engineering solutions on big data ecosystems, developing custom applications, and modifying existing...

  • Big Data Engineer

    1 month ago


    Phoenix, Arizona, United States eTek IT Services, Inc. Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at eTek IT Services, Inc. in Phoenix, AZ. The ideal candidate will have hands-on experience with Spark, Scala, and Hive, as well as a strong understanding of Big Data querying tools.Key Responsibilities:Design and develop scalable Big Data applications using Spark...

  • Big Data Engineer

    3 weeks ago


    Phoenix, Arizona, United States Lorven Technologies Full time

    Job Title: Big Data EngineerJob Summary:Lorven Technologies is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and...

  • Big Data Engineer

    7 days ago


    Phoenix, Arizona, United States Group Nine LLC Full time

    Job Description:As a Big Data Developer at Group Nine LLC, you will be responsible for designing and developing data engineering solutions on big data ecosystems. You will work closely with the SRE team to provide post-implementation and ongoing support. Your key responsibilities will include developing and designing software applications, assessing and...

  • Big Data Engineer

    2 days ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with large-scale application development using the Big Data ecosystem, including Hadoop, Hive, Kafka, Spark, Scala, and Snowflake utilities.Key...

  • Big Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States SysMind Tech Full time

    Job Title: Big Data EngineerAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at SysMind Tech. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop technologies.Key Responsibilities:• Minimum 6 years of experience in Big Data Hadoop...

  • Big Data Engineer

    3 days ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience working with large-scale application development using the Big Data ecosystem, including Hadoop, Hive, and Kafka.Key Responsibilities:Design and develop scalable data...

  • Big Data Engineer

    3 days ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have expertise in MapReduce, Spark, Hive, and SQL, with a strong background in data warehousing and analytics.Key Responsibilities:Design and develop big data applications using Spark, Hive, and...

  • Big Data Engineer

    1 week ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Title: Big Data EngineerLocation: RemoteDuration: 12+ MonthsExperience: 8+ YearsEssential Skills:Hands-on experience with Hadoop (HDFS, MapReduce, Yarn), Hive, and KafkaProficiency in Spark, Scala, and Spark SQLExperience with Snowflake utilities, SnowSQL, SnowPipe, and Big Data modeling techniques using PythonRole Description:As a Big Data Engineer, you...

  • Big Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States SysMind Tech Full time

    {"title": "Big Data Engineer", "description": "Job DescriptionAs a Big Data Engineer at SysMind Tech, you will be responsible for designing and developing large-scale data processing systems, handling complex data sets, and ensuring the smooth operation of our data infrastructure.You will work closely with our SRE team to ensure the reliability and...

  • Big Data Engineer

    1 week ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies Inc. The ideal candidate will have expertise in designing and developing large-scale data processing systems using Hadoop and Spark.Key Responsibilities:Design and implement data processing pipelines using MapReduce and SparkDevelop and...

  • Big Data Engineer

    6 days ago


    Phoenix, Arizona, United States BS Technologies Inc. Full time

    Job Opportunity: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at BS Technologies Inc.Key Responsibilities:Conduct face-to-face client interviews in Phoenix, AZDevelop and maintain big data solutionsCollaborate with cross-functional teams to drive business outcomesRequirements:Local to Phoenix, AZExperience with big data...

  • Big Data Engineer

    7 days ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Title: Big Data EngineerRole Overview:Diverse Lynx LLC is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key Responsibilities: Design and develop data processing pipelines using...

  • Big Data Engineer

    1 month ago


    Phoenix, Arizona, United States Lorven Technologies Full time

    Hi, we're Lorven Technologies, and we're looking for a skilled Big Data Engineer to join our team.Job Title: Big Data EngineerLocation: Multi Location (USA)Duration: Contract / Full-TimePrimary Skills:AWS CloudPython programming and AWS services (EC2, RDS, S3, Lambda,.Airflow DAGPython to support data operations.Integrate various internal and external data...

  • Big Data Engineer

    3 weeks ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies.Key Responsibilities:Design and develop scalable big data architectures using Hadoop and Spark.Implement data warehousing solutions on public cloud platforms (GCP, Azure, AWS).Develop and maintain ETL pipelines using SQL and data warehousing...

  • Big Data Engineer

    3 days ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description:At Diverse Lynx LLC, we are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have expertise in Big Data and Hadoop ecosystems, with a strong focus on MapR. Additionally, they will have hands-on experience with programming languages such as Python and Java, as well as application design and software...