Big Data Engineer

4 months ago


Piscataway, United States Lorven Technologies Full time

Hi,

Our client is looking for a Big Data Engineer with a Long-Term Contract project in Multi location - USA below is the detailed requirement.

Position: Big Data Engineer

Location: Multi location - USA

Duration: Contract/Fulltime

Job Description:

Responsibilities:

Using AWS cloud services. Develop and maintain automated data pipelines, ensuring data accuracy and efficient processing using Airflow DAG. Write high-quality, maintainable code in Python to support data operations. Integrate various internal and external data sources (including SharePoint, One Drive, One Note, to create a unified data platform. Build tools for document ingestion, dynamic file previewing, and tabular data extraction. Manage graph database systems and support large text corpus management. Implement security controls to maintain data integrity and compliance. Use Large Language Models for keyword extraction and data analysis to gain insights.

Requirements:

Proven experience with Python programming and AWS services (EC2, RDS, S3, Lambda, . Proficient in managing and orchestrating workflows with Airflow. Solid understanding of CI/CD tools and practices. Demonstrated experience with data engineering and familiarity with graph database management. Expertise in data processing, corpus management, and keyword extraction. Strong problem-solving abilities, attention to detail, and organizational skills. Excellent communication and teamwork skills to collaborate with cross-functional teams

  • Piscataway, New Jersey, United States Accord Technologies Inc. Full time

    Job DescriptionData Engineering RoleA highly skilled AWS Data Engineer is required to design and implement robust data pipelines for big data processing. The ideal candidate will have expertise in AWS services such as EMR, S3, RDS, and Redshift, as well as experience with container orchestration using Kubernetes.Key ResponsibilitiesData Pipeline Development:...

  • AWS Data Engineer

    4 weeks ago


    Piscataway, United States Synechron Full time

    Job Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...

  • Data Engineer

    4 weeks ago


    Piscataway, New Jersey, United States Colgate-Palmolive Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Colgate-Palmolive. As a Data Engineer, you will be responsible for developing digital infrastructure and data pipelines to accelerate product innovation, product design, and product development. You will work closely with cross-functional teams to gather, wrangle, cleanse,...

  • AWS Data Engineer

    2 weeks ago


    Piscataway, United States Synechron Full time

    Job Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...


  • Piscataway, New Jersey, United States Colgate-Palmolive Full time

    Job Title: Data Engineering ManagerAbout the Role:We are seeking a highly skilled Data Engineering Manager to lead our team in building and maintaining scalable data pipelines. As a Data Engineering Manager, you will be responsible for leading a technical team to design, develop, and deploy data engineering solutions that meet the needs of our business.Key...


  • Piscataway, New Jersey, United States Colgate-Palmolive Full time

    We are seeking a highly skilled Data Engineering Manager to lead our team in building and maintaining data pipelines that support our analytics strategy.The ideal candidate will have a strong background in data engineering tools and methods, with expertise in code and platform deployment. They will be responsible for enforcing data engineering standards,...

  • Data Engineer

    4 weeks ago


    Piscataway, New Jersey, United States Colgate-Palmolive Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Colgate-Palmolive. As an Analytics Engineer, you will be responsible for developing and maintaining digital infrastructure and data pipelines to accelerate product innovation, product design, and product development.You will work closely with cross-functional teams to gather,...


  • Piscataway, New Jersey, United States Virtusa Full time

    Job Description**Cloud Data Solutions Architect**We are seeking a seasoned Cloud Data Solutions Architect to lead our cloud data platform initiatives. As a key member of our team, you will be responsible for architecting and implementing modern cloud data platforms that support high-throughput event data collection and real-time analytics.**Key...


  • Piscataway, New Jersey, United States Colgate-Palmolive Full time

    About the RoleWe are seeking a skilled Data Engineering Platform Owner to join our team at Colgate-Palmolive. As a key member of our Data Engineering team, you will be responsible for enhancing our platforms, implementing governance, and maximizing value.Key ResponsibilitiesLead Agile Sprints, utilizing the expertise of platform engineers to drive platform...

  • Salesforce Data Cloud

    3 months ago


    Piscataway, United States Haavia, Inc. Full time

    The ideal candidate will have a strong technical background, experience in implementing and optimizing Salesforce Data Cloud solutions, and a passion for leveraging data to drive business insights and efficiencies. Key Responsibilities: - Design, develop, and implement customized solutions within the Salesforce Data Cloud platform. - Collaborate with...


  • Piscataway, New Jersey, United States Haavia, Inc. Full time

    Job Title: Salesforce Data Cloud Solutions ArchitectAt Haavia, Inc., we are seeking a highly skilled Salesforce Data Cloud Solutions Architect to join our team.Key Responsibilities:- Design, develop, and implement customized solutions within the Salesforce Data Cloud platform.- Collaborate with data analysts, business stakeholders, and other developers to...


  • Piscataway, New Jersey, United States Lorven Technologies Full time

    Hi, Lorven Technologies is seeking a highly skilled Data Engineer with expertise in cloud services to join our team. This is a long-term contract position that offers a unique opportunity to work with cutting-edge technology and contribute to the success of our clients. As a Data Engineer with Lorven Technologies, you will be responsible for designing,...

  • Product Engineer

    3 weeks ago


    Piscataway, New Jersey, United States Tiger Analytics Full time

    Tiger Analytics is a leading advanced analytics consulting firm, trusted by Fortune 100 companies to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI, recognized by market research firms like Forrester and Gartner.We are seeking a skilled Product Engineer to build enterprise-grade scalable...


  • Piscataway, New Jersey, United States Softek International Inc Full time

    Job DescriptionAt Softek International Inc, we are seeking a highly skilled Senior Splunk Engineer to join our team. The ideal candidate will have a strong background in Splunk architecture, design, and implementation, as well as experience in leading engineering efforts and mentoring team members.Key Responsibilities:Design, implement, and maintain Splunk...


  • Piscataway, New Jersey, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Data Center Operations Technician to join our team at Amazon. As a Data Center Operations Technician, you will be responsible for the day-to-day operations and maintenance of mechanical and electrical equipment in our data centers.Key ResponsibilitiesOversee the day-to-day operations and maintenance of mechanical...


  • Piscataway, New Jersey, United States Syntricate Technologies Full time

    Job Summary:As a Senior GCP Looker Developer at Syntricate Technologies, you will be responsible for designing and developing complex data models, creating dashboards and reports, and fine-tuning BigQuery. You will work closely with our team to deliver high-quality solutions that meet our clients' needs.Key Responsibilities: Conduct systems and requirements...

  • Software Engineer

    4 weeks ago


    Piscataway, New Jersey, United States First Tek Full time

    We are seeking a highly skilled Software Engineer to join our team at First Tek, Inc. The ideal candidate will have a master's degree in Computer Science or a related field and at least 6 months of experience in developing custom programs and applications using technical skills in Java, J2EE, JSP, JavaScript, Data Engineering, and Data Analytics. Expertise...


  • Piscataway, New Jersey, United States Marsh LLC Full time

    Job SummaryMarsh McLennan Agency is seeking a highly skilled Senior Data Security Architect to join our team. As a key member of our Data team, you will be responsible for establishing consistent data standards, reference architectures, patterns, and practices across the organization.Key ResponsibilitiesDefine reference data architecture and work with agile...


  • Piscataway, New Jersey, United States First Tek Full time

    As a Cloud Data Engineer at First Tek, Inc., you will be responsible for developing custom programs and applications using technical skills in Java, J2EE, JSP, JavaScript, Data Engineering, and Data Analytics. You will have expertise in Python, SQL, BigData, and AWS services like S3, Redshift, EMR, Kinesis, and Apache Spark. You will work in a Datawarehouse...

  • DCIM Engineer II

    4 weeks ago


    Piscataway, New Jersey, United States Quality Technology Services, LLC Full time

    Job Title: DCIM Engineer IIWe are seeking a highly skilled DCIM Engineer II to join our team at Quality Technology Services, LLC. As a DCIM Engineer II, you will be responsible for the management and administration of Electric Power Monitoring Systems (EPMS) and Building Management Systems (BMS) in our data centers.Key Responsibilities:Manage and administer...