Senior Data Engineer

3 weeks ago

Seattle, United States ApTask Full time

Job title: Sr. Data Engineer II/ III/ IV

Job location: Seattle, WA/ Huntsville, AL/ Space Coast, FL - Onsite 3 days a week

Duration: 6-12 months Contract to hire role


Job Description:

As a Senior Data Engineer, you will be instrumental in driving the practice of federating data ingestion, curation, and hydrating the ontology within our Palantir Foundry platform. Your expertise will guide the definition of common standards for data pipelines, ensuring high data quality, robust Role-Based Access Control (RBAC), and precise data classification. You will be at the helm of creating patterns and standards for Change Data Capture (CDC), incremental loads, and streaming data within the platform. Additionally, you will lead the design and implementation of DevOps practices, data platform monitoring, and observability to ensure operational excellence and high availability of data services. Need to solution & implement complex data pipelines orchestration for a knowledge graph build.


Responsibilities:

  • Federate Data Ingestion and Curation: Lead the efforts to streamline data ingestion and curation processes, ensuring efficient and scalable data handling within the Palantir Foundry platform.
  • Hydrate Ontology: Spearhead the development and maintenance of the ontology, facilitating a structured and intuitive understanding of the data landscape.
  • Define Data Pipeline Standards: Establish common standards for data pipelines, focusing on data quality, RBAC, and data classification to maintain integrity and security.
  • Develop Data Patterns and Standards: Create and implement patterns and standards for CDC, incremental loads, and real-time data streaming, enhancing the platform's responsiveness and flexibility.
  • Lead Ontology Build: Guide the construction of the ontology, ensuring it meets the complex needs of aerospace manufacturing data.
  • Mentor Data Engineers: Provide leadership and mentorship to other data engineers, promoting the adoption of standards, patterns, and DataOps practices for federating data pipeline work across the enterprise.
  • Accelerate Delivery and Self-Service: Drive the acceleration of data pipeline delivery and promote data self-service consumption, enabling faster decision-making and innovation.
  • DevOps Practices: Design and implement DevOps practices for data operations, ensuring continuous integration, continuous delivery, and automated testing are at the core of the data engineering workflow.
  • Monitoring and Observability: Establish comprehensive monitoring and observability frameworks for the data platform, enabling proactive issue detection and resolution to maintain high service availability.


Technology Stack Experience:

  • Programming Languages - Python, PySpark, Java, SQL
  • Databases - Postgres, Oracle
  • Cloud Services – AWS, Azure, GCP (storage, compute, databases, catalogs, streaming, replication, Queueing & Notification, Logging & Monitoring service) – any one of the cloud platforms is good but AWS is preferred.
  • Big Data Frameworks
  • Metadata Catalogs – DataHub, Informatica, Collibra (experience in any one is good)
  • Data Quality Platforms – Anomolo, Informatica, BigEye (experience in any one is good)
  • Event Platforms – Kafka, MSK
  • Data Platforms – Palantir Foundry, Databricks, Snowflake (experience in any one is good but Foundry experience will be a bonus)


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 5-8 years required in the data engineering & data management with a strong focus on data platforms like Databricks, Snowflake or Palantir Foundry
  • Extensive knowledge of data ingestion, ETL processes, and data modeling.
  • Strong problem-solving skills and the ability to work with complex data integration challenges.
  • Experience with data reconciliation, data pipeline & data monitoring, and performance optimization.
  • Excellent communication and teamwork skills
  • Leadership experience and the ability to mentor junior engineers.
  • Prior experience in aerospace manufacturing or a related industry is a plus
  • Ability to earn trust, maintain positive and professional relationships, and contribute to a culture of inclusion

  • Senior Data Engineer

    5 days ago

    Seattle, Washington, United States GTT, LLC Full time

    Job DescriptionSenior Data EngineerContract Duration: 6+ monthsPay Rate: Up to $120/hrRole Overview:We are looking for a skilled Senior Data Engineer to join our team and drive the use of the Palantir Foundry platform to boost our data capabilities.As a Senior Data Engineer, you will lead in federating data ingestion, curation, and ontology development...

  • Senior Data Engineer

    1 week ago

    Seattle, United States Mainz Brady Group Full time

    Senior Data Engineer - 6 Month Contract - Hybrid, Seattle Washington - W2 ONLY, NO C2C or OPT EADSeeking a Senior Data Engineer to join a dynamic team. This role involves building foundational datasets from clickstream and quality of service telemetry data to support engineering, analytics, and operational teams.Qualifications5+ years of data engineering...

  • Senior Data Engineer

    3 weeks ago

    Seattle, United States GTT, LLC Full time

    Senior Data EngineerContract Duration 6+ monthsPay rate up to $120/hrJob Description:Our client is currently seeking a Senior Data Engineer to join our team and play a pivotal role in leveraging the Palantir Foundry platform to enhance our data capabilities.As a Senior Data Engineer, you will be instrumental in driving the practice of federating data...

  • Senior Data Engineer

    5 days ago

    Seattle, Washington, United States GTT, LLC Full time

    Senior Data Engineer Contract Duration: 6+ months Pay Rate: up to $120/hr Job Description: Join our team as a Senior Data Engineer to enhance our data capabilities using Palantir Foundry. Drive data ingestion, curation, and ontology hydration within the platform. Define standards for data pipelines, RBAC, and data classification. Create patterns for Change...

  • Senior Data Engineer

    4 weeks ago

    Seattle, United States GTT, LLC Full time

    Job DescriptionJob DescriptionSenior Data EngineerContract Duration 6+ monthsPay rate up to $120/hrJob Description:Our client is currently seeking a Senior Data Engineer to join our team and play a pivotal role in leveraging the Palantir Foundry platform to enhance our data capabilities.As a Senior Data Engineer, you will be instrumental in driving the...

  • Senior Data Engineer

    3 weeks ago

    Seattle, United States GTT, LLC Full time

    Job DescriptionJob DescriptionSenior Data EngineerContract Duration 6+ monthsPay rate up to $120/hrJob Description:Our client is currently seeking a Senior Data Engineer to join our team and play a pivotal role in leveraging the Palantir Foundry platform to enhance our data capabilities.As a Senior Data Engineer, you will be instrumental in driving the...

  • Senior Data Engineer

    4 days ago

    Seattle, United States Washington Federal Full time

    Senior Data Engineer Location : Location US-WA-Seattle Location : Address 425 Pike Street Location : City Seattle Location : State/Province WA ID 2024-2816 Category Technology Position Type Full Time Min USD $130,000.00/Yr. Max USD $160,000.00/Yr. Min USD $130,000.00/Yr. Max USD $160,000.00/Yr. Job Summary About the WaFd Enterprise Data Department Are you...

  • Senior Data Engineer

    2 weeks ago

    Seattle, United States Washington Federal Full time

    Senior Data Engineer Location : Location US-WA-Seattle Location : Address 425 Pike Street Location : City Seattle Location : State/Province WA ID 2024-2816 Category Technology Position Type Full Time Min USD $130,000.00/Yr. Max USD $160,000.00/Yr. Min USD $130,000.00/Yr. Max USD $160,000.00/Yr. Job Summary About the WaFd Enterprise Data Department Are you...

  • Senior Data Engineer

    1 month ago

    Seattle, United States aKUBE Full time

    Senior Data EngineerLocation: Seattle, WA 98104Onsite/ Hybrid/ Remote: Onsite, 4 days a weekDuration: 9 months to start with an extensionRate Range: $ 89/hr on W2 depending on experience (no C2C or 1099 or sub-contract)Work Authorization: GC, USC, All valid EADs except H1bResponsibilities:● 7+ years in design, development, and maintenance of data pipelines...

  • Senior Data Engineer

    24 hours ago

    Seattle, United States aKUBE Full time

    Senior Data Engineer Location: Seattle, WA 98104 Onsite/ Hybrid/ Remote: Onsite, 4 days a week Duration: 9 months to start with an extension Rate Range: $ 89/hr on W2 depending on experience (no C2C or 1099 or sub-contract) Work Authorization: GC, USC, All valid EADs except H1b Responsibilities: ? 7+ years in design, development, and maintenance of data...

  • Senior Data Engineer

    3 weeks ago

    Seattle, United States aKUBE Full time

    Senior Data EngineerLocation: Seattle, WA 98104Onsite/ Hybrid/ Remote: Onsite, 4 days a weekDuration: 9 months to start with an extensionRate Range: $ 89/hr on W2 depending on experience (no C2C or 1099 or sub-contract)Work Authorization: GC, USC, All valid EADs except H1bResponsibilities:● 7+ years in design, development, and maintenance of data pipelines...

  • Senior Data Engineer

    7 days ago

    Seattle, United States ApTask Full time

    Job title: Sr. Data Engineer II/ III/ IV Job location: Seattle, WA/ Huntsville, AL/ Space Coast, FL - Onsite 3 days a week Duration: 6-12 months Contract to hire role Job Description: As a Senior Data Engineer, you will be instrumental in driving the practice of federating data ingestion, curation, and hydrating the ontology within our Palantir Foundry...

  • Senior Data Engineer

    3 weeks ago

    Seattle, United States ApTask Full time

    Job title: Sr. Data Engineer II/ III/ IVJob location: Seattle, WA/ Huntsville, AL/ Space Coast, FL - Onsite 3 days a weekDuration: 6-12 months Contract to hire roleJob Description: As a Senior Data Engineer, you will be instrumental in driving the practice of federating data ingestion, curation, and hydrating the ontology within our Palantir Foundry...

  • Senior Data Engineer

    2 weeks ago

    Seattle, United States Grid Dynamics Full time

    Description Position at Grid Dynamics  Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic...

  • Senior Data Engineer

    4 days ago

    Seattle, United States SoFi Full time

    Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, were changing the way people think about and interact with personal finance. Were a next-generation fintech company using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an...

  • Senior Data Engineer

    23 hours ago

    Seattle, United States Picket Homes Full time

    We do not accept solicitations from third-party recruiters for any positions. Please note that Hybrid positions require that you be located in the immediate metro area in which the job is posted. We are not able to consider candidates outside this area. Picketis a technology-powered real estate company that is transforming the single-family home rental...

  • Data Center Civil Engineer, AWS Data Center Design Engineering

    5 days ago

    Seattle, Washington, United States Amazon Data Services, Inc. Full time

    Data Center Civil Engineer at Amazon Web Services (AWS)AWS is looking for a Data Center Civil Engineer to be part of the team in Seattle, WA. As part of the team responsible for the planning and operation of AWS global infrastructure, you'll be working on keeping the cloud up and running, ensuring our customers have access to the innovation they need.Join a...

  • Senior Data Engineer

    3 weeks ago

    Seattle, WA, United States GTT, LLC Full time

    Senior Data EngineerContract Duration 6+ MonthsPay range - $70 to $85/hrJob Summary:Our mission is to leverage cutting-edge technology to design, build, and maintain rockets that are not only safe and reliable but also environmentally friendly.Our client is currently seeking a Senior Data Engineer to join our team and play a pivotal role in leveraging the...

  • Data Center Civil Engineer, AWS Data Center Design Engineering

    2 weeks ago

    Seattle, United States Amazon Data Services, Inc. Full time

    Amazon Web Services (AWS) is seeking a Data Center Civil Engineer to join its design team in Seattle, WA. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking,...

  • Senior Data Engineer

    2 weeks ago

    Seattle, United States Milliman Full time

    Description Company Overview: Leading with our core values of Quality, Integrity, and Opportunity, MedInsight is one of the healthcare industry's most trusted solutions for healthcare intelligence. Our company purpose is to empower easy, data-driven decision-making on important healthcare questions. Through our products, education, and services, MedInsight...