Senior Data Platform Engineer

1 day ago


Washington, United States General Motors Full time
Job Description

We are seeking a highly skilled engineer to enhance the robustness and scalability of our infrastructure.

This role involves working across various areas, including enhancing underlying HPC infrastructure, optimizing Kubernetes and Kubeflow setups, and refining training infrastructure components.

  • Enhance the resilience and reliability of our Machine Learning platform infrastructure.
  • Optimize Kubernetes clusters and manage Kubeflow deployments.
  • Streamline and optimize training infrastructure to improve efficiency and scalability.
  • Collaborate closely with cross-functional teams to understand requirements and implement solutions.
  • Troubleshoot complex HPC infrastructure issues and implement effective resolutions.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 8+ years of experience in designing and building scalable data platforms and data pipelines.
  • Strong proficiency in managing and optimizing Kubernetes clusters.
  • Knowledge of cloud platforms and their Machine Learning services.
  • Strong problem-solving skills and ability to work independently and collaboratively.

  • Senior Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States Visualsoft Full time

    At Visual Soft, Inc, we're seeking a talented Senior Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for implementing data engineering activities on high-impact projects. You'll design, develop, and deploy scalable data pipelines and platforms that enable our clients to make data-driven decisions.You'll...

  • Senior Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States Occam Solutions Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Occam Solutions. The ideal candidate will have expertise in designing and implementing large-scale data pipelines, as well as experience with cloud-based data platforms.Key Responsibilities:Design and implement data pipelines using AWS and KubernetesDevelop and maintain data...


  • Washington, United States Snowflake Full time

    Build the future of the AI Data Cloud. Join the Snowflake team. Snowflake has revolutionized data management by harnessing the power of the public cloud to create the Data Cloud, a global network that empowers organizations across diverse industries, such as healthcare, finance, retail, and technology, to mobilize data with unparalleled scale and...


  • Washington, United States TriOptus LLC Full time

    Randstad is seeking a Senior Informatica Data Engineer for a client in Washington, DC. This role focuses on designing, implementing, and optimizing data pipelines using Informatica, IDMC, and cloud technologies to manage and transform both structured and unstructured data. The engineer will collaborate with teams to create data solutions aligned with...


  • Washington, Washington, D.C., United States Jobs for Humanity Full time

    Job DescriptionAt Jobs for Humanity, we're collaborating with Booking.com to build an inclusive and just employment ecosystem. We're seeking a Senior Software Engineer to join our Data and Machine Learning Platform team.This role will involve designing and implementing multiple privacy compliance controls, working with multi-functional teams to integrate...


  • Washington, United States Serigor Inc Full time

    Job Title: Senior Talend Data EngineerWe are seeking a highly skilled Senior Talend Data Engineer to join our team at Serigor Inc.Job SummaryThe successful candidate will be responsible for designing and implementing complex data pipelines using Talend, as well as ensuring data quality and integrity.Key ResponsibilitiesDesign and develop Talend data...

  • Senior Data Engineer

    3 weeks ago


    Washington, Washington, D.C., United States Serigor Inc Full time

    Job Title: Senior Data Engineer - Adobe Analytics ExpertJob Summary: We are seeking a highly skilled Senior Data Engineer with expertise in Adobe Analytics and AEP platform to join our team at Serigor Inc.Key Responsibilities:* Configure AEP to extract the required data sets* Design and develop ETL solutions using AWS Glue and Spark to load data into the...


  • Washington, Washington, D.C., United States CoStar Realty Information, Inc. Full time

    About CoStar GroupCoStar Group is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. We have been living and breathing the world of real estate information and online marketplaces for over 37 years, giving us the perspective to create truly unique and valuable products and services.Job...

  • Senior Data Engineer

    3 weeks ago


    Washington, Washington, D.C., United States CoStar Realty Information, Inc. Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at CoStar Realty Information, Inc. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining real-time and batch processed data pipelines. You will also develop and maintain data storage and retrieval systems, ensuring data accuracy,...

  • Senior Data Architect

    4 weeks ago


    Washington, Washington, D.C., United States Go intellects Inc Full time

    Job OverviewGo intellects Inc is seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have expertise in designing and implementing large-scale data systems, including data lakes, warehouses, and pipelines.Responsibilities:Design and implement data architectures for enterprise data operationsDevelop and maintain data...


  • Washington, United States Citian Full time

    Job DescriptionJob DescriptionCitian is a fast growing, venture backed SaaS technology company based in Washington, DC. Our software solutions revolutionize how our transportation systems – roads, rail, transit, bicycle, pedestrian – operate.Our tech solutions:Reduce traffic fatalitiesEnhance pedestrian accessibilityEmpower system operators to save time...


  • Washington, United States Tyler Technologies Full time

    We are looking for a remarkable Senior Software Engineer to join us! We've built a team of not just the best engineers, but some really awesome humans as well. This team builds cloud software (platform + apps + ecosystem) to accelerate the flow of government data into the hands of citizens, developers, businesses and researchers. With our Data & Insights...


  • Washington, Washington, D.C., United States Fiserv Full time

    We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world.We connect financial institutions, corporations, merchants and consumers to one another millions of times a day - quickly, reliably, and securely.Any time you swipe your credit card, pay through a mobile app, or withdraw money from the bank,...

  • Senior Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States CoStar Realty Information, Inc. Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at CoStar Realty Information, Inc. This role will be responsible for designing, building, and maintaining real-time and batch processed data pipelines, as well as developing and maintaining data storage and retrieval systems.The ideal candidate will have a strong background...

  • Data Engineering Lead

    3 weeks ago


    Washington, Washington, D.C., United States Akumin Full time

    Data Engineering Role at AkuminThe Senior Data Engineer role at Akumin will be responsible for supporting all of Analytics & Business Intelligence in our data engineering needs. This position will assume responsibility for our data pipelines across all Line of Businesses, manage our enrichments and define the schemas for our core data warehouse tables,...

  • Senior Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States US News Full time

    About the RoleU.S. News & World Report is seeking an experienced Senior Data Engineer to join our data warehouse team. As a key member of our team, you will specialize in data modeling and data transformation within BigQuery, helping us build our large-scale data platform for reporting and analysis.You will work with a variety of ingested data sources to...


  • Washington, Washington, D.C., United States Serigor Inc Full time

    Job Title: Senior Talend Data EngineerJob Summary: We are seeking a highly skilled Senior Talend Data Engineer to join our team at Serigor Inc.Key Responsibilities:* Design and develop complex Talend data pipelines* Ensure data quality and integrity* Collaborate with cross-functional teamsRequirements:* 10+ years of experience in data engineering*...

  • Senior Data Engineer

    4 weeks ago


    Washington, Washington, D.C., United States KPMG Full time

    Job Title: Senior Specialist, Federal Data EngineerKPMG is seeking a highly skilled Senior Specialist to join our Federal Advisory practice. As a key member of our team, you will be responsible for developing and implementing robust data pipelines and ETL processes using Databricks and other relevant technologies to support financial data workflows.Key...


  • Washington, Washington, D.C., United States Huntington Ingalls Industries Full time

    Job SummaryEnlighten, an HII Company, is seeking a highly skilled Cloud Platform Engineer to join our team. As a Cloud Platform Engineer, you will play a critical role in the development and deployment of custom software components and integration of open-source code to address complex time series analysis problems through the use of cutting-edge Big Data /...

  • Senior Data Engineer

    1 month ago


    Washington, Pennsylvania, United States Serigor Inc Full time

    Job Title: Sr Data Engineer Job Summary: We are seeking a highly experienced Sr Data Engineer to join our team at Serigor Inc. The ideal candidate will have a strong background in cloud computing, data engineering, and Adobe Analytics/AEP platform experience. Key Responsibilities: * Design and develop ETL solutions to meet complex use cases * Configure...