Current jobs related to Sr. Data Engineer - Washington - Pyramid Systems, Inc.

  • Sr Data Engineer

    15 hours ago


    washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Sr Data Engineer

    17 hours ago


    Washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Sr Data Engineer

    10 hours ago


    Washington, United States Serigor Inc Full time

    Title: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with Adobe Analytics or AEP(Adobe...

  • Sr Data Engineer

    4 months ago


    Washington, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionTitle: Sr Data EngineerLocation: 100% Remote – EST Time zoneDuration: 12+ MonthsKey Skills: AWS, Spark, Adobe Analytics/AEP(Adobe Experience Platform) platform experience, Glue, Lamda, Python, Scala, EMR, Talend, PostgreSQL, RedshiftJob Description:Looking for a Sr level person – Min 10+ YearsLook for a Sr Data Engineer with...


  • Washington, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionTitle: Sr Talend Data EngineerLocation: Washington DC (Remote 100%)Duration: 12+ MonthsJob Description:Looking for a Sr level person – Min 10+ YearsPrefer people near the DC Area – So can be in the office when there is a needShould have good experience in Talend, SQL, AWS Tech Stack - Must Have:Talend Expertise Proficiency...


  • Washington, United States Serigor Inc Full time

    Title: SrTalend Data EngineerLocation: Washington DC (Remote 100%)Duration: 12+ MonthsJob Description:Looking for a Sr level person – Min 10+ YearsPrefer people near the DC Area – So can be in the office when there is a needShould have good experience in Talend, SQL, AWSTech Stack - Must Have:Talend Expertise Proficiency with SQL.Experience using AWS...


  • washington, United States Serigor Inc Full time

    Title: SrTalend Data EngineerLocation: Washington DC (Remote 100%)Duration: 12+ MonthsJob Description:Looking for a Sr level person – Min 10+ YearsPrefer people near the DC Area – So can be in the office when there is a needShould have good experience in Talend, SQL, AWSTech Stack - Must Have:Talend Expertise Proficiency with SQL.Experience using AWS...


  • Washington, Washington, D.C., United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking an experienced Electrical Design Engineer to join our team at Amazon Data Services, Inc. as a Sr. Electrical Design Engineer, Data Center Design Engineering. This is a unique opportunity to work on complex electrical design projects for our data centers, collaborating with cross-functional teams to deliver high-quality...


  • Washington, Washington, D.C., United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking an experienced Electrical Design Engineer to join our team at Amazon Data Services, Inc. as a Sr. Electrical Design Engineer, Data Center Design Engineering. This is a critical role that will be responsible for designing and developing electrical systems for our data centers.Key ResponsibilitiesData Center Electrical Designs:...


  • Washington, United States One Elite Staffing Full time $85

    Job DescriptionJob DescriptionTitle:  Sr Data EngineerLocation:  Washington, DCPay: $85/HourSUMMARY OF DUTIESDesign, develop, and maintain scalable ETL data pipelines for batch and streaming data, handling both structured and unstructured formats effectively.Utilize advanced analytics tools and methodologies to supplement and enhance the analytics...


  • Washington, United States Redpanda Data Inc. Full time

    About the Role:We are a team of seasoned engineers, hackers, and builders, working on the future of data streaming at Redpanda Data Inc.Funded by premier investors, we are building a unified streaming data platform for developers, delivering a reduction in complexity, wicked-fast performance, onboard Wasm transforms, and transparent tiered storage.Key...


  • Washington, United States Redpanda Data Inc. Full time

    About the Role:We are a team of seasoned engineers, hackers, and builders, working on the future of data streaming at Redpanda Data Inc.Funded by premier investors, we are building a unified data streaming platform for developers, delivering a reduction in complexity, wicked-fast performance, onboard Wasm transforms, and transparent tiered storage.Key...


  • Washington, Washington, D.C., United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking an experienced Electrical Design Engineer to join our Data Center Design Engineering team at Amazon Data Services, Inc. As an Electrical Design Engineer, you will be responsible for designing and developing electrical systems for our data centers, ensuring they meet the highest standards of quality, reliability, and...

  • Sr. Data Scientist

    1 month ago


    Washington, United States Visa Full time

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr Data Engineer

    3 weeks ago


    Washington, United States Chabez Tech Full time

    Job DescriptionJob DescriptionJob DescriptionTitle: Data EngineerLocation: Washington, DCDuration:  12 + month contract positionVisa: USC, GC, GCEAD, H4EAD Description: Seeking a Data Engineer Our client is on a journey to becoming the best IT organization in the airline industry, a journey of transformation. They are changing the way we do business from...


  • Washington, Washington, D.C., United States NTT DATA Full time

    Job Title: Data Center Infrastructure LeaderJob Summary:NTT DATA Services is seeking a Data Center Infrastructure Leader to join our team in the Washington D.C. metropolitan area. As a key member of our data center operations team, you will be responsible for leading and managing data center infrastructure operations for a large federal client, ensuring the...


  • Washington, Washington, D.C., United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Center Infrastructure Leader to join our team in the Washington D.C. metropolitan area. As a key member of our data center operations team, you will be responsible for leading and managing data center infrastructure operations for a large federal client, ensuring the efficient and resilient...


  • Washington, Washington, D.C., United States NTT DATA Full time

    Job SummaryWe are seeking a highly skilled Data Center Infrastructure Leader to join our team at NTT DATA. As a key member of our data center operations team, you will be responsible for leading and managing data center infrastructure operations for a large federal client.Key ResponsibilitiesLead and manage data center infrastructure operations, ensuring...


  • Washington, Washington, D.C., United States NTT DATA Full time

    Job SummaryWe are seeking a highly skilled Data Center Infrastructure Leader to join our team at NTT DATA. As a key member of our organization, you will be responsible for leading and managing data center infrastructure operations for a large federal client.Key ResponsibilitiesLead and manage data center infrastructure operations, ensuring efficient and...


  • Washington, United States GovCIO Full time

    Overview GovCIO is currently hiring for a Sr. Network Engineer. This position will be located in Washington, D.C. and will be onsite. Responsibilities The successful candidate will function as the SME responsible for the development, implementation, and configuration, of OMC Network Infrastructure across multiple locations operating a broad range of...

Sr. Data Engineer

3 months ago


Washington, United States Pyramid Systems, Inc. Full time

Sr. Data Engineer

Job Locations

US-DC

Job ID

# of Openings

1

Overview

Pyramid Systems is looking for a Data Engineer (Senior) who is passionate about bringing creative architect solutions to end customers.



Responsibilities

  • You'll work with AI team members to operationalize data pipelines and ML tasks
  • You'll provide day-to-day support of deploying Python-native ML pipelines
  • You'll perform data engineering tasks to enable AI/ML capabilities
  • You'll present results to a diverse audience in presentation or report form
  • You'll support architectural leadership, technical support, and advisement services to ensure identity management system technologies are integrated and meeting the appropriate security requirements
  • You'll support leadership who engage with senior level executives at a public facing Federal agency and provide subject matter expertise in security architecture and other key domain areas


Qualifications

  • You have the ability to obtain and maintain DHS Suitability
  • You are a US Citizen
  • Plan, create, and maintain data architectures, ensuring alignment with business requirements.
  • Obtain data, formulate dataset processes, and store optimized data.
  • Experiance in Databricks, PySpark and SQL
  • Identify problems and inefficiencies and apply solutions.
  • Determine tasks where manual participation can be eliminated with automation.
  • "Identify and optimize data bottlenecks, leveraging automation where possible
  • Create and manage data lifecycle policies (retention, backups/restore, etc.)"
  • Create, maintain and manage ETL/ELT pipelines & data transformations
  • Create, maintain and manage data quality gates (Great Expectations) to ensure high data quality
  • Support the AI/ML teams with optimizing feature engineering code
  • Lots and lots of Spark updates
  • Create, maintain and manage Spark Structured Streaming jobs, including using the newer Delta Live Tables and/or DBT
  • Research existing data in the data lake to determine best sources for data
  • Create, manage and maintain ksqlDB and Kafka Streams queries/code
  • Maintain and update Python-based data processing scripts executed on AW Lambdas
  • Unit tests for all our Spark, Python data processing, and Lambda codes
  • Maintain our PCIS Reporting Database data lake with optimizations and maintenance (perf tuning, etc.)

Education

  • Bachelor's degree in Computer Science or related discipline
Why Pyramid?

Pyramid Systems, Inc. is an award-winning, technology leader, driving digital transformation across federal agencies. We empower forward-thinking innovations, accelerate production-ready software, and deliver secure solutions so federal agencies can meet their mission goals. Voted a Top Workplace, both regionally (Washington, DC) and Nationally (USA) the past 2 years (2023 and 2024) based on the feedback from our employees, we are headquartered in Fairfax, VA. and have a growing national footprint. We value and promote our Flexible Workplace approach because of the positive impacts it has on work-life integration. We remain committed to ensuring every employee voice is heard, performance and results are recognized and rewarded, development and advancement is a focus, and diversity, equity and inclusion is a company priority. Our people and its culture have endured and delivered for its clients for nearly three decades.

We offer competitive compensation and benefits (including a recently launched Employee Stock Option Plan - ESOP), a robust performance-based rewards program, and we know how to have fun

Company EEO Statement

Pyramid Systems, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.