Mid-Level Data Ops Engineer
4 weeks ago
This will be working onsite 100% at the Pentagon
Candidates must have an active TS/SCI clearance
Role Description & Requirements
Our data engineers support data collection, ingestion, validation, and loading of optimized data in the appropriate data stores
They work on a team made up of analyst(s), developer(s), data scientist(s), and a product lead and everyone on the team collaborates in support of a specific the mission
Working directly with the analyst(s) and the product lead, the data engineer identifies and implements solutions for the data requirements, including building pipelines to collect data from disparate, external sources, implementing rules to validate that expected data is received, cleansed, transformed, massaged and in an optimized output format for the data store
The Data Engineer performs validation and analytics corresponding with client requirements and evolves solutions through automation, optimizing performance with minimal human involvement
As pipelines are executed, the data engineer monitors their status, performance, and troubleshoots issues while working on improvements to ensure the solution is the very best version to address the customer need
As a Mid-Level Data Ops Engineer, this role focuses specifically on the development and maintenance of scalable data stores that supply big data in forms needed for business analysis
The best athlete candidate for this position will be able to apply advanced consulting skills, extensive technical expertise and has full industry knowledge to develop innovative solutions to complex problems
This candidate is able to work without considerable direction and may mentor or supervise other team members
What we’re looking for: • Someone with a solid background developing solutions for high volume, low latency applications and can operate in a fast paced, highly collaborative environment.
• A candidate with distributed computer understanding and experience with SQL, Spark, ETL
• A person who appreciates the opportunity to be independent, creative and challenged
• An individual with a curious mind, passionate about solving problems quickly and bringing innovative ideas to the table
Basic Qualifications:
• 2+ years of experience with Python and SQL
• Experience with connecting to other data systems through APIs, Web Services, SFTP, etc.
• Knowledge of the software development life cycle, testing, and version control
• Experience working with structured, unstructured and/or semi-structured data
• Experience working with data science projects and integrating AI workflows Additional Qualifications:
• Experience with event-driven micro-service architectures
• Experience with distributed programming languages and paradigms such as Spark, Scala, etc.
• Experience with data engineering tools such as Databricks, ElasticSearch, Apache NiFi, StreamSets, etc.
• Experience with data lakes, data warehouses, and/or data lake houses
• Experience with different database paradigms including but not limited to relational databases (Deltalake, SQL/PostgreSQL/MySQL/etc.), document storage databases (NoSQL, MongoDB, etc.), Graph databases (Neo4J, etc.)
• Experience with cloud services such as AWS S3, Athena, Glue, Lambda, SQS, or Azure Blob, Data Factory, Functions, Storage Queues, etc.
• Experience with data governance and data quality
• Experience with CI/CD, such as Gitlab CI/CD, GitHub Actions, Tekton, Jenkins, Docker, etc.
• Experience with Test Driven Development and Test Frameworks, such as pytest or unittest
• Experience with Data Catalog tools, such as Collibra, Alation, etc.
• Possession of excellent verbal and written communication skills
• Masters degree
-
System Engineer Mid-Level
2 days ago
Washington, United States IC-CAP, LLC Full timeSystem engineer mid level: Position Description: IC-CAP is seeking a motivated product quality SYSTEM ENGINEER to lead the planning, test development, data definition, and task execution for new and existing products within the National System for Geospatial-Intelligence (NSG). The candidate will need to write clear test plans to satisfy the test objective....
-
Merrifield, VA, United States Tanvi IT Full timeMid-Level Pega CDH Data Engineer II Merrifield, VA (Hybrid) 6++ Months Note: Location: Hybrid ONLY to HQ, GPO and San Diego, CA offices. Description: Top 3 Required Skills: Hands-on experience creating automated data pipelines using Pega DataFlow and other modern technology stacks for batch ETL or APIHands-on experience with Pega 8.X, Postgres and...
-
Mid-Level Automation Engineer
4 weeks ago
Washington, United States Sayres and Associates Full timeSayres, a leading provider of defense support services to the DOD, is seeking a skilled MID-LEVEL AUTOMATION ENGINEER with a SECRET clearance, verifiable in DISS in Washington, DC. This position may offer remote and/or hybrid work arrangements based on customer discretion, with limited travel requirements. As a Mid-Level Automation Engineer, you will be...
-
Mid-Level Automation Engineer
4 weeks ago
Washington, United States Sayres & Associates Full timeJob DescriptionJob DescriptionSayres, a leading provider of defense support services to the DOD, is seeking a skilled MID-LEVEL AUTOMATION ENGINEER with a SECRET clearance, verifiable in DISS in Washington, DC. This position may offer remote and/or hybrid work arrangements based on customer discretion, with limited travel requirements.As a Mid-Level...
-
Mid-Level Mechanical Engineer
4 weeks ago
Washington, United States Sayres and Associates Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Mid-Level Systems Engineer
2 weeks ago
Washington, United States Sayres and Associates Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Mid-Level Systems Engineer
2 weeks ago
Washington, United States Sayres and Associates Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Mid-Level Systems Engineer
3 weeks ago
Washington, United States Sayres & Associates Full timeJob DescriptionJob DescriptionSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and...
-
Mid-Level Structural Engineer
1 week ago
Washington, United States Sayres and Associates Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Mid-Level Design Engineer
1 month ago
Washington, United States Sayres & Associates Full timeJob DescriptionJob DescriptionSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and...
-
Mid-Level Structural Engineer
2 weeks ago
Washington, United States Sayres and Associates Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Mid-Level Structural Engineer
4 weeks ago
Washington, United States Sayres & Associates Full timeJob DescriptionJob DescriptionSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and...
-
Mid-Level Marine Engineer
2 weeks ago
Washington, United States Sayres and Associates Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Mid-Level Marine Engineer
1 month ago
Washington, United States Sayres & Associates Full timeJob DescriptionJob DescriptionSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and...
-
Mid-Level Mechanical Engineer
1 month ago
Washington, United States Sayres & Associates Full timeJob DescriptionJob DescriptionSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and...
-
Washington, United States Sayres Defense Full timeSayres, a leading provider of defense support services to the DOD, is seeking a skilled MID-LEVEL AUTOMATION ENGINEER with a SECRET clearance, verifiable in DISS in Washington, DC. This position may offer remote and/or hybrid work arrangements based on customer discretion, with limited travel requirements. As a Mid-Level Automation Engineer, you will be...
-
Engineer - Mid Level with Security Clearance
4 weeks ago
Washington, United States R&P Technologies Full timeR&P is looking for a general engineer, mid-level, who wants to join our DDG-51 Systems Enginering Branch support team in support of the DDG 51 Acquisition Program Office. We are a small-sized defense contractor providing Engineering, Logistics, Program Management and Technical Services to government clients. Responsibilities Support the DDG 51 Acquisition...
-
Washington, United States Sayres Defense Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
-
Direct Mail and Mid-level Specialist
4 weeks ago
Washington, United States Greenpeace USA Full time**ABOUT GREENPEACE**: **Greenpeace** is a global, independent campaigning organization that uses peaceful protest, creative communication and people power to expose global environmental problems and promote solutions that are essential to a green and peaceful future. For more than fifty years, Greenpeace has fought to save the planet from the threats of...
-
Washington, United States Sayres Defense Full timeSayres is a leader in defense support services to the DOD. Our 300+ program support experts empower our customers' senior leadership with long term planning and analytics, insightful decision making, and day-to-day operations. Headquartered in Washington, DC, Sayres has offices in California, Maine, and Alabama. Sayres and Associates has been providing...
