Data Engineer(Cloud/AWS, API, and ETL Pipeline Experience)
2 days ago
Data Engineer (Cloud/AWS, API, and ETL Pipeline Experience)
Data Engineer (Cloud/AWS, API, and ETL Pipeline Experience)Apply locations: USA DC Washington
Time type: Full time
Posted on: Posted 30+ Days Ago
Job requisition id: RQ184518
Type of Requisition: Regular
Clearance Level Must Currently Possess: Top Secret/SCI
Clearance Level Must Be Able to Obtain: Top Secret/SCI
Public Trust/Other Required: None
Job Family: Systems Engineering
Job Qualifications:
Skills: AWS Cloud Computing, Programming Languages, Systems Design
Certifications: None
Experience: 5+ years of related experience
US Citizenship Required: Yes
Job Description:
As a Data Engineer, you will be required to interpret business needs and select appropriate technologies and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and optimize data pipelines as workloads move from development to production for specific use cases to ensure seamless data flow for the use case. You will perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics. You will analyze data and systems architecture, create designs, and implement information systems solutions.Qualifications :
- Understanding of cloud architectures and enabling tools and technologies, such as AWS Cloud (GovCloud/C2S).
- Familiar with Amazon Web Managed Services (AWS).
- Working knowledge with software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
- Proficient experience utilizing JavaScript, Elasticsearch, JSON, SQL, XML.
- Working knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis.
- Familiar with Linux/Unix server environments.
- Experience with Agile development methodology.
- Publishing and/or presenting design reports
- Coordinating with other team members to reach project milestones and deadlines
- Working knowledge with Collaboration tools, such as Jira and Confluence.
Preferred Qualifications :
- Familiarity and experience with the Intelligence Community (IC), and the intel cycle.
- Familiarity and experience with the Department of Homeland Security (DHS).
- Direct Experience with DHS and Intelligence Community (IC) component's data architectures and environments (IC-GovCloud experience preferred).
- Experience with cloud message APIs and usage of push notifications.
- Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security.
- Working knowledge with public keys and digital certificates.
- Experience with DevOps environments.
- Expertise in various COTS, GOTS, and open source tools which support development of data integration and visualization applications.
- Experience with cloud message APIs and usage of push notifications.
- Specialization in Object Oriented Programming languages, scripting, and databases.
Responsibilities :
- Define and communicate a clear product vision for our client’s software products, aligning with user needs and business objectives.
- Create and manage product roadmaps that reflect both innovation and growth strategies.
- Partner with a government product owner and a product team of 7-8 FTEs.
- Develop and design data pipelines to support an end-to-end solution.
- Develop and maintain artifacts (e.g., schemas, data dictionaries, and transforms related to ETL processes).
- Integrate data pipelines with AWS cloud services to extract meaningful insights.
- Manage production data within multiple datasets ensuring fault tolerance and redundancy.
- Design and develop robust and functional dataflows to support raw data and expected data.
- Provide Tier 3 technical support for deployed applications and dataflows.
- Collaborate with the rest of the data engineering team to design and launch new features.
- Coordinate and document dataflows, capabilities, etc.
- Occasionally (as needed) support to off-hours deployment such as evening or weekends.
Minimum Requirements:
- 5+ years of experience
- TS-SCI clearance required
- Bachelor’s degree or equivalent practical experience.
- Master’s degree or equivalent experience in a related field.
Skills:
- Stakeholder Management
- ETL
- Data Pipelines
- Effective Team Communication
- Product Management
- Data Engineering
- Data Management
- Master Data Management
- Agile
- Intelligence Community
- Client Engagement
-
Data Engineer – API Integration
3 days ago
Chicago, IL, United States Wavicle Data Solutions Full timeAbout the Role We are looking for a Data Engineer who will provide support to the Data and Application Integration Team by developing and communicating middleware-based integration architecture, strategies, guidelines, standards, and leading practices. The ideal candidate will also be expected to provide support on technical and architectural direction,...
-
Cloud Data Engineer
3 days ago
San Francisco, CA, United States Unreal Gigs Full timeAre you passionate about building and optimizing data pipelines that drive data-driven decision-making in cloud environments? Do you have the technical expertise to design robust data architectures that manage large-scale data processing and ensure seamless data flow? If you’re ready to harness the power of cloud technology to create scalable data...
-
Senior Data Engineer
2 weeks ago
Chicago, IL, United States Collabera Full timeJob Title: Senior Data Engineer (ETL/ELT, Informatica IICS) Scroll down the page to see all associated job requirements, and any responsibilities successful candidates can expect. Location: Chicago, IL 60606 (Hybrid Role) Duration: 6+ Months Contract Role + Extension Pay Range: $60/hr to $75/hr Job Description: Data Engineerirg with good Data pipeline...
-
Washington, Washington, D.C., United States General Dynamics Information Technology Full timeGeneral Dynamics Information Technology is a global technology and professional services company that delivers consulting, technology and mission services to every major agency across the U.S. government, defense and intelligence community.We are seeking a Cloud Data Engineer with advanced experience in designing, developing, and implementing data pipelines...
-
Sr. Data Engineer
1 month ago
Chicago, IL, United States The Judge Group Full timeIdeal Skill SetData Engineering with good Data pipelines development experienceGood Experience in Informatica IDMCVery good Python and SQL programmingGood knowledge of AWS technologies.Kafka Data Streaming and API experience PURPOSE:The Senior Data Engineer will design, code, test, and analyze software programs and applications. This includes researching,...
-
AWS Data Engineer
4 weeks ago
Charlotte, NC, United States Brooksource Full timeLocationCharlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...
-
ETL Tester
4 weeks ago
Milwaukee, WI, United States Compunnel Inc. Full timeRole: - ETL TesterLocation:- Milwaukee WIETL Tester:As an ETL Test Engineer, you will be responsible for both manual and automated testing to validate data sources, extract data, apply transformation logic, and load data into target tables. You'll work closely with data engineering teams to ensure a sustainable testing approach. Key responsibilities...
-
ETL Tester
1 month ago
Milwaukee, WI, United States Quantum World Technologies Inc. Full timeAs an ETL Test Engineer, you will be responsible for both manual and automated testing to validate data sources, extract data, apply transformation logic, and load data into target tables. You'll work closely with data engineering teams to ensure a sustainable testing approach. Key responsibilities include:Testing data validation scenarios, data ingestion,...
-
AWS Cloud Engineer
4 weeks ago
Arlington, VA, United States ALTA IT Services Full timeCloud Engineer (AWS) Find out more about this role by reading the information below, then apply to be considered. Rosslyn, VA - hybrid (1-2 days a week onsite) Active Secret clearance is required Job Description: Support the design, implementation, and maintenance of the cloud infrastructure for an AWS-based data and API platform. Assist in deploying and...
-
Data Engineer
1 month ago
Kent, WA, United States Robert Half Full timeRobert Half Technology is looking for a Data Developer for a local Public Safety client based in Kent, Washington! This position is primarily remote but can be worked hybrid if local to the office site. This is a 4–6-month contract, with the possibility of extension. Location: Kent, Washington (candidate must reside in the state of Washington)Employment...
-
Data Engineer
1 month ago
Raleigh, NC, United States InterEx Group Full timeJob SummaryWe are seeking a skilled and motivated Data Engineer to join a Specialty Insurance Firm. In this role, you will be responsible for building, maintaining, and optimizing the data infrastructure and pipelines to support advanced analytics, risk modeling, and data-driven decision-makingKey ResponsibilitiesData Pipeline Development: Design, build, and...
-
Big Data Engineer
3 days ago
San Francisco, CA, United States Unreal Gigs Full timeAre you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you. We’re seeking a...
-
Big Data Engineer
2 days ago
San Francisco, CA, United States ZipRecruiter Full timeJob Description Are you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you....
-
Data Engineering Manager for Cloud Services
7 days ago
Washington, United States Working America Associa Full timeWe are seeking a seasoned Data Engineering Manager to lead our team of data engineers in the design, development, and maintenance of robust data pipelines and infrastructure. With at least 7 years of experience in data engineering and management, you will be responsible for overseeing quality control processes, mentoring team members, and collaborating with...
-
ETL Data Engineer
2 months ago
Washington, United States Serigor Inc Full timeJob Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...
-
ETL Data Engineer
2 months ago
washington, United States Serigor Inc Full timeJob Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...
-
Cloud Data Architect
1 week ago
Washington, Washington, D.C., United States Inclusion Cloud Full timeAbout the JobWe are seeking a highly skilled Azure Data Architect to join our Artificial Intelligence and Analytics team at Inclusion Cloud.This is a greenfield opportunity to design and implement AI and Analytics applications in the ERP and Work Management space.The Azure Data Architect will be responsible for designing and implementing Big Data and BI...
-
AWS Data Architect
4 weeks ago
Woodland, CA, United States New York Technology Partners Full timeRole : AWS Data Architect Duration : Long Term Contact Location : Woodland Hills, CA HybridMust-havesStep Function, EMR and ICEBERG. 2/3Responsibilities • Designing and Implementing Data Solutions: Create blueprints for data storage, processing, and access using AWS services like S3, Glue, EMR, Kinesis by considering factors like performance, scalability,...
-
Cloud Engineer
1 month ago
Irvine, CA, United States Insight Global Full timeRequired Skills & Experience:7+ years of experience cloud-native architecture and design, with a strong background in cloud environments such as AWS, Google Cloud, or Azure.Extensive experience with Kubernetes with a deep understanding of Kubernetes principles, custom resource definitions, and the broader Kubernetes ecosystem.Experience with Terraform...
-
ETL Informatica Developer
2 days ago
Washington, DC, United States Vied Technologies, Inc. Full timeIncorporated in 2006; Headquartered in Chantilly, VA. Viedtech has established itself globally with its services and solution excellence. Viedtech offers fast, reliable, cost effective and value added IT and Staffing Services. We constantly strive hard to refine our quality, expand our capabilities, increase our efficiency, and elevate the superior level of...