Data Engineer

3 weeks ago

McLean, United States Infinitive Full time

*Candidates must be local to the Washington D.C. metro area.


About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.

Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post “Top Workplace”, Washington

Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”


We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.


Responsibilities:

Data Architecture and Design:

  • Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
  • Develop data models and schema designs to optimize data storage and retrieval.

ETL Development:

  • Implement ETL processes to extract, transform, and load data from various sources.
  • Ensure data quality, integrity, and consistency throughout the ETL pipeline.

Python and PySpark Development:

  • Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
  • Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices.

Data Integration:

  • Integrate data from different systems and sources to provide a unified view for analytical purposes.
  • Collaborate with data scientists and analysts to implement solutions that meet their data integration needs.

Streaming and Batch Workflows:

  • Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
  • Develop batch processing workflows for large-scale data processing and analysis.

CI/CD Implementation:

  • Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines using Jenkins or GitHub Actions.
  • Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing.
  • Hands-on experience with ETL tools and processes.
  • Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
  • Solid understanding of data modeling, database design, and data warehousing concepts.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.


Preferred Skills:

  • Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience with version control systems (e.g., Git).
  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Understanding of data security and privacy best practices.


Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa. Infinitive is an Equal Opportunity Employer.

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    2 days ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 day ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Scientist/Data Engineer

    1 month ago

    McLean, United States Cleared Recruiters Full time

    Job DescriptionJob DescriptionDescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill...

  • Data Scientist/Data Engineer

    1 day ago

    McLean, United States Cleared Recruiters Full time

    Job DescriptionJob DescriptionDescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill...

  • Data Engineer

    1 month ago

    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionData EngineerDescriptionMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective...

  • Data Engineer

    1 day ago

    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionData EngineerDescriptionMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective...

  • Data Scientist/Data Engineer

    1 month ago

    McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...

  • Data Scientist/Data Engineer

    2 days ago

    McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...

  • Wireless Data Engineer

    1 week ago

    McLean, United States Foxhound Federal Full time

    Benefits:401(k)Competitive salaryDental insuranceFlexible scheduleHealth insurancePaid time offVision insuranceJoin our dynamic team at DGS, a cutting-edge data solutions company, for wireless networks, where innovation meets excellence in the realm of Radio Frequency (RF) awareness and environmental monitoring technologies. We are seeking a qualified...

  • Remote - Data Engineer

    1 month ago

    McLean, United States Resource Informatics Group Inc Full time

    Job DescriptionJob Description Data Engineer - Mclean VA + Remote Position Technical ResponsibilitiesThe Sr. Data Engineer's mission will be to guide this platform’s development so that it becomes the engine of a healthcare-wide transition to value-based care by enabling effective data sharing, analytics, performance transparency, and value-based...

  • Remote - Data Engineer

    1 day ago

    McLean, United States Resource Informatics Group Inc Full time

    Job DescriptionJob Description Data Engineer - Mclean VA + Remote Position Technical ResponsibilitiesThe Sr. Data Engineer's mission will be to guide this platform’s development so that it becomes the engine of a healthcare-wide transition to value-based care by enabling effective data sharing, analytics, performance transparency, and value-based...

  • Data Exploit Engineer

    2 weeks ago

    McLean, United States The Swift Group Full time

    Job DescriptionJob DescriptionThe Swift Group is looking for a Data Exploit Engineer who use an array of skills to interface with end-users and the Development team. An ideal candidate will have significant data engineering technical capabilities, as well as intelligence analysis skills (analytical methodology and practice; writing and production; briefing;...

  • Data Exploit Engineer

    1 day ago

    McLean, United States The Swift Group Full time

    Job DescriptionJob DescriptionThe Swift Group is looking for a Data Exploit Engineer who use an array of skills to interface with end-users and the Development team. An ideal candidate will have significant data engineering technical capabilities, as well as intelligence analysis skills (analytical methodology and practice; writing and production; briefing;...

  • Cloud engineer

    2 weeks ago

    McLean, United States LanceSoft Full time

    Location: Mclean, VA (Hybrid) Duration: 6 months with possible extension Job Description Must have : spark, python, scala and aws (glue & lambda, s3 , IAM) Design and develop scalable data architectures and systems that extract, store, and process large amounts of data. Develop and architect scalable data pipelines and ETL processes using programming...

  • Wireless Data Engineer

    3 weeks ago

    McLean, United States DGS Full time

    Job DescriptionJob DescriptionWireless Data Engineer:We are seeking a Wireless Data Engineer who will play a pivotal role in designing, developing, and maintaining globally distributed data architectures to support the efficient processing and analysis of large-scale network data. They will accelerate all aspects of data processing, from ingestion to storage...

  • Wireless Data Engineer

    1 day ago

    McLean, United States DGS Full time

    Job DescriptionJob DescriptionWireless Data Engineer:We are seeking a Wireless Data Engineer who will play a pivotal role in designing, developing, and maintaining globally distributed data architectures to support the efficient processing and analysis of large-scale network data. They will accelerate all aspects of data processing, from ingestion to storage...

  • Senior Data Engineer

    7 days ago

    McLean, United States Prosum Full time

    This position requires active TS/SCI with Full Scope PolygraphLocated in Herndon or McLean, VABasic Qualifications: • 10-14 years of experience in data engineering • Demonstrated experience in Extract, Transform, and Load (ETL) data engineering • Demonstrated experience with REST APIs • Demonstrated experience with Java Desired skills: •...