Data Engineer

3 weeks ago


McLean, United States Diverse Lynx Full time

Job details:- Data Engineer & ETL/Pyspark Developer

PySpark Developer (ETL) / Data Engineers:

Contact

expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clientsY

Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions

Implement ETL processes to extract, transform, and load data from various sources

Ensure data quality, integrity, and consistency throughout the ETL pipelines

Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts

Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices

Integrate data from different systems and sources to provide a unified view for analytical purposes

Collaborate with data analysts to implement solutions that meet their data integration needs

Design and implement streaming workflows using PySpark Streaming or other relevant technologies

Develop batch processing workflows for large-scale data processing and analysi

Must have:

Python, Spark, Data Processing experience, SQL, AWS, Snowflake

Good to have:

Java

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

#J-18808-Ljbffr


  • Data Engineer

    3 weeks ago


    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    3 weeks ago


    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    3 weeks ago


    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 week ago


    McLean, United States Tandym Group Full time

    An education tech services company in Virginia is currently seeking a new Data Engineer for a promising opportunity with their growing staff. In this role, the Data Engineer will be responsible for the design, structure, and maintenance of data. ***This is a Hybrid opportunity requiring the qualified professional to work onsite at least 2 days a week.*** ...

  • Data Engineer

    1 week ago


    McLean, United States Sky Solutions LLC Full time

    Join Sky Solutions, LLC - Pioneering Digital Transformation Excellence! Welcome to Sky Solutions, LLC, a dynamic Digital Transformation Firm nestled in the vibrant heart of the Washington D.C. Metro Area. We specialize in empowering leading organizations in the Financial Services and Healthcare sectors, achieving remarkable business outcomes through...


  • McLean, United States Cleared Recruiters Full time

    Job DescriptionJob DescriptionDescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill...

  • Data Engineer

    3 weeks ago


    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionData EngineerDescriptionMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective...

  • Data Engineer

    7 days ago


    McLean, United States Mindlance Full time

    Software Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data. Must have 4+ years of developing data centric application using Spark/Scala or Python running on EMR or AWS Glue. Must have data pipeline orchestration experience using...

  • Data Engineer

    6 days ago


    McLean, United States Mindlance Full time

    Software Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data. Must have 4+ years of developing data centric application using Spark/Scala or Python running on EMR or AWS Glue. Must have data pipeline orchestration experience using...

  • Data Engineer

    1 week ago


    McLean, United States Mindlance Full time

    Software Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data. Must have 4+ years of developing data centric application using Spark/Scala or Python running on EMR or AWS Glue. Must have data pipeline orchestration experience using...


  • McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...


  • McLean, United States Somatus Full time

    Overview The Director, Data Engineer will be responsible for developing, executing, and implementing data strategy, including delivering solutions involving data integration, data governance and performance optimization. This position will report to the SVP of Technology. This position requires you to be on site at our HQ in Mclean,...


  • McLean, United States Resource Informatics Group Inc Full time

    Job DescriptionJob Description Data Engineer - Mclean VA + Remote Position Technical ResponsibilitiesThe Sr. Data Engineer's mission will be to guide this platform’s development so that it becomes the engine of a healthcare-wide transition to value-based care by enabling effective data sharing, analytics, performance transparency, and value-based...

  • Jr. Data Engineer

    1 week ago


    McLean, United States Somatus Full time

    Overview The Jr. Data Engineer position will work collaboratively with the technology team to support our clinical, operational, and finance teams to integrate data from diverse sources for consumption by internal and external stakeholders. This role will require you to be on-site at our HQ in McLean, VA. Responsibilities Collaborate with solution &...

  • Data Engineer

    1 week ago


    McLean, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive: Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 weeks ago


    McLean, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and...

  • Data Engineer

    4 weeks ago


    McLean, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and...


  • McLean, United States US Tech Solutions Full time

    *Job Title: Data Protection Engineer *Location: McLean, VA (22102) *Duration: 12 months contract, Full-Time * Employment Type: W-2 Job Description: · Experience in database and folder level security (encryption and data...


  • McLean, United States Hexaware Technologies Full time

    We are looking for a strong Data Engineer with skills as listed below:Must have: Java, AWS, Data Processing experience, SQL Good to have: Experienced ETL with PySpark, EMR and hands on working on AWS services.


  • McLean, United States Hexaware Technologies Full time

    We are looking for a strong Data Engineer with skills as listed below:Must have: Java, AWS, Data Processing experience, SQL Good to have: Experienced ETL with PySpark, EMR and hands on working on AWS services.