Data Engineer

1 month ago

Ashburn, United States Infinitive Full time

*Candidates must be local to the Washington D.C. metro area.

About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.

Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.

Responsibilities:

Data Architecture and Design:

  • Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
  • Develop data models and schema designs to optimize data storage and retrieval.

ETL Development:

  • Implement ETL processes to extract, transform, and load data from various sources.
  • Ensure data quality, integrity, and consistency throughout the ETL pipeline.

Python and PySpark Development:

  • Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
  • Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices.

Data Integration:

  • Integrate data from different systems and sources to provide a unified view for analytical purposes.
  • Collaborate with data scientists and analysts to implement solutions that meet their data integration needs.

Streaming and Batch Workflows:

  • Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
  • Develop batch processing workflows for large-scale data processing and analysis.

CI/CD Implementation:

  • Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines using Jenkins or GitHub Actions.
  • Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing.
  • Hands-on experience with ETL tools and processes.
  • Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
  • Solid understanding of data modeling, database design, and data warehousing concepts.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Preferred Skills:

  • Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience with version control systems (e.g., Git).
  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Understanding of data security and privacy best practices.

Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is an Equal Opportunity Employer.

  • Senior Project Engineer, NA

    6 days ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • Senior Network Engineer

    4 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data CentersVantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience.Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large...

  • Senior Network Engineer

    4 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data CentersVantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience.Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large...

  • Senior Network Engineer

    6 days ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one anothers experience. Vantage Data Centers powers, cools, protects and connects the technology of the worlds well-known hyperscalers, cloud providers and large...

  • Data Engineer

    1 week ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    1 week ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 days ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Senior Project Engineer, NA

    4 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    Description Vantage is looking for an ambitious and self-starting Senior Project Engineer to drive core project coordination efforts across a wide spectrum of ongoing construction projects. Daily tasks include submittal/RFI workflow management, change order management, design coordination, project closeout management, payment application reviews,...

  • SDP QA Engineer

    22 hours ago

    Ashburn, United States QTS Data Centers Full time

    Learn what makes QTS a unique place to grow your career! As a Quality Assurance (QA) Engineer, you’ll manage the platform testing requirements, test plans, and execution related to development and change events for all Service Delivery Platform (SDP) modules and applications. This includes unit, functional, regression, smoke, penetration testing of all SDP...

  • Data Engineer

    1 month ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Inc Full time

    Job DescriptionJob Description*Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Inc Full time

    Job DescriptionJob Description*Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new...

  • Data Engineer

    1 month ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Regional Safety Engineer, Data Center Health Safety DCC Communities

    7 hours ago

    Ashburn, Virginia, USA, United States Amazon Data Services, Inc. Full time

    About AWSAmazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Join the world class safety culture...

  • Senior Director, Site Operations, NA

    3 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • Data Centre Network Engineer- Onsite

    4 weeks ago

    Ashburn, United States Cognizant Full time

    Role: Data Centre Network Engineer Location: Ashburn, Virginia Roles & Responsibilities: This position will work in a Network Lab managing different equipment deployed in the Visa Network environment. The candidate will perform various functions listed below to keep the operations of the Lab at optimum performance while supporting senior test...

  • Category Sourcing Manager

    2 days ago

    Ashburn, United States QTS Data Centers Full time

    Our life is a digital life, filled with streams of information flowing ceaselessly. Every click, every swipe, every interaction connects us. But where does all that information go? Enter the world of data centers. In the fast-paced world of data, QTS is dedicated to leading the industry in a thoughtful and intentional way. We believe that how we deliver...

  • Data Center Technician

    4 weeks ago

    Ashburn, United States VortalSoft Usa Full time

    **Role - Data Center technician (Customer Engineer)** **Location -Ashburn, VA** We are looking for 5 self-motivated, dedicated individuals who are ready to put their technical skills to work in a fast-paced, customer-focused environment. Utilizing their technical knowledge, they will have the responsibility of responding to customer calls in a timely and...

  • Data Scientist with Security Clearance

    4 weeks ago

    Ashburn, United States Go Epic Solutions Full time

    The Data Scientist will provide support for the Customer’s machine learning model development and deployment efforts specific to its cyber focus and targets. Additionally, they will need to have extensive experience with developing and implementing machine learning methodologies to triage large commercial cyber datasets. The Data Scientist will implement...

  • Engineer

    7 days ago

    Ashburn, United States Orion Talent Full time

    Description Position Details: Title: Engineer I and II Location: Ashburn, VA Shift: 1st, 2nd, and 3rd Shift available (4 10's schedule). Candidates should have flexibility for at least 2 shifts. Compensation: Engineer I $35-$36/hour + OT + 10% bonus | Engineer II $37-$40/hour + OT + 10% bonus Benefits: Medical, Dental, Vision insurance / 401(K) / Holidays +...