Data Engineer

1 week ago

Ashburn, United States Infinitive Inc Full time
Job DescriptionJob Description

*Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa.

About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment. Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”

Job Summary:

We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and be proficient in using Logstash and Databricks for data processing and analytics. This role is critical in helping us manage and optimize our clients data pipelines, ensuring the availability, reliability, and performance of our data infrastructure.

Responsibilities:

  • Design, develop, and maintain data pipelines using Logstash and Databricks to ingest, process, and transform data from various sources.
  • Collaborate with data scientists and analysts to understand their data requirements and ensure the data engineering infrastructure can support their needs.
  • Optimize data pipelines for efficiency, scalability, and performance to meet business objectives.
  • Troubleshoot and resolve issues related to data processing and pipeline failures.
  • Ensure data security and compliance with relevant data protection regulations.
  • Document data engineering processes and procedures for future reference and knowledge sharing.
  • Stay up-to-date with the latest trends and best practices in data engineering and cloud-based data processing technologies.

Requirements:

  • Bachelor's degree in computer science, information technology, or a related field. A master's degree is a plus.
  • Proven experience as a data engineer with a focus on data processing and integration.
  • Strong knowledge and hands-on experience with Elasticsearch.
  • Proficiency in Databricks for data analytics, ETL, and data engineering.
  • Familiarity with big data technologies such as Apache Spark is a plus.
  • Solid understanding of data warehousing concepts and relational databases.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Knowledge of data modeling and data warehouse design principles.
  • Excellent problem-solving and debugging skills.
  • Strong teamwork and communication skills to collaborate effectively with cross-functional teams.

Preferred Qualifications:

  • AWS Certified Data Analytics - Specialty or relevant certifications.
  • Experience working with data streaming technologies like Apache Kafka or Amazon Kinesis.
  • Knowledge of DevOps practices for CI/CD pipelines.
  • Familiarity with data governance and data quality best practices.
  • Experience with version control systems like Git.

Infinitive is an Equal Opportunity Employer.

Powered by JazzHR

FljeOlgII4

  • Data Center Engineering Operations Tech, DCC Communities

    6 days ago

    Ashburn, United States Amazon Data Services, Inc. Full time

    At Amazon, we're working to be the most customer-centric company on earth. To get there, we need exceptionally talented, bright, and driven people. If you'd like to help us build the place to find and buy anything online, this is your chance to make history.This position serves as a technical resource to support Amazon.com within its owned and operated data...

  • Regional Safety Engineer, Data Center Health Safety DCC Communities

    1 week ago

    Ashburn, Virginia, United States Amazon Data Services, Inc. Full time

    About AWSAmazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Join the world class safety culture at...

  • Data Center Technician L1

    4 weeks ago

    Ashburn, United States NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Center Technician L1

    3 weeks ago

    Ashburn, United States NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • HVAC | Critical Facilities | Data Center

    3 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud...

  • Azure Data Engineer

    1 month ago

    Ashburn, United States teamworkonline Full time

    Job Title: Azure Data Engineer / Azure Cloud Data EngineerOverview:   We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database...

  • Azure Data Engineer

    3 weeks ago

    Ashburn, United States teamworkonline Full time

    Job Title: Azure Data Engineer / Azure Cloud Data EngineerOverview:   We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database...

  • Azure Data Engineer

    1 month ago

    Ashburn, Virginia, United States teamworkonline Full time

    Job Title: Azure Data Engineer / Azure Cloud Data EngineerOverview: We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database...

  • Azure Data Engineer

    4 weeks ago

    Ashburn, Virginia, United States teamworkonline Full time

    Job Title: Azure Data Engineer / Azure Cloud Data EngineerOverview: We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database...

  • IT Construction Engineer, NA

    1 week ago

    Ashburn, Virginia, United States Vantage Data Centers Full time

    Join our Team at Vantage Data CentersVantage Data Centers is dedicated to fostering an inclusive and diverse workplace culture where respect, equity, and acceptance thrive. Our company celebrates the uniqueness of each individual and values learning from diverse experiences.Discover Vantage Data Centers:Powering, cooling, protecting, and connecting...

  • DCEO Chief Engineer 4

    4 weeks ago

    Ashburn, United States Amazon Data Services, Inc. Full time

    Amazon is looking for an energetic, detail-oriented individual to join our Data Center Engineering Operations Team. This committed group works to maintain the critical physical infrastructure that supports Amazon Web Services. Specifically, this team works to ensure that the data center's MEP operates at 100% availability while maintaining first-class...

  • DCEO Chief Engineer 4

    3 weeks ago

    Ashburn, United States Amazon Data Services, Inc. Full time

    Amazon is looking for an energetic, detail-oriented individual to join our Data Center Engineering Operations Team. This committed group works to maintain the critical physical infrastructure that supports Amazon Web Services. Specifically, this team works to ensure that the data center's MEP operates at 100% availability while maintaining first-class...

  • DevOps Engineer, Global

    4 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • SME Data Engineer

    2 weeks ago

    Ashburn, United States CMCI Full time

    Job Description SME Data Engineer Location: Ashburn, VA Why CMCI? CMCI provides management consulting and IT services that empower enterprises to achieve their business goals in today's highly competitive market. Our goal is to seamlessly integrate into each customer's organization to fully understand their business and technology needs. This approach...

  • Data QA Engineer

    2 weeks ago

    Ashburn, United States Urbane Systems Full time

    Role: Data QA EngineerLocation: Ashburn, VA (Hybrid role)Duration: Long TermKeywords: DataQA, Data Quality, SQL (Should be Very Strong in SQL), HL7, DICOM, Health InformaticsWe're in search of a Data QA Engineer with a meticulous eye for detail and a penchant for analytical thinking to join our team. In this role, you'll play a pivotal part in ensuring the...

  • Data QA Engineer

    2 weeks ago

    Ashburn, United States Urbane Systems Full time

    Role: Data QA EngineerLocation: Ashburn, VA (Hybrid role)Duration: Long TermKeywords: DataQA, Data Quality, SQL (Should be Very Strong in SQL), HL7, DICOM, Health InformaticsWe're in search of a Data QA Engineer with a meticulous eye for detail and a penchant for analytical thinking to join our team. In this role, you'll play a pivotal part in ensuring the...

  • Data Engineer

    2 months ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and...