Data Engineer

1 week ago

McLean, United States SRS Consulting Inc Full time

Role: Data Engineer/Data integration WITH DBT

Onsite Mc Lean, VA

Client: EOK TECH/Health care


Relocation Ok


Skills: DBT, Snowflake, Looker, AWS are needed


Need Senior Profiles with Good Exp.

Responsibilities

  • Develop data pipelines for streaming and batch data processing needs to move data in and out of Snowflake data warehouse
  • Collaborate with engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions
  • Develop scripts to Extract, Load and Transform data and other utility functions
  • Hands-on experience with Snowflake, including schema design, query optimization, and data load techniques.
  • Strong experience with DBT, including model development, testing, and documentation.
  • Familiarity with ETL/ELT tools and processes
  • Troubleshoot issues such data load problems, transformation translation problems raised by team members, investigating and providing effective solutions
  • Optimize data pipelines, ETL processes, and data integrations for large-scale data analytics use cases
  • Ensure data quality, integrity, and governance standards are maintained in data processing workflows

Experience

Required Skills:

  • Bachelor's degree in computer science, Information Systems, or related field
  • 7+ years of experience in building and maintaining data pipelines and ETL/ELT processes in data-intensive organizations
  • Design, build, and maintain scalable data pipelines using Snowflake and DBT.
  • Develop and manage ETL processes to ingest data from various sources into Snowflake.
  • Optimize and tune data pipelines for performance and cost efficiency.
  • Able to build data integrations and ingestion pipelines for streaming and batch data
  • Competence in Cloud database systems including 3+ years with Snowflake
  • Hands-on experience with data movement using Snowpipe, Snow SQL, etc.
  • Strong coding skills with Python and SQL for manipulating and analyzing data
  • Knowledge of data governance and data security best practices.
  • Hands-on experience with cloud platforms such as AWS and Google Cloud
  • Other Desired Skills:
  • Minimum 5 years of designing and implementing operational production grade large-scale data pipelines, ETL/ELT and data integration solutions
  • Hands on experience with product ionized data ingestion and processing pipelines
  • Strong understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
  • Proficiency with Kafka, AWS S3, SQS, Lambda, Pub/Sub, AWS DMS, Glue
  • Experience working with structured, semi-structured, and unstructured data

Preferred Skills:

  • Background in healthcare data especially patient centric clinical data and provider data is a plus
  • Familiarity with API security frameworks, token management and user access control including OAuth, JWT etc.,

Bachelor's or master's degree in computer science, Information Systems, or related field

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    3 weeks ago

    McLean, United States AE Strategies Full time

    About Us AE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 day ago

    McLean, United States Praxis Engineering Full time

    Senior Data Engineer The Data Engineer will manipulate data and data flows for both existing and new systems. Additionally, they will provide support in the areas of data extraction, transformation and load (ETL), data mapping, analytics, operations, databases, and maintenance of data and associated systems. As a member of the team, candidate will work in a...

  • Data Engineer

    1 month ago

    McLean, United States Booz Allen Hamilton Full time

    Ever-expanding te chn ology like IoT, machine learning, and artifi cia l intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need a data professional like you to help our...

  • Data Scientist/Data Engineer

    2 days ago

    McLean, United States Cleared Recruiters Full time

    Department: Data Scientist/Engineer Employment Type: Full Time Location: McLean (VA) Description TS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED! We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S. Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve...

  • Data Engineer

    3 weeks ago

    McLean, United States QinetiQ Full time

    Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial...

  • Data Engineer

    4 weeks ago

    McLean, United States Booz Allen Hamilton Full time

    Job Number: R0198743 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need a...

  • Data Engineer

    4 weeks ago

    McLean, United States Booz Allen Hamilton Full time

    Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like...

  • Data Engineer

    1 month ago

    McLean, United States LMI Consulting, LLC Full time

    Data Engineer Job Locations US-Remote | US-Remote | US-VA-Tysons | US-NY-New York Job ID 2023-9995 # of Openings 1 Category Data/Analytics Overview LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions,...

  • Data Engineer

    3 days ago

    McLean, United States Booz Allen Hamilton Full time

    Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data...

  • Data Scientist/Data Engineer

    1 month ago

    McLean, United States Cleared Recruiters Full time

    Job DescriptionJob DescriptionDescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill...

  • Data Engineer

    1 month ago

    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionData EngineerDescriptionMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective...

  • Data Engineer

    3 days ago

    McLean, United States Diamondpick Full time

    Sr. Data Engineer Mclean, VA (Hybrid) 5 to 7yrs Please share your updated resume and Employer details if interested. Required Skills: Python and PySpark and AWS and SQL and Unix Job Summary As a Sr. Data engineer with 5 to 7 years of experience, your expertise in Python, PySpark, AWS, SQL, and Unix will be crucial in optimizing our data infrastructure and...

  • Big Data Engineer

    2 weeks ago

    McLean, United States ConsultNet Full time

    Senior Data Engineer Remote- must work standard EST hours Long term contract/ contract to hire Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving,...

  • Big Data Engineer

    2 weeks ago

    McLean, United States ConsultNet Full time

    Senior Data Engineer Remote- must work standard EST hours Long term contract/ contract to hire Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving,...

  • Data Scientist/Data Engineer

    1 month ago

    McLean, United States Cleared Recruiters Full time

    DescriptionTS/SCI FULL-SCOPE SECURITY CLEARANCE REQUIRED!We are seeking Mission Driven data engineers to join our team supporting one of the most valuable U.S.Government customers. You will be responsible for preparing, maintaining, and improving data pipelines to solve our customers’ hardest mission problems. As a Cyberhill Engineer, you and your team...

  • Data Engineer

    2 weeks ago

    McLean, United States Diamondpick Full time

    Sr. Data EngineerMclean, VA (Hybrid)5 to 7yrsPlease share your updated resume and Employer details if interested.Required Skills: Python and PySpark and AWS and SQL and Unix Job SummaryAs a Sr. Data engineer with 5 to 7 years of experience, your expertise in Python, PySpark, AWS, SQL, and Unix will be crucial in optimizing our data infrastructure and...

  • Data Engineer

    2 weeks ago

    McLean, United States Diamondpick Full time

    Sr. Data Engineer Mclean, VA (Hybrid) 5 to 7yrs Please share your updated resume and Employer details if interested. Required Skills: Python and PySpark and AWS and SQL and Unix Job Summary As a Sr. Data engineer with 5 to 7 years of experience, your expertise in Python, PySpark, AWS, SQL, and Unix will be crucial in optimizing our data infrastructure and...

  • Data Engineer

    1 week ago

    McLean, United States SRS Consulting Inc Full time

    Role: Data Engineer/Data integration WITH DBTOnsite Mc Lean, VAClient: EOK TECH/Health care Relocation OkSkills: DBT, Snowflake, Looker, AWS are neededNeed Senior Profiles with Good Exp. ResponsibilitiesDevelop data pipelines for streaming and batch data processing needs to move data in and out of Snowflake data warehouseCollaborate with engineering and...