Data Engineer

2 weeks ago

Washington DC United States Addison Group Full time

We are focused on leveraging technology to drive data insights and innovation. We are seeking a skilled Data Engineer with experience in Google Cloud Platform (GCP), SQL, and ETL processes to join our growing data team. This role offers the opportunity to work on cutting-edge cloud-based solutions, build scalable data pipelines, and contribute to impactful data-driven projects.

As a Data Engineer, you will be responsible for designing, building, and maintaining efficient data pipelines and ETL processes on Google Cloud Platform. You will work closely with data analysts, data scientists, and software engineers to ensure the availability, quality, and integrity of data for reporting and analytics. Your expertise in SQL and GCP services will play a key role in transforming raw data into valuable insights that support strategic decision-making.

Key Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain scalable ETL pipelines to ingest, process, and store large volumes of structured and unstructured data from multiple sources.
  • Google Cloud Platform (GCP) Expertise: Utilize GCP services such as BigQuery, Cloud Storage, Dataflow, and Pub/Sub to build, optimize, and manage cloud-based data infrastructure.
  • SQL Querying: Write and optimize complex SQL queries for data extraction, manipulation, and reporting to ensure efficient access to data across different systems.
  • Data Integration: Collaborate with cross-functional teams to integrate data from diverse sources including APIs, databases, and external platforms into a unified data warehouse.
  • Data Warehousing: Implement and manage cloud-based data warehousing solutions using Google BigQuery or similar platforms to store and organize large datasets for easy accessibility.
  • Data Quality and Governance: Ensure data accuracy, consistency, and security through the implementation of data quality checks, monitoring, and governance practices.
  • Performance Tuning: Optimize database performance by analyzing and tuning SQL queries, ETL processes, and data pipeline workflows for efficiency and scalability.
  • Automation: Develop automated data workflows and monitoring systems to ensure timely data availability and minimize manual intervention.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements, provide insights, and enable data-driven decision-making.
  • Documentation: Create and maintain comprehensive documentation for data pipelines, ETL processes, and database structures to ensure team alignment and knowledge sharing.

Qualifications:

  • Education: Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field. Master’s degree is a plus.
  • Experience:
  • 3+ years of experience as a Data Engineer or similar role, working with data pipelines, ETL processes, and cloud technologies.
  • Hands-on experience with Google Cloud Platform (GCP) services such as BigQueryDataflowCloud Storage, and Pub/Sub
  • Proficiency in writing complex SQL queries and optimizing them for large datasets.
  • Experience with ETL tools and processes to transform and integrate data from multiple sources.
  • Strong understanding of data warehousing concepts, database design, and data modeling.
  • Technical Skills:
  • Advanced knowledge of SQL for querying, analyzing, and manipulating data.
  • Experience with PythonJava, or other programming languages for data processing tasks is a plus.
  • Familiarity with GCP’s IAM policiesdata security, and cost management
  • Experience with Airflow or other orchestration tools to automate workflows.
  • Strong understanding of ETL frameworksdata lakes, and data warehousing solutions.
  • Knowledge of version control systems like Git and CI/CD pipelines.
  • Soft Skills:
  • Strong analytical and problem-solving skills with the ability to work with complex data sets.
  • Excellent verbal and written communication skills, with the ability to collaborate effectively with both technical and non-technical stakeholders.
  • Detail-oriented with a focus on data accuracy and quality.
  • Ability to work independently and in a collaborative team environment.

Preferred Qualifications:

  • Experience with Apache SparkDataproc, or other distributed data processing frameworks.
  • Familiarity with NoSQL databases such as Firestore or MongoDB.
  • Certifications in Google Cloud Platform (e.g., Google Professional Data Engineer).
  • Experience with machine learning pipelines and data science workflows

  • Data Engineer

    4 weeks ago

    Washington, DC, United States Booz Allen Full time

    Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a Data Engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced data...

  • Data Scientist

    4 weeks ago

    Washington, Washington, D.C., United States Data Society Full time

    Job DescriptionWe are seeking a highly skilled Data Scientist to join our team at Data Society Group. As a Data Scientist, you will be responsible for combining your expert knowledge in statistical analysis, data mining, data engineering, and artificial intelligence to build complex end-to-end business analytics, artificial intelligence, and IT solutions.Key...

  • Data Engineer in Test

    4 weeks ago

    Osseo, MN, United States Data Recognition Corporation Full time

    DRC is one of the largest educational assessment and curriculum/instruction companies in the industry. Data Engineer (quality focus) - remote/central time zone Data Recognition Corp - MinnesotaNo agencies, pleaseCompany cannot provide sponsorship for this positionSUMMARY:DRC has more than thirty years of proven experience in reporting and analytics,...

  • ETL Data Engineer

    2 weeks ago

    Washington, DC, United States Serigor Inc Full time

    Job Title:ETL Data Engineer (ONSITE)Location:Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...

  • Data Center Infrastructure Leader

    5 months ago

    Washington, United States NTT DATA Full time

    Job Description Req ID: 252378 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Center Infrastructure Leader to join our team in DC, District of Columbia (US-DC),...

  • Data Center Design Manager

    4 weeks ago

    Washington, United States Vantage Data Centers Full time

    About the RoleVantage Data Centers is seeking a highly skilled Design Manager to join our Design Engineering team in North America. As a key member of our team, you will be responsible for leading the development, review, and maintenance of design packages, standards, and specifications to ensure consistent, reliable systems.Key ResponsibilitiesLead the...

  • Data & AnalySr Data Engineer (Life and Annuity)tics Consulting Manager

    1 week ago

    Boston, MA, United States NTT DATA, Inc. Full time

    Location - US/BostonJob Duties: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability,...

  • Data Analyst

    2 weeks ago

    Herndon, VA, United States Numero Data Full time

    Required Skills:Ideal candidate should have a degree in a quantitative field (e.g., mathematics, computer science, physics, economics, engineering, statistics, operations research, quantitative social science, etc.).Basic Knowledge on software development principles and architecture.Good analytical and problem-solving abilities.Ability to break down and...

  • Data Scientist

    2 weeks ago

    Herndon, VA, United States Numero Data Full time

    Strictly on W2Required Skills:Ideal candidate should have a degree in a quantitative field (e.g., mathematics, computer science, physics, economics, engineering, statistics, operations research, quantitative social science, etc.).Basic Knowledge on software development principles and architecture.Good analytical and problem-solving abilities.Ability to break...

  • Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Merit 321 Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to support the acquisition of mission-critical data sets. The ideal candidate will have a background in supporting cyber and/or network-related missions within the military spaces, as either a developer, analyst, or engineer.Key ResponsibilitiesThe successful candidate will have worked with big data...

  • Naval Architect Position at Pantheon Data

    4 weeks ago

    Washington, Washington, D.C., United States Pantheon Data Full time

    Company OverviewPantheon Data is a private, small business based in the Washington, DC area. We provide a range of services, including infrastructure resiliency, contact center operations, information technology, software engineering, program management, strategic communications, engineering, and cybersecurity. Our customer base includes commercial clients,...

  • Marine HVAC/R Engineer

    1 month ago

    Washington, Washington, D.C., United States Pantheon Data Full time

    Job SummaryPantheon Data is seeking a highly skilled Marine HVAC/R Engineer to support a major surface acquisition program for the U.S. Coast Guard (USCG). The selected candidate will work as part of a dynamic cross-functional team to design and develop Coast Guard ships and boats.Key Responsibilities:Design, develop, and evaluate operation of shipboard...

  • Data Engineer

    3 weeks ago

    Washington, United States Booz Allen Full time

    Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a Data Engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced data...

  • Data Engineer

    3 weeks ago

    Washington, United States Booz Allen Full time $60,400 - $137,000

    Data EngineerAll candidates should make sure to read the following job description and information carefully before applying.The Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a Data Engineer, you know that organizing...

  • Data Engineer

    2 weeks ago

    Washington, United States Synergy Staffing Full time

    Job DescriptionJob DescriptionWe are seeking a talented and experienced Data Engineer to join our team and help stand up a robust Snowflake environment in Azure for a high-priority project in the energy grid sector. This position requires expertise in data engineering, cloud infrastructure, and data pipelines, with a specific focus on leveraging Azure Data...

  • Data Engineer

    1 day ago

    Washington, United States Square Peg Technologies Full time

    Job DescriptionJob DescriptionFull Job Description Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. The Mission: At Square Peg, we rely on powerfully insightful data to inform our systems and solutions—and we’re seeking an experienced pipeline-centric data engineer to put it to use. The Data Engineer will be responsible for designing,...

  • Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Metronome LLC Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Metronome LLC. As a Data Engineer, you will play a critical role in ensuring the successful acquisition and management of mission-critical and mission support data sets.You will work closely with our team of experts to design and implement data solutions that meet the unique...

  • Data Engineer

    2 weeks ago

    Washington, United States Booz Allen Full time

    Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need a data professional...

  • Data Engineer

    2 weeks ago

    Washington, United States Booz Allen Full time $60,400 - $137,000

    Data EngineerMaking sure you fit the guidelines as an applicant for this role is essential, please read the below carefully.The Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing...

  • Data Engineer

    1 day ago

    Washington, United States Client Server Software Solutions Full time

    Job DescriptionJob DescriptionJob Description:Constellation West is looking for an entry-level to senior-level Data Engineer to support the CDAO's Mission Analytics Directorate through the Advana program, which provides core and data analytics across various domains, including procurement and financial management (FM). By enhancing the integration of...