Data Engineer

3 weeks ago

Richmond, United States Compunnel Inc. Full time

As a Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Terraform, etc.), automation and innovation.

Primary Responsibilities:

• Create & maintain data pipelines using Azure & Snowflake as primary tools

• Create SQL Stored procs and Functions to perform complex transformations

• Understand data requirements and design optimal pipelines to fulfil the use-cases

• Creating logical & physical data models to ensure data integrity is maintained

• Code management, CI/CD pipeline creation & automation using GitHub & GIT Actions

• Tuning and optimizing data processes

• Design and build best in class processes to clean and standardize data

• Code Deployments to production environment, troubleshoot production data issues

• Modelling of big volume datasets to maximize performance for our Business Intelligence & Data Science Team

Qualifications

Required Qualifications:

• Computer Science bachelor's degree or similar

• Min 1-4 years of industry experience as a Hands-on Data engineer

• Excellent communication skills – Verbal and Written

• Excellent knowledge of SQL

• Excellent knowledge of Azure Services such as – Blobs, Functions, Azure Data Factory, Service Principal, Containers, Key Vault, etc.

• Excellent knowledge of Snowflake - Architecture, Features, Best practices

• Excellent knowledge of Data warehousing & BI Solutions

• Excellent Knowledge of change data capture (CDC), ETL, ELT, SCD etc.

• Hands on experience on the following technologies:

o Developing data pipelines in Azure & Snowflake

o Writing complex SQL queries

o Building ETL/ELT/data pipelines using SCD logic

o Query analysis and optimization

• Analytical and problem-solving experience applied to a Big Data datasets

• Data warehousing principles, architecture and its implementation in large environments

• Experience working in projects with agile/scrum methodologies and high performing team(s)

• Knowledge of different data modelling techniques such as Star Schema, Dimensional models, Data vault is an Advantage

• Experience in code lifecycle management and repositories such as GIT & GitHub

• Exposure to DevOps methodology

• Good understanding of Access control and Data masking

  • Data Scientist

    1 month ago

    Richmond, Virginia, United States Data Society Full time

    Job OverviewWe are seeking a highly skilled Data Scientist to join our team at Data Society Group. As a Data Scientist, you will be responsible for overseeing the collection, analysis, and interpretation of data to support our clients in the energy sector.Key ResponsibilitiesSupport transmission modeling planning projects and work with client teams to...

  • Data Scientist

    3 weeks ago

    Richmond, Virginia, United States Data Society Full time

    Job Title: Data ScientistWe are seeking a highly skilled Data Scientist to join our team at Data Society Group. As a Data Scientist, you will be responsible for overseeing the collection, analysis, and interpretation of data to support our clients in the energy sector.Key Responsibilities:Support transmission modeling planning projects and work with client...

  • Data Scientist

    2 weeks ago

    Richmond, Virginia, United States Data Society Full time

    Job Title: Data Scientist - Power Grid SystemsWe are seeking a highly skilled Data Scientist to join our team at Data Society Group. As a Data Scientist, you will be responsible for overseeing the collection, analysis, and interpretation of data related to power grid systems.Key Responsibilities:Support transmission modeling planning projectsResearch and...

  • Data Engineer

    3 weeks ago

    Richmond, Virginia, United States Strategic Staffing Solutions Full time

    Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Strategic Staffing Solutions. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure.Key Responsibilities:Design and develop robust data pipelines using Python and PySpark to process large volumes of data...

  • Data Engineer

    2 weeks ago

    Richmond, Virginia, United States Compunnel Full time

    Job Title: Data EngineerCompunnel is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining complex data pipelines and architectures to support our business needs.Key Responsibilities:Design and develop data pipelines using Azure and Snowflake as primary toolsCreate and...

  • Data Engineer

    3 weeks ago

    Richmond, Virginia, United States Edward Jones Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Edward Jones. As a Data Engineer, you will be responsible for designing, developing, and maintaining secure, consistent, and reliable ETL solutions that support critical business processes across various business units.Key Responsibilities:Design and develop ETL...

  • Data Engineer

    4 weeks ago

    Richmond, Virginia, United States Calibro Corp. Full time

    Job Title: Data EngineerCalibro Corp. is seeking a highly skilled Data Engineer to support our client's development of a comprehensive cloud-based data management and analytics solution.Key Responsibilities:Design and implement data pipelines that integrate governance and analyticsDevelop and maintain data warehouses and data lakesEnsure data security and...

  • Data Center Construction Project Manager

    1 month ago

    Richmond, Virginia, United States QTS Data Centers Full time

    Data Center Construction MEP Project ManagerThe Data Center Construction MEP Project Manager is a critical role that oversees the design, preconstruction, and construction activities for data center projects. This position requires strong leadership and management skills, as well as excellent communication and interpersonal skills.Key Responsibilities:Manage...

  • Data Center Construction Project Manager

    2 months ago

    Richmond, Virginia, United States QTS Data Centers Full time

    Data Center Construction MEP Project ManagerThe Data Center Construction MEP Project Manager is a critical role that oversees the design, preconstruction, and construction activities for data center projects. This position requires strong leadership and management skills, as well as the ability to interact effectively with various stakeholders, including...

  • Data Engineer

    1 month ago

    Richmond, Virginia, United States Marathon Consulting Full time

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Marathon Consulting.Key Responsibilities:Design and develop ETL processes using SSIS and Azure Synapse Analytics/Azure Data Factory.Develop and maintain cloud-hosted databases, preferably in Azure.Collaborate with cross-functional teams to ensure data integrity and...

  • Data Engineer/Platform Engineer

    4 weeks ago

    Richmond, Virginia, United States Pyramid Consulting Full time

    Job Title: Data Engineer/Platform EngineerWe are seeking a talented Data Engineer/Platform Engineer to join our team. This is a 12+ months contract opportunity with long-term potential and is located in McLean, VA/Richmond, VA (Hybrid).Job Description:As a Data Engineer/Platform Engineer, you will be part of a team designing and building Enterprise Level...

  • Cloud Data Engineer

    5 days ago

    Richmond, California, United States Cynet Systems Full time

    Job Title: Cloud Data Engineer - Data ArchitectJob Summary: We are seeking a highly skilled Cloud Data Engineer - Data Architect to join our team at Cynet Systems. The ideal candidate will have a strong background in designing and building large-scale cloud data solutions, with expertise in cloud databases, data warehousing, and data...

  • Cloud Data Engineer

    1 month ago

    Richmond, Virginia, United States Open Systems Technologies Full time

    Job Title: Databricks Cloud Data EngineerWe are seeking a highly skilled Databricks Cloud Data Engineer to join our team at Open Systems Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems on the Databricks Lakehouse platform.Responsibilities:Design and...

  • Senior Data Engineer

    2 weeks ago

    Richmond, Virginia, United States Capital One Full time

    Transforming Data at Capital OneWe're seeking a seasoned Data Engineer to join our team and drive innovation in data management. As a key member of our engineering team, you'll play a crucial role in designing, developing, and implementing cutting-edge data solutions that drive business growth and customer satisfaction.Key Responsibilities:Collaborate with...

  • Senior Data Engineer

    2 weeks ago

    Richmond, Virginia, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures.Key Responsibilities:Collaborate with cross-functional teams to design and develop data solutions that meet...

  • Data Engineer

    2 weeks ago

    Richmond, Virginia, United States Capital One Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Capital One. As a Data Engineer, you will play a critical role in designing, developing, and implementing technical solutions that drive business value.Key ResponsibilitiesCollaborate with Agile teams to design, develop, test, implement, and support technical solutions in...

  • Data Engineering Specialist

    4 weeks ago

    Richmond, Virginia, United States Jones Lang LaSalle IP, Inc. Full time

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team at Jones Lang LaSalle IP, Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes to support the ingestion, processing, and storage of large...

  • Data Engineer

    3 weeks ago

    richmond, United States Compunnel Inc. Full time

    As a Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Terraform, etc.), automation and innovation. Primary Responsibilities: • Create & maintain data pipelines using Azure & Snowflake as primary tools • Create SQL...

  • Data Engineering Specialist

    4 weeks ago

    Richmond, Virginia, United States JLL Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at JLL. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes to support the ingestion, processing, and storage of large datasets.Key ResponsibilitiesDesign and develop data pipelines and ETL processes to extract,...

  • Senior Data Engineer

    4 weeks ago

    Richmond, Virginia, United States Ampcus Full time

    Job Title: Sr. Data EngineerJob Summary:Ampcus is seeking a highly skilled Sr. Data Engineer to join our team. As a Sr. Data Engineer, you will be responsible for designing and building Enterprise Level scalable, low-latency, fault-tolerant data pipelines that provide meaningful and timely insights. You will work with a team of engineers to build the next...