Senior Data Engineer

2 weeks ago

Raleigh, United States Targan, Inc. Full time

As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with a diverse range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists. Your expertise in Azure, Fabric, Data Factory, IoT, and common data formats such as Parquet and JSON will be crucial in optimizing our data processes and driving insightful business decisions through Power BI. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. This Data Engineer's skills also include familiarity with several programming languages and knowledge of learning machine methods.

Key Responsibilities

  • Design, develop, and maintain data pipelines using Azure Data Factory / Fabric.
  • Implement data storage solutions using Azure SQL Database, Azure Data Lake, and other Azure services.
  • Develop and maintain ETL processes to ensure data is accurately and efficiently processed.
  • Collaborate with data analysts and business stakeholders to understand data requirements and deliver appropriate solutions.
  • Build and maintain data models and data warehouses to support business intelligence and reporting needs.
  • Develop and maintain data integration solutions using Azure Data Factory and other relevant tools.
  • Create and optimize complex SQL queries to retrieve and manipulate data.
  • Implement and manage data security and compliance measures.
  • Create and maintain documentation related to data architecture, processes, and workflows.
  • Utilize Power BI and Power Query to create interactive and insightful reports and dashboards for business users.
  • Work with cutting-edge technologies like Fabric and IoT to drive innovation in data solutions.
  • Engage with a wide range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists, to understand their data needs and provide tailored solutions.
  • Handle data in various formats, including Parquet, JSON, and other common formats.
  • Monitor and optimize costs associated with data storage and processing, ensuring efficient use of resources.
  • Monitor and troubleshoot data issues, ensuring high availability, reliability and performance of data systems.
  • Working knowledge of Python and Jupyter Notebooks or similar tools a plus.
  • Knowledge of Azure Purview and data security best practices a plus.
Requirements
  • Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
  • 5+ years of experience as a Data Engineer or in a similar role.
  • Strong proficiency in Azure services, including Azure Data Factory, Pipelines, Azure SQL Database, Azure Data Lake, and other Azure data services.
  • Experience with ETL tools and processes.
  • Strong SQL skills and experience with relational databases; knowledge of big-data modeling concepts such as Star / Snowflake Schemas.
  • Proficiency in Power BI and Power Query for data visualization and reporting.
  • Knowledge of data warehousing concepts and best practices; understanding of data ops principles for transformation/curation of data (raw, structured, and semantic transformation layers).
  • Knowledge of data formats such as Parquet, JSON, and other common formats.
  • Familiarity with IoT platforms and data integration from various IoT devices.
  • Experience with cost monitoring and optimization in a cloud environment.
  • Detail-oriented with a high level of accuracy in work.


Working Conditions

Must be able to work in both industrial environments and office settings. This involves adhering to safety protocols, wearing appropriate protective gear, and sometimes working with industrial machinery or in environments with strict access controls.

Please Note: To 3rd Party Search Firms/Employment Agencies: All inquiries must be directed to careers@targan.com. Please do not call or email any TARGAN employee about current or future job openings. All resumes submitted by search firms or employment agencies to any employee at TARGAN via email, telephone, social media, or other means will be deemed to be the sole property of TARGAN unless the firm submitting the resume has previously entered into a written agreement with TARGAN regarding recruitment services and has been approved by Human Resources to work on an open position. TARGAN will not pay any fee or remuneration concerning candidates without complying with this requirement.

  • Senior Data Migration Engineer

    15 hours ago

    Raleigh, North Carolina, United States Golden Technology Full time

    About the RoleWe are seeking a highly skilled Senior Data Migration Engineer to join our team at Golden Technology. As a key member of our data engineering team, you will be responsible for designing, implementing, and migrating data systems from on-premises to the cloud, specifically using Snowflake and Azure.Key ResponsibilitiesPlan and execute a smooth...

  • Senior Data Engineer

    3 months ago

    Raleigh, United States TARGAN Inc. Full time

    Job DescriptionJob DescriptionDescription:As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with a diverse range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists. Your expertise in Azure, Fabric, Data...

  • Data Engineer

    3 months ago

    Raleigh, United States Wipro Limited Full time

    Job descriptionabout the role Identify and analyze user requirements. Work closely with IT and Business stakeholders to understand business needs and work collaboratively to deliver solutions Prioritize assign and execute tasks throughout the Data/BI project life cycle. Build BI reports and dashboards based on business requirements Develop/integrate...

  • Data Engineer

    3 weeks ago

    Raleigh, North Carolina, United States Wipro Limited Full time

    Job descriptionabout the role Identify and analyze user requirements. Work closely with IT and Business stakeholders to understand business needs and work collaboratively to deliver solutions Prioritize assign and execute tasks throughout the Data/BI project life cycle. Build BI reports and dashboards based on business requirements Develop/integrate...

  • Senior Data Engineer

    2 weeks ago

    Raleigh, United States Golden Technology Full time

    In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like...

  • Senior Data Engineer

    3 weeks ago

    Raleigh, United States Golden Technology Full time

    In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like...

  • Senior Data Engineer

    3 weeks ago

    Raleigh, United States Golden Technology Full time

    In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like...

  • Senior Data Engineer

    3 weeks ago

    Raleigh, United States Golden Technology Full time

    Our client is looking for a Data Engineer to join their team! In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills...

  • Senior Data Engineer

    3 weeks ago

    Raleigh, United States Golden Technology Full time

    Our client is looking for a Data Engineer to join their team! In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills...

  • Data Engineer

    3 weeks ago

    Raleigh, North Carolina, United States LMI Consulting, LLC Full time

    OverviewLMI is seeking a Data Engineer to support a DOD Army Program.LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions, logistics, and management advisory services. We deliver integrated capabilities that incorporate emerging technologies and are tailored to...

  • Software Data Engineer

    2 weeks ago

    Raleigh, United States Genworth Full time

    At Enact Mortgage Insurance (Nasdaq: ACT), we understand that there's no place like home. That's why we bring our deep expertise, insightful offerings, and extra mile service to work every day to help lenders put more people in homes and keep them there. We're looking for a career professional Software Data Engineer in Raleigh, NC to join us in fulfilling...

  • Senior Backend Software Engineer

    2 weeks ago

    Raleigh, North Carolina, United States Pendo Full time

    Become a Key Player in Pendo's Data Ingestion Team as a Senior Backend Software EngineerWe are seeking a talented Senior Backend Software Engineer to join our data ingestion team at Pendo. This team plays a vital role in managing and enhancing the data pipeline that supports our analytics, guides, session replay, and various event-driven features through...

  • Data Engineer

    2 months ago

    Raleigh, North Carolina, United States Royal Bank of Canada Full time

    Job SummaryJob DescriptionWhat is the opportunity?The RBC Bank US Engineering team is looking for a Data Engineer to support the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. The Data Engineer will lead the engineering work to align with the approved solution architecture and RBC digital...

  • Senior RTL Design Engineer

    1 month ago

    Raleigh, United States Acceler8 Talent Full time

    Senior RTL Design Engineer Acceler8 Talent is seeking a Senior RTL Design Engineer to join a very well-funded AI hardware startup that’s developing groundbreaking hardware to solve critical bottlenecks in next-gen computing workloads.Founded by a group of architects, developers, and hackers who are responsible for building silicon infrastructure and...

  • Senior RTL Design Engineer

    1 month ago

    Raleigh, United States Acceler8 Talent Full time

    Senior RTL Design Engineer Acceler8 Talent is seeking a Senior RTL Design Engineer to join a very well-funded AI hardware startup that’s developing groundbreaking hardware to solve critical bottlenecks in next-gen computing workloads.Founded by a group of architects, developers, and hackers who are responsible for building silicon infrastructure and...

  • Senior Data Architect

    13 hours ago

    Raleigh, North Carolina, United States TARGAN Inc. Full time

    Job DescriptionAbout the RoleTARGAN Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with a diverse range of users, including business stakeholders, leadership, mechanical engineers, controls programmers,...

  • Senior Data Analyst

    2 days ago

    Raleigh, North Carolina, United States My3Tech Full time

    Job Title: Senior SQL/Snowflake-Tableau AnalystJob Summary:We are seeking a highly skilled Senior SQL/Snowflake-Tableau Analyst to join our team at My3Tech. As a key member of our data analytics team, you will be responsible for providing analysis and leadership on data analysis projects across the enterprise, focusing on School Business Data.Key...

  • Senior Golang Software Engineer, CIS Data Services

    3 months ago

    Raleigh, United States Centripetal Networks Full time

    Job DescriptionJob DescriptionDo you want to be at the forefront of intelligence-driven cybersecurity?  We at Centripetal are innovators of disruptive cybersecurity solutions.  Our CleanINTERNET managed service operationalizes billions of threat indicators in real-time to prevent over 90% of known threats against enterprise networks.  Our customers love...

  • Data Engineering Manager

    1 month ago

    Raleigh, United States Coastal Credit Union Full time

    Job DescriptionJob DescriptionJob Title: Data Engineering ManagerPosition Location: Raleigh, NCYour impact:As a Data Engineering Manager at Coastal Credit Union, you'll lead our data engineering team in designing, developing, and maintaining robust data infrastructure and solutions. The Data Engineering Manager will play a critical role in driving the...

  • Senior Project Engineer

    1 month ago

    Raleigh, United States Timmons Group Full time

    Company DescriptionJob Description Timmons Group is currently accepting applications for experienced Senior Civil Project Engineer candidates in our Raleigh Residential Land Development group. The Senior Civil Project Engineer is responsible for delivering technically sound products to meet internal and external client expectations. They will also make...