Senior Data Engineer

14 hours ago

Alpharetta, United States Vsolutions Technologies Full time

Job Summary: The Data Engineer will be responsible for designing, developing, and maintaining data pipelines and ETL processes, ensuring the smooth integration of data from various sources into Snowflake. This role will focus on using Matillion for data transformation, working with Snowflake for cloud data warehousing, and leveraging Microsoft Azure tools for data orchestration and automation.

Key Responsibilities:

  • ETL Development & Data Pipeline Management:
  • Design, develop, and optimize ETL processes using Matillion to integrate, transform, and load data into Snowflake data warehouse.
  • Collaborate with data architects and other teams to gather requirements and build robust, scalable data pipelines.
  • Troubleshoot and optimize existing ETL workflows to enhance performance and minimize bottlenecks.
  • Cloud Data Engineering:
  • Work with Snowflake to design, implement, and manage data models, schemas, and tables.
  • Ensure data quality, integrity, and consistency across various platforms.
  • Manage the lifecycle of data stored in Snowflake and ensure proper governance, access control, and security protocols are followed.
  • Integration with Azure:
  • Leverage Azure Data Factory and other Azure services (e.g., Azure Databricks, Azure Data Lake) for orchestration and automation of data workflows.
  • Manage and monitor the data pipeline performance, ensuring timely data movement across cloud environments.
  • Utilize Azure Blob Storage or Azure Data Lake Storage for data storage and processing needs.
  • Collaboration & Documentation:
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data needs.
  • Document processes, architectures, and pipelines to ensure clear knowledge sharing within the team.
  • Data Optimization & Performance Tuning:
  • Optimize Snowflake queries and data models to ensure high-performance analytics.
  • Implement best practices for query performance, data compression, and cost optimization in Snowflake.

Required Skills and Qualifications:

  • Experience:
  • Proven experience as a Data Engineer, Data Analyst, or similar role, with hands-on experience working with Matillion, Snowflake, and Azure technologies.
  • Strong experience in designing and managing ETL pipelines using Matillion.
  • Solid experience working with Snowflake data warehousing solutions (data modeling, SQL, query optimization).
  • Expertise in Azure cloud services (Azure Data Factory, Azure Blob Storage, Azure Databricks, etc.).
  • Experience in cloud-based data integration and transformation workflows.
  • Technical Skills:
  • Strong proficiency in SQL for data querying, optimization, and debugging.
  • Familiarity with scripting languages such as Python or Bash for automation tasks.
  • Knowledge of Data Warehousing, Data Lakes, and Data Modeling concepts.
  • Understanding of cloud architecture and design patterns.
  • Soft Skills:
  • Strong analytical and problem-solving skills.
  • Excellent communication skills, with the ability to articulate technical concepts to non-technical stakeholders.
  • Ability to work independently as well as part of a collaborative team.

Desired Qualifications:

  • Experience in other Azure services such as Azure Synapse Analytics.
  • Knowledge of data governance frameworks and security best practices.
  • Familiarity with version control systems like Git.
  • Certification in Matillion, Snowflake, or Azure is a plus.

  • Data Engineer

    2 weeks ago

    Alpharetta, United States Navtech Full time

    Job Title: Data Engineer - SeniorWe are seeking an experienced Data Engineer - Senior to join our team at Navtech Inc in Alpharetta, GA.Estimated Salary: $120,000 - $180,000 per year.Company Overview:Navtech Inc is a leading technology company that specializes in data engineering and analytics. We are looking for a talented individual to help us build and...

  • Senior Data Engineer

    1 month ago

    Alpharetta, United States ExecuSource Full time

    Senior Data Engineer Location: Alpharetta, GA Pay: $145k plus bonus Schedule: Hybrid - 3 days in office/2 days remote Summary: As a Senior Data Engineer, you'll drive key projects like re-platforming data services on both cloud and on-prem, and building real-time streaming for business applications. You'll focus on optimizing data processing, modeling,...

  • Data Engineering Lead

    3 weeks ago

    Alpharetta, United States ExecuSource Full time

    About the RoleWe are seeking a Senior Data Engineer to lead key projects, including re-platforming data services on cloud and on-prem, and building real-time streaming for business applications. As a Senior Data Engineer, you will focus on optimizing data processing, modeling, pipeline architecture, and managing data SLAs to ensure quality, usability, and...

  • Senior GCP Data Engineer

    7 days ago

    Alpharetta, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Senior GCP Data Engineer. This is a 11+ Months Contract opportunity with long-term potential and is located in Alpharetta, GA(Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45596Pay Range: $70 - $75/hour. Employee benefits include, but are not limited to, health insurance...

  • Senior GCP Data Engineer

    6 days ago

    Alpharetta, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Senior GCP Data Engineer. This is a 11+ Months Contract opportunity with long-term potential and is located in Alpharetta, GA(Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45596Pay Range: $70 - $75/hour. Employee benefits include, but are not limited to, health insurance...

  • Senior Data Professional

    2 weeks ago

    Alpharetta, United States Colonial Pipeline Full time

    Colonial Pipeline is the largest refined products pipeline in the United States, transporting over 100 million gallons of gasoline, diesel fuel, home heating oil, jet fuel, and fuels for the U.S. military through a network of 5,500 miles of underground pipe. We're seeking a Senior Data Engineer to join our team and help us revolutionize the energy...

  • Data Engineering Leadership Position

    1 month ago

    Alpharetta, United States Colonial Pipeline Full time

    At Colonial Pipeline, we're seeking a highly skilled Senior Data Engineer to join our team. This critical role will play a key part in shaping our data engineering strategy and driving business value through data-driven insights.Data Engineering Leadership:We're looking for a seasoned data engineering professional with a proven track record of designing and...

  • Senior Software Engineer, Data Science

    2 months ago

    Alpharetta, United States PlayOn LLC Full time

    THE ROLE. PlayOn is looking for a highly skilled Senior Software Engineer to join our Data Science team. As a Senior Software Engineer, your core responsibilities will encompass spearheading and actively participating in the formulation, development, and upkeep of our shared services such as Scores & Recommendations. You will collaborate seamlessly with...

  • Data Engineering Specialist

    1 month ago

    Alpharetta, United States Avanos Medical Full time

    About Avanos MedicalAvanos Medical is a leading medical device company dedicated to delivering innovative solutions that make a difference in people's lives. Our mission is to create groundbreaking products that address the most pressing healthcare challenges.The RoleWe are seeking a highly skilled Junior AI/Data Engineering Associate to join our dynamic...

  • Data Engineer-Senior

    3 weeks ago

    Alpharetta, United States Global Payments Full time

    Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers using our payments solutions for credit, debit, prepaid and merchant services. Our worldwide team helps over 3 million companies, more than 1,300 financial institutions and over 600 million cardholders grow with confidence and achieve amazing results....

  • Senior Cloud Data Architect

    2 weeks ago

    Alpharetta, United States ExecuSource Full time

    Job DescriptionThis is a challenging opportunity for a Senior Data Engineer to drive innovation in our data and analytics infrastructure. You will work with departments to enhance data assets and identify key datasets for business opportunities. Additionally, you will lead design sessions, code reviews, and guide data collection and ETL pipeline...

  • Senior Data Systems Engineer Position

    1 month ago

    Alpharetta, United States Navtech Full time

    We are seeking an expert Data Engineer to join our team at Navtech Inc. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Develop and implement data pipelines using Python and SQLDesign and maintain large-scale data warehousesEnsure data quality, consistency, and...

  • Senior Hadoop Engineer

    3 weeks ago

    Alpharetta, United States CapB InfoteK Full time

    Are you a seasoned Senior Hadoop Engineer looking for a new challenge? We have an exciting opportunity at CapB InfoteK that offers a salary of around $160,000 per year, depending on your level of experience.About the Job:We need someone with extensive experience in designing and developing big data solutions using Hadoop and its ecosystem tools. The...

  • Pyramid Consulting, Inc | Senior GCP Data Engineer

    1 week ago

    alpharetta, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Senior GCP Data Engineer. This is a 11+ Months Contract opportunity with long-term potential and is located in Alpharetta, GA(Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45596Pay Range: $70 - $75/hour. Employee benefits include, but are not limited to, health insurance...

  • Senior Data Architect III

    2 weeks ago

    Alpharetta, United States LexisNexis Risk Solutions Group Full time

    Job OverviewAs a Senior Data Scientist III at LexisNexis Risk Solutions Group, you will play a key role in building novel data processing architectures to enable our products to utilize massive models with minimal latency. With a strong background in computer science and engineering, you will develop new product feature prototypes and demonstrate their value...

  • Senior Data Innovation Manager

    2 weeks ago

    Alpharetta, United States LexisNexis Risk Solutions Full time

    About UsLexisNexis Risk Solutions is a global leader in risk management and business process outsourcing. We help organizations make informed decisions by providing them with accurate and reliable data. Our team is passionate about innovation and committed to delivering exceptional results.Job DescriptionWe are seeking a highly skilled Senior Data Scientist...

  • Data Engineer

    5 months ago

    Alpharetta, United States ATech Placement Full time

    We are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue Technical Skills and Requirements Work experience with ETL, Data Modeling, and Data Architecture. Experience with Big...

  • Data Engineer

    2 weeks ago

    Alpharetta, United States CCube Solutions Full time

    Unleash your talents and venture into a new career that innovates and transforms products & services globally! Data Engineer (Java & Spark) Job Type: W2/Full Time Location: Alpharetta, GA (Hybrid - 3 Days a Week) Salary: $110k - $130k (additional $20k bonus.) [Key Responsibilities] We are seeking an experienced Data Engineer with a strong background in Java...

  • Data Engineer

    17 hours ago

    Alpharetta, United States Ccube Full time

    Job DescriptionJob DescriptionUnleash your talents and venture into a new career that innovates and transforms products & services globally!Data Engineer (Java & Spark) Job Type: W2/Full TimeLocation: Alpharetta, GA (Hybrid - 3 Days a Week)Salary: $110k - $130k (additional $20k bonus.) [Key Responsibilities]We are seeking an experienced Data Engineer with...

  • Senior Data Architecture Specialist

    3 weeks ago

    Alpharetta, United States CapB InfoteK Full time

    We are seeking a highly skilled Senior Data Architecture Specialist to join our team at CapB InfoteK in Alpharetta, GA. This is a remote opportunity until further notice.Job DescriptionWe are looking for an experienced Big Data Engineer to lead the development of cloud-based data solutions. The ideal candidate will have 5-10 years of hands-on experience...