Cloud Data Engineer

4 weeks ago


Madison, Wisconsin, United States Saxon Global Full time
Job Summary

We are seeking a highly skilled Cloud Data Engineer to join our team at Saxon Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines using AWS services.

Key Responsibilities:

  • Collaborate with data engineering and development teams to design and implement data pipelines using AWS services such as Redshift, Glue, and DMS.
  • Architect and implement end-to-end data pipelines, ensuring data accuracy, reliability, and performance.
  • Design and implement ETL processes, including Changed Data Capture (CDC) and Slow Changing Dimension (SCD) logics, to integrate data from diverse source systems.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization.
  • Integrate Redshift with other AWS services, such as AWS Lambda, Amazon S3, and Airflow, to build end-to-end data pipelines.
  • Perform data profiling and analysis to troubleshoot data-related challenges and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
Requirements

To be successful in this role, you will need:

  • 12+ years of experience with AWS stack, including Glue, Spark, Python, and Redshift.
  • 10+ years of experience working with and personally implementing solutions involving CDC, SCD, and surrogate keys.
  • Proficient in SQL and Redshift for data manipulation.
  • Hands-on experience with AWS services like DMS, S3, Glue, Redshift, and Airflow.
  • Strong ETL knowledge and data modeling skills.
  • Skilled in complex ETL scenarios and data integration.
  • Expertise in AWS DMS for on-prem to cloud data migration.
  • Proficient in Python for Airflow DAGs and operators.
  • Oracle to Redshift script conversion experience.
  • Familiar with Git for version control.
  • Adept at identifying and optimizing Redshift queries.
  • Strong problem-solving skills with data accuracy focus.
  • Collaborative, agile team player with technical communication skills.
  • Proven track record of on-time, high-quality data solutions.
  • Experience in large-scale data environments.
  • Extensive Redshift and AWS experience for scalable solutions.
  • AWS data engineering or database certifications are a plus.

  • Senior Cloud Engineer

    4 weeks ago


    Madison, Wisconsin, United States Metasys Technologies Full time

    Job SummaryMetasys Technologies is seeking a highly skilled Senior Cloud Engineer to lead our cloud platform initiatives. The ideal candidate will have extensive experience in Google Cloud Platform (GCP) and a strong background in software development, with a focus on cloud-native solutions.Key Responsibilities:Design and implement scalable cloud...


  • Madison, Wisconsin, United States Metasys Technologies Full time

    GCP Lead EngineerMetasys Technologies is seeking a highly skilled GCP Lead Engineer to join our team in Madison, WI. As a key member of our cloud engineering team, you will be responsible for designing, implementing, and maintaining large-scale cloud-based systems on Google Cloud Platform.Key Responsibilities:Lead the design and implementation of cloud-based...

  • Cloud Engineer

    4 weeks ago


    Madison, Wisconsin, United States Starcom consulting limited Full time

    Job DescriptionWe are seeking a highly skilled Cloud Engineer with expertise in Google Cloud Platform to join our team at Starcom Consulting Limited. The ideal candidate will have hands-on experience with Google Cloud Platform services, including BigQuery, CloudRun, Cloud Storage, Pub/Sub, Cloud Composer, Containers, Workflows, IAM, and more.Key...

  • Senior Cloud Engineer

    4 weeks ago


    Madison, Wisconsin, United States American Family Insurance Full time

    Job SummaryWe are seeking a highly skilled Cloud Engineer to join our team at American Family Insurance. As a key member of our Datacenter Engineering Group, you will be responsible for designing, implementing, and maintaining cloud-based solutions that meet the needs of our business.Key ResponsibilitiesAnalyze business requirements and specifications to...

  • Senior Data Engineer

    1 month ago


    Madison, Wisconsin, United States Alliant Energy Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Alliant Energy. As a Senior Data Engineer, you will play a crucial role in advancing our data and analytics practices, leading the design, development, implementation, enhancement, and maintenance of data pipelines across multiple technology platforms.Key...


  • Madison, Wisconsin, United States Epic Full time

    Cloud Infrastructure EngineerEpic is seeking a skilled Cloud Infrastructure Engineer to join our Hosting team. As a key member of our team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure. You will work closely with our development teams to ensure seamless integration of our cloud services.Key...


  • Madison, Wisconsin, United States Epic Full time

    Cloud Platform EngineerWe are seeking an exceptional early-career IT professional to join our multi-tenant Hosting team as a Cloud Engineer. As a Cloud Engineer, you'll deploy and maintain infrastructure as a service (IaaS) and platform as a service (PaaS) resources to public cloud providers in order to host and support our world-class software.Key...


  • Madison, Wisconsin, United States Flexion Full time

    Job DescriptionWe are seeking a highly skilled Cloud Engineer to join our team at Flexion. As a Cloud Engineer, you will be responsible for designing, developing, and maintaining cloud-based systems and applications.Key Responsibilities:Design and develop cloud-based systems and applications using AWS.Develop and maintain cloud infrastructure using...


  • Madison, Wisconsin, United States Flexion Full time

    Job Title: Backend Cloud EngineerAbout the Role:We are seeking a highly skilled Backend Cloud Engineer to join our team at Flexion. As a Backend Cloud Engineer, you will be responsible for designing, developing, and maintaining large-scale, enterprise-wide systems for government and commercial clients.Key Responsibilities:Design and develop new Cloud and...


  • Madison, Wisconsin, United States JobRialto Full time

    Job SummaryWe are seeking a highly skilled Cloud Infrastructure Specialist to join the Datacenter Engineering Group within Enterprise IT. The initial focus will be on private cloud service delivery and infrastructure solutions across both public (AWS, GCP, Azure) and private cloud environments.The role involves developing data pipeline architectures,...

  • Data Engineer II

    4 weeks ago


    Madison, Wisconsin, United States AMERICAN FAMILY MUTUAL INSURANCE CO Full time

    Job Requirements:As a Data Engineer II at American Family Mutual Insurance Co., you will work independently and collaborate with cross-functional business and IT stakeholders to provide and maintain data, reporting, and analytical solutions for large scope and high-impact critical projects. You will provide flexibility to specialize in one area and/or play...


  • Madison, Wisconsin, United States Oracle Full time

    Job SummaryOracle is seeking a highly skilled and experienced Cloud Engineering Lead to join our team. As a key member of our cloud engineering team, you will be responsible for driving strategic opportunities and owning end-to-end customer engagement. You will exercise creativity, independent judgment, and business acumen in selecting methods and techniques...


  • Madison, Wisconsin, United States Compunnel Full time

    Job SummaryWe are seeking a highly skilled Platform Engineer to join the Datacenter Engineering Group within Enterprise IT. The initial focus will be on private cloud service delivery and infrastructure solutions across both public (AWS, GCP, Azure) and private cloud environments. The role involves developing data pipeline architectures, including...


  • Madison, Wisconsin, United States CRIBL INC Full time

    About the RoleCribl Inc is seeking a highly skilled Cloud Software Development Engineer to join our team. As a Cloud Software Development Engineer, you will be responsible for designing, implementing, and maintaining our cloud-based software systems.Key ResponsibilitiesDesign and develop scalable, secure, and efficient cloud-based software systemsCollaborate...


  • Madison, Wisconsin, United States Serigor Inc Full time

    Job Title:DevOps Engineer II - Security FocusJob Description:This contractor will serve in a DevOps Engineer II role with a primary focus on security for the Department's Unemployment Insurance Systems Modernization project.The project aims to modernize the client's Unemployment Insurance systems, moving from on-premise to a cloud-based infrastructure within...

  • Senior Cloud Engineer

    4 weeks ago


    Madison, Wisconsin, United States State of Wisconsin Investment Board Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Site Reliability Engineer to oversee the build and transformation of our cloud native technology stack. This role will service in a critical capacity to ensure all aspects of the Software Development Lifecycle (SDLC) are built from the ground up with modern tools and techniques.Key...


  • Madison, Wisconsin, United States UW Health Full time

    Job SummaryWe are seeking a highly skilled Cybersecurity Engineer to join our team at UW Health. As a key member of our security team, you will be responsible for leading the implementation and management of security technology solutions that advance our security program.Key Responsibilities:Lead the planning, research, implementation, management, and...

  • Senior Data Engineer

    3 weeks ago


    Madison, Wisconsin, United States Alliant Energy Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Alliant Energy. As a key member of our data and analytics team, you will play a crucial role in advancing our data and analytics practices.Key ResponsibilitiesLead the design, development, implementation, enhancement, and maintenance of data pipelines across multiple...

  • Data Engineer Intern

    4 weeks ago


    Madison, Wisconsin, United States State of Wisconsin Investment Board Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Engineer Intern to join our Data Services and Engineering Division. As a member of our team, you will have the opportunity to work on a variety of projects, including developing and managing data quality metrics and dashboards, and supporting the development of an enterprise-wide...


  • Madison, Wisconsin, United States Creative Financial Staffing Full time

    About Our ClientOur client is a forward-thinking financial services organization that is revolutionizing the industry through cutting-edge technology. The leadership team is dedicated to employee success by embracing innovation, fostering creativity, and striving for excellence in all of their endeavors. You'll be part of a team that is dedicated to pushing...