Cloud data Engineer

1 week ago


Madison, Wisconsin, United States Saxon Global Full time

Role: Certified Cloud Engineer

End Client: State of WI.

Contract Length: 9+months

Work Type: LOCAL CANDIDATES TO WI. CAN WORK 100% REMOTE

Location: Madison, WI.

Rate C2C: 100/hr

Work Auth - All Except H1B

***Please send proof of legal location. I will only be accepting candidates who are currently RESIDING IN WI***

Job Summary:

  • Collaborate with data engineering and development teams to design, develop, test, and maintain robust and scalable ELT/ETL pipelines using SQL scripts, Redshift stored procedures, and other AWS tools and services.
  • Collaborate with our engineering and data teams to understand business requirements and data integration needs, translate them into effective data solutions, that yield top-quality outcomes.
  • Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
  • Employ AWS DMS and other services for efficient data ingestion from on-premises databases into Redshift.
  • Design and implement ETL processes, encompassing Changed Data Capture (CDC) and Slow Changing Dimension (SCD) logics, to seamlessly integrating data from diverse source systems.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization.
  • Design and implement efficient orchestration workflows using Airflow, ensuring seamless coordination of complex ETL processes.
  • Integrate Redshift with other AWS services, such as AWS DMS, AWS Glue, AWS Lambda, Amazon S3, Airflow, and more, to build end-to-end data pipelines.
  • Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
  • Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git.
  • Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.
REQUIRED SKILLS:
  • 12+ years of experience with AWS stack including:
    • Glue, Spark, Python, and Redshift.
  • 10+ years working with and personally implementing solutions involving the following concepts:
    • CDC (Change Data Capture), SCD (Slowly Changing Dimensions), and surrogate keys.
  • Proficient in SQL and Redshift for data manipulation.
  • Hands-on experience with AWS services like DMS, S3, Glue, Redshift, and Airflow.
  • Strong ETL knowledge and data modeling skills.
  • Skilled in complex ETL scenarios and data integration.
  • Expertise in AWS DMS for on-prem to cloud data migration.
  • Proficient in Python for Airflow DAGs and operators.
  • Oracle to Redshift script conversion experience.
  • Familiar with Git for version control.
  • Adept at identifying and optimizing Redshift queries.
  • Strong problem-solving skills with data accuracy focus.
  • Collaborative, agile team player with technical communication skills.
  • Proven track record of on-time, high-quality data solutions.
  • Experience in large-scale data environments.
  • Extensive Redshift and AWS experience for scalable solutions.
  • AWS data engineering or database certifications are a plus.


  • Madison, Wisconsin, United States American Family Insurance Full time

    We're seeking a skilled Salesforce Cloud Engineer to join our team at American Family Insurance. In this role, you'll be responsible for designing and delivering integrated marketing automation solutions using Salesforce Marketing Cloud platform. Your expertise in executing Salesforce Marketing Cloud integrations with external systems will enable seamless...


  • Madison, Wisconsin, United States American Family Insurance Full time

    About the RoleThis Cloud Solutions Engineer position at American Family Insurance is responsible for developing and implementing integrated marketing automation solutions using the Salesforce Marketing Cloud platform. The ideal candidate will have 5+ years of experience in Salesforce Marketing Cloud and a strong understanding of data architecture/schema,...

  • Data Engineer

    2 weeks ago


    Madison, Wisconsin, United States Rural Mutual Insurance Full time

    Rural Mutual Insurance is looking for an experienced and motivated data professional to play a critical role in the design, development, and maintenance of the company's data warehouse and related data marts. This role will be responsible for implementing and optimizing data pipelines, ensuring data quality, and building data models that support analytics...


  • Madison, Wisconsin, United States TalentFish Full time

    Job Title: Cloud Software Engineer Primary Location: Madison, Wisconsin- Hybrid, 3 Days In-Office Position Type: Direct HireOverview TalentFish is casting a line for a Cloud Software Engineer with our premier client. This is a direct hire role that is hybrid with 3-days in-office in Madison, WI. This exciting opportunity to join our client's Data Services &...

  • Data Engineer

    3 weeks ago


    Madison, Wisconsin, United States Hiebing Full time

    If you're looking for a full-service agency that's shaking up the marketing landscape and creating momentum– you're in the right place. At Hiebing, we're a passionate, full-service crew fueled by curiosity, dedicated to doing great work and good deeds. Collaboration is second nature for our teams in both Madison and Austin. They work together to craft...

  • Data Engineer

    2 weeks ago


    Madison, Wisconsin, United States Rural Mutual Insurance Full time

    Rural Mutual Insurance is looking for an experienced and motivated data professional to play a critical role in the design, development, and maintenance of the company's data warehouse and related data marts. This role will be responsible for implementing and optimizing data pipelines, ensuring data quality, and building data models that support analytics...


  • Madison, Wisconsin, United States TechVest Global Solutions Inc. Full time

    Position OverviewNOTE: NEED US CITIZEN & GREEN CARD HOLDERS ONLY.Essential activities:Enable data-driven decision-making through innovative analytical solutions and models.Convey complex data concepts to technical and non-technical stakeholders.Utilize programming languages such as Python and SQL for data manipulation, analysis, and model development.Act as...


  • Madison, Wisconsin, United States TechVest Global Solutions Inc. Full time

    Position OverviewNOTE: NEED US CITIZEN & GREEN CARD HOLDERS ONLY.Essential activities:Enable data-driven decision-making through innovative analytical solutions and models.Convey complex data concepts to technical and non-technical stakeholders.Utilize programming languages such as Python and SQL for data manipulation, analysis, and model development.Act as...


  • Madison, Wisconsin, United States Hiebing Full time

    Data Engineer RoleAs a key member of our data science team, you will be responsible for building and maintaining the data infrastructure, including databases, data warehouses, and cloud-based solutions. You will work closely with cross-functional teams to understand business requirements and deliver data-driven solutions.We are seeking a highly motivated...


  • Madison, Wisconsin, United States Confluent Full time

    About ConfluentWe are a company that is dedicated to helping organizations unlock the full potential of their data. Our goal is to create an entirely new category within data infrastructure - data streaming.We believe that data should be free-flowing and easily accessible, enabling businesses to make informed decisions quickly and efficiently. To achieve...


  • Madison, Wisconsin, United States State of Wisconsin Investment Board Full time

    Making a Difference The State of Wisconsin Investment Board (SWIB), founded in 1951, is a premier global investment organization responsible for managing the more than $156 billion of assets of the fully funded Wisconsin Retirement System (WRS), the State Investment Fund and other state funds. Through SWIB's effective and innovative investment management,...


  • Madison, Wisconsin, United States Centene Corporation Full time

    You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. **Position Purpose:** Manages the technical approach...


  • Madison, Wisconsin, United States Exact Sciences Careers Full time

    About the PositionWe are seeking an experienced Senior Data Systems Engineer to join our team. In this role, you will be responsible for designing, developing, and deploying large-scale data systems that support business-critical applications.Responsibilities:Design and develop scalable data architectures to meet business requirements.Collaborate with...

  • Data Engineer

    2 weeks ago


    Madison, Wisconsin, United States Realta Fusion Inc. Full time

    Realta Fusion is a rapidly growing start-up developing compact magnetic mirror fusion energy systems to address the biggest challenge of our time – tackling global climate change while ensuring a sufficient energy supply for at least ten billion people on (and off) earth. Realta is targeting the need to decarbonize industrial process heat as the fastest...


  • Madison, Wisconsin, United States TalentFish Full time

    The OpportunityWe are seeking a seasoned Cloud Software Engineer to join our team and contribute to the development of industry-leading systems and platforms. As a key member of the Data Services & Engineering Team, you will be responsible for implementing data quality frameworks, conducting data validation ensuring accuracy of analysis, and utilizing...


  • Madison, Wisconsin, United States DataChat Full time

    Innovate with DataChatWe are seeking an exceptional Chief Technology Officer to drive our technological vision and innovation in AI and data analytics. If you have a passion for transforming business decision-making with data-driven insights, we invite you to join our team.ResponsibilitiesDevelop Innovative Solutions: Design and develop cutting-edge AI and...


  • Madison, Wisconsin, United States DataChat Full time

    About DataChatDataChat is a pioneering data analytics company that leverages generative AI to empower businesses with actionable insights. Our platform combines cutting-edge machine learning, natural language processing, and automated analytics to transform complex data into intuitive, decision-ready insights.Role OverviewAs the Chief Technology Officer...


  • Madison, Wisconsin, United States Exact Sciences Careers Full time

    Role SummaryWe are seeking a seasoned Principal Data Architect to lead our data architecture efforts. In this role, you will be responsible for designing and implementing data architectures that support business-critical applications.Key Responsibilities:Lead the design and implementation of data architectures, ensuring scalability, performance, and...

  • DevOps Engineer-II.

    1 week ago


    Madison, Wisconsin, United States Serigor Inc Full time

    Job Title: DevOps Engineer-II. (REMOTE) Location: Madison, WI 53703 Duration: 3 Months Job Description: This contractor is required to serve in a DevOps Engineer II role with a primary focus around "Security" for the Department's Unemployment Insurance Systems Modernization project. This project is an effort to systematically and incrementally modernize the...


  • Madison, Wisconsin, United States Exact Sciences Careers Full time

    Job DescriptionWe are seeking a highly skilled Lead Data Software Developer to lead our data engineering efforts. In this role, you will be responsible for designing, developing, and deploying large-scale data systems that support business-critical applications.Key Responsibilities:Lead the design and implementation of data architectures, ensuring...