Certified Cloud Engineer

2 days ago

Madison, WI, United States Kaav Inc. Full time
Candidates MUST be WI residents or willing to relocate to WI at their own expense prior to starting. This position can work 100% remotely (within the state of WI).

AWS Engineer

The Universities of Wisconsin Enterprise Analytics Platform (EAP) team supports the development and support of the data lake for the UW System Office and member universities. We are seeking an experienced AWS Redshift Data Engineer to assist our team in designing, developing, and optimizing data pipelines for our AWS Redshift-based data lake house. Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and movement of data from Workday to AWS Redshift for consumer and analytic use.

Key Responsibilities:
  • Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
  • Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization.
  • Assist with design and implementation of workflows using Airflow.
  • Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
  • Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git/Bitbucket.
  • Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.
Required Qualifications and Skills:
  • Advanced hands-on experience designing AWS data lake solutions.
  • Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
  • Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
  • Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code.
  • Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
  • Experience with Airflow DAG creation.
  • Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
  • Ability to work in a highly complex python object oriented platform.
  • Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
  • Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
  • Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
  • Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
  • Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.
Additional Useful Experience:
  • Docker
  • Airflow Server Administration
  • Parquet file formats
  • AWS Security
  • Jupyter Notebooks
  • API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
  • Git, Git flow best practices
  • Release management and DevOps
  • Shell scripting
  • AWS certifications related to data engineering or databases are a plus.
  • Experience with DevOps technologies and processes.
  • Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
  • Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
  • Experience working with large-scale, high-volume data environments.
  • Exposure to higher education, finance, and/or human resources data is a plus.
  • Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.

Required Skills : Cloud SQL,AWS Cloud Formation
Additional Skills : Cloud Engineer,AWS Engineer

  • Cloud Engineer

    8 hours ago

    Madison, WI, United States GovCIO Full time

    Overview GovCIO is currently hiring for a Cloud Engineer tomanage service provider for Army and DoD IT systems. This position will be located in Radford,VA and will be a remote position. Responsibilities The cloud engineer designs, builds, maintains, and troubleshoots secure and scalable cloud based systems and infrastructure to meet business needs. Their...

  • DevOps Cloud Engineer

    7 days ago

    Madison, WI, United States Realta Fusion Inc. Full time

    We are seeking a DevOps Cloud Engineer to help design, deploy, and maintain our multi-cloud, high-performance computing (HPC) infrastructure. This role will collaborate closely with our managed service partner and our in-house scientific and engineering teams to establish and manage our cloud-based compute environment. Over time, this engineer will assume...

  • Cloud Infrastructure Engineer

    3 days ago

    Madison, WI, United States Information Resource Group Full time

    Role: Cloud Infrastructure Engineer Location: Madison, WI-Hybrid Duration: 6 Months Contract Job Description: IT Systems & Cloud Engineer plays a central role in managing, securing, and optimizing both cloud and on-premises infrastructure for the agency. This includes server environments, virtual machines, M365 and Entra ID services, enterprise SaaS...

  • AWS Cloud Engineer

    6 days ago

    Madison, WI, United States ECP Full time

    ECP is a market-leading SaaS platform that helps senior living communities provide better care for their residents and is trusted by more than 7,000 communities around the world. As we continue to grow, we’re expanding both our customer base and the scope of our products to deliver even greater value to the senior living industry. We’re seeking a remote...

  • Cloud Software Engineer

    1 week ago

    Madison, WI, United States TalentFish Full time

    Job Title: Full Stack Cloud Engineer Primary Location: Madison, Wisconsin- Hybrid Position Type: Direct HireOverview TalentFish is casting a line for a Full Stack Cloud Engineer with our premier client. This is a direct hire role that is hybrid in Madison, WI. Location Flexibility: Madison, WI area (within 50-mile radius): 3 days in-office per week...

  • Cloud Software Engineer

    2 weeks ago

    Madison, WI, United States TalentFish Full time

    Job Title: Full Stack Cloud Engineer Primary Location: Madison, Wisconsin- Hybrid Position Type: Direct HireOverview TalentFish is casting a line for a Full Stack Cloud Engineer with our premier client. This is a direct hire role that is hybrid in Madison, WI. Location Flexibility: Madison, WI area (within 50-mile radius): 3 days in-office per week...

  • Cloud Software Engineer

    6 days ago

    Madison, WI, United States TalentFish Full time

    Job Title: Full Stack Cloud Engineer Primary Location: Madison, Wisconsin- Hybrid Position Type: Direct HireOverview TalentFish is casting a line for a Full Stack Cloud Engineer with our premier client. This is a direct hire role that is hybrid in Madison, WI. Location Flexibility: Madison, WI area (within 50-mile radius): 3 days in-office per week...

  • Lead Software Engineer

    2 days ago

    Madison, WI, United States Sumo Logic Full time

    At Sumo Logic, we are transforming the landscape of security across cloud and hybrid environments with our innovative Cloud SIEM platform. With a focus on advanced analytics and machine learning, our solution provides organizations with real-time threat detection, incident response, and compliance management capabilities. We are looking for an experienced...

  • Lead Software Engineer

    6 days ago

    Madison, WI, United States Sumo Logic Full time

    At Sumo Logic, we are transforming the landscape of security across cloud and hybrid environments with our innovative Cloud SIEM platform. With a focus on advanced analytics and machine learning, our solution provides organizations with real-time threat detection, incident response, and compliance management capabilities. We are looking for an experienced...

  • Senior SaaS Cloud Capacity Engineer

    7 days ago

    Madison, WI, United States Oracle Full time

    Job Description What You'll Do Capacity Engineering - Act as a strategic capacity partner, immersing in the end-to-end architecture and performance of SaaS production services. Ensure mission-critical workloads-including emerging agentic AI and MLOps pipelines -are forecasted, scaled, and optimized for OCI cloud capacity at enterprise scale. Cost...