Certified Cloud Engineer

1 week ago

Madison, WI, United States Concord IT Systems Full time
Key Responsibilities:

  • Collaborate with data engineering and development teams to design, develop, test, and maintain robust and scalable ELT/ETL pipelines using SQL scripts, Redshift stored procedures, and other AWS tools and services.
  • Collaborate with our engineering and data teams to understand business requirements and data integration needs, translate them into effective data solutions, that yield top-quality outcomes.
  • Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
  • Employ AWS DMS and other services for efficient data ingestion from on-premises databases into Redshift.
  • Design and implement ETL processes, encompassing Changed Data Capture (CDC) and Slow Changing Dimension (SCD) logics, to seamlessly integrating data from diverse source systems.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization.
  • Design and implement efficient orchestration workflows using Airflow, ensuring seamless coordination of complex ETL processes.
  • Integrate Redshift with other AWS services, such as AWS DMS, AWS Glue, AWS Lambda, Amazon S3, Airflow, and more, to build end-to-end data pipelines.
  • Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
  • Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git.
  • Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.
Qualifications and Skills:
  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Extensive hands-on experience designing, developing, and maintaining data pipelines and ETL processes on AWS Redshift, including data lakes and data warehouses.
  • Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.
  • Hands-on experience with AWS services such as AWS DMS, Amazon S3, AWS Glue, Redshift, Airflow, and other pertinent data technologies.
  • Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
  • Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
  • Demonstrated expertise in AWS DMS for seamless ingestion from on-prem databases to AWS cloud.
  • Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
  • Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
  • Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
  • Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries,
  • Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
  • Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.
  • Proven track record of delivering high-quality data solutions within designated timelines.
  • Experience working with large-scale, high-volume data environments.
  • The ideal candidate possesses several years of hands-on experience working with Redshift and other AWS services and a proven track record of delivering high-performing, scalable data platforms and solutions within the AWS cloud.
  • AWS certifications related to data engineering or databases are a plus.
Top Skills (3) & Years of Experience:
  • 1+ Years of Experience with extensive hands-on experience designing, developing, and maintaining data pipelines and ETL processes on AWS Redshift, including data lakes and data warehouses
  • Hands-on experience with AWS services such as AWS DMS, Amazon S3, AWS Glue, Redshift, Airflow, and other pertinent data technologies,
  • Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
Nice to Have:
  • Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation
  • AWS certifications related to data engineering or databases are a plus.
  • Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems,
  • Demonstrated expertise in AWS DMS for seamless ingestion from on-prem databases to AWS cloud
Interview Process:
  • Remote, Microsoft Teams
Duration:
  • 6 months with the possibility of extension for another 3 or 6 months
Onsite or Remote?
  • This position can work 100% remote (within the state of WI).
  • Candidates MUST be WI residents or willing to relocate to WI prior to starting the role at their own expense.
Additional Details:
  • The manager is not requiring certification, but it is a Nice to Have Skill. Please view attached Position Description for additional Top Skills, Nice to haves etc.
Access to FTI (Federal Tax Information)?
  • No

Security Required:
Yes

  • Certified Cloud Engineer AWS

    1 week ago

    Madison, WI, United States Nava Software Solutions Full time

    NAVA Software solutions is looking for a Certified Cloud Engineer/ AWS Engineer Details: Certified Cloud Engineer/ AWS Engineer Location: Remote project (Need to be based in WI state) Duration: 12 months The Enterprise Analytics Platform (EAP) team supports the development and support of the data lake for the UW System Office and member universities. We are...

  • DevOps Cloud Engineer

    3 hours ago

    Madison, WI, United States Realta Fusion Inc. Full time

    We are seeking a DevOps Cloud Engineer to help design, deploy, and maintain our multi-cloud, high-performance computing (HPC) infrastructure. This role will collaborate closely with our managed service partner and our in-house scientific and engineering teams to establish and manage our cloud-based compute environment. Over time, this engineer will assume...

  • Cloud Software Engineer

    2 days ago

    Madison, WI, United States TalentFish Full time

    Job Title: Full Stack Cloud Engineer Primary Location: Madison, Wisconsin- Hybrid Position Type: Direct HireOverview TalentFish is casting a line for a Full Stack Cloud Engineer with our premier client. This is a direct hire role that is hybrid in Madison, WI. Location Flexibility: Madison, WI area (within 50-mile radius): 3 days in-office per week...

  • Cloud Software Engineer

    7 days ago

    Madison, WI, United States TalentFish Full time

    Job Title: Full Stack Cloud Engineer Primary Location: Madison, Wisconsin- Hybrid Position Type: Direct HireOverview TalentFish is casting a line for a Full Stack Cloud Engineer with our premier client. This is a direct hire role that is hybrid in Madison, WI. Location Flexibility: Madison, WI area (within 50-mile radius): 3 days in-office per week...

  • Lead Software Engineer

    2 hours ago

    Madison, WI, United States Sumo Logic Full time

    At Sumo Logic, we are transforming the landscape of security across cloud and hybrid environments with our innovative Cloud SIEM platform. With a focus on advanced analytics and machine learning, our solution provides organizations with real-time threat detection, incident response, and compliance management capabilities. We are looking for an experienced...

  • Senior SaaS Cloud Capacity Engineer

    2 weeks ago

    Madison, WI, United States Oracle Full time

    Job Description What You'll Do Capacity Engineering - Act as a strategic capacity partner, immersing in the end-to-end architecture and performance of SaaS production services. Ensure mission-critical workloads-including emerging agentic AI and MLOps pipelines -are forecasted, scaled, and optimized for OCI cloud capacity at enterprise scale. Cost...

  • Senior SaaS Cloud Capacity Engineer

    4 hours ago

    Madison, WI, United States Oracle Full time

    Job Description What You'll Do Capacity Engineering - Act as a strategic capacity partner, immersing in the end-to-end architecture and performance of SaaS production services. Ensure mission-critical workloads-including emerging agentic AI and MLOps pipelines -are forecasted, scaled, and optimized for OCI cloud capacity at enterprise scale. Cost...

  • Cloud Architect

    1 week ago

    Madison, WI, United States Ryder Full time

    Job Seekers can review the Job Applicant Privacy Policy by clicking here (http://ryder.com/job-applicant-privacy-policy) . Job Description : Position Summary The Cloud Architect will play a pivotal role in shaping Ryder's cloud strategy and operational excellence. This individual will lead the design, governance, and implementation of scalable, secure, and...

  • Lead Cloud Architect with LIS or LIMS

    2 weeks ago

    Madison, WI, United States Mitchell Martin Full time

    Title: Lead Cloud Architect with LIS or LIMS. Location: Madison, WI Position Type: Full Time Compensation Pay Range:$150,000-$170,000 Per Year Job Description: This full-time role located in Madison, WI, requires designing and supporting cloud services and platforms. The position involves collaboration with engineering teams to optimize cloud solutions,...

  • Remote Senior Software Engineer

    4 days ago

    Madison, WI, United States Oracle Full time

    Job Description As a Senior Member of Technical Staff, you will be a key contributor to the development and success of our next-generation CDA platform, which leverages the power of generative AI and cloud-native technologies. Your expertise in data platform engineering will drive the creation of a robust and intelligent system, enhancing the healthcare...