Current jobs related to Senior AWS Redshift Data Engineer - Madison - Novalink Solutions LLC

  • Cloud Data Engineer

    1 day ago

    Madison, Wisconsin, United States Saxon Global Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Saxon Global. As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines using AWS services.Key Responsibilities:Collaborate with data engineering and development teams to design and...

  • IICS (Informatica Intelligent Cloud Services) Architect with AWS

    4 weeks ago

    Madison, United States Redleo Software Inc Full time

    This role will primarily focus on analyzing, developing, implementing, Testing, and Supporting Data Integration Solutions using Informatica Intelligent Cloud Services (IICS), ideally on the AWS platform.Mentor team on creating and implementing Informatica Intelligent Cloud Services (IICS) integrations.Contribute to IICS integration design for future-state HR...

  • IICS (Informatica Intelligent Cloud Services) Architect with AWS ::: Madison WI

    4 weeks ago

    Madison, United States REDLEO SOFTWARE INC. Full time

    This role will primarily focus on analyzing, developing, implementing, Testing, and Supporting Data Integration Solutions using Informatica Intelligent Cloud Services (IICS), ideally on the AWS platform. Sample responsibilities:Mentor team on creating and implementing Informatica Intelligent Cloud Services (IICS) integrations.Contribute to IICS integration...

  • Senior Data Engineer

    4 weeks ago

    Madison, United States RIT Solutions, Inc. Full time

    Senior Data EngineerMadison, WI Primary Skills API,Python,SQL Required Skills Job Description Client is seeking a Senior Data Engineer (Snowflake/ Informatica) to play a crucial role in advancing the data and analytics practices within the organization. In this role, you will lead the design, development, implementation, enhancement, and maintenance of...

  • Data Architect

    3 weeks ago

    Madison, Wisconsin, United States Sift Healthcare Full time

    About the RoleSift Healthcare is seeking a highly skilled Data Engineer III to join our team. As a key member of our data science team, you will play a critical role in designing and developing data pipelines to integrate disparate systems and curate data for machine learning.The ideal candidate will have a strong understanding of data modeling principles...

  • Senior Cloud Software Engineer

    2 days ago

    Madison, Wisconsin, United States CRIBL INC Full time

    Job Title: Senior Cloud Software EngineerCribl Inc. is seeking a highly skilled Senior Cloud Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable and secure cloud-based software systems.Key Responsibilities:Design and develop cloud-based software systems using...

  • Senior Software Engineer

    3 weeks ago

    Madison, Wisconsin, United States Tarvos Talent Full time

    Tarvos Talent is on the lookout for a Senior Software Engineer to take on a pivotal role within a rapidly expanding organization. This position has become available as the company aims to enhance its workforce and shift towards cloud-centric solutions. This is an excellent opportunity for an individual eager to make a substantial contribution and advance...

  • WI Resident Informatica Technical Architect 4

    4 weeks ago

    Madison, United States Sundial Software Full time

    The State of Wisconsin is looking for a Technical Architect IV Top Skills (3) & Years of Experience: -3+ years of experience in Analysis, Design, Development, Implementation, Testing and Support of Data Integration Solutions using Informatica Intelligent Cloud Services (IICS) -3+ years of experience developing ETL integrations -3+ years of experience...

  • Data Engineer

    5 days ago

    Madison, New Jersey, United States Ascendion Full time

    About AscendionWe are a full-service digital engineering solutions company that empowers growth and delivers captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients.Our culture is built on opportunity, inclusion, and a...

  • Senior Software Engineer

    4 weeks ago

    Madison, Wisconsin, United States Tarvos Talent Full time

    Tarvos Talent is on the lookout for a Senior Software Engineer to join a forward-thinking organization that is rapidly evolving. This position has opened up as the company aims to enhance its workforce and shift towards cloud-centric solutions. This is an excellent chance for a skilled professional eager to make a substantial contribution and advance their...

  • Informatica IICS Architect

    4 weeks ago

    Madison, United States Talent Groups Full time

    13+ years of experience with 3+ years of experience in Analysis, Design, Development, Implementation, Testing and Support of Data Integration Solutions using Informatica Intelligent Cloud Services (IICS).3+ years of experience developing ETL integrations -3+ years of experience implementing batch and real-time (event-based and API) data integration...

  • Data Engineer

    6 days ago

    Madison, Wisconsin, United States Sift Healthcare Full time

    About Sift HealthcareSift Healthcare is a data science company dedicated to improving payments operations and outcomes in the healthcare industry.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer at Sift Healthcare, you will play a critical role in designing and developing data pipelines to integrate disparate...

  • Data Engineer

    4 weeks ago

    Madison, United States Great Lakes Full time

    JOB REQUIREMENTS: Job Description Job Summary Great Wolf Lodge is seeking a talented and motivated Data Engineer to join our Analytics team. As a Data Engineer, you will play a crucial role in shaping our data infrastructure and analytics capabilities, enabling data-driven decision-making across the organization. You will work closely with data scientists,...

  • Data Engineer

    17 hours ago

    Madison, Wisconsin, United States Sift Healthcare Full time

    About Sift HealthcareSift Healthcare is a data science company dedicated to improving payments operations and outcomes in the healthcare industry. Our team is passionate about technology and committed to delivering innovative solutions.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer at Sift Healthcare, you will...

  • Technical Architect IV

    1 month ago

    Madison, United States Vision It US Full time

    Job DescriptionJob DescriptionCandidates MUST be WI residents or willing to relocate to WI at their own expense prior to starting. This position can work 100% remotely (within the state of WI).UW-Madison's Division of Information Technology - Enterprise Business Systems is looking for an Informatica Intelligent Cloud Services (IICS) consultant with...

  • Senior data engineer

    4 weeks ago

    Madison, United States Randstad Full time

    job summary: Are you looking for the chance to work alongside skilled engineers with a focus on coding, data and analytics? If so, apply to this opportunity today! We are looking for a Senior Engineer to join the team on a contract to hire basis (must be able to work as an FTE, on a W-2 basis, without sponsorship). This is a hybrid position; candidates can...

  • Senior Software Engineer

    1 day ago

    Madison, Wisconsin, United States CRIBL INC Full time

    About Cribl IncCribl Inc is a remote-first company that empowers its employees to do their best work, wherever they are. We believe in putting customers first and are passionate about solving their most pressing data needs.Job RequirementsWe are looking for a back-end focused Senior Engineer to collaborate on a diverse, inclusive, cross-functional team of...

  • Senior Software Engineer

    1 week ago

    Madison, United States TEKsystems Full time

    Job DescriptionJob DescriptionWe are hiring a Senior Software Engineer to join our team on a hybrid basis in Madison, WI. Responsibilities and Required Technologies:Ability to work on Full Stack .NET applicationsExperience writing and using webservicesExperience with C#Experience with any cloud technologies (Azure, AWS, or GCP)Strong experience with SQLAny...

  • Senior Cloud Software Engineer

    5 days ago

    Madison, Wisconsin, United States CRIBL INC Full time

    Job Title: Senior Cloud Software EngineerCribl Inc. is seeking a highly skilled Senior Cloud Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable and secure cloud-based software systems.Key Responsibilities:Design and develop cloud-based software systems using...

  • Senior Software Engineer, Cribl Lake

    5 days ago

    Madison, Wisconsin, United States CRIBL INC Full time

    About the RoleCribl Inc. is seeking a highly skilled Senior Software Engineer to join our team and contribute to the development of Cribl Lake. As a key member of our engineering team, you will work closely with Product, Operations, and other business functions to deliver end-to-end features and functionality for Cribl Lake.Key ResponsibilitiesContribute to...

Senior AWS Redshift Data Engineer

4 months ago

Madison, United States Novalink Solutions LLC Full time
Job Description
The Universities of Wisconsin Enterprise Analytics Platform (EAP) team supports the development and support
of the data lake for the UW System Office and member universities.
Job Overview:
We are seeking an experienced AWS Redshift Data Engineer to assist our team in designing, developing, and
optimizing data pipelines for our AWS Redshift-based data lake house.
Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and
movement of data from Workday to AWS Redshift for consumer and analytic use.
Collaborate with data engineering, business analysts, and development teams to design, develop, test,
and maintain robust and scalable data pipelines from Workday to AWS Redshift.
Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data
quality, performance, and timeliness.
Provide expertise in Redshift database optimization, performance tuning, and query optimization.
Assist with design and implementation of workflows using Airflow.
Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions
to address those concerns.
Proactively identify opportunities to automate tasks and develop reusable frameworks.
Work closely with version control team to maintain a well-organized and documented repository of
codes, scripts, and configurations using Git/Bitbucket.
Provide technical guidance and mentorship to fellow developers, sharing insights into best practices,
tips, and techniques for optimizing Redshift-based data solutions.
Advanced hands-on experience designing AWS data lake solutions.
Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena,
Airflow.
Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins
and transforming dataframes with pyspark code.
Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML
defined IAM policies and roles.
Experience with Airflow DAG creation.
Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log
Insights, Cloudtrail, IAM.
Ability to work in a highly complex python object oriented platform.
Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical
concepts to non-technical stakeholders.
Additional Useful Experience:
Airflow Server Administration
Parquet file formats
AWS Security
Jupyter Notebooks
API Best Practices, API Gateway, Route Structuring and standard API authentication protocols
including tokens
Git, Git flow best practices
Release management and DevOps
Shell scripting
AWS certifications related to data engineering or databases are a plus.
Experience with DevOps technologies and processes.
Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from
multiple source systems.
Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
Experience working with large-scale, high-volume data environments.
Exposure to higher education, finance, and/or human resources data is a plus.
Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and
transformation.