Current jobs related to AWS Data Engineer - Madison - Element6Talent

  • Data Engineer

    1 day ago

    Madison, New Jersey, United States Ascendion Full time

    About AscendionWe are a full-service digital engineering solutions company that empowers growth and delivers captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients.Our culture is built on opportunity, inclusion, and a...

  • Data Engineer

    2 days ago

    Madison, Wisconsin, United States Sift Healthcare Full time

    About Sift HealthcareSift Healthcare is a data science company dedicated to improving payments operations and outcomes in the healthcare industry.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer at Sift Healthcare, you will play a critical role in designing and developing data pipelines to integrate disparate...

  • Data Engineer

    3 weeks ago

    Madison, United States Great Lakes Full time

    JOB REQUIREMENTS: Job Description Job Summary Great Wolf Lodge is seeking a talented and motivated Data Engineer to join our Analytics team. As a Data Engineer, you will play a crucial role in shaping our data infrastructure and analytics capabilities, enabling data-driven decision-making across the organization. You will work closely with data scientists,...

  • IICS (Informatica Intelligent Cloud Services) Architect with AWS

    3 weeks ago

    Madison, United States Redleo Software Inc Full time

    This role will primarily focus on analyzing, developing, implementing, Testing, and Supporting Data Integration Solutions using Informatica Intelligent Cloud Services (IICS), ideally on the AWS platform.Mentor team on creating and implementing Informatica Intelligent Cloud Services (IICS) integrations.Contribute to IICS integration design for future-state HR...

  • IICS (Informatica Intelligent Cloud Services) Architect with AWS ::: Madison WI

    4 weeks ago

    Madison, United States REDLEO SOFTWARE INC. Full time

    This role will primarily focus on analyzing, developing, implementing, Testing, and Supporting Data Integration Solutions using Informatica Intelligent Cloud Services (IICS), ideally on the AWS platform. Sample responsibilities:Mentor team on creating and implementing Informatica Intelligent Cloud Services (IICS) integrations.Contribute to IICS integration...

  • Software Engineer

    1 month ago

    Madison, United States Rentable Full time

    Job DescriptionJob DescriptionWe're Changing the Rentals IndustryWe're a profitable, growth-stage company specializing in industry-leading martech and data SaaS products for the rentals industry. Originally known for building and operating one of the U.S.'s largest rental marketplaces, Rentable, we have since expanded our portfolio to include two...

  • Data Architect

    3 weeks ago

    Madison, Wisconsin, United States Focused HR Solutions Full time

    Focused HR Solutions is seeking a highly skilled and experienced Data Architect to lead the design, development, and implementation of our enterprise data platforms. The ideal candidate will possess a deep understanding of data architecture principles, best practices, and emerging technologies. In this role, you will be responsible for translating business...

  • Data Integration Specialist

    1 day ago

    Madison, Wisconsin, United States Creative Financial Staffing Full time

    About Our ClientCreative Financial Staffing is proud to partner with a leading-edge technology company at the forefront of data management solutions, driving innovation in the field of information technology.Committed to fostering a culture of growth and development, they empower their employees to excel in a collaborative environment that values creativity...

  • Platform Engineer

    1 week ago

    Madison, United States Intelliswift Software, Inc Full time

    Job Title: Platform Engineer Location: Madison, WI 53783 (up to 10 days/month onsite) Duration: 12 months Pay Rate Range: $60 - $71.73/Hour Intelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift...

  • Data Engineer

    4 weeks ago

    Madison, United States Promega Full time

    Job Description OUR TEAM: We are the Data Science and Engineering team. We are made up of different specialists who play multiple roles: data scientists, data architects, data engineers, business analysts, and database administrators. We provide our expertise in all things data to Promega. We lend our expertise to designing, integrating, and providing...

  • Cloud Infrastructure Engineer

    4 days ago

    Madison, Wisconsin, United States Intelliswift Software Inc Full time

    Job Title: Cloud Infrastructure EngineerLocation: Madison, WIDuration: 12 monthsPay Rate Range: $60 - $71.73/HourAbout Intelliswift Software Inc.We conceptualize, build, and support the world's most amazing technology products and solutions. Our team of experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in...

  • Data Architect

    2 weeks ago

    Madison, Wisconsin, United States Sift Healthcare Full time

    About the RoleSift Healthcare is seeking a highly skilled Data Engineer III to join our team. As a key member of our data science team, you will play a critical role in designing and developing data pipelines to integrate disparate systems and curate data for machine learning.The ideal candidate will have a strong understanding of data modeling principles...

  • Data Engineer Intern

    6 days ago

    Madison, Wisconsin, United States General Motors Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Engineer Intern to join our team at General Motors. As a Data Engineer Intern, you will play a critical role in building industrialized data assets and optimizing data pipelines in support of Business Intelligence and Advanced Analytics objectives.Key ResponsibilitiesDesign and develop...

  • Data Engineer Intern

    6 days ago

    Madison, Wisconsin, United States General Motors Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Engineer Intern to join our team at General Motors. As a Data Engineer Intern, you will play a critical role in building industrialized data assets and optimizing data pipelines in support of Business Intelligence and Advanced Analytics objectives.Key ResponsibilitiesDesign and develop...

  • Data Engineer Intern

    5 days ago

    Madison, Wisconsin, United States General Motors Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Engineer Intern to join our team at General Motors. As a Data Engineer Intern, you will play a critical role in building industrialized data assets and optimizing data pipelines in support of Business Intelligence and Advanced Analytics objectives.Key ResponsibilitiesDesign and develop...

  • DevOps Engineer

    5 days ago

    Madison, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are extending an opportunity for a DevOps Engineer to join our team in Madison, Wisconsin. This role offers a contract to hire employment opportunity, ideal for individuals who are keen to make a significant contribution to our operations. As a DevOps Engineer, you will be instrumental in managing and enhancing our technical...

  • Senior Data Engineer

    3 weeks ago

    Madison, United States RIT Solutions, Inc. Full time

    Senior Data EngineerMadison, WI Primary Skills API,Python,SQL Required Skills Job Description Client is seeking a Senior Data Engineer (Snowflake/ Informatica) to play a crucial role in advancing the data and analytics practices within the organization. In this role, you will lead the design, development, implementation, enhancement, and maintenance of...

  • Data Engineer and Analyst

    2 weeks ago

    Madison, Wisconsin, United States University of Wisconsin Full time

    About the RoleThe University of Wisconsin is seeking a highly skilled Business Intelligence Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, implementing, and maintaining databases, data warehouses, and data models to support analysis and reporting.Key ResponsibilitiesDatabase Design and...

  • Senior Software Engineer

    3 weeks ago

    Madison, Wisconsin, United States Tarvos Talent Full time

    Tarvos Talent is on the lookout for a Senior Software Engineer to take on a pivotal role within a rapidly expanding organization. This position has become available as the company aims to enhance its workforce and shift towards cloud-centric solutions. This is an excellent opportunity for an individual eager to make a substantial contribution and advance...

  • Staff Software Engineer

    1 month ago

    Madison, United States Tarvos Talent Full time

    Tarvos Talent is seeking a Staff Software Engineer for an exciting opportunity with a rapidly growing company. This role is open due to the company's desire to expand their team and transition to cloud-based solutions. This is a fantastic opportunity for a professional looking to make a significant impact and grow their career in a dynamic, supportive...

AWS Data Engineer

3 months ago

Madison, United States Element6Talent Full time

Element6's client is seeking an experienced AWS Redshift Data Engineer to assist their team in designing, developing, and optimizing data pipelines for their AWS Redshift-based data lake house. This is a remote role, but candidates MUST be Wisconsin residents.


Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and movement of data from Workday to AWS Redshift for consumer and analytic use.


Key Responsibilities:

  • Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
  • Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization. Assist with design and implementation of workflows using Airflow.
  • Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
  • Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git/Bitbucket.
  • Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.


Required Qualifications and Skills:

  • Advanced hands-on experience designing AWS data lake solutions. Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
  • Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators. Experience with Pyspark and Glue ETL scripting including functions such as relationalize, performing joins and transforming dataframes with Pyspark code.
  • Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
  • Experience with Airflow DAG creation.
  • Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
  • Ability to work in a highly complex python object-oriented platform.
  • Strong understanding of ETL best practices, data integration, data modeling, and data transformation. Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
  • Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
  • Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
  • Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.


Additional Useful Experience:

  • Docker
  • Airflow Server Administration
  • Parquet file formats
  • AWS Security
  • Jupyter Notebooks
  • API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
  • Git, Git flow best practices
  • Release management and DevOps
  • Shell scripting
  • AWS certifications related to data engineering or databases are a plus.
  • Experience with DevOps technologies and processes.
  • Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
  • Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
  • Experience working with large-scale, high-volume data environments.
  • Exposure to higher education, finance, and/or human resources data is a plus.
  • Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.