AWS Cloud Engineer--Wisconsin Residents--REMOTE

3 weeks ago

Minneapolis, United States Beacon Hill Full time

Top Skills (3) & Years of Experience: 3 years advanced hands-on experience designing AWS data lake solutions, integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow, experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code

Nice to Have: Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators, Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles, Experience with Airflow DAG creation, Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.

Job Overview:

We are seeking an experienced AWS Redshift Data Engineer to assist our team in designing, developing, and

optimizing data pipelines for our AWS Redshift-based data lake house.

Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and

movement of data from Workday to AWS Redshift for consumer and analytic use.

Key Responsibilities:

 Collaborate with data engineering, business analysts, and development teams to design, develop, test,

and maintain robust and scalable data pipelines from Workday to AWS Redshift.

 Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data

quality, performance, and timeliness.

 Provide expertise in Redshift database optimization, performance tuning, and query optimization.

 Assist with design and implementation of workflows using Airflow.

 Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions

to address those concerns.

 Proactively identify opportunities to automate tasks and develop reusable frameworks.

 Work closely with version control team to maintain a well-organized and documented repository of

codes, scripts, and configurations using Git/Bitbucket.

 Provide technical guidance and mentorship to fellow developers, sharing insights into best practices,

tips, and techniques for optimizing Redshift-based data solutions.

Required Qualifications and Skills:

 Advanced hands-on experience designing AWS data lake solutions.

 Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena,

Airflow.

 Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.

 Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins

and transforming dataframes with pyspark code.

 Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML

defined IAM policies and roles.

 Experience with Airflow DAG creation.

 Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log

Insights, Cloudtrail, IAM.

 Ability to work in a highly complex python object oriented platform.

 Strong understanding of ETL best practices, data integration, data modeling, and data transformation.

 Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.

 Familiarity with version control systems, particularly Git, for maintaining a structured code repository.

 Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.

 Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical

concepts to non-technical stakeholders.

Additional Useful Experience:

 Docker

 Airflow Server Administration

 Parquet file formats

 AWS Security

 Jupyter Notebooks

 API Best Practices, API Gateway, Route Structuring and standard API authentication protocols

including tokens

 Git, Git flow best practices

 Release management and DevOps

 Shell scripting

 AWS certifications related to data engineering or databases are a plus.

 Experience with DevOps technologies and processes.

 Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from

multiple source systems.

 Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.

 Experience working with large-scale, high-volume data environments.

 Exposure to higher education, finance, and/or human resources data is a plus.

 Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and

transformation.

Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.


If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser:


Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.


Company Profile:


Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.


Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.


Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting


We look forward to working with you.


Beacon Hill. Employing the Future (TM)

  • AWS Cloud Engineer

    2 weeks ago

    Minneapolis, United States Diverse Lynx Full time

    Position: AWS Cloud Engineer Location: Minneapolis, MN- Onsite / Hybrid - Felxible Duration: 12+ months Relevant Experience (in Yrs) 6-12 years of Relevant Experience Technical/Functional Skills Required Skills: • 3+ years of experience in similar DevOps, SRE, or Platform roles in a cloud-based environment • Experience with Kubernetes networking/routing....

  • aws cloud engineer

    2 weeks ago

    Minneapolis, Minnesota, United States Randstad Full time

    aws cloud engineer. minneapolis , minnesota (remote) posted 1 day ago job details summary $54 - $64 per hour contract bachelor degree category computer and mathematical occupations reference job details job summary: Engineer II - AWS Cloud Tell us about your department: We are the Priorities Acceleration group within DAT. We are creating a team...

  • REMOTE AWS Cloud Engineer

    3 weeks ago

    Minneapolis, United States Capgemini Full time

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore. Sogeti brings...

  • aws cloud migration engineer

    2 weeks ago

    Minneapolis, Minnesota, United States RIT Solutions, Inc. Full time

    Must have a valid LinkedIn profile Duration: 12+ months EST or CST candidates Responsibilities: Be part of a team that creates, maintains, and supports our cloud environments. Work with product teams to engineer and translate their requests into cloud related operational actions. Explore new capabilities and patterns within cloud. Embed within a product...

  • AWS Engineer

    4 weeks ago

    Minneapolis, United States BCforward Full time

    AWS Engineer BCforward is currently seeking a highly motivated Senior IT Cloud Engineer for a remote position. Position Title: Senior IT Cloud EngineerLocation: RemoteAnticipated Start Date: [6/15/2024] Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date. Expected Contract...

  • Cloud Data Engineer

    3 weeks ago

    Minneapolis, United States Solution Design Group Full time

    SDG is a high-performance software community. We are a team of collaborative and creative consultants who build and deliver custom software for some of the most recognizable local and national brands. In this role, you will be asked to leverage your current skills while also learning new ones. Working in over 500 different technologies and continually...

  • Security/Cloud Architect

    4 weeks ago

    Minneapolis, United States C4 Technical Services Full time

    Security Analyst IV Location: Remote Collaborate with cross functional teams to perform threat analysis to identify cybersecurity risks and address information security concerns related to Azure/AWS platforms, including IoT and AI capabilities. Responsibilities: • Translate security and technical requirements into business requirements and communicate...

  • Cloud Software Engineer

    3 weeks ago

    Minneapolis, United States Saxon Global Full time

    CloudSoftware Engineer I 12 month contract100% Remote This engineering team develops services, controls, and reusable patterns that enable product teams to deliver value safely, quickly, and sustainably in the public cloud. This critical work ultimately helps people live healthier lives and makes the health system work better for everyone. Individual will...

  • Cloud Software Engineer

    4 weeks ago

    Minneapolis, United States Saxon Global Full time

    CloudSoftware Engineer I 12 month contract100% Remote This engineering team develops services, controls, and reusable patterns that enable product teams to deliver value safely, quickly, and sustainably in the public cloud. This critical work ultimately helps people live healthier lives and makes the health system work better for everyone. Individual will be...

  • Cloud Platform Engineer

    4 weeks ago

    Minneapolis, United States IDeaS Inc Full time

    Passionate people. Loyal clients. Leading solutions. With a rich culture of creative collaboration and professional growth, IDeaS' team members build successful careers with us. IDeaS is proud to be a global powerhouse of innovation and excellence; challenge and reward. No matter where we're working, our teams come together to create leading revenue...

  • Cloud Platform Engineer

    4 weeks ago

    Minneapolis, United States IDeaS Inc Full time

    : Passionate people. Loyal clients. Leading solutions. With a rich culture of creative collaboration and professional growth, IDeaS team members build successful careers with us. IDeaS is proud to be a global powerhouse of innovation and excellence; challenge and reward. No matter where were working, our teams come together to create leading revenue...

  • AWS/Java Engineer

    6 days ago

    Minneapolis, United States Concord Full time

    Qualifications Minimum of 3 years' experience in the design & implementation of distributed applications Minimum of 5 years Java experience Minimum of 2 years AWS experience in developing and delivering AWS solutions Must Have: In-depth, hands-on expertise in Java Must Have: AWS Development Experience Strong knowledge of AWS cloud environment Knowledge of...

  • AWS/Java Engineer

    2 weeks ago

    Minneapolis, United States Concord Full time

    Qualifications• Minimum of 3 years’ experience in the design & implementation of distributed applications• Minimum of 5 years Java experience• Minimum of 2 years AWS experience in developing and delivering AWS solutions• Must Have: In-depth, hands-on expertise in Java• Must Have: AWS Development Experience• Strong knowledge of AWS cloud...

  • Sr. Software Dev Engineer, AWS Direct Connect

    3 weeks ago

    Minneapolis, United States Amazon.com Inc Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, were the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, AWS, Software, Operations Manager, Software Engineer, Development Engineer, Network Engineer, Technology

  • Security Engineer IV

    4 weeks ago

    Minneapolis, United States C4 Technical Services Full time

    Security Engineer IV (AWS, Terraform) Location: Richfield, MN (Hybrid Schedule)Tell us about your department: Cloud Native Foundations is creating a platform based on AWS Cloud Native capabilities that will allow product teams control their infrastructure and deployments of their applications. Teams will have their own accounts with the ability to build out...

  • AWS Developer

    3 weeks ago

    Minneapolis, United States Diverse Lynx Full time

    Job Title: AWS Developer Location: Minneapolis, MN Duration: FulltimeSkill: AWS AdminJob Description: Must Have Technical/Functional Skills Bachelor's/Master's Degree or equivalent professional experience. Experience in enterprise-scale cloud and hybrid infrastructures for migrations, and technology management. Technology industry experience with ability...

  • AWS Developer

    4 weeks ago

    Minneapolis, United States Diverse Lynx Full time

    Job Title: AWS Developer Location: Minneapolis, MN Duration: FulltimeSkill: AWS AdminJob Description: Must Have Technical/Functional Skills Bachelor's/Master's Degree or equivalent professional experience. Experience in enterprise-scale cloud and hybrid infrastructures for migrations, and technology management. Technology industry experience with ability...

  • Lead Cloud DBA- MongoDB Atlas- 100% Remote

    1 week ago

    Minneapolis, United States Zillion Technologies, Inc. Full time

    Technical Lead_Cloud DB Administrator Specialist- 100% Remote Duration: 6 months. Opportunity for conversion OR extension.Location: Open to REMOTE.Work Authorization: USC GCYears of experience: 7Must Have: Postgres, Aurora, Mongo Atlas, Cloud CFT, Understanding of VPC (Virtual Private Cloud), Cloud Automation developmentPreferred: Understanding of Neptune,...

  • DevOps Lead

    3 weeks ago

    Minneapolis, United States CleanChoice Energy Full time

    CleanChoice Energy, a national renewable energy company that empowers people and businesses to cut emissions and live cleaner, healthier lives, is seeking a DevOps Lead to join the Engineering department. This is a unique opportunity to join a mission driven organization transforming the U.S. electricity market by switching homes and businesses to 100%...

  • DevSecOps Engineer

    2 hours ago

    Minneapolis, United States Calabria Group Full time

    1 year plus contract REMOTE ****Pay $70-75hr W2 ***** Must be US citizen or Green Card holder for Security clearance reasons The successful candidate must have hands-on experience in cloud-native software development, service, or support and be a highly adaptable team player who can quickly ramp up on new technologies and accomplish goals in a fast-paced...