AWS Data Engineer

1 month ago

charlotte, United States Brooksource Full time

Location: Charlotte, NC (Hybrid 2-3 days a week on site)

3-year contract with opportunity for extension or full-time hire

W-2 Only, No Corp-to-Corp or 1099


Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC.


RESPONSIBILITIES:

  • Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery
  • Lead the Design, Build, Test and Deployment of components
  • Where applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead)
  • Understand requirements / use case to outline technical scope and lead delivery of technical solution
  • Confirm required developers and skillsets specific to product
  • Provides leadership, direction, peer review and accountability to developers on the product (key responsibility)
  • Works closely with the Product Owner to align on delivery goals and timing
  • Assists Product Owner with prioritizing and managing team backlog
  • Collaborates with Data and Solution architects on key technical decisions
  • The architecture and design to deliver the requirements and functionality
  • Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality
  • Designs data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance
  • Manage and resolve issues in production data warehouse environments on AWS


TECHNICAL REQUIREMENTS:

  • 5+ years of AWS experience, specifically including AWS Redshift
  • AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight
  • Experience with Kafka/Messaging preferably Confluent Kafka
  • Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB and Aurora
  • Experience with Amazon Redshift for AWS data warehousing tools such as Amazon Redshift and Amazon Athena
  • Proven track record in the design and implementation of data warehouse solutions using AWS
  • Skilled in data modeling and executing ETL processes tailored for data warehousing
  • Competence in developing and refining data pipelines within AWS
  • Proficient in handling both real-time and batch data processing tasks
  • Extensive understanding of database management fundamentals
  • Expertise in creating alerts and automated solutions for handling production problems
  • Tools and Languages – Python, Spark, PySpark and Pandas
  • Infrastructure as Code technology – Terraform/CloudFormation
  • Experience with Secrets Management Platform like Vault and AWS Secrets manager
  • Experience with Event Driven Architecture
  • DevOps pipeline (CI/CD); Bitbucket; Concourse
  • Experience with RDBMS platforms and Strong proficiency with SQL
  • Experience with Rest APIs and API gateway
  • Deep knowledge of IAM roles and Policies
  • Experience using AWS monitoring services like CloudWatch, CloudTrail ad CloudWatch events
  • Deep understanding of networking DNS, TCP/IP and VPN
  • Experience with AWS workflow orchestration tool like Airflow or Step Functions


PREFFERED SKILLS

  • Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch
  • Databases - Document DB, Mongo DB
  • Hadoop platform (Hive; HBase; Druid)
  • Java, Scala, Node JS
  • Workflow Automation
  • Experience transitioning on premise big data platforms into cloud-based platforms such as AWS
  • Strong Background in Kubernetes, Distributed Systems, Microservice architecture and containers


ADDITIONAL REQUIREMENTS

  • Ability to perform hands on development and peer review for certain components / tech stack on the product
  • Standing up of development instances and migration path (with required security, access/roles)
  • Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows)
  • Lead implementation of integrated data quality framework
  • Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data)
  • Supports data scientist with test and validation of models
  • Performs impact analysis and identifies risk to design changes
  • Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications
  • Ability to implement data pipelines with the right attentiveness to durability and data quality
  • Implements data warehousing products thinking of the end users experience (ease of use with right performance)
  • Ensures Test Driven development
  • 5+ years of Experience leading teams to deliver complex products
  • Strong technical skills and communication skills
  • Strong skills with business stakeholder interactions
  • Strong solutioning and architecture skills
  • 5+ years of Experience building real time data ingestion streams (event driven)
  • Ensure data security and permissions solutions, including data encryption, user access controls and logging

  • AWS Data Engineer

    4 weeks ago

    Charlotte, United States Brooksource Full time

    AWS Data EngineerLocation: Charlotte, NC (hybrid, 2-3 days/week in office)3- year contract with opportunity for extension or full-time hireW-2 only (cannot accommodate Corp-to-Corp or 1099)Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • AWS Data Engineer

    1 month ago

    charlotte, United States Brooksource Full time

    Location: Charlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099 Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...

  • AWS Data Engineer

    1 month ago

    Charlotte, United States Brooksource Full time

    Location: Charlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099 Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...

  • AWS Data Engineer

    1 month ago

    Charlotte, United States Brooksource Full time

    Location: Charlotte, NC (hybrid, 2-3 days/week in office)3- year contract with opportunity for extension or full-time hireW-2 only (cannot accommodate Corp-to-Corp or 1099) Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • AWS Data Engineer

    3 weeks ago

    charlotte, United States Brooksource Full time

    Location: Charlotte, NC (hybrid, 2-3 days/week in office)3- year contract with opportunity for extension or full-time hireW-2 only (cannot accommodate Corp-to-Corp or 1099) Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • AWS Data Engineer

    4 weeks ago

    charlotte, United States Brooksource Full time

    Location: Charlotte, NC (hybrid, 2-3 days/week in office)3- year contract with opportunity for extension or full-time hireW-2 only (cannot accommodate Corp-to-Corp or 1099) Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • AWS Data Engineer

    2 weeks ago

    Charlotte, NC, United States Brooksource Full time

    LocationCharlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...

  • AWS Cloud Engineer

    4 weeks ago

    Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Engineer to join our team at eTek IT Services, Inc. as a Snowflake Expert. This is an exciting opportunity to work with cutting-edge technology and contribute to the growth of our analytics landscape.The ideal candidate will have extensive experience in data engineering, data warehousing, and cloud...

  • AWS Data Engineer

    1 month ago

    Charlotte, North Carolina, United States Eliassen Group Full time

    Job DescriptionOur client, a leader in their industry, has an excellent opportunity for an AWS Data Engineer to work on a 36-month contract position in Charlotte, NC.Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision...

  • AWS Software Engineer

    2 weeks ago

    Charlotte, United States Eliassen Group Full time

    Description: **Onsite | Charlotte, NC** Our client has an exciting opportunity for an AWS Software Engineer. Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate:...

  • AWS Software Engineer

    3 weeks ago

    Charlotte, United States Eliassen Group Full time

    Description: Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $80 - $85 / hr. w2 Responsibilities: Provide technical direction, guide the team on key...

  • AWS Cloud Migration Test Automation Specialist

    4 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: AWS Cloud Migration Test Automation SpecialistJob Summary:Pantheon Data is seeking a skilled AWS Cloud Migration Test Automation Specialist to join our team for a critical cloud migration project. The ideal candidate will have deep knowledge of automation testing, including the collection and documentation of test requirements, preparation and...

  • Data Engineer Lead

    4 weeks ago

    Charlotte, North Carolina, United States Omni Inclusive Full time

    Job SummaryOmni Inclusive is seeking a highly skilled Data Engineer Lead to join our team. The ideal candidate will have a strong background in cloud development, data engineering, and technical leadership.Key Responsibilities Design and implement data pipelines using AWS services, including AWS Lambda, API Gateway, and AWS Data Flow. Collaborate with...

  • Data Engineer

    3 weeks ago

    Charlotte, United States Strategic Staffing Solutions Full time

    Data Engineer IV Location: Charlotte, NC (Hybrid) Pay: $100/hr (W2 ONLY) Contract: 24+ Month's About the Role: We are seeking a highly skilled and knowledgeable Subject Matter Expert (SME) to join our team in advancing Data Fabric. This role involves developing and optimizing our interconnected data capabilities and products to deliver data efficiently...

  • Senior Data Engineer

    2 weeks ago

    charlotte, United States Kellton Full time

    Position: Sr. Data EngineerWork Location: Remote (working CST or EST) and able to travel quarterly for PI planning Duration: 6 Month (Contract-to-Hire)Manager Notes:Sr. Data EngineerExperience on several DE projects, hands onStrong snowflake expertise - administrations Advanced SQL and Python skills Extracting data from APIs ETL processes, data ingestion AWS...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, United States Kellton Full time

    Position: Sr. Data EngineerWork Location: Remote (working CST or EST) and able to travel quarterly for PI planning Duration: 6 Month (Contract-to-Hire)Manager Notes:Sr. Data EngineerExperience on several DE projects, hands onStrong snowflake expertise - administrations Advanced SQL and Python skills Extracting data from APIs ETL processes, data ingestion AWS...

  • Data Engineer

    3 weeks ago

    Charlotte, United States My IT LLC Full time

    Job Title: Data Engineer Duration: 6+ MonthsLocation: Charlotte, NCExp Level: 8 YearsJob Summary: We are seeking a skilled Data Engineer  to join our dynamic team. The ideal candidate will design, build, and maintain scalable data pipelines and architectures, ensuring efficient data integration and high performance. This role requires a deep...

  • AWS Devops Engineer

    3 weeks ago

    charlotte, United States A-Line Staffing Solutions Full time

    Position: Senior Cloud Platform EngineerLocation: Hybrid, Charlotte, NCRate: 55-65 on w-2 (no C2C or third party candidates will be accepted on this role.)Compensation: Competitive and commensurate with experienceOverview:We are looking for a specialized AWS IAM professional to join our cloud engineering team. This role is ideal for a strategic thinker and...

  • AWS Devops Engineer

    4 weeks ago

    Charlotte, United States A-Line Staffing Solutions Full time

    Job DescriptionJob DescriptionPosition: Senior Cloud Platform EngineerLocation: Hybrid, Charlotte, NCRate: 55-65 on w-2 (no C2C or third party candidates will be accepted on this role.)Compensation: Competitive and commensurate with experienceOverview:We are looking for a specialized AWS IAM professional to join our cloud engineering team. This role is...

  • AWS Devops Engineer

    3 weeks ago

    Charlotte, United States A-Line Staffing Solutions Full time

    Position: Senior Cloud Platform EngineerLocation: Hybrid, Charlotte, NCRate: 55-65 on w-2 (no C2C or third party candidates will be accepted on this role.)Compensation: Competitive and commensurate with experienceOverview:We are looking for a specialized AWS IAM professional to join our cloud engineering team. This role is ideal for a strategic thinker and...