AWS Data Engineer

6 days ago

Charlotte, North Carolina, United States Brooksource Full time
Job Title: AWS Data Engineer

We are seeking an experienced AWS Data Engineer to join our team at Brooksource. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.

Responsibilities:
  • Design and implement data pipelines using AWS services such as S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step Functions.
  • Develop and maintain data warehousing solutions using Amazon Redshift and Amazon Athena.
  • Collaborate with data scientists and analysts to design and implement data models and ETL processes.
  • Ensure data quality and integrity by implementing data validation and data cleansing processes.
  • Work closely with the product owner to align on delivery goals and timing.
  • Assist the product owner with prioritizing and managing the team backlog.
  • Collaborate with data and solution architects on key technical decisions.
Requirements:
  • 5+ years of experience with AWS services, specifically including AWS Redshift.
  • Experience with data modeling and executing ETL processes tailored for data warehousing.
  • Competence in developing and refining data pipelines within AWS.
  • Proficient in handling both real-time and batch data processing tasks.
  • Extensive understanding of database management fundamentals.
  • Expertise in creating alerts and automated solutions for handling production problems.
  • Tools and Languages – Python, Spark, PySpark, and Pandas.
  • Infrastructure as Code technology – Terraform/CloudFormation.
  • Experience with Secrets Management Platform like Vault and AWS Secrets manager.
  • Experience with Event Driven Architecture.
  • DevOps pipeline (CI/CD); Bitbucket; Concourse.
  • Experience with RDBMS platforms and Strong proficiency with SQL.
  • Experience with Rest APIs and API gateway.
  • Deep knowledge of IAM roles and Policies.
  • Experience using AWS monitoring services like CloudWatch, CloudTrail, and CloudWatch events.
  • Deep understanding of networking DNS, TCP/IP, and VPN.
  • Experience with AWS workflow orchestration tool like Airflow or Step Functions.
Preferred Skills:
  • Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch.
  • Databases – Document DB, Mongo DB.
  • Hadoop platform (Hive; HBase; Druid).
  • Java, Scala, Node JS.
  • Workflow Automation.
  • Experience transitioning on-premise big data platforms into cloud-based platforms such as AWS.
  • Strong Background in Kubernetes, Distributed Systems, Microservice architecture, and containers.
Additional Requirements:
  • Ability to perform hands-on development and peer review for certain components/tech stack on the product.
  • Standing up of development instances and migration path (with required security, access/roles).
  • Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows).
  • Lead implementation of integrated data quality framework.
  • Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data).
  • Supports data scientist with test and validation of models.
  • Performs impact analysis and identifies risk to design changes.
  • Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications.
  • Ability to implement data pipelines with the right attentiveness to durability and data quality.
  • Implements data warehousing products thinking of the end-user experience (ease of use with right performance).
  • Ensures Test Driven development.
  • 5+ years of Experience leading teams to deliver complex products.
  • Strong technical skills and communication skills.
  • Strong skills with business stakeholder interactions.
  • Strong solutioning and architecture skills.
  • 5+ years of Experience building real-time data ingestion streams (event-driven).
  • Ensure data security and permissions solutions, including data encryption, user access controls, and logging.

  • AWS Cloud Developer with Python and Data Integration

    4 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Developer with expertise in Python, data integration, and ETL solutions to join our team at NTT DATA. As a key member of our Strategic Platform Engineering team, you will be responsible for designing and developing cloud-based data integration solutions that drive business value and innovation.Key...

  • AWS Cloud Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    Job Title: AWS Cloud EngineerWe are seeking a highly skilled AWS Cloud Engineer to join our team at eTek IT Services, Inc. The ideal candidate will have extensive experience in designing, building, and deploying cloud-based data solutions using AWS services.Job SummaryThe AWS Cloud Engineer will be responsible for architecting and implementing cloud-based...

  • AWS Cloud Developer with Python and Data Integration

    4 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Developer with expertise in Python, data integration, and Snowflake to join our team in Charlotte, North Carolina. As a key member of our Strategic Platform Engineering team, you will be responsible for designing and developing cloud-based data integration solutions that drive business value and...

  • AWS Data Engineer

    5 days ago

    Charlotte, North Carolina, United States Brooksource Full time

    Job Title: AWS Data EngineerWe are seeking an experienced AWS Data Engineer to join our team at Brooksource. The successful candidate will have expertise in designing and implementing data warehousing solutions using AWS Redshift.Key Responsibilities:Provide technical direction and guidance to the team on key technical aspects.Lead the design, build, test,...

  • AWS Cloud Data Engineer

    4 weeks ago

    Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    Job Title: AWS Cloud EngineerWe are seeking a highly skilled AWS Cloud Engineer to join our team at eTek IT Services, Inc. The ideal candidate will have extensive experience in designing, building, and deploying cloud-based data solutions using AWS services.Job SummaryThe AWS Cloud Engineer will be responsible for architecting and implementing cloud-based...

  • AWS Data Engineer

    5 days ago

    Charlotte, North Carolina, United States Brooksource Full time

    Job Title: AWS Data EngineerLocation: Charlotte, NC (Hybrid 2-3 days a week on site)Contract Details: 3-year contract with opportunity for extension or full-time hireEmployment Type: W-2 Only, No Corp-to-Corp or 1099Brooksource is seeking an experienced AWS Data Engineer to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • AWS Cloud Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: AWS Cloud Engineer - Hybrid NetworkingPantheon Data is seeking an experienced AWS Cloud Engineer to join our team. As a key member of our cloud engineering team, you will be responsible for designing and implementing hybrid network architectures within AWS GovCloud.Responsibilities:Design and implement hybrid network architectures within AWS...

  • AWS Cloud Developer with Python and Data Integration

    4 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Developer with expertise in Python, GIT, Snowflake, and ETL to join our team in Charlotte, North Carolina. As a key member of our Strategic Platform Engineering team, you will be responsible for designing and developing data integration solutions on our cloud data warehouses and data lakes.Key...

  • AWS Cloud Data Engineer

    4 hours ago

    Charlotte, North Carolina, United States Adroit Innovative Solutions Full time

    Job DescriptionJob DescriptionRole: AWS Cloud Data EngineerLocation: Remote or On-SiteExperience: 8+ yearsVisa: Any / c2c / w2Key Responsibilities:* Provide years of Redshift experience.* Years of migration experience.* Ensure sell packs meet requirements.* Include interview availability Thursday through MondayTechnical Requirements:* Extensive Redshift...

  • AWS Data Engineer

    2 days ago

    Charlotte, North Carolina, United States Eliassen Group Full time

    Job DescriptionOur client, a leader in their industry, has an excellent opportunity for an AWS Data Engineer to work on a 36-month contract position in Charlotte, NC.Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision...

  • AWS Cloud Engineer

    10 hours ago

    Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    Job Title: AWS Cloud EngineerWe are seeking a highly skilled AWS Cloud Engineer to join our team at eTek IT Services, Inc. The ideal candidate will have extensive experience in designing, building, and deploying cloud-based solutions using AWS services.Key Responsibilities:Design and implement cloud-based architectures using AWS servicesDevelop and deploy...

  • AWS Cloud Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Cognizant North America Full time

    ROLE:AWS Lead DevelopmentCognizant North America is seeking a highly skilled AWS Cloud Engineer to lead the design and implementation of scalable cloud-based architectures using AWS services.Responsibilities:Lead the design and implementation of scalable cloud-based architectures using AWS services.Oversee the development and deployment of data pipelines...

  • Software Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Software DeveloperCompany Overview:Pantheon Data is a private, small business based in the Washington, DC, area. With over a decade of experience in providing acquisition and supply chain management services to the US Coast Guard, the company has expanded its service offerings to include infrastructure resiliency, contact center operations,...

  • Software Engineer

    1 month ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Software DeveloperCompany Overview:Pantheon Data is a private, small business based in the Washington, DC, area. With over a decade of experience in providing services to the US Coast Guard and other federal agencies, we have expanded our offerings to include infrastructure resiliency, contact center operations, information technology, software...

  • Cloud Solutions Engineer

    2 months ago

    Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    Job DescriptionPosition: Cloud Solutions Engineer specializing in AWSDuration: Long-term engagementKey Qualifications:• Over 7 years of expertise in data engineering, data warehousing, or similar fields.• Profound hands-on experience with Snowflake implementations and enhancements, particularly in real-time data processing involving AWS S3 data lakes and...

  • Software Engineer

    4 days ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Software DeveloperCompany Overview:Pantheon Data is a private, small business based in the Washington, DC, area. We provide a range of services, including infrastructure resiliency, contact center operations, information technology, software engineering, program management, strategic communications, engineering, and cybersecurity.Position...

  • Cloud Migration Engineer

    2 days ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Cloud Migration EngineerJob Summary:Pantheon Data is seeking a highly skilled Cloud Migration Engineer to spearhead a pivotal cloud migration project from on-premise systems to the AWS GovCloud environment for a high-profile federal defense client. The successful candidate will be instrumental in deploying DevSecOps methodologies, securing...

  • Software Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Software DeveloperPantheon Data is seeking a highly skilled Software Developer to join our team. As a Software Developer, you will play a critical role in the strategic migration of large legacy applications to the AWS GovCloud, tailored for our federal clients.Responsibilities:Develop and migrate Java-based applications from IBM WebSphere...

  • AWS Cloud ETL Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Infosys Full time

    Job DescriptionInfosys is seeking a skilled AWS Cloud ETL Engineer to join our team. As an AWS Cloud ETL Engineer, you will be responsible for designing, developing, and implementing ETL pipelines using Amazon Redshift and EMR to extract, transform, and load data from various sources into our data warehouse.Key Responsibilities:Design and develop ETL...

  • AWS Cloud Engineer

    1 month ago

    Charlotte, North Carolina, United States Global Channel Management Full time

    AWS DevOps EngineerGlobal Channel Management is seeking a highly skilled AWS DevOps Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud infrastructure on Amazon Web Services (AWS).Key Responsibilities:Design and implement cloud infrastructure on...