data engineer iv

4 weeks ago


Charlotte, United States Randstad Full time

data engineer iv. charlotte , north carolina posted 1 day ago job details summary $74.45 - $84.45 per hour contract bachelor degree category computer and mathematical occupations reference1073648 job details job summary: Description: AWS Data Engineer IV Core Technical Skills 5+ years of AWS experience AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight Experience with Kafka/Messaging preferably Confluent Kafka Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB and Aurora Experience with AWS data warehousing tools such as Amazon Redshift and Amazon Athena Proven track record in the design and implementation of data warehouse solutions using AWS Skilled in data modeling and executing ETL processes tailored for data warehousing Competence in developing and refining data pipelines within AWS Proficient in handling both real-time and batch data processing tasks Extensive understanding of database management fundamentals Expertise in creating alerts and automated solutions for handling production problems Tools and Languages - Python, Spark, PySpark and Pandas Infrastructure as Code technology - Terraform/CloudFormation Experience with Secrets Management Platform like Vault and AWS Secrets manager Experience with Event Driven Architecture DevOps pipeline (CI/CD); Bitbucket; Concourse Experience with RDBMS platforms and good proficiency with SQL Experience with Rest APIs and API gateway Deep knowledge of IAM roles and Policies Experience using AWS monitoring services like CloudWatch, CloudTrail ad CloudWatch events Deep understanding of networking DNS, TCP/IP and VPN Experience with AWS workflow orchestration tool like Airflow or Step Functions AWS Data Engineer IV Additional Technical Skills (nice to have, but not required for the role) Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch Databases - Document DB, Mongo DB Hadoop platform (Hive; HBase; Druid) Java, Scala, Node JS Workflow Automation Experience transitioning on premise big data platforms into cloud-based platforms such as AWS Excellent background in Kubernetes, Distributed Systems, Microservice architecture and containers Core Experience and Abilities Ability to perform hands on development and peer review for certain components / tech stack on the product Standing up of development instances and migration path (with required security, access/roles) Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows) Lead implementation of integrated data quality framework Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data) Supports data scientist with test and validation of models Performs impact analysis and identifies risk to design changes Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications Ability to implement data pipelines with the right attentiveness to durability and data quality Implements data warehousing products thinking of the end users experience (ease of use with right performance) Ensures Test Driven development 5+ years of Experience leading teams to deliver complex products Good technical skills and communication skills Good skills with business stakeholder interactions Good solutioning and architecture skills 5+ years of Experience building real time data ingestion streams (event driven) Ensure data security and permissions solutions, including data encryption, user access controls and logging location: Charlotte, North Carolina job type: Contract salary: $74.45 - 84.45 per hour work hours: 8am to 5pm education: Bachelors responsibilities: Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery Lead the Design, Build, Test and Deployment of components Where applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) Understand requirements / use case to outline technical scope and lead delivery of technical solution Confirm required developers and skillsets specific to product Provides leadership, direction, peer review and accountability to developers on the product (key responsibility) Works closely with the Product Owner to align on delivery goals and timing Assists Product Owner with prioritizing and managing team backlog Collaborates with Data and Solution architects on key technical decisions The architecture and design to deliver the requirements and functionality Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality Designs data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance Manage and resolve issues in production data warehouse environments on AWS qualifications: Experience level: Experienced Minimum 5 years of experience Education: Bachelors skills: Data WarehouseEqual Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).This posting is open for thirty (30) days.


  • Lead Data Engineer

    1 week ago


    Charlotte, North Carolina, United States Pantheon Data Full time

    About Pantheon DataWe are a private, small business based in the Washington, DC, area. Our service offerings have grown over the years to include infrastructure resiliency, contact center operations, information technology, software engineering, program management, strategic communications, engineering, and cybersecurity. We have expanded our customer base...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    About Pantheon DataAt Pantheon Data, we are dedicated to delivering exceptional services and solutions to our clients. Our team of experts provides a range of capabilities, including acquisition and supply chain management, infrastructure resiliency, contact center operations, information technology, software engineering, program management, strategic...

  • Cloud Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Pantheon Data Full time

    Job DescriptionPantheon Data is seeking a skilled Data Engineer to develop data pre-processing and analytics code using Python, R, and similar languages. The successful candidate will contribute to ETL pipeline solutions that ingest and process data from multiple sources and create cloud-based data warehouse(s) that provide inputs to predictive models.The...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Cloud Data EngineerAbout Us:Pantheon Data is a private company based in the Washington, DC area. Founded in 2011, we have grown to offer various services including infrastructure resiliency, contact center operations, and software engineering. Our customer base includes commercial clients and federal agencies.Position Overview:We are seeking an...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Are you a skilled Machine Learning Engineer looking for a challenging role that combines technical expertise with business acumen? Pantheon Data, a leading provider of innovative solutions to the US government and commercial clients, is seeking a seasoned Deep Learning Engineer to join our team.About the RoleThis is a unique opportunity to leverage your...

  • Data Science Engineer

    4 weeks ago


    Charlotte, North Carolina, United States NTT DATA Full time

    About NTT DATA ServicesNTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    As a Data Engineer at Pantheon Data, you will play a key role in supporting our cloud-first migration strategy by designing and developing technical solutions for our customers. This role requires strong hands-on experience with data integration and/or data migration, as well as proficiency in data warehousing ETL pipelines. In addition to working...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job Overview">We are seeking a highly skilled Data Engineer to join our growing engineering team at Pantheon Data. The ideal candidate will have hands-on experience with data integration and/or data migration, as well as proficiency in data warehousing ETL pipelines.This role will play a crucial part in supporting our 'cloud-first' migration for various...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job SummaryPantheon Data is seeking a Technical Solutions/Engineering Team Lead with a strong background in data-driven solution architecture and development to serve as a leader of a growing team of engineers. This role requires U.S. Citizenship and the ability to obtain/maintain Secret clearance.About UsPantheon Data is a private, small business based in...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job OverviewPantheon Data is a private, small business based in the Washington, DC area.We are seeking a skilled Data Engineer with expertise in designing data-centric technical solutions.The ideal candidate will have hands-on experience with data modeling, data warehousing, and ETL pipelines.Analyze customer technology landscapes, business processes, and...


  • Charlotte, North Carolina, United States United Engineers & Constructors, Inc. Full time

    We are seeking a highly skilled Mechanical Engineer IV to join our team at United Engineers & Constructors, Inc. in Mt. Laurel, NJ or Charlotte, NC. The successful candidate will have experience in designing and managing mechanical systems for power generation and heavy industrial projects.Job Responsibilities:Design and development of HVAC and plumbing...

  • AWS Data Engineer

    2 days ago


    Charlotte, United States Brooksource Full time

    Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift and Kafka to join our Fortune 500 client in Charlotte, NC. AWS Data Engineer IV Core Technical Skills 5+ years of AWS experience AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight Experience with...

  • AWS Data Engineer

    3 days ago


    Charlotte, United States Brooksource Full time

    Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift and Kafka to join our Fortune 500 client in Charlotte, NC. AWS Data Engineer IV Core Technical Skills 5+ years of AWS experience AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight Experience with...


  • Charlotte, North Carolina, United States NTT DATA Full time

    We're seeking a highly skilled Data Science Technology Specialist to join our team in Charlotte, North Carolina. As a key member of our data practice, you'll play a critical role in delivering innovative solutions that drive business growth and success.The estimated salary for this position is around $120,000 - $180,000 per year, based on industry standards...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    At Pantheon Data, we are committed to attracting and retaining top talent in the industry. As a Data Engineer, you will be responsible for designing and developing technical solutions for our customers, working collaboratively with other engineers and project managers to ensure successful outcomes. Key responsibilities include data profiling on RDBMS...


  • charlotte, United States Brooksource Full time

    Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift and Kafka to join our Fortune 500 client in Charlotte, NC. AWS Data Engineer IV Core Technical Skills 5+ years of AWS experience AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight Experience with...


  • Charlotte, North Carolina, United States NTT DATA Full time

    At NTT DATA, we are committed to delivering innovative and impactful solutions to our clients. As an AI Solutions Engineer, you will play a key role in developing and deploying cutting-edge AI and machine learning technologies that drive business growth and transformation.About the Role:We are seeking a highly skilled and experienced AI Solutions Engineer to...


  • Charlotte, North Carolina, United States NTT DATA Full time

    About the RoleWe are seeking a highly skilled AI Engineer to join our team in Charlotte, North Carolina. As an AI Engineer, you will be responsible for designing and implementing solutions based on client needs, collaborating with customers on future system enhancements, and delivering elite solutions that impact their products, customers, and services.


  • Charlotte, North Carolina, United States NTT DATA Full time

    At NTT DATA, we're seeking a highly skilled AI and Machine Learning Engineer to join our team in Charlotte, North Carolina. As a key member of our data practice, you'll play a critical role in delivering innovative solutions that drive business growth and success.We estimate the salary for this position to be around $120,000 - $180,000 per year, based on...


  • Charlotte, North Carolina, United States ZipRecruiter Full time

    Job OverviewWe are seeking a highly skilled Senior Electrical/I&C Engineer III/IV to join our team at United E&C, Inc. in Charlotte, NC.This is a full-time position with a salary range of $120,000 - $180,000 per year, depending on experience.