Data Engineer IV

Primary Talent Partners has a new contract opening for a
Data Engineer IV
with our large power and utilities client in Charlotte, NC. This is a 12-month contract with a potential for extension. 

Pay:
$ $92.00/hr
; W2 contract, no PTO, no Benefits. ACA-compliant supplemental package available for enrollment.

Schedule:
9 AM-5PM EST

Description:

• Enterprise Data Platforms Team is seeking a Subject Matter Expert to help develop Data Fabric as an interconnected network of data capabilities and data products designed to deliver data efficiently and at scale.
• Candidates should have expertise in developing and building data platforms, demonstrating experience with overcoming obstacles and avoiding pitfalls.
• They should also possess skills in optimizing and automating deliverables to production using the required tech stack.
• Additionally, candidates should be experienced and adaptable to changing demands and priorities in an Agile development environment.
• We are specifically looking for individuals with at least 5+ years of experience in Data Engineering and/or Software Engineering roles who can provide knowledge and support to our existing engineers.

Must have experience with similar platform engineering/management solutions:

• Building/optimizing Data LakeHouse with Open Table formats
• Kubernetes deployments/cluster administration
• Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS
• Distributed Systems, Microservice architecture, and containers
• Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis)

Must have experience with below tech stack:

• Git Hib and Git Hub Actions
• AWS
• IAM
• API Gateway
• Lambda
• Step Functions
• Lake formation
• EKS & Kubernetes
• Glue: Catalog, ETL, Crawler
• Athena
• Lambda
• S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc)
• Apache Hudi
• Apache Flink
• PostgreSQL and SQL
• RDS (Relational Database Services).
• Python
• Java
• Terraform Enterprise
• Must be able to explain what TF is used for
• Understand and explain basic principles (e.g. modules, providers, functions)
• Must be able to write and debug TF

Helpful tech stack experience would include:

• Helm
• Kafka and Kafka Schema Registry
• AWS Services: CloudTrail, SNS, SQS, CloudWatch, Step Functions, Aurora, EMR, Redshift, Iceberg
• Secrets Management Platform: Vault, AWS Secrets manager

Core Responsibilities and Soft Skills:

• Provides technical direction, engage team in discussion on how to best guide/build features on key technical aspects and responsible for product tech delivery
• Works closely with the Product Owner and team to align on delivery goals and timing
• Collaborates with architects on key technical decisions for data and overall solution
• Lead design and implementation of data quality check methods
• Ensure data security and permissions solutions, including data encryption, user access controls and logging
• Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements.
• Self-starter mentality
• Willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another
• Thrive in a fail-fast environment, involving mini PoCs, and participate in an inspect and adapt process.
• Questioning and Improvement mindset
• Must be ready to ask questions about why something is currently done the way it is and suggest alternative solutions
• Customer facing skills
• Interfacing with stakeholders and other product teams via pairing, troubleshooting support, and debugging issues they encounter with our products

*Primary Talent Partners is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.

If you are a person with a disability needing assistance with the application or at any point in the hiring process, please contact us at *