Lead Data Engineer
2 months ago
Role: Lead Data Engineer- W2 role
Location: Charlotte, NC
Qualification: Must Have:
Strong experience with AWS services on big data platforms.
Strong Python experience in building Dash application in AWS
Spark
Shell scripting and Linux knowledge
Nice to have:
Investment Knowledge preferred
Looking for candidates who have worked in Investment/Finance space
Machine Learning Skills
Responsibilities
The person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems.
Data Ingestion: Implement data ingestion processes to collect data from various sources, including databases, streaming data, and external APIs.
Data Transformation: Develop ETL (Extract, Transform, Load) processes to transform and cleanse raw data into a structured and usable format for analysis.
Data Storage: Manage and optimize data storage solutions, including Amazon S3, Redshift, and other AWS storage services.
Data Processing: Utilize AWS services like AWS Glue, Amazon EMR, and AWS Lambda to process and analyze large datasets.
Data Monitoring and Optimization: Continuously monitor and optimize data pipelines and infrastructure for performance, cost-efficiency, and scalability.
Integration: Collaborate with data scientists, analysts, and other stakeholders to integrate AWS-based solutions into data analytics and reporting platforms.
Documentation: Maintain thorough documentation of data engineering processes, data flows, and system configurations.
Scalability: Design AWS-based solutions that can scale to accommodate growing data volumes and changing business requirements.
Cost Management: Implement cost-effective solutions by optimizing resource usage and recommending cost-saving measures.
Troubleshooting: Diagnose and resolve AWS-related issues to minimize downtime and disruptions.
-
Data Engineer
2 months ago
Charlotte, North Carolina, United States NTT DATA Full timeNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Python/PySpark) - Onsite to join our team in Charlotte, North Carolina (US-NC), United States (US).We are...
-
Lead Data Engineer
1 month ago
Charlotte, United States Abidi Solutions Full timeJob DescriptionJob DescriptionJob Title: Lead Data EngineerLocation: Hybrid in Charlotte, NC Duration: 6 month contract to hireMust Haves:9+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses2+ years of experience working as a lead and developing/mentoring other...
-
Lead Data Engineer
3 weeks ago
Charlotte, United States Compunnel Inc. Full timeRequired Skills & Experience* 10+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses* 2+ years of experience working as a lead and developing/mentoring other engineers* Strong proficiency in SQL, Python and PySpark programming languages* Strong experience with the Azure...
-
Lead Data Engineer
2 weeks ago
Charlotte, United States Circle K Stores, Inc. Full timeJob Description: As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...
-
Lead Data Engineer
3 months ago
Charlotte, United States Circle K Full timeJob Description:As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...
-
Data Engineering Lead
2 days ago
Charlotte, North Carolina, United States Hunt Hive Talent Full timeAbout Hunt Hive TalentWe are a leading talent recruiting agency dedicated to connecting top talent with exciting opportunities. Our mission is to empower businesses and professionals to reach new heights.About the RoleWe are seeking a highly skilled Data Engineering Lead to join our client's team. As a key member of the organization, you will be responsible...
-
Lead Data Engineer
3 months ago
Charlotte, United States Chatham Financial Full timeOverview: We don't simply hire employees. We invest in them. When you work at Chatham, we empower you - offering professional development opportunities to help you grow in your career, no matter if you've been here for five months or 15 years. Chatham has worked hard to create a distinct work environment that values people, teamwork, integrity, and client...
-
Lead Data Engineer
4 weeks ago
Charlotte, United States Amtex Systems Inc. Full timeTitle: Lead Data EngineerLocation: Charlotte, NC(Hybrid)Duration: 12+ Months· Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.· Gather and process raw, structured, semi-structured and unstructured data using batch and...
-
Lead Data Engineer
4 weeks ago
Charlotte, United States Amtex Systems Inc. Full timeTitle: Lead Data EngineerLocation: Charlotte, NC(Hybrid)Duration: 12+ Months· Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.· Gather and process raw, structured, semi-structured and unstructured data using batch and...
-
Data Lead Engineer
1 month ago
Charlotte, United States Whistle Express Car Wash Full timeWhistle Express is a leading and rapidly expanding express car wash operator in the U.S. Whistle Express operates car washes with locations in Alabama, Florida, Georgia, North Carolina, Ohio, South Carolina, Tennessee, and Virginia. Whistle is focused on building upon its established market position in the Southeast. We’re looking for people with a strong...
-
Data Lead Engineer
1 month ago
Charlotte, United States Whistle Express Car Wash Full timeWhistle Express is a leading and rapidly expanding express car wash operator in the U.S. Whistle Express operates car washes with locations in Alabama, Florida, Georgia, North Carolina, Ohio, South Carolina, Tennessee, and Virginia. Whistle is focused on building upon its established market position in the Southeast. We’re looking for people with a strong...
-
Lead Cloud Security Engineer
1 week ago
Charlotte, North Carolina, United States Pantheon Data Full timeJob OverviewCompany Background:Pantheon Data, a subsidiary of Kenific Holding, operates as a private enterprise in the Washington, DC area. Established in 2011, the company initially focused on acquisition and supply chain management services for the US Coast Guard. Over the past decade, Pantheon Data has diversified its offerings to include infrastructure...
-
Lead Data Engineer
2 weeks ago
Charlotte, United States American Red Cross Full timePlease use Google Chrome or Mozilla Firefox when accessing Candidate Home. By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spirit at its best. Are you ready to be part of the world's largest humanitarian network? Join us-Where your Career is a Force for Good! Job Description: WHY CHOOSE...
-
Lead Data Engineering
2 months ago
Charlotte, United States Compunnel Inc. Full timeInterview Process:hacker rank (30mins SQL / 30 mins python)initial interview1 hour technical3 hour panelMust Have Skills: "And if someone is coming from a software background and then getting into data engineering, that's a perfect fit."Looking for around 12+ years of experienceData - python & SQL are a must have2-3 years retail experienceDatabricks (azure...
-
Lead Data Engineering
2 months ago
Charlotte, United States Compunnel Inc. Full timeInterview Process:hacker rank (30mins SQL / 30 mins python)initial interview1 hour technical3 hour panelMust Have Skills: "And if someone is coming from a software background and then getting into data engineering, that's a perfect fit."Looking for around 12+ years of experienceData - python & SQL are a must have2-3 years retail experienceDatabricks (azure...
-
Lead Engineer
3 weeks ago
Charlotte, North Carolina, United States NTT DATA Services Full timeReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Engineer (Opentext Exstream Cloud Native) to join our team in Charlotte, North Carolina (US-NC), United States (US). Job...
-
Lead Data Engineer
1 month ago
Charlotte, United States WELLS FARGO BANK Full timeAbout this role:Wells Fargo is seeking a Lead Data EngineerIn this role, you will:Lead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology areaDesign, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadershipReview and...
-
Lead Data Engineer
2 months ago
Charlotte, United States Compunnel Inc. Full timeRole: Lead Data Engineer- W2 roleLocation: Charlotte, NCQualification: Must Have: Strong experience with AWS services on big data platforms.Strong Python experience in building Dash application in AWSSparkShell scripting and Linux knowledgeNice to have:Investment Knowledge preferredLooking for candidates who have worked in Investment/Finance spaceMachine...
-
Lead Data Engineer
3 weeks ago
Charlotte, United States WELLS FARGO BANK Full timeAbout this role:Wells Fargo is seeking a Lead Data Engineer experienced in Data visualization tools Microsoft Power BI and Tableau, and Windows, Oracle, and Teradata databases to join our Major Incident Management Command Center team. In this role, you will:Lead complex initiatives with broad impact and act as key participant in large scale software planning...
-
Technical Lead
3 days ago
Charlotte, United States Hunt Hive Talent Full timeBuzz About Us: Welcome to Hunt Hive Talent Recruiting Agency where we are all about connecting amazing talent with fantastic opportunities! Our mission To help businesses and professionals soar to new heights. If youre ready for an adventure in the recruiting world look no further. Join our vibrant team and be part of something extraordinary! About the Role:...