AWS Data Engineer
3 weeks ago
The person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems.
- Data Ingestion: Implement data ingestion processes to collect data from various sources, including databases, streaming data, and external APIs.
- Data Transformation: Develop ETL (Extract, Transform, Load) processes to transform and cleanse raw data into a structured and usable format for analysis.
- Data Storage: Manage and optimize data storage solutions, including Amazon S3, Redshift, and other AWS storage services.
- Data Processing: Utilize AWS services like AWS Glue, Amazon EMR, and AWS Lambda to process and analyze large datasets.
- Data Monitoring and Optimization: Continuously monitor and optimize data pipelines and infrastructure for performance, cost-efficiency, and scalability.
- Integration: Collaborate with data scientists, analysts, and other stakeholders to integrate AWS-based solutions into data analytics and reporting platforms.
- Documentation: Maintain thorough documentation of data engineering processes, data flows, and system configurations.
- Scalability: Design AWS-based solutions that can scale to accommodate growing data volumes and changing business requirements.
- Cost Management: Implement cost-effective solutions by optimizing resource usage and recommending cost-saving measures.
- Troubleshooting: Diagnose and resolve AWS-related issues to minimize downtime and disruptions.
- Qualifications
Must Have:
- Strong experience with AWS services on big data platforms.
- Strong Python experience in building Dash application in AWS
- Spark
- Shell scripting and Linux knowledge
Nice to have:
- Investment Knowledge preferred
- Looking for candidates who have worked in Investment/Finance space
- Machine Learning Skills
Qualifications:
- Educational Background: A bachelor's degree in computer science, information technology, or a related field is typically required.
- A master's degree is preferred with GPA of 3.8+
Problem-Solving:
- Strong analytical and problem-solving skills to address complex data engineering challenges.
- Communication Skills:
- Effective communication and collaboration skills to work with cross-functional teams.
Required Skills : AWS Cloud Formation,ETL,Python
Additional Skills : AWS Engineer,Software Developer,Big Data
-
AWS Data Engineer with Tableau
1 day ago
Charlotte, United States New York Technology Partners Full timeTitle: AWS Data Engineer with TableauLocation: Charlotte, NC (Hybrid)Duration: Long term contractJob DescriptionResponsibilitiesThe person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems for Client. Data Ingestion: Implement data ingestion processes to collect data from various...
-
AWS Data Engineer with Tableau
2 days ago
Charlotte, United States New York Technology Partners Full timeTitle: AWS Data Engineer with TableauLocation: Charlotte, NC (Hybrid)Duration: Long term contractJob DescriptionResponsibilitiesThe person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems for Client. Data Ingestion: Implement data ingestion processes to collect data from various...
-
AWS BIG DATA Engineer
7 days ago
Charlotte, United States Diverse Lynx Full timeAWS BIG DATA Engineer Charlotte - NC We are looking for a strong Cloud Engineer with AWS , Python and Airflow skills 3.Experience 10to12Yrs Required Skills ,AWS Big Data Roles & Responsibilities Should have experience working as a Cloud Engineer with AWS skillsets. Should be experienced in developing systems using Python. Should have strong Python...
-
Big Data AWS Engineer
2 weeks ago
Charlotte, United States Entech Full timeWe’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...
-
Big Data AWS Engineer
2 weeks ago
Charlotte, United States Entech Full timeWe’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...
-
AWS Engineer
6 days ago
Charlotte, United States Diverse Lynx Full timeJob Description: Title: AWS Engineer Location: Charlotte, NC (Onsite) Term: Contract W2 Must Haves: 1. AWS 2. Kafka (or any other data processing skill) 3. Python Required: AWS, Java, Python, EMR, Flink, Streams Processing application development experience using Kafka Streams and/or Flink java APIs, Redshift, Lake Formation, Experience with Postgres,...
-
Data Engineer
4 weeks ago
Charlotte, United States Ryan Consulting Group Full timeJob DescriptionJob DescriptionFull-time, in office positionMust have AWS, ETL & Python experienceMust be very hands-onData EngineerThe Data Engineer will be part of the overall team that is actively engaged in the ongoing database engineering process, partnering with development groups, and providing deep subject matter expertise to feature design, and as an...
-
AWS DevOps Engineer
4 weeks ago
Charlotte, United States Abacus Full timeRequisition Number OMF-REQ-0001547 Number of Resources 1 Start Date 10/9/2023 End Date 4/8/2024 Work Location HQ_Charlotte NC Management Office (1616 Camden Rd Ste 450, charlotte, NC 28203) Estimated Total Expense Amount Per Resource Requisition Status Open Job Description Type of Service Contingent Workforce - Technology Job Title WS DevOps Engineer ...
-
AWS Cloud Engineer
1 month ago
Charlotte, North Carolina, United States karwell technologies Full timePrimary Skill Amazon Web Services (AWS) Role DescriptionThe AWS Cloud Engineer would need to have at least 10 years of experience. As the AWS Cloud Engineer you will participate in the creation and maintenance of development test and production environments with a goal of high availability fault-tolerance and scalability.You will also be responsible for...
-
Python developer
6 days ago
Charlotte, United States Diverse Lynx Full timeRole: Python developer / AWS Engineer Location: Charlotte, NC or Remote (Must work EST hours) Term: Contract 1. Python 2. AWS 3. Kafka (or any other data processing skill) • Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery • Lead the Design, Build, Test and Deployment of components •...
-
Senior Big Data Engineer
7 hours ago
Charlotte, United States Entech Full timeWe re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...
-
AWS Cloud Engineer
1 month ago
Charlotte, United States karwell technologies Full timePrimary Skill Amazon Web Services (AWS) Role DescriptionThe AWS Cloud Engineer would need to have at least 10 years of experience. As the AWS Cloud Engineer you will participate in the creation and maintenance of development test and production environments with a goal of high availability fault-tolerance and scalability.You will also be responsible for...
-
AWS Engineer
24 hours ago
Charlotte, United States A-Line Staffing Solutions Full timeJob DescriptionJob DescriptionTitle: AWS Engineer (Python)Location: Charlotte, NC (Hybrid)Rate: $50/hrNote: This position is a contract on W2, and is NOT open to C2C This role is focused on end-to-end Cloud Native Application Development with Python. This is not a Data Engineering Role. Top Skills:At least 7 years of experience in Python...
-
Senior Data Engineer
2 weeks ago
Charlotte, United States Judge Consulting Group Full timeJob Description:As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...
-
Senior Data Engineer
3 weeks ago
Charlotte, United States Judge Consulting Group Full timeJob Description:As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...
-
Senior Data Engineer
1 day ago
Charlotte, United States LendingTree Full timeJob DescriptionJob Description*PLEASE NOTE: We offer a hybrid 3-2 work schedule (Three days in the office, two days of teleworking) to accommodate the need for flexibility.*Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.Position:LendingTree is seeking a...
-
MAX - Senior AWS Cloud Engineer
5 days ago
Charlotte, United States Lighthouse Technology Services Full time*Remote Contract-to-Hire Opportunity* Lighthouse Technology Services is partnering with our client to fill their AWS Cloud Engineer position! This is a 6+ month contract-to-hire opportunity and can be remote in the United States. This role will be a W2 employee of Lighthouse Technology Services. What You'll Be Doing: • 3 years AWS experience • 3-5...
-
AWS Developer/Engineer
6 days ago
Charlotte, United States Resource Informatics Group Full timeRole 1: AWS Developer/Engineer - 3 positions Location: Work from office in Charlotte, NC / Malvern, Pennsylvania. Duration: 6+ months Rate: $Market Job Description: 1. Strong experience with AWS services (EMR, LAMBDA, Code hooks, S3 etc) 2. Hands-on coding experience in Python 3. Strong Experience with AWS SageMaker 4. 1-2yrs Experience with Large Language...
-
Sr. AWS Cloud Architect
2 weeks ago
Charlotte, United States Acruex Inc. Full timeAWS Certified Solutions Architect Professional.Only Local professional in Charlotte, North Carolina OR Detroit, MI AWS Certified DevOps Engineer, or relevant certifications Bachelor's degree in Computer Science or related relevant experience? Expert knowledge of application and AWS (cloud) architecture and related technologies Proficiency designing and...
-
Sr. AWS Cloud Architect
2 weeks ago
Charlotte, United States Acruex Inc. Full timeAWS Certified Solutions Architect Professional.Only Local professional in Charlotte, North Carolina OR Detroit, MI AWS Certified DevOps Engineer, or relevant certifications Bachelor's degree in Computer Science or related relevant experience? Expert knowledge of application and AWS (cloud) architecture and related technologies Proficiency designing and...