Big Data AWS Engineer

3 weeks ago

Charlotte, United States Entech Full time

We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive end-to-end offerings, we advise, engineer, and manage, ensuring our clients proactively drive toward success in this ever-evolving digital landscape.



Our team is growing, and we’re searching for a Big Data Engineer who is a creative problem-solver with their fingertips on the latest industry practices to help our clients achieve digital realization. You’ll join a group of industry veterans, blending the power of tried-and-true methods with cutting-edge technologies. We prioritize authentic partnerships in a collaborative environment, and we’re excited to welcome a Big Data Engineer who is eager to bring their expertise to our team.



Responsibilities

  • The person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems for Vanguard.
  • Data Ingestion: Implement data ingestion processes to collect data from various sources, including databases, streaming data, and external APIs.
  • Data Transformation: Develop ETL (Extract, Transform, Load) processes to transform and cleanse raw data into a structured and usable format for analysis.
  • Data Storage: Manage and optimize data storage solutions, including Amazon S3, Redshift, and other AWS storage services.
  • Data Processing: Utilize AWS services like AWS Glue, Amazon EMR, and AWS Lambda to process and analyze large datasets.
  • Data Monitoring and Optimization: Continuously monitor and optimize data pipelines and infrastructure for performance, cost-efficiency, and scalability.
  • Integration: Collaborate with data scientists, analysts, and other stakeholders to integrate AWS-based solutions into data analytics and reporting platforms.
  • Documentation: Maintain thorough documentation of data engineering processes, data flows, and system configurations.
  • Scalability: Design AWS-based solutions that can scale to accommodate growing data volumes and changing business requirements.
  • Cost Management: Implement cost-effective solutions by optimizing resource usage and recommending cost-saving measures.
  • Troubleshooting: Diagnose and resolve AWS-related issues to minimize downtime and disruptions.


Qualifications

Must Have:

  • Strong experience with AWS services on big data platforms.
  • Strong Python experience in building Dash application in AWS
  • Spark
  • Shell scripting and Linux knowledge

Nice to have:

  • Investment Knowledge preferred
  • Looking for candidates who have worked in Investment/Finance space
  • Machine Learning Skills


Qualifications:

  • Educational Background: A bachelor's degree in computer science, information technology, or a related field is typically required.
  • A master's degree is preferred with GPA of 3.8+
  • Problem-Solving:
  • Strong analytical and problem-solving skills to address complex data engineering challenges.
  • Communication Skills:
  • Effective communication and collaboration skills to work with cross-functional teams.

Company Benefits

●Health, Dental, Vision, 401(k), 25 days of Paid Time Off (PTO)

Additionally

●Entech is an equal-opportunity employer.

●This is an On-site Hybrid work schedule based out of our Charlotte North Carolina Office

●No Third-party candidates will be accepted, this is strictly a direct employment opportunity with Entech.

  • AWS BIG DATA Engineer

    2 weeks ago

    Charlotte, United States Diverse Lynx Full time

    AWS BIG DATA Engineer Charlotte - NC We are looking for a strong Cloud Engineer with AWS , Python and Airflow skills 3.Experience 10to12Yrs Required Skills ,AWS Big Data Roles & Responsibilities Should have experience working as a Cloud Engineer with AWS skillsets. Should be experienced in developing systems using Python. Should have strong Python...

  • Senior Big Data Engineer

    6 days ago

    Charlotte, United States Entech Full time

    We re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • AWS Data Engineer with Tableau

    7 days ago

    Charlotte, United States New York Technology Partners Full time

    Title: AWS Data Engineer with TableauLocation: Charlotte, NC (Hybrid)Duration: Long term contractJob DescriptionResponsibilitiesThe person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems for Client. Data Ingestion: Implement data ingestion processes to collect data from various...

  • AWS Data Engineer with Tableau

    1 week ago

    Charlotte, United States New York Technology Partners Full time

    Title: AWS Data Engineer with TableauLocation: Charlotte, NC (Hybrid)Duration: Long term contractJob DescriptionResponsibilitiesThe person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems for Client. Data Ingestion: Implement data ingestion processes to collect data from various...

  • Big Data Engineer

    5 days ago

    Charlotte, United States Sripen Full time

    Title : Big Data DeveloperLoc: Charlotte, NCNEED 14+JD:PYSpark - MandatoryHive - Mandatory , Need Python Hands-on Coding, Hadoop, Scala, HDFS, Hdoop basics, Hive. Big Data Engineer

  • Senior Data Engineer

    3 days ago

    Charlotte, United States Incedo Inc. Full time

    Senior Data Engineer Location: Charlotte, North Carolina Hybrid role FulltimeAWS Data Engineer (Spark, AWS, Glue) Must Skill:- Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities- Design and develop data applications using big data technologies (AWS, Spark) to ingest, process,...

  • Senior Data Engineer

    3 days ago

    Charlotte, United States Incedo Inc. Full time

    Senior Data Engineer Location: Charlotte, North Carolina Hybrid role FulltimeAWS Data Engineer (Spark, AWS, Glue) Must Skill:- Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities- Design and develop data applications using big data technologies (AWS, Spark) to ingest, process,...

  • Senior Data Engineer

    4 days ago

    Charlotte, United States Incedo Inc. Full time

    Senior Data Engineer Location: Charlotte, North Carolina Hybrid role FulltimeAWS Data Engineer (Spark, AWS, Glue) Must Skill:- Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities- Design and develop data applications using big data technologies (AWS, Spark) to ingest, process,...

  • Big Data Platform Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Bank of America Full time

    Job Description:At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day.One of the keys to driving Responsible Growth is being a great place to work for our...

  • AWS Engineer

    2 weeks ago

    Charlotte, United States Diverse Lynx Full time

    Job Description: Title: AWS Engineer Location: Charlotte, NC (Onsite) Term: Contract W2 Must Haves: 1. AWS 2. Kafka (or any other data processing skill) 3. Python Required: AWS, Java, Python, EMR, Flink, Streams Processing application development experience using Kafka Streams and/or Flink java APIs, Redshift, Lake Formation, Experience with Postgres,...

  • Tableau Developer Data Engineer

    1 day ago

    Charlotte, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, New York Technology Partners, is seeking the following. Apply via Dice today! Role : Tableau Developer with Data Engineer Duration Long Term Contract Location : Charlotte, NC Hybrid This is a 50/50 blend between Tableau Development and Data Engineering....

  • Data Engineer

    1 month ago

    Charlotte, United States Ryan Consulting Group Full time

    Job DescriptionJob DescriptionFull-time, in office positionMust have AWS, ETL & Python experienceMust be very hands-onData EngineerThe Data Engineer will be part of the overall team that is actively engaged in the ongoing database engineering process, partnering with development groups, and providing deep subject matter expertise to feature design, and as an...

  • Python developer

    2 weeks ago

    Charlotte, United States Diverse Lynx Full time

    Role: Python developer / AWS Engineer Location: Charlotte, NC or Remote (Must work EST hours) Term: Contract 1. Python 2. AWS 3. Kafka (or any other data processing skill) • Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery • Lead the Design, Build, Test and Deployment of components •...

  • Big Data Engineer

    7 days ago

    Charlotte, United States Emblue Full time

    Responsibilities Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems. Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development. Gathers analyzes synthesizes and develops...

  • Big Data Engineer

    1 week ago

    Charlotte, North Carolina, United States Emblue Full time

    Responsibilities Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems. Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development. Gathers analyzes synthesizes and develops visualizations...

  • AWS DevOps Engineer

    1 month ago

    Charlotte, United States Abacus Full time

    Requisition Number OMF-REQ-0001547 Number of Resources 1 Start Date 10/9/2023 End Date 4/8/2024 Work Location HQ_Charlotte NC Management Office (1616 Camden Rd Ste 450, charlotte, NC 28203) Estimated Total Expense Amount Per Resource Requisition Status Open Job Description Type of Service Contingent Workforce - Technology Job Title WS DevOps Engineer ...

  • AWS Cloud Engineer

    1 month ago

    Charlotte, North Carolina, United States karwell technologies Full time

    Primary Skill Amazon Web Services (AWS) Role DescriptionThe AWS Cloud Engineer would need to have at least 10 years of experience. As the AWS Cloud Engineer you will participate in the creation and maintenance of development test and production environments with a goal of high availability fault-tolerance and scalability.You will also be responsible for...

  • AWS Cloud API Developer

    12 hours ago

    Charlotte, United States Saxon Global Full time

    Job Role: - AWS Cloud API Developer Location: - Austin TX and Charlotte NC ( Hybrid) Job Type: - Contract Must Have :- SDLC, PyCharm, Py Test, AWS Security Experience Required 12+Years. Job Description: Develop, deploy, and maintain cloud-based APIs using AWS services. Design and implement RESTful APIs using Lambda functions, Python, and API...

  • AWS Cloud Engineer

    1 month ago

    Charlotte, United States karwell technologies Full time

    Primary Skill Amazon Web Services (AWS) Role DescriptionThe AWS Cloud Engineer would need to have at least 10 years of experience. As the AWS Cloud Engineer you will participate in the creation and maintenance of development test and production environments with a goal of high availability fault-tolerance and scalability.You will also be responsible for...

  • AWS Engineer

    7 days ago

    Charlotte, United States A-Line Staffing Solutions Full time

    Job DescriptionJob DescriptionTitle: AWS Engineer (Python)Location: Charlotte, NC (Hybrid)Rate: $50/hrNote: This position is a contract on W2, and is NOT open to C2C This role is focused on end-to-end Cloud Native Application Development with Python. This is not a Data Engineering Role. Top Skills:At least 7 years of experience in Python...