Senior Big Data Engineer

2 weeks ago

Charlotte, United States Entech Full time

We re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive end-to-end offerings, we advise, engineer, and manage, ensuring our clients proactively drive toward success in this ever-evolving digital landscape. Our team is growing, and we re searching for a Senior Big Data Engineer who is a creative problem-solver with their fingertips on the latest industry practices to help our clients achieve digital realization. You ll join a group of industry veterans, blending the power of tried-and-true methods with cutting-edge technologies. We prioritize authentic partnerships in a collaborative environment, and we re excited to welcome a Big Data who is eager to bring their expertise to our team. ResponsibilitiesThe person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems.Data Ingestion: Implement data ingestion processes to collect data from various sources, including databases, streaming data, and external APIs.Data Transformation: Develop ETL (Extract, Transform, Load) processes to transform and cleanse raw data into a structured and usable format for analysis.Data Storage: Manage and optimize data storage solutions, including Amazon S3, Redshift, and other AWS storage services.Data Processing: Utilize AWS services like AWS Glue, Amazon EMR, and AWS Lambda to process and analyze large datasets.Data Monitoring and Optimization: Continuously monitor and optimize data pipelines and infrastructure for performance, cost-efficiency, and scalability.Integration: Collaborate with data scientists, analysts, and other stakeholders to integrate AWS-based solutions into data analytics and reporting platforms.Documentation: Maintain thorough documentation of data engineering processes, data flows, and system configurations.Scalability: Design AWS-based solutions that can scale to accommodate growing data volumes and changing business requirements.Cost Management: Implement cost-effective solutions by optimizing resource usage and recommending cost-saving measures.Troubleshooting: Diagnose and resolve AWS-related issues to minimize downtime and disruptions. Qualifications Must Have:Strong experience with AWS services on big data platforms.Strong Python experience in building Dash application in AWS SparkShell scripting and Linux knowledge Nice to have:Investment Knowledge preferredLooking for candidates who have worked in Investment/Finance spaceMachine Learning Skills Qualifications:Educational Background: A bachelor's degree in computer science, information technology, or a related field is typically required.A master's degree is preferred with GPA of 3.8+Problem-Solving:Strong analytical and problem-solving skills to address complex data engineering challenges.Communication Skills:Effective communication and collaboration skills to work with cross-functional teams Company BenefitsHealth, Dental, Vision, 401(k), 25 days of Paid Time Off (PTO)AdditionallyEntech is an equal-opportunity employer.This is an On-site Hybrid work schedule based out of our Charlotte North Carolina OfficeNo Third-party candidates will be accepted, this is strictly a direct employment opportunity with Entech.

  • Big Data Engineer

    2 weeks ago

    Charlotte, United States Sripen Full time

    Title : Big Data DeveloperLoc: Charlotte, NCNEED 14+JD:PYSpark - MandatoryHive - Mandatory , Need Python Hands-on Coding, Hadoop, Scala, HDFS, Hdoop basics, Hive. Big Data Engineer

  • AWS BIG DATA Engineer

    3 weeks ago

    Charlotte, United States Diverse Lynx Full time

    AWS BIG DATA Engineer Charlotte - NC We are looking for a strong Cloud Engineer with AWS , Python and Airflow skills 3.Experience 10to12Yrs Required Skills ,AWS Big Data Roles & Responsibilities Should have experience working as a Cloud Engineer with AWS skillsets. Should be experienced in developing systems using Python. Should have strong Python...

  • Big Data Platform Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Bank of America Full time

    Job Description:At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day.One of the keys to driving Responsible Growth is being a great place to work for our...

  • Big Data AWS Engineer

    4 weeks ago

    Charlotte, United States Entech Full time

    We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • Big Data AWS Engineer

    4 weeks ago

    Charlotte, United States Entech Full time

    We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • Big Data AWS Engineer

    2 days ago

    Charlotte, United States Entech Full time

    We’re living and working in the midst of a digital revolution, and the demand for optimized technology practices has never been more critical for businesses. At Entech, it’s our mission to help companies navigate the changing environment and accelerate digital realization through the power of solutions, services, and product platforms. With comprehensive...

  • Senior Data Engineer

    1 week ago

    Charlotte, United States Incedo Inc. Full time

    Senior Data Engineer Location: Charlotte, North Carolina Hybrid role FulltimeAWS Data Engineer (Spark, AWS, Glue) Must Skill:- Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities- Design and develop data applications using big data technologies (AWS, Spark) to ingest, process,...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, United States Incedo Inc. Full time

    Senior Data Engineer Location: Charlotte, North Carolina Hybrid role FulltimeAWS Data Engineer (Spark, AWS, Glue) Must Skill:- Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities- Design and develop data applications using big data technologies (AWS, Spark) to ingest, process,...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, United States Incedo Inc. Full time

    Senior Data Engineer Location: Charlotte, North Carolina Hybrid role FulltimeAWS Data Engineer (Spark, AWS, Glue) Must Skill:- Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities- Design and develop data applications using big data technologies (AWS, Spark) to ingest, process,...

  • Big Data Engineer

    2 weeks ago

    Charlotte, United States Emblue Full time

    Responsibilities Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems. Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development. Gathers analyzes synthesizes and develops...

  • Big Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Emblue Full time

    Responsibilities Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems. Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development. Gathers analyzes synthesizes and develops visualizations...

  • Lead Data Engineer

    6 days ago

    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)Required experience: Python, SQL, Databricks, Azure, Retail industryWhat...

  • Lead Data Engineer

    2 days ago

    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)Required experience: Python, SQL, Databricks, Azure, Retail industryWhat...

  • Lead Data Engineer

    17 hours ago

    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)Required experience: Python, SQL, Databricks, Azure, Retail industryWhat...

  • Data Engineer

    2 months ago

    Charlotte, United States Infinicsinc.com Full time

    Bachelors' degree in Computer Science Engineering Information Technology or related area 7+ years' experience on ETL Development Tools Spark / Java (preferred) Python Ab Initio Informatica Advanced experience & demonstrated proficiency in Spark. Experience with Apache Beam Cloud Data Flow Dataproc Cloud Composer and Big Query 3+ years'...

  • Data Engineer

    2 months ago

    Charlotte, North Carolina, United States Infinicsinc Full time

    Bachelors' degree in Computer Science Engineering Information Technology or related area 7+ years' experience on ETL Development Tools Spark / Java (preferred) Python Ab Initio Informatica Advanced experience & demonstrated proficiency in Spark. Experience with Apache Beam Cloud Data Flow Dataproc Cloud Composer and Big Query 3+ years' experience in Big Data...

  • Senior AWS Data Engineer

    3 days ago

    Charlotte, United States TMS Full time

    Job DescriptionJob DescriptionTitle: Senior AWS Data EngineerLocation: Charlotte, NC (Onsite hybrid day 1)Duration: 12+ MonthsSummary:We are seeking a highly skilled and experienced Senior AWS Data Engineer to join our team in Charlotte, NC. The ideal candidate will have a minimum of 10 years of experience in data engineering, with a strong focus on...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, United States LendingTree Full time

    Job DescriptionJob Description*PLEASE NOTE: We offer a hybrid 3-2 work schedule (Three days in the office, two days of teleworking) to accommodate the need for flexibility.*Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.Position:LendingTree is seeking a...

  • Cloud Senior Data Engineer

    2 months ago

    Charlotte, North Carolina, United States Bank of America Full time

    Job Description:About UsAt Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities, and shareholders every day. One of the keys to driving Responsible Growth is being a great place to...

  • Lead Data Engineer

    7 days ago

    Charlotte, United States Circle K Full time

    Job Description:As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with...