Data Engineer

3 days ago

Atlanta, Georgia, United States STEMtech Full time $80,000 - $120,000 per year
Company Description

STEMtech has a client in the Atlanta area looking for a Data Engineer who will aid in the optimization of operations by manipulating and aggregating the disparate operational and back office data sources into a format that is easily digestible by both data scientists and statistically adept colleagues.  His/her core responsibility will be to combine large volumes of disparate complex data, conduct quality checks on the data, manipulate the data and ensure continuous access to a clean format of the operational data for data scientists and other stakeholders. In addition, he/she will also assist in developing the data pipeline to ensure ongoing data collection, consolidation, and management

Job Description

· Create data ingestion pipeline and processes based on jointly defined requirements

· Profile and analyze data to identify gaps and potential data quality issues; works with business SME's to resolve these issues

· Identifies relationships between disparate data sources

· Uses Python, "R", Informatica, and other Big Data tools and technologies to code the data Engineering routines

· Designs and develops the Data Engineering routines for feature extraction, feature generation and feature engineering

· Works with the group of data scientists and business SMEs to get the requirements and present the details in data

· Designs and jointly develops the data architecture with data architect and ensures security and maintenance

· Explores suitable options, designs, and creates data pipeline (data lake / data warehouses) for specific analytical solutions 

· Identifies gaps and implements solutions for data security, quality and automation of processes

· Builds data tools and products for effort automation and easy data accessibility

· Supports maintenance, bug fixing and performance analysis along data pipeline

· Diagnoses existing architecture and data maturity and identifies gaps

· Gather requirements, assess gaps and build roadmaps and architectures to help the analytics driven organization achieve its goals

Qualifications

· years of experience in data engineering and Data Lake using any Hadoop ecosystem

· Bachelor's Degree in Computer Science, Engineering, and/or background in Mathematic and Statistics; Master's or other advanced degree a plus

· Previous leadership experience

· Experience on Big Data platforms (e.g. Hadoop, Map/Reduce, Spark, HBase, HDInsight, Data Bricks, Hive) and with programming languages like UNIX shell scripting, Python etc.

· Has used SQL, PL/SQL or T-SQL with RDBMSs like Teradata, MS SQL Server, Oracle etc in production environments

· Experience with reporting and BI packages e.g. PowerBI, Tableau, SAP BO etc.

· Strong critical thinking and problem solving skills

· Success at working on cross-functional teams to meet a common goal

· Self-starter with a high sense of urgency

Additional Information

All your information will be kept confidential according to EEO guidelines.

  • Data Engineer

    3 days ago

    Atlanta, Georgia, United States SoHo Dragon Full time $80,000 - $120,000 per year

    Position: Data EngineerLocation: Atlanta, GA(Hybrid 3x in office)Employment Type:Contract-to-hireContract Duration: 6months-1yearThe data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. The data engineer will work with a multidisciplinary Agile team to build...

  • Data Engineer

    1 day ago

    Atlanta, Georgia, United States Carman Solutions Group Full time $120,000 - $180,000 per year

    Job Title: Data EngineerLocation: Alpharetta, GADuration: Long Term ContractVisa: H1B Transfers OnlyExperience: 10+ Years (Must)Job DescriptionWe are looking for an experienced Data Engineer with strong expertise in building and optimizing data processing applications using Java and Python, ensuring high performance and scalability of data pipelines.Key...

  • IT Data Engineer

    2 days ago

    Atlanta, Georgia, United States Kanak Elite Services Full time $140,000 - $170,000 per year

    Title - IT Data EngineerLocation - GA Local requiredDuration - 12+We have some urgent requirements with atleast 3 years experience asData Engineerto join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data...

  • Data Engineer

    3 days ago

    Atlanta, Georgia, United States Apollo Technology Solutions LLC Full time $90,000 - $120,000 per year

    Job Title: Data EngineerLocation: Atlanta, GA(Hybrid)Duration: 8+ months Note:Must be physically located in GeorgiaOn-site: Tuesday to Thursday (per manager's discretion)Mandatory in-person meetings: All Hands, Enterprise ApplicationsShort Description:Under broad supervision, combines strong technical skills with knowledge of database administration. Works...

  • Data Engineer

    3 days ago

    Atlanta, Georgia, United States Largeton Group Full time $120,000 - $140,000 per year

    Location- Atlanta,Georgia-Hybrid- Local candidates Only-with State ExperienceLinkedin- Must be strongDuration- 9 months2 Mangerial Refrence RequiredWe have some urgent requirements with atleast 3 years experience asData Engineerto join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development,...

  • Data Engineer

    2 weeks ago

    Atlanta, Georgia, United States DS Technologies Inc Full time $80,000 - $120,000 per year

    About US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...

  • Senior Data Engineer

    1 day ago

    Atlanta, Georgia, United States Aptonet Full time $120,000 - $180,000 per year

    Senior Data Engineer (Databricks) – Hybrid, Metro AtlantaLocation:Metro Atlanta, GA (Hybrid – 3 days onsite per week)Type:Long-term contract / Full-time opportunityOverviewWe are seeking aSenior Data Engineerwith strong hands-on experience inDatabricksand modern data engineering practices. This role is ideal for an engineer who enjoys building,...

  • Senior Data Engineer

    3 days ago

    Atlanta, Georgia, United States Heritage Distribution Holdings Full time $120,000 - $180,000 per year

    Heritage Distribution Holdings is building a next-generation business management platform from the ground up — and we're looking for a hands-on Senior Data Engineer to deliver and scale our data strategy. As we grow rapidly through mergers and acquisitions, we face a rich and complex data environment. This role will be central to cleaning, unifying, and...

  • Data Engineer Manager

    2 days ago

    Atlanta, Georgia, United States Furniture Full time $150,000 - $250,000 per year

    We're looking for a Data Engineering Manager to lead a team of highly skilled senior data engineers. This leadership role is not only technical, it's strategic and collaborative. The right candidate will have a proven track record in data architecture and solution design, strong interpersonal leadership, and the emotional intelligence to manage change and...

  • Data Engineer, Enterprise

    3 days ago

    Atlanta, Georgia, United States Delta Air Lines Full time $120,000 - $180,000 per year

    How You'll Help Us Keep Climbing (Overview & Key Responsibilities)At Delta Air Lines, connection is at the heart of everything we do and guides our every action. We strive to welcome and care for all our customers during their travels with us and aim to deliver an elevated experience.Delta is focused on sustaining a strong IT operation, growing our...