Senior Data Engineer

3 weeks ago

Hawthorne NY United States Sun Pharma (Taro Pharma) Full time

As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. A successful candidate is an active listener with good interpersonal communication and can ask for and give feedback to others. The Sr. Data Engineer is someone who constantly communicates with different internal and external stakeholders and business owners.

 

Duties and responsibilities

  • Work with management and internal stakeholders to define business requirements and analytical needs and execute against them.
  • Develop a deep understanding of existing eCommerce performance, customer, brands, and productivity metrics, and develop new KPIs, metrics, and measures to gauge eCommerce performance.
  • Own regular and ad-hoc analysis on operational performance and projects to continuously improve and scale Alchemee's eCommerce operations.
  • Work to define and structure eCommerce customer and operational data and ensure the reliability and integrity of data sources.
  • Perform data modeling using/modifying existing models.
  • Build automated data flows on AWS by extracting and transforming data from existing e-commerce systems, log files, and API sources.

Qualifications

  • Expert-level skills in writing and optimizing SQL.
  • Experience operating very large data warehouses or data lakes.
  • Expertise in ETL optimization, designing, coding, and data ingestion from Rest and GraphQL API.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Sound knowledge of distributed systems and data architecture utilizing Lambda, Python, and Jupyter.
  • Experience in AWS Data Analytics platform and related services - S3, AWS Glue, Redshift, Athena, Lake Formation, Lambda, etc.
  • Experience in building data pipelines using Spark/Glue
  • Good understanding of Data Warehousing and Data Modelling concepts on AWS Redshift
  • Experience in designing and optimizing Redshift Workloads
  • Good knowledge of defining data access roles and permission for Redshift
  • Capable of learning and adapting to new technologies along with good Analytical skills
  • Experience working on Visualization tools like AWS QuickSight, Tableau, or Sigma is a plus.
  • Experience in Java, IntelliJ, Bitbucket, Gradle is plus.
  • 4-year degree (Economics, Statistics, Mathematics, Computer Science, MIS, or similar focus) and 3-5 years of relevant work experience.
  • 5+ years of experience in ETL, Data warehousing, Data pipelines, Data Analytics, in Microsoft or Amazon cloud. AWS Data Stack is preferred.

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. A successful candidate is an active listener with good interpersonal communication and can ask for and give feedback to others. The Sr. Data Engineer is someone who constantly communicates with different internal and external stakeholders and business owners.

     

    Duties and responsibilities

  • Work with management and internal stakeholders to define business requirements and analytical needs and execute against them.
  • Develop a deep understanding of existing eCommerce performance, customer, brands, and productivity metrics, and develop new KPIs, metrics, and measures to gauge eCommerce performance.
  • Own regular and ad-hoc analysis on operational performance and projects to continuously improve and scale Alchemee's eCommerce operations.
  • Work to define and structure eCommerce customer and operational data and ensure the reliability and integrity of data sources.
  • Perform data modeling using/modifying existing models.
  • Build automated data flows on AWS by extracting and transforming data from existing e-commerce systems, log files, and API sources.

  • Qualifications

  • Expert-level skills in writing and optimizing SQL.
  • Experience operating very large data warehouses or data lakes.
  • Expertise in ETL optimization, designing, coding, and data ingestion from Rest and GraphQL API.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Sound knowledge of distributed systems and data architecture utilizing Lambda, Python, and Jupyter.
  • Experience in AWS Data Analytics platform and related services - S3, AWS Glue, Redshift, Athena, Lake Formation, Lambda, etc.
  • Experience in building data pipelines using Spark/Glue
  • Good understanding of Data Warehousing and Data Modelling concepts on AWS Redshift
  • Experience in designing and optimizing Redshift Workloads
  • Good knowledge of defining data access roles and permission for Redshift
  • Capable of learning and adapting to new technologies along with good Analytical skills
  • Experience working on Visualization tools like AWS QuickSight, Tableau, or Sigma is a plus.
  • Experience in Java, IntelliJ, Bitbucket, Gradle is plus.
  • 4-year degree (Economics, Statistics, Mathematics, Computer Science, MIS, or similar focus) and 3-5 years of relevant work experience.
  • 5+ years of experience in ETL, Data warehousing, Data pipelines, Data Analytics, in Microsoft or Amazon cloud. AWS Data Stack is preferred.

  • Senior Data Engineer

    4 weeks ago

    Hawthorne, NY, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to...

  • Senior Data Engineer

    2 weeks ago

    Hawthorne, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    4 weeks ago

    Hawthorne, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    4 weeks ago

    Hawthorne, NY, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    3 weeks ago

    Hawthorne, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    3 weeks ago

    Hawthorne, United States Sun Pharma (Taro Pharma) Full time

    Job DescriptionAs a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many...

  • Senior Data Engineer

    2 weeks ago

    Hawthorne, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    3 weeks ago

    HAWTHORNE, United States Sun Pharma (Taro Pharma) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    2 weeks ago

    Hawthorne, United States Alchemee (formerly The Proactiv Company) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer

    2 weeks ago

    Hawthorne, United States Alchemee (formerly The Proactiv Company) Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Manager, Data Science, Ring Data Science

    2 weeks ago

    Hawthorne, California, United States Amazon Inc Full time

    Come build the future of smart security with us. Are you interested in helping shape the future of devices and services designed to give Neighbors peace of mind inside, protection outside, and a connection to what's happening in the neighborhood? Ab Data Science, Science, Manager, Engineer, Data Scientist, Senior, Technology

  • Senior Data Engineer

    1 month ago

    Rocky Hill, CT, United States ebbo Full time

    We're looking for this person to come into our Rocky Hill, CT office twice a week:Position Overview of Senior Data Engineer Ebbo is looking for a Senior Data Engineer to help build and support data infrastructure for the virtual data warehouse. This Senior Data Engineer will develop jobs to ingest, validate and verify incoming data from internal and external...

  • Senior Software Engineer

    3 weeks ago

    Hawthorne, United States CareerBuilder Full time

    We want you to join us full-time in our Data Pipeline team. We work remotely first, but we are more than happy to meet you in our nice office in Bratislava or Brno. And if you are interested in who will be your engineering manager, check out .Intrigued? Read on Your responsibilities You will develop a data pipeline processing a large amount of data reliably...

  • Senior Software Engineer

    1 month ago

    Boise, ID, United States Resource Data Full time

    As a Senior Software Engineer with Resource Data, you'll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You'll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems.Key ResponsibilitiesAnalyze, design, develop, and...

  • Senior Software Engineer

    1 month ago

    Boise, ID, United States Resource Data Full time

    As a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You’ll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems.Key ResponsibilitiesAnalyze, design, develop,...

  • Senior Software Engineer

    2 weeks ago

    Boise, ID, United States Resource Data Full time

    As a Senior Software Engineer with Resource Data, you'll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You'll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems.Key ResponsibilitiesAnalyze, design, develop, and...

  • Senior Software Engineer

    3 weeks ago

    Boise, ID, United States Resource Data Full time

    As a Senior Software Engineer with Resource Data, you’ll help design and develop software solutions that elevate enterprise systems efficiency, performance, and value. You’ll join a team of high-achieving technical consultants and help provide solutions to our clients' most challenging enterprise IT problems.Key ResponsibilitiesAnalyze, design, develop,...

  • Senior Data and Integration Engineer

    1 week ago

    United States Magellan Health Full time

    Candidates for this remote Senior Data and Integration Engineer r position should have a favorably adjudicated T3 investigation / secret clearance to be eligible for this role. This position is contingent upon a contract award. This is also a fully remote position.This position will analyze problems and is an expert in at least two or more Data Management...

  • Data Engineer

    4 weeks ago

    United States Rakirs Systems LLC Full time

    Job Title Data EngineerLocation Alpharetta GADuration 12 months (extendable)Experience 2 - 8+yrspay rate $47.26/hourJob DescriptionThe Senior/ Junior Data Admin Analyst will work in the Brokerage platform that develops and supports applications that is responsible for compliance and reporting. The title/role is synonomous with that of Senior &...

  • Data Engineer

    1 month ago

    United States Rakirs Systems LLC Full time

    Job Title Data EngineerLocation Alpharetta GADuration 12 months (extendable)Experience - 8+yrspay rate $47.26/hourJob DescriptionThe Senior/ Junior Data Admin Analyst will work in the Brokerage platform that develops and supports applications that is responsible for compliance and reporting. The title/role is synonomous with that of Senior & Junior Data...