Senior Data Engineer

2 weeks ago

New York, United States Sun Pharma Full time

As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. A successful candidate is an active listener with good interpersonal communication and can ask for and give feedback to others. The Sr. Data Engineer is someone who constantly communicates with different internal and external stakeholders and business owners.

Duties and responsibilities

  • Work with management and internal stakeholders to define business requirements and analytical needs and execute against them.
  • Develop a deep understanding of existing eCommerce performance, customer, brands, and productivity metrics, and develop new KPIs, metrics, and measures to gauge eCommerce performance.
  • Own regular and ad-hoc analysis on operational performance and projects to continuously improve and scale Alchemee's eCommerce operations.
  • Work to define and structure eCommerce customer and operational data and ensure the reliability and integrity of data sources.
  • Perform data modeling using/modifying existing models.
  • Build automated data flows on AWS by extracting and transforming data from existing e-commerce systems, log files, and API sources.

Qualifications

  • Expert-level skills in writing and optimizing SQL.
  • Experience operating very large data warehouses or data lakes.
  • Expertise in ETL optimization, designing, coding, and data ingestion from Rest and GraphQL API.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Sound knowledge of distributed systems and data architecture utilizing Lambda, Python, and Jupyter.
  • Experience in AWS Data Analytics platform and related services - S3, AWS Glue, Redshift, Athena, Lake Formation, Lambda, etc.
  • Experience in building data pipelines using Spark/Glue
  • Good understanding of Data Warehousing and Data Modelling concepts on AWS Redshift
  • Experience in designing and optimizing Redshift Workloads
  • Good knowledge of defining data access roles and permission for Redshift
  • Capable of learning and adapting to new technologies along with good Analytical skills
  • Experience working on Visualization tools like AWS QuickSight, Tableau, or Sigma is a plus.
  • Experience in Java, IntelliJ, Bitbucket, Gradle is plus.
  • 4-year degree (Economics, Statistics, Mathematics, Computer Science, MIS, or similar focus) and 3-5 years of relevant work experience.
  • 5+ years of experience in ETL, Data warehousing, Data pipelines, Data Analytics, in Microsoft or Amazon cloud. AWS Data Stack is preferred.

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. A successful candidate is an active listener with good interpersonal communication and can ask for and give feedback to others. The Sr. Data Engineer is someone who constantly communicates with different internal and external stakeholders and business owners.

    Duties and responsibilities

  • Work with management and internal stakeholders to define business requirements and analytical needs and execute against them.
  • Develop a deep understanding of existing eCommerce performance, customer, brands, and productivity metrics, and develop new KPIs, metrics, and measures to gauge eCommerce performance.
  • Own regular and ad-hoc analysis on operational performance and projects to continuously improve and scale Alchemee's eCommerce operations.
  • Work to define and structure eCommerce customer and operational data and ensure the reliability and integrity of data sources.
  • Perform data modeling using/modifying existing models.
  • Build automated data flows on AWS by extracting and transforming data from existing e-commerce systems, log files, and API sources.

  • Qualifications

  • Expert-level skills in writing and optimizing SQL.
  • Experience operating very large data warehouses or data lakes.
  • Expertise in ETL optimization, designing, coding, and data ingestion from Rest and GraphQL API.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Sound knowledge of distributed systems and data architecture utilizing Lambda, Python, and Jupyter.
  • Experience in AWS Data Analytics platform and related services - S3, AWS Glue, Redshift, Athena, Lake Formation, Lambda, etc.
  • Experience in building data pipelines using Spark/Glue
  • Good understanding of Data Warehousing and Data Modelling concepts on AWS Redshift
  • Experience in designing and optimizing Redshift Workloads
  • Good knowledge of defining data access roles and permission for Redshift
  • Capable of learning and adapting to new technologies along with good Analytical skills
  • Experience working on Visualization tools like AWS QuickSight, Tableau, or Sigma is a plus.
  • Experience in Java, IntelliJ, Bitbucket, Gradle is plus.
  • 4-year degree (Economics, Statistics, Mathematics, Computer Science, MIS, or similar focus) and 3-5 years of relevant work experience.
  • 5+ years of experience in ETL, Data warehousing, Data pipelines, Data Analytics, in Microsoft or Amazon cloud. AWS Data Stack is preferred.

  • Senior Data Engineer

    4 weeks ago

    New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Systems Engineer

    1 month ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Systems Engineer

    3 weeks ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer

    2 months ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    7 days ago

    New York, United States ASCENDING Full time

    Job DescriptionJob DescriptionFull-time, Remote - Must work standard EST hoursAvailable for W-2 or 1099 Individual. Senior Data Engineer Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data...

  • Senior Data Engineer

    4 days ago

    New York, United States ASCENDING Full time

    Job DescriptionJob DescriptionFull-time, Remote - Must work standard EST hoursAvailable for W-2 or 1099 Individual. Senior Data Engineer Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data...

  • Senior Data Engineer

    3 weeks ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Data Engineer

    3 weeks ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Data Engineer

    1 week ago

    New York, United States Forsyth Barnes Full time

    Position: Senior Data EngineerSalary: up to $180,000Industry: RetailLocation: Remote, USWe are currently partnered with a global organization on their search for a Senior Data Engineer. The Data Engineer will play a critical role in engineering of data solutions that support reporting and analytic needs. As a key member of the Data engineering team, will...

  • Senior Data Engineer

    2 days ago

    New York, United States Perchwell Full time

    Who We Are Perchwell is the premier workflow software and data platform for real estate professionals and consumers. Based on the industry's foundational data, Perchwell builds a modern software suite to empower real estate professionals to do their best work, provide differentiated service to their clients, and grow their businesses. Backed by Founders...

  • Senior Data Engineer

    7 days ago

    New York, New York, United States Viola Full time

    Similarweb is transforming the business approach to the digital landscape by providing comprehensive insights into online activities. Our diverse data and solutions serve more than 4,300 clients worldwide, including renowned names like Google, eBay, and Adidas, enabling them to make impactful decisions to enhance their digital strategies.If you are...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Blood Bank of Delmarva Full time

    Overview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...

  • Senior Data Engineer

    7 days ago

    New York, United States Quilt Software LLC Full time

    Job DescriptionJob DescriptionAbout Quilt Software: Quilt LLC is PSG Equity's latest vertical software and integrated payments platform, similar to their successful EverCommerce investment which recently went public. Quilt provides specialty inventory and POS software through a family of vertically focused, independently managed subsidiaries. See...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    4 weeks ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    1 month ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...