Data Engineering Lead

3 weeks ago


New York, New York, United States Prophecy Full time
About the Role">

This is an amazing opportunity to be an early engineer in a high-growth, high-potential startup. You will be working with a team of dynamic engineers who take pride in solving complex problems.

Responsibilities:">
  • ">
  • Troubleshoot and resolve complex customer issues related to the Prophecy IDE ">
  • Assist with issues around third-party integrations with the Prophecy environment ">
  • Reproduce customer bugs in production and sandbox environments to capture additional context, build documentation and better understand the root cause ">
  • Set clear expectations with customers on the next steps and then meet or exceed them ">
  • Surprise and delight customers, even when problems are not solved quickly ">
  • Provide best practices guidance and support for solutions developed by customers using Prophecy IDE ">
  • Deliver proactive suggestions for improving performance and efficiency in customer-specific environments ">
  • Demonstrate a true sense of ownership and coordinate with engineering to achieve timely resolution of customer issues and requests ">
  • Participate in the creation and maintenance of company documentation and knowledge articles ">
  • Be a true proponent of customer advocacy ">
  • Be a team player and coach other team members as needed ">
  • Develop and maintain advanced knowledge of Prophecy IDE architecture and administration ">
  • Support customers and other customer support team members via chat, email and video conference ">

We're seeking A players to work with A players. We're a high-growth company on a once-in-a-lifetime journey to revolutionize the way data engineering is done.

Requirements:">
  • ">
  • 4+ years of experience troubleshooting and supporting B2B large enterprise applications ">
  • Advanced skills in Spark ">
  • Strong work experience in production issue resolution ">
  • You have built managed and maintained all aspects of ETL including development, bug fixing, monitoring and debugging of jobs ">
  • Expert in Spark architecture and experience with Databricks/Snowflake environment configuration and management ">
  • Experience with Git and CI/CD technologies ">
  • Technology experience in SQL, Databricks/ Hadoop/ Spark Experienced in a variety of tools and products including Snowflake, BigQuery, Azure, Hadoop, CDP etc. ">
  • You have experience of 'hands-on' technical support and escalation (through Incident, Change and Problem Management procedures) and ensure that SLAs are achieved, whilst also looking for ways to improve the day-to-day product delivery. ">
  • Excellent verbal and written communication skills in English ">
  • The ability to break down complex technical concepts and communicate them to stakeholders verbally and in writing ">
  • Have a creative attitude toward problem-solving ">
  • Entrepreneurial spirit, priding yourself on getting things done with a high level of quality ">
  • Desire to work in a fast paced and unstructured startup environment ">
  • Bachelors Degree in CS or Equivalent ">
Salary:">

$120,000 per year, plus benefits and bonuses

">Location:">

Remote, with opportunities to work from home

">About Us:">

Prophecy is the data copilot company. Fortune 500 enterprises - including the largest institutions in banking, insurance, healthcare & life sciences, and technology - rely on Prophecy Data Transformation Copilot to accelerate AI and analytics by delivering data that is clean, trusted, and timely.

We enable all data users and make them productive by helping develop, deploy, and observe data pipelines on cloud data platforms. Organizations trust Prophecy for the most demanding workloads, including tens of thousands of data pipelines that deliver massive volumes of data for AI and analytics.

">

We're backed by top VCs and investors including Insight Partners, SignalFire, Databricks, and JPMorgan Chase.



  • New York, New York, United States Hudson Data Full time

    Hudson Data is a cutting-edge technology company that is seeking a highly skilled Azure Data Engineering Lead to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design,...


  • New York, New York, United States The Data Sherpas Full time

    Job Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...

  • Data Engineering Lead

    3 weeks ago


    New York, New York, United States Vic Full time

    Job DescriptionWe are seeking a highly skilled and experienced Data Engineering Lead to join our team at Vic.ai in Oslo, Norway. As a remote company, we offer the flexibility to work from anywhere while being part of a talented, hard-driving team led by experienced entrepreneurs.As a key member of our engineering team, you will be responsible for leading...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States Chobani Full time

    Data Engineering Lead at ChobaniChobani, a purpose-driven food and wellness company, is seeking an experienced Data Engineering Lead to join our team. In this role, you will play a pivotal part in delivering cutting-edge data solutions that drive business performance. Your expertise in designing and implementing scalable data pipelines and architectures will...


  • New York, New York, United States Rhode Island Blood Center Full time

    Job Title: Lead Data Engineer and Team LeadAbout Our Company: Our company is a leading provider of blood products and services, with a commitment to innovation and excellence in all aspects of our business. We are seeking a highly skilled Lead Data Engineer to join our team.Job Summary: As a Lead Data Engineer, you will be responsible for leading the...

  • Data Engineering Lead

    3 weeks ago


    New York, New York, United States 1stdibs Full time

    About the JobAt 1stDibs, we're driven by a passion for design and a commitment to empowering creatives. As a Data Engineering Lead, you'll be responsible for overseeing the design, development, and maintenance of our data pipelines and ETL/ELT processes. Your expertise will shape the future of our analytics capabilities, driving business growth and...


  • New York, New York, United States The Data Sherpas Full time

    Job DescriptionThe Data Sherpas is seeking a talented GCP Machine Learning Engineer to join our team. In this role, you will play a key part in driving technology innovation and delivering world-class machine learning solutions. Your primary focus will be on integrating GCP-native and third-party technologies to build scalable data infrastructures, focusing...


  • New York, New York, United States Grata Full time

    Job DescriptionWe are seeking a highly skilled and experienced Data Engineering Lead to join our team at Grata. Our company is the leading private market dealmaking platform, making it easy for investors, investment bankers, management consultants, and corporate development teams to discover and win more deals.The ideal candidate will have a strong...


  • New York, New York, United States Grubhub Full time

    About the JobWe are seeking a highly skilled Data Engineering Lead to join our team at Grubhub. Our company is dedicated to connecting hungry diners with over 300,000 restaurants nationwide through user-friendly platforms and streamlined delivery capabilities.At Grubhub, we treat data as a valuable asset that drives decision making. The mission of the...

  • Data Engineer Lead

    3 weeks ago


    New York, New York, United States GroupM Choreograph Full time

    Job Overview"At GroupM Choreograph, we are seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines, architectures, and systems that support our business goals. With a strong focus on innovation and collaboration, you will work closely...

  • Cloud Data Engineer

    6 days ago


    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers assisting clients throughout their cloud journey. Our expertise lies in cloud, data, and application services.Job OverviewThis is an exciting opportunity for self-motivated and data-driven engineers to support our clients' data platform upgrades. Ideal candidates will have a solid...


  • New York, New York, United States Kalshi Full time

    Company ProfileKalshi is a leading player in the prediction markets space, pushing the boundaries of innovation and disruption. Our team is comprised of talented individuals who share a passion for data-driven decision making and a commitment to excellence.Job RoleWe are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States A Place for Mom Full time

    Cloud Platform ManagerA Place for Mom is seeking an experienced Cloud Platform Manager to join our team. As a key member of our cloud platform group, you will manage the design, development, and support of our cloud-based data platforms. This strategic role involves leading cross-functional teams to shape the future of data engineering, driving innovation,...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States January Technologies, Inc. Full time

    Senior Software Engineer RoleThe Senior Software Engineer will be responsible for leading the design and implementation of complex data ingestion and ETL pipelines that are robust, scalable, and maintainable. This role requires 5+ years of full-stack software development experience, with a strong focus on back-end development and a passion for solving...


  • New York, New York, United States Hudson Data Full time

    Hudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...


  • New York, New York, United States The Custom Group of Companies Full time

    Job Overview:The Custom Group of Companies seeks a highly skilled Senior Data Engineer to lead the design, development, and maintenance of data pipelines in Databricks on an AWS 6 ecosystem. As a key member of our team, you will collaborate with cross-functional teams to understand data needs and translate them into effective data pipeline solutions.About...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States Delphi-US Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team and lead the transition of our legacy Martech pipelines to our modern ELT architecture.Key Responsibilities:Design, develop, test, deploy, and support data pipelines and models using dbt, Snowflake, Fivetran, and SNP Glue.Monitor and...


  • New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Lead Azure Data Engineer PositionFutran Tech Solutions Pvt. Ltd. is seeking a talented Data Engineering Lead on Azure to oversee the design, implementation, and optimization of data solutions on the Azure cloud platform. As a leader in cloud data engineering, you will work closely with cross-functional teams to understand data requirements and deliver...

  • Lead Data Engineer

    4 weeks ago


    New York, New York, United States Diverse Lynx Full time

    We are seeking a Lead Data Engineer to join our team in New York. As a Lead Data Engineer, you will be responsible for leading the design and implementation of database solutions using MS SQL Server Development platform.Your primary goal will be to ensure the integrity and performance of our database systems. You will work closely with cross-functional teams...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States CVS Health Full time

    Job SummaryWe are seeking a highly skilled Analytics Engineer to join our Pharmacy Services Finance Business Intelligence, Automation, & Analytics organization. As an integral member of our team, you will play a crucial role in building scalable and sustainable pipelines for massive amounts of enterprise data.You will leverage industry-leading technology to...