Data Transformation Expert

5 days ago


Palo Alto, California, United States Prophecy Full time

We are seeking a highly skilled Data Transformation Expert to join our team at Prophecy, a data copilot company that accelerates AI and analytics by delivering clean, trusted, and timely data.

About Prophecy

Prophecy is the go-to solution for Fortune 500 enterprises in banking, insurance, healthcare & life sciences, and technology. Our cutting-edge technology enables all data users to develop, deploy, and observe data pipelines on cloud data platforms. With tens of thousands of data pipelines delivering massive volumes of data for AI and analytics, we are the trusted partner for the most demanding workloads.

Backed by top VCs and investors, including Insight Partners, SignalFire, Databricks, and JPMorgan Chase, we are on a once-in-a-lifetime journey to revolutionize the way data engineering is done. Be part of it

About the Role

This is an amazing opportunity to be an early engineer in a high-growth, high-potential startup. You will work with a dynamic team of engineers who take pride in solving complex problems. We're seeking A-players to work with A-players in a fast-paced and unstructured startup environment.

Key Responsibilities
  • Troubleshoot and resolve complex customer issues related to the Prophecy IDE
  • Assist with issues around third-party integrations with the Prophecy environment
  • Reproduce customer bugs in production and sandbox environments to capture additional context, build documentation, and better understand the root cause
  • Set clear expectations with customers on the next steps and then meet or exceed them
  • Surprise and delight customers, even when problems are not solved quickly
  • Provide best practices guidance and support for solutions developed by customers using Prophecy IDE
  • Deliver proactive suggestions for improving performance and efficiency in customer-specific environments
  • Demonstrate a true sense of ownership and coordinate with engineering to achieve timely resolution of customer issues and requests
  • Participate in the creation and maintenance of company documentation and knowledge articles
  • Be a true proponent of customer advocacy
  • Be a team player and coach other team members as needed
  • Develop and maintain advanced knowledge of Prophecy IDE architecture and administration
  • Support customers and other customer support team members via chat, email, and video conference
Requirements
  • 4+ years of experience troubleshooting and supporting B2B large enterprise applications
  • Advanced skills in Spark
  • Strong work experience in production issue resolution
  • You have built managed and maintained all aspects of ETL including development, bug fixing, monitoring, and debugging of jobs
  • Expert in Spark architecture and experience with Databricks/Snowflake environment configuration and management
  • Experience with Git and CI/CD technologies
  • Technology experience in SQL, Databricks/Hadoop/Spark Experienced in a variety of tools and products including Snowflake, BigQuery, Azure, Hadoop, CDP, etc.
  • You have experience of 'hands-on' technical support and escalation (through Incident, Change, and Problem Management procedures) and ensure that SLAs are achieved, whilst also looking for ways to improve the day-to-day product delivery
  • Excellent verbal and written communication skills in English
  • The ability to break down complex technical concepts and communicate them to stakeholders verbally and in writing
  • Have a creative attitude toward problem-solving
  • Entrepreneurial spirit, priding yourself on getting things done with a high level of quality
  • Desire to work in a fast-paced and unstructured startup environment
  • Bachelor's Degree in Computer Science or related
Preferred Qualifications
  • Full-stack Data platform knowledge
  • Good knowledge of cloud, on-prem, and service architecture in multi-region setups
  • Familiarity with OAuth/OIDC and IAM technologies
  • Experience creating queries, alerts, and monitors in Grafana, Datadog, or similar tools
  • Experience developing pipelines in Prophecy IDE
Benefits and Perks
  • Prophecy covers 99% of employee health insurance and 75% for dependents
  • Very competitive compensation - $120,000 per year
  • We offer $200 per month towards wellness, classes, gyms, massages, facials, and more
  • Celebrate your birthday and anniversary with a day off
  • Flexible PTO
  • Prophecy provides employees with a $500 professional development reimbursement every year
  • Company-sponsored Long Term Disability and Life Insurance
  • FSA/HSA
  • Ability to have your fingerprint on an innovative platform
  • End-to-end ownership of your projects
  • And more

*Benefits and perks may vary per country

Our Commitment to Diversity and Inclusion

We are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Prophecy are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, political affiliation, race, religion, sexual orientation, socio-economic status, and any other protected characteristics.



  • Palo Alto, California, United States International Flavors and Fragrances Full time

    Job SummaryWe are seeking an experienced data engineer to accelerate our efforts in transforming the chemical industry from petroleum-based to bio-based. At International Flavors and Fragrances, we have a long history of developing cell factories that produce enzymes at scale for a wide range of applications.We are overhauling our workflows to streamline...


  • Palo Alto, California, United States Match Group Full time

    About Our MissionTinder has transformed how people connect, growing from a single match to over one billion matches in just two years. This rapid growth highlights its ability to meet a fundamental human need: genuine connection. Today, the app has been downloaded over 630 million times, resulting in more than 97 billion matches, serving approximately 50...


  • Palo Alto, California, United States Navan Group Full time

    We are Navan Group, a company passionate about revolutionizing the business travel experience. As a Data Science Expert for AI Innovation, you will play a pivotal role in shaping our machine learning strategy and driving technological advancements.With strong MLOps skills and a deep understanding of data-driven decision-making, you will work closely with our...


  • Palo Alto, California, United States Tidepool Full time

    Company OverviewTidepool is a 501(c)3 nonprofit organization dedicated to making diabetes data more accessible, actionable, and meaningful for people with diabetes, their care teams, and researchers. The company was founded in 2013 with the aim of improving the lives of individuals with diabetes through innovative solutions.SalaryThe selected candidate can...


  • Palo Alto, California, United States HP Full time

    Job DescriptionHP seeks a highly skilled Data Scientist to join the Workforce Experience Platform team. This role involves leveraging AI/ML to drive innovation and deliver stellar customer experiences using one of the largest data lakes in the world.Responsibilities:Collaborate with product management to understand product vision and user engagement...


  • Palo Alto, California, United States Rivian Full time

    About RivianRivian is a pioneering force in the electric vehicle industry, driven by a mission to preserve the world's adventurous spirit. This vision extends to our employees, whom we strive to attract with purpose and challenge through innovative experiences.As an organization, we continuously push beyond conventional boundaries, redefining what's possible...


  • Palo Alto, California, United States Machinify, Inc. Full time

    Machinify, Inc. is a pioneering force in the healthcare industry, leveraging cutting-edge technology to transform claims and payment operations.Company OverviewMachinify's innovative AI-platform has revolutionized the way healthcare claims are processed, enabling companies to increase speed and accuracy by orders of magnitude.About the RoleWe're seeking an...


  • Palo Alto, California, United States Stanford Blood Center Full time

    Job OverviewStanford University seeks a highly skilled Senior Research Scientist to join its Department of Emergency Medicine. This is a fixed-term, 3-year position with the possibility of renewal at 100% FTE.About the RoleThe Senior Research Scientist will play a key role in advancing the department's research activities, contributing to cutting-edge...


  • Palo Alto, California, United States Machinify Full time

    Transform Healthcare Claims Processing with MachinifyMachinify is a leading provider of AI-powered software products that revolutionize healthcare claims and payment operations. Every year, the healthcare industry incurs over $200 billion in mispayments, resulting in unnecessary waste, friction, and frustration for patients, providers, and payers alike.We're...


  • Palo Alto, California, United States Machinify Full time

    Exciting Opportunity at MachinifyMachinify is revolutionizing the healthcare industry with its cutting-edge AI-platform, transforming claims and payment operations. Our innovative solutions have already made a significant impact, saving billions of dollars in mispayments each year.We are seeking a highly skilled Staff Software Engineer, Backend to join our...


  • Palo Alto, California, United States Purgo Full time

    Purgo AI is an innovative application design studio powered by generative AI, transforming business problem statements into efficient design, source code, and deployment of data applications over cloud data warehouses. Our product's fine-tuned LLMs specialize in solving complex business challenges with business intelligence (ETL/ELT), cloud migration, and...


  • Palo Alto, California, United States Machinify, Inc. Full time

    Transforming Healthcare with AI: A Technical Leadership RoleMachinify, Inc. is revolutionizing the healthcare industry by leveraging AI to transform claims and payment operations. Our innovative platform has already demonstrated significant success in increasing the speed and accuracy of claims processing.We are seeking an exceptional Data Science Lead to...


  • Palo Alto, California, United States Machinify, Inc. Full time

    Machinify, Inc. is revolutionizing the healthcare industry with its AI-powered software products that transform claims and payment operations.About MachinifyWe are seeking a highly skilled Senior Data Engineer Lead to join our team and help us achieve our mission.Salary RangeThe estimated base salary for this position is $220k-$250k per year, which is...


  • Palo Alto, California, United States Celonis Full time

    Job Description">We are seeking a highly skilled Product Data Scientist to join our Engineering organization. The successful candidate will be part of the Product Analytics & Data Sciences team, which provides analytical support and strategic perspective to product and engineering teams.The ideal candidate will have a strong background in data analysis,...

  • Product Designer

    6 days ago


    Palo Alto, California, United States Uniphore Technologies Inc Full time

    Uniphore Technologies Inc is a leading B2B AI-native company with decades of experience in developing scalable solutions for the enterprise. Our mission is to drive business outcomes across multiple industry verticals and enable large-scale global deployments.We infuse AI into every aspect of the enterprise that impacts customers, delivering a unique...

  • Data Scientist

    5 days ago


    Palo Alto, California, United States OPPO US Research Center Full time

    Role OverviewAs a key member of the OPPO US Research Center's Research and Development team, we are seeking a highly skilled Data Scientist to join our technology innovation leadership team. In this position, you will play a crucial role in enhancing the user experience of our AI products by leveraging data-driven insights to address significant business...


  • Palo Alto, California, United States Machinify Full time

    Machinify is revolutionizing the healthcare industry with its cutting-edge AI-powered software products. By streamlining claims processing and increasing accuracy, Machinify is making a significant impact on reducing waste and frustration for patients, providers, and payers.As a Staff Software Engineer, Backend | ML, you will play a crucial role in...


  • Palo Alto, California, United States Prophecy Full time

    Transformative Role in Cloud Data EngineeringWe are seeking a highly skilled Cloud Data Architect - Data Pipeline Optimization Specialist to join our team at Prophecy. This role offers an unparalleled opportunity to leverage your expertise in cloud data engineering, driving innovation and efficiency in our cutting-edge data pipelines.About ProphecyProphecy...


  • Palo Alto, California, United States Wing Aviation Full time

    About Wing Aviation">Wing Aviation is a pioneering company in drone delivery, offering a safe, fast, and sustainable solution for last-mile logistics. With consumer appetites for on-demand services increasing, traditional delivery methods are inefficient, costly, and contribute to road accidents and air pollution. Our fleet of highly automated drones can...


  • Palo Alto, California, United States Rhombus Power, Inc. Full time

    About the RoleRhombus Power, Inc. is a pioneering technology firm in Palo Alto, California, that's revolutionizing defense and global security through cutting-edge AI solutions.As a PhD Statistician at Rhombus Power, you will play a vital role in transforming complex decision-making processes with data-driven insights.