Data Transformation Engineer for Cloud Data Platforms

6 days ago


New York, New York, United States Prophecy Full time
About Prophecy

We are a leading data copilot company, trusted by Fortune 500 enterprises to accelerate AI and analytics. Our mission is to deliver data that is clean, trusted, and timely.

Prophecy enables all data users to be productive by helping develop, deploy, and observe data pipelines on cloud data platforms. With our expertise, organizations can focus on making data-driven decisions.

About the Role

This is an exciting opportunity to join a high-growth startup as a key member of our engineering team. You will work closely with dynamic engineers who take pride in solving complex problems.

We're seeking talented professionals to help us revolutionize the way data engineering is done. If you have a passion for innovation and a drive to succeed, we encourage you to apply.

Key Responsibilities
  • Troubleshoot and resolve complex customer issues related to data transformation
  • Assist with issues around third-party integrations with our platform
  • Reproduce customer bugs in production and sandbox environments to capture additional context and understand root causes
  • Set clear expectations with customers on next steps and meet or exceed them
  • Surprise and delight customers even when problems are not solved quickly
  • Provide best practices guidance and support for solutions developed by customers using our platform
  • Demonstrate a true sense of ownership and coordinate with engineering to achieve timely resolution of customer issues and requests
  • Participate in the creation and maintenance of company documentation and knowledge articles
  • Be a true proponent of customer advocacy
  • Develop and maintain advanced knowledge of our platform architecture and administration
Requirements
  • 4+ years of experience troubleshooting and supporting large enterprise applications
  • Advanced skills in Spark and Databricks
  • Strong work experience in production issue resolution
  • You have built and maintained all aspects of ETL, including development, bug fixing, monitoring, and debugging of jobs
  • Expert in Spark architecture and experience with Databricks/Snowflake environment configuration and management
  • Experience with Git and CI/CD technologies
  • Technology experience in SQL, Databricks/Hadoop/Spark and familiarity with various tools and products
  • You have experience in 'hands-on' technical support and escalation and ensuring SLAs are achieved
  • Excellent verbal and written communication skills in English
  • The ability to break down complex technical concepts and communicate them to stakeholders verbally and in writing
  • Have a creative attitude toward problem-solving
  • Entrepreneurial spirit, priding yourself on getting things done with a high level of quality
  • Bachelors Degree in CS or Equivalent
Benefits
  • Competitive salary ($150,000 - $180,000 per year)
  • We cover 99% of employee health insurance and 75% for dependents
  • We offer $200 per month towards wellness, classes, gyms, massages, facials, and more
  • Celebrate your birthday and anniversary with a day off
  • Flexible PTO
  • We provide employees with a $500 professional development reimbursement every year
  • Company-sponsored Long Term Disability and Life Insurance
  • FSA/HSA
  • Ability to have your fingerprint on an innovative platform


  • New York, New York, United States Prophecy Full time

    We are seeking an experienced Cloud Data Transformation Expert to join our team at Prophecy.About ProphecyProphecy is a data transformation copilot company that helps Fortune 500 enterprises accelerate AI and analytics by delivering clean, trusted, and timely data. We enable all data users and make them productive by helping develop, deploy, and observe data...


  • New York, New York, United States Capital One Full time

    About the RoleWe are seeking a Senior Data Engineer to join our team, driving innovation in cloud-driven technologies and real-time data transformation. As a key member of our engineering community, you will collaborate with cross-functional teams to design, develop, and implement cutting-edge solutions.Key ResponsibilitiesDesign and develop robust...


  • New York, New York, United States Capital One Full time

    OverviewCapital One is a leader in the technology space, seeking passionate data engineers to pioneer innovative solutions. As a Cloud Data Transformation Leader, you'll be part of a collaborative and inclusive environment where complex business problems are solved iteratively.SalaryWe offer a competitive salary range for our Cloud Data Transformation Leader...


  • New York, New York, United States Capital One Services, LLC Full time

    OverviewCapital One Services, LLC is seeking a skilled Senior Software Engineer to join our team in developing an enterprise-grade platform for business customer data management.SalaryThe estimated annual salary for this position is between $165,100 and $188,500, based on location, with opportunities for performance-based incentives.About the RoleThis Senior...


  • New York, New York, United States Eliassen Group Full time

    Hybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...

  • Cloud Data Engineer

    2 weeks ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...


  • New York, New York, United States Capital One Full time

    About UsCapital One is a leading financial institution dedicated to empowering individuals and families to achieve financial freedom. We are committed to innovation, collaboration, and diversity in our workplace.Job SummaryWe are seeking an experienced Data Transformation Engineer to join our team. As a key member of our data engineering group, you will...


  • New York, New York, United States Center for Justice Innovation Full time

    About the Center for Justice InnovationThe Center for Justice Innovation is a community justice organization that prioritizes safety and racial justice. Our organization has been driving justice nationwide in innovative, powerful, and durable ways since our founding in 1996.Job OpportunityWe are seeking a highly skilled Data Engineer to contribute to the...

  • Cloud Data Architect

    4 weeks ago


    New York, New York, United States Unreal Gigs Full time

    At Unreal Gigs, we're seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer at Unreal Gigs, you'll play a vital role in designing, developing, and managing cloud-based data infrastructures that support analytical and operational needs across the organization. You'll collaborate with data scientists, analysts, and software...


  • New York, New York, United States NYC IT Inc Full time

    We are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...


  • New York, New York, United States Capital One Full time

    Job OverviewAchieve a major transformation within Capital One's infrastructure by harnessing data with emerging technologies as a Senior Data Engineer. This role is part of a team building a platform for deploying real-time streaming data transformation jobs within the company's data ecosystem.Key Responsibilities:* Collaborate with Agile teams to design,...

  • Data Engineer

    7 days ago


    New York, New York, United States Center for Justice Innovation Full time

    Center for Justice Innovation seeks a Data Engineer to contribute to the development of data systems that integrate information from diverse platforms and sources. The ideal candidate will have 3 years of experience as a Data Engineer or similar role.About UsWe are a community justice organization that centers safety and racial justice. Our mission is to...


  • New York, New York, United States Tech Tammina Full time

    About the RoleWe are seeking a highly experienced Cloud Data Engineering Lead to join our team at Tech Tammina. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and implement data ingestion, transformation, and...


  • New York, New York, United States Capital One Full time

    Join Capital One as a Cloud-Based Data Transformation Lead and play a pivotal role in driving major transformations within the company. As a seasoned professional, you will have the opportunity to be on the forefront of marrying data with emerging technologies.About the RoleThis is an exciting opportunity to work with Agile teams to design, develop, test,...


  • New York, New York, United States PRI Technology Full time

    OverviewPRI Technology is a leading technology firm providing innovative solutions to the financial services industry.Salary Range$140,000 - $200,000 per year.About the RoleWe are seeking an experienced Senior Cloud Data Engineer to join our team. The successful candidate will work closely with the Global Data Manager to design and build high-performing...


  • New York, New York, United States HR Recruiting Services Full time

    **Job Title:** Cloud Data Engineering Lead**Job Type:** Full-time**Location:** Remote (USA)**Salary:** $150,000 - $200,000 per yearWe are seeking an experienced Cloud Data Engineering Lead to join our team at HR Recruiting Services. The ideal candidate will have a strong background in data engineering and cloud computing, with a proven track record of...


  • New York, New York, United States Capital One Full time

    Capital One seeks a Cloud Data Engineer Leader to pioneer in the technology space, building and driving a major transformation within the company. With a passion for marrying data with emerging technologies, you will have the opportunity to be on the forefront of innovation.About UsWe are a big group of makers, breakers, doers and disruptors who solve real...


  • New York, New York, United States Publicis Sapient Full time

    Unlock Business Value with Databricks ExpertiseAbout the Role:We're seeking a highly skilled Data Engineering Architect to lead the build of global Databricks platforms, enabling real business outcomes for our enterprise clients. As a top-notch technologist, you'll create impact for some of the world's biggest brands by translating their needs into...


  • New York, New York, United States Inizio Partners Full time

    About the JobData Engineers at Inizio Partners design, build, and maintain large-scale data systems. We are seeking a highly skilled Data Engineer to join our team. Key Responsibilities:Design and implement scalable data architectures using cloud-based platforms (i.e., Azure, GCP, AWS)Develop and maintain real-time data pipelines using technologies like...


  • New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is seeking a highly skilled Azure Cloud Data Solutions Architect to lead our data engineering efforts. As a key member of our team, you will design, implement, and optimize data solutions on the Azure cloud platform, ensuring scalability, security, and performance.Key Responsibilities:Develop and maintain data pipelines using...