Data Engineering Expert

3 days ago


New York, New York, United States Prophecy Full time

About Prophecy

We're a data copilot company that helps Fortune 500 enterprises accelerate AI and analytics by delivering clean, trusted, and timely data.

Our customers rely on us to develop, deploy, and observe data pipelines on cloud data platforms. We make all data users productive by helping them create, manage, and monitor massive volumes of data for AI and analytics.

We're backed by top VCs and investors including Insight Partners, SignalFire, Databricks, and JPMorgan Chase.

About the Role

This is an exciting opportunity to be an early engineer in a high-growth startup that's revolutionizing data engineering. You'll work with a team of dynamic engineers who take pride in solving complex problems.

We're seeking talented individuals to join our team of A-players. As a key member of our team, you'll contribute to the development and growth of our cutting-edge data platform.

Job Responsibilities
  • Troubleshoot and resolve complex customer issues related to our data platform
  • Assist with issues around third-party integrations and ensure seamless integration with our environment
  • Reproduce customer bugs in production and sandbox environments to capture additional context, build documentation, and understand root causes
  • Set clear expectations with customers on next steps and meet or exceed them
  • Surprise and delight customers even when problems are not solved quickly
  • Provide best practices guidance and support for solutions developed by customers using our data platform
  • Demonstrate a true sense of ownership and coordinate with engineering to achieve timely resolution of customer issues and requests
  • Participate in the creation and maintenance of company documentation and knowledge articles
  • Be a true proponent of customer advocacy and contribute to our mission of delivering exceptional customer experiences
Requirements
  • 4+ years of experience troubleshooting and supporting large enterprise applications
  • Advanced skills in Spark and strong work experience in production issue resolution
  • You have built managed and maintained all aspects of ETL including development, bug fixing, monitoring, and debugging of jobs
  • Expert in Spark architecture and experience with Databricks/Snowflake environment configuration and management
  • Experience with Git and CI/CD technologies and technology experience in SQL, Databricks/Hadoop/Spark
  • You have experience of 'hands-on' technical support and escalation (through Incident, Change and Problem Management procedures) and ensure that SLAs are achieved while looking for ways to improve day-to-day product delivery
  • Excellent verbal and written communication skills in English
  • The ability to break down complex technical concepts and communicate them to stakeholders verbally and in writing
  • A creative attitude toward problem-solving and entrepreneurial spirit with a focus on getting things done with high quality
  • A strong desire to work in a fast-moving startup environment with a high level of autonomy
  • Bachelors Degree in CS or Equivalent
Salary and Benefits

We offer a competitive salary range of $120,000 - $180,000 per year, depending on location and experience. Additionally, we provide comprehensive benefits including health insurance, flexible PTO, and professional development opportunities.

We're committed to fostering a diverse and inclusive culture where everyone can excel. Our hiring practices meet equal employment opportunity standards, and we welcome applications from individuals of all backgrounds.



  • New York, New York, United States Infojini Full time

    **Job Description:**We are seeking a highly skilled Data Engineering Expert to join our team at Infojini. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines that meet the needs of our business.**Key Responsibilities:**Create optimal data pipeline architecture using best practices and...


  • New York, New York, United States The Custom Group of Companies Full time

    We are seeking a seasoned Data Engineering expert to join our team at The Custom Group of Companies. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines in Databricks on an AWS 6 ecosystem with Delta Lake, Python, SQL, and Starburst as the technology stack.In this role, you will collaborate with...

  • Data Engineer Expert

    2 weeks ago


    New York, New York, United States Capital One Full time

    Join Capital One as a Sr. Data EngineerWe are seeking an experienced Data Engineer to join our team at Capital One in Plano, Texas. As a Sr. Data Engineer, you will be responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.Responsibilities:Collaborate with Agile teams...


  • New York, New York, United States EDO Full time

    We are the TV outcomes company - a leading platform measuring Convergent TV advertising.Combining real-time engagement signals with world-class decision science, we maximize creative and media performance for modern marketers at leading brands, TV networks, entertainment studios, and ad agencies.We align advertising investments to business results - with...


  • New York, New York, United States Prophecy Full time

    We are seeking an experienced Cloud Data Transformation Expert to join our team at Prophecy.About ProphecyProphecy is a data transformation copilot company that helps Fortune 500 enterprises accelerate AI and analytics by delivering clean, trusted, and timely data. We enable all data users and make them productive by helping develop, deploy, and observe data...

  • Data Solutions Expert

    22 hours ago


    New York, New York, United States Integrated Resources Full time

    **Key Responsibilities**We are seeking a highly skilled Data Solutions Expert to join our team at Integrated Resources. As a key member of our team, you will be responsible for:Designing, developing, and implementing data solutions within the Epic EMR system.Creating reports and dashboards to support clinical and financial modules.Developing data...


  • New York, New York, United States adMarketplace Full time

    We are looking for a Cloud Data Architect Expert to join our team at adMarketplace. As a key member of our data architecture group, you will be responsible for designing and implementing scalable cloud-based data systems and pipelines that drive business growth.About the CompanyadMarketplace is a leading provider of consumer search technology, delivering...


  • New York, New York, United States Capital One Full time

    About Capital One: We are a technology-driven bank that empowers our customers to achieve financial freedom by combining innovative products and services with high-quality customer experience. Our data engineers play a crucial role in shaping the future of banking, driving business growth through data-driven insights.Job Overview: We are seeking an...


  • New York, New York, United States Capital One Full time

    OverviewCapital One is a dynamic financial institution that seeks to hire experienced Senior Data Engineers. Our ideal candidate will be passionate about building and pioneering in the technology space, with expertise in marrying data with emerging technologies.Estimated Salary: $173,300 - $198,100 per year, depending on location and experience. Job...


  • New York, New York, United States Capital One Full time

    About the Role:Capital One is seeking a Senior Data Engineer to join our team, responsible for designing, developing, and implementing data engineering solutions using Python, Spark, and AWS. As a key member of our team, you will work on complex business problems in a fast-paced environment, collaborating with Agile teams to deliver robust cloud-based...


  • New York, New York, United States Vimeo Full time

    We're seeking a seasoned Cloud Data Infrastructure Migration Expert to join our team at Vimeo. As a key member of our data engineering team, you'll be responsible for designing and implementing scalable cloud-based solutions using AWS, Azure, or Google Cloud platforms.**Job Summary:**We're looking for an experienced expert in cloud platforms, data...

  • Data Engineer

    2 weeks ago


    New York, New York, United States RIT Solutions, Inc. Full time

    Job Information:RIT Solutions, Inc. is seeking a highly skilled Software Engineer to join our team in New York City. The ideal candidate will have a strong background in data platform building, Python programming, and database management.Key Responsibilities:Review and approve database modifications and developmentInstruct staff to write and code logical and...


  • New York, New York, United States Spotify Full time

    Overview:We are seeking a highly skilled Senior Machine Learning Engineer to join our team at Spotify USA, Inc. in the United States. As a key member of our agile team, you will collaborate with software engineers, data engineers, and other experts to build innovative product features that leverage machine learning.Estimated Salary: $233,575Job...

  • Data Engineer Lead

    2 weeks ago


    New York, New York, United States Diverse Lynx Full time

    We are seeking an experienced Data Engineer Lead to join our team in New York, NY. This is a long-term contract opportunity with a competitive salary.About the RoleIn this role, you will lead the design and implementation of data engineering solutions using AWS technologies such as AWS Lake Formation, AWS Glue Data Catalog, and AWS EMR. You will work closely...


  • New York, New York, United States BlackHawk Data LLC Full time

    Job OverviewWe are seeking a highly skilled IT System Design Expert to join our team at BlackHawk Data LLC.

  • Data Engineer Lead

    2 weeks ago


    New York, New York, United States Capital One Full time

    Unlock Career Advancement Opportunities as a Data Engineer LeadCapital One is seeking an experienced Data Engineer Lead to drive innovation and transformation in our technology space. If you are passionate about marrying data with emerging technologies, this role may be the perfect fit for you.About the Role:We are looking for a seasoned professional to lead...


  • New York, New York, United States Summer Full time

    About SummerSummer is a mission-driven company dedicated to helping Americans save money through smart, algorithm-based recommendations for student loan borrowers.Our MissionWe combine policy expertise and innovative technology to serve student loan borrowers across the country. Our founding team draws on years of experience in public policy, law, consumer...

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States NBCUniversal Full time

    About NBCUniversalNBCUniversal owns and operates over 20 different businesses across the globe, including a portfolio of news and entertainment television networks, a premier motion picture company, significant television production operations, a leading television stations group, world-renowned theme parks, and a premium ad-supported streaming service.As a...


  • New York, New York, United States Synchrony Full time

    OverviewSynchrony is a leading provider of consumer financial services and we are seeking a highly skilled Senior Data Protection Engineer to join our team. As a key member of our Information Security organization, you will play a critical role in safeguarding our data and protecting our customers' sensitive information.Salary Range: $95,000 - $160,000 per...


  • New York, New York, United States JPCL Engineering Full time

    We are seeking a highly skilled and experienced Pile Installation Expert to join our team at JPCL Engineering. The successful candidate will play a crucial role in ensuring the structural integrity of foundation systems by conducting thorough inspections and providing expert evaluations.About the RoleThis position is focused on performing special inspections...