Senior Data Engineering Specialist

5 days ago


New York, New York, United States Diverse Lynx Full time

About the Role

Diverse Lynx LLC is seeking a highly skilled Senior Data Engineering Specialist to join our team as a Databricks/PySpark Developer. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and PySpark.

Key Responsibilities

  • Design and develop scalable data pipelines using Databricks and PySpark
  • Collaborate with cross-functional teams to identify business requirements and develop solutions
  • Maintain and improve existing data processing systems to ensure high performance and reliability

Requirements

To be successful in this role, you will need:

  • Minimum 4 years of experience working as a Databricks Developer
  • Minimum 4 years of experience working on Python and PySpark
  • Experience with AWS is a plus
  • Prior software engineering background is preferred

Bonus Points

  • AWS experience
  • Typescript experience

What We Offer

We offer a competitive salary range of $120,000 - $180,000 per year, depending on experience, as well as a comprehensive benefits package, including medical, dental, and vision insurance, 401(k) matching, and generous paid time off.

About Us

Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company. Our company culture values collaboration, innovation, and continuous learning.


  • Senior Data Engineer

    1 month ago


    New York, New York, United States TechnoGen Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...


  • New York, New York, United States JPCL Engineering Full time

    Foundation Specialist Position at JPCL EngineeringWe are seeking an experienced Senior Foundation Engineer to join our team in New York. The successful candidate will be responsible for conducting thorough inspections and providing expert evaluations on pile installations, ensuring the integrity and safety of foundation systems.About the JobThis is a...


  • New York, New York, United States Scale AI Full time

    **About Us**Solidify the future of artificial intelligence by joining Scale AI's Operator Group team.We're accelerating the development of AI applications, leveraging our expertise to power the world's most advanced LLMs and generative models. Our mission is to make this transition happen faster across every industry.As a Senior Software Engineer and Data...


  • New York, New York, United States Data Intellect Full time

    About This RoleWe are seeking a highly skilled Senior Financial Data Developer to join our team. In this role, you will be responsible for developing and maintaining complex financial data systems using kdb+.This is an exciting opportunity for someone who is passionate about working with data and wants to make a real impact in the financial industry.


  • New York, New York, United States NYU Langone Health Full time

    Job Title:Senior Data Engineer - Data Integration and AnalyticsJob Summary:NYU Langone Health is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing and developing robust ETL pipelines to integrate diverse data sources.Key Responsibilities:Strategize, design, and develop automated cloud...


  • New York, New York, United States Capital One Full time

    Capital One is seeking a Senior Data Architect and Engineer to drive the design and implementation of high-performance data ecosystems that support real-time, intelligent experiences for its Risk Management functions.This role involves shaping the Risk Management Data domains that will drive standardized data assets and products. The ideal candidate will...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial...


  • New York, New York, United States OmegaHires Full time

    Job SummaryWe are seeking a highly skilled Senior Data Architecture Specialist to join our team at OmegaHires.About the RoleThe successful candidate will be responsible for designing and implementing large-scale data processing systems using Big Data technologies such as Java, Spark, Hive, and MapReduce.Key Responsibilities:Lead the design and development of...


  • New York, New York, United States thisiswhy Full time

    Job Title: Senior Software Engineer - Data Pipeline SpecialistOverviewThis role is crucial in designing, developing, and implementing high-quality software solutions using Python programming. As a key member of the team, you will contribute significantly to the organization's success by creating efficient and scalable applications.SalaryWe offer a...


  • New York, New York, United States NBCUniversal Full time

    About NBCUniversalNBCUniversal owns and operates over 20 different businesses across the globe, including a portfolio of news and entertainment television networks, a premier motion picture company, significant television production operations, a leading television stations group, world-renowned theme parks, and a premium ad-supported streaming service.As a...


  • New York, New York, United States NYC IT Inc Full time

    We are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...


  • New York, New York, United States Capital One Full time

    About the RoleWe are seeking a Senior Data Engineer to join our team at Capital One. As a key member of our engineering group, you will play a crucial role in designing, developing, and deploying cutting-edge big data solutions.Key ResponsibilitiesCollaborate with cross-functional teams to design and implement technical solutions using full-stack development...


  • New York, New York, United States INFOTRON Full time

    Job Title: Data Engineering SpecialistINFOTRON seeks a detail-oriented Data Engineer to analyze large amounts of raw data and discover patterns and insights.About the Role:We are looking for an analytical professional with a passion for data to collect, analyze, and present findings in an easy-to-understand manner. The ideal candidate will design, develop,...


  • New York, New York, United States Data Intellect Full time

    Job OverviewWe are seeking a skilled kdb+ data analyst specialist to join our team at Data Intellect.This role involves working with business users to define requirements for new application functionality, developing and testing code for client applications, and supporting project delivery as part of a collaborative team.About the RoleDevelop and implement...


  • New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. seeks a highly skilled Data Engineer to design, build, and maintain scalable ETL pipelines using Python, SQL, and Apache Airflow in any cloud environment.In this role, you will collaborate with data scientists to implement machine learning models (MLOps) in production and partner with business units to identify and fulfill...


  • New York, New York, United States Synchrony Full time

    OverviewSynchrony is a leading provider of consumer financial services and we are seeking a highly skilled Senior Data Protection Engineer to join our team. As a key member of our Information Security organization, you will play a critical role in safeguarding our data and protecting our customers' sensitive information.Salary Range: $95,000 - $160,000 per...


  • New York, New York, United States Eliassen Group Full time

    We are currently hiring a Senior Data Analytics Engineer to join our team at Eliassen Group. This is a full-time, 100% remote role that requires designing, architecting, developing, scaling, and improving next-generation data analytics platforms using advanced big data technologies.The ideal candidate will have 5+ years of experience in designing,...


  • New York, New York, United States Capital One Full time

    Job Summary:We are seeking a highly skilled Data Engineering Specialist to join our team at Capital One.About Us:Capital One is committed to diversity and inclusion in the workplace. We strive to create an environment where all employees feel valued, respected, and supported.About the Role:The successful candidate will have experience in big data...


  • New York, New York, United States Averity Full time

    About AverityAverity is a VC backed early stage startup that is currently in stealth mode. Our founders bring extensive experience in the problem we are aiming to solve and have worked for some of the most recognizable organizations in technology.In short, without divulging too much, we are developing a platform to solve security issues and streamline...


  • New York, New York, United States Delphi-US Full time

    Job Title: Senior ELT Data EngineerDescription:We're seeking a Senior ELT Data Engineer to develop and implement our new enterprise data warehousing architecture. The ideal candidate will have advanced experience with dbt, Snowflake, Fivetran, and GitHub, and will be responsible for designing, developing, testing, deploying, and supporting data pipelines and...