Senior Data Engineer

3 weeks ago

New York, United States Dandi Technologies Full time
About Dandi

Dandi is the enterprise-grade intelligence platform for workplace DEI.

Built by a team of DEI, data, and design experts, Dandi gives organizations the ability to collect, measure, and display people data—all in a secure, privacy-safe environment.

With built-in intersectional measurement, powerful pay analytics, and enterprise-ready security, Dandi unlocks insights that make workplaces better every day—for everyone.

Founded in 2018 and launched publicly in 2022, Dandi is headquartered in New York City and Stockholm. Learn more at itsdandi.com.

Our core beliefs

  • Optimism: Things can and will change for the better. Our role is to help accelerate that change.
  • Objectivity: Our data may reveal uncomfortable truths. We’re OK with that because we tell it as it is and never shy away from the truth.
  • Rigor: DEI can be an emotional subject. It’s our job to bring data and research to the conversation, so we can help move things forward most effectively.
  • Transformation: DEI is transformative. Data has the power to ignite this transformation.
  • Balance: We’re serious about data, but try not to take ourselves so seriously. It’s who we are and who we’ll always be.

Our values

  • Voice of reason
    • Data-driven
    • Directional
    • Professional
  • Eternally curious
    • Inquisitive
    • Exploratory
    • Open to understanding
  • The catalyst
    • Provocative
    • Thorough
    • Transparent
  • Intentionally kind
    • Vulnerable
    • Compassionate
    • Willing to laugh at ourselves

We’d love to share more with you how this impacts how we interact every day.

 

Role description

At Dandi, we are looking for our first Data Engineers to join and grow our existing core team.
As a Data Engineer, you will be working on our core systems, engines and product services using the most sophisticated cutting edge technologies to solve challenging problems that are unique to the DEI world

We have primed ourselves since day one to build one of the most resilient and scalable systems to support what we saw as one of the most interesting challenges in our careers. Our system currently processes TBs/s of data with upwards of 2m writes per second - and as we grow those numbers are ought to grow with us.

We have also built our infrastructure and systems to allow innovation - You have an idea to implement, or new technology to try out - this is the right place for you

Dandi engineering infrastructure is built on top of GCP utilizing cutting edge technologies & softwares such as Bigtable, BigQuery, Apache Spark, AI Platform & Tensorflow, Apache Airflow, K8s to mention a few

What you’ll do:

You’ll be responsible to build and expand our core systems, engines and product services:

  • Work with Apache Spark batch & real time streaming to process data at scale
  • Work with Scala microservices hosted on K8s (GKE) to support our products
  • Work with MlLib and Tensorflow on Vertex AI to solve forecasting, simulations in addition to a variety of machine learning challenges
  • Deploy new models and engines for new ideas and analyses

What you won’t do:

  • You won’t be responsible for any frontend application work
  • You won’t be managing other team members
  • You won’t work on technical debt as that is something we don’t have
  • You won’t be bored as there’s always new technologies to implement and new innovations to test

The Senior Data Engineer at Dandi is a full-time position, reports to the CTO and comes with remote, in-person or hybrid options. The Sr. Data Engineer comes with a $200,000 base salary, with 0.5% fully diluted ownership with standard four-year vesting.

Ideal background

We encourage all applicants to apply. These are the ideal skills and attributes for the position, but we’re quite open minded, so reach out See below: 

  • B.S. in Computer Science or a higher degree
  • Advanced knowledge of different non-relational schema models (Column Family, Graph, Document, Object)
  • Experience with advanced topologies and architecture design such as KAPPA and LAMBDA architectures
  • Experience in Scala or any similar JVM based language
  • Experience in Python
  • Experience with high throughput systems
  • Experience in Go is a great bonus to have
Benefits 

Making business better for everyone means bringing your best self to work everyday. To help make this a reality, Dandi provides the following benefits to help support you and your family: 

  • Competitive salary and meaningful equity
  • Comprehensive health, dental, and vision coverage for you and your dependents
  • Paid parental leave
  • Subscriptions to One Medical and Spring Health
  • Remote and hybrid work environments with flexible hours
  • Pre-tax commuter benefits

Equal Opportunity

Dandi is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Learn more at www.itsdandi.com.

  • Senior Data Engineer

    3 weeks ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    4 weeks ago

    New York, New York, United States The Cypress Group Full time

    Location: Fully Remote (Must live in the US)We are seeking a Senior Data Engineer to join our team and play a crucial role in scaling out our healthcare marketing platform.As a key member of our engineering team, you will be working with Scala, Apache Spark, and Databricks to develop and maintain our data infrastructure.Develop and maintain scalable data...

  • Senior Data Engineer

    1 week ago

    New York, United States Stott and May Full time

    Senior Data EngineerFull-TimeHybrid (NYC)Base Salary - $140-170k DOEMy client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the...

  • Senior Data Engineer

    4 weeks ago

    New York, United States Intelletec Full time

    Summary:Seeking a Senior Data Engineer to bolster our infrastructure, focusing on data ingestion, pipeline management, and resilience. Utilize Snowflake, dbt, and Python scripting while spearheading modernization initiatives and establishing governance frameworks. Ideal for a technically adept individual with a knack for innovation.Your Impact:Overhaul data...

  • Senior Data Engineer

    4 weeks ago

    New York, United States Intelletec Full time

    Summary:Seeking a Senior Data Engineer to bolster our infrastructure, focusing on data ingestion, pipeline management, and resilience. Utilize Snowflake, dbt, and Python scripting while spearheading modernization initiatives and establishing governance frameworks. Ideal for a technically adept individual with a knack for innovation.Your Impact:Overhaul data...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Blood Bank of Delmarva Full time

    Senior Data EngineerJob Locations US-NY-New YorkID 2023-5206Category Information TechnologyWork Location Type HybridType Regular Full-TimeOverviewAt New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service,...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Community Blood Center Full time

    Senior Data EngineerJob Locations US-NY-New YorkID 2023-5206# of Openings 0Category Information TechnologyWork Location Type HybridOverviewAt New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service,...

  • Senior Consultant

    3 weeks ago

    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization. You will be part of a highly collaborative...

  • Senior Data Engineer

    6 days ago

    New York, United States Blood Bank of Delmarva Full time

    Overview At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...

  • Senior Data Engineer

    4 weeks ago

    New York County, New York, United States PMX Full time

    Job Description About Publicis Media: Publicis Media is one of Publicis Groupe's four solution hubs, aligning all of Publicis Groupe's media agencies and operations. Publicis Groupe (Euronext Paris Exchange: FR(phone number removed); CAC 40 index), is the world's third-largest communications group. The Business Platforms Global Practice was created to...

  • Senior Consultant

    2 weeks ago

    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization.You will be part of a highly collaborative...

  • Senior Data Engineer

    4 weeks ago

    New York, United States Storm3 Full time

    ⚡ Senior Data Engineer Series B, Startup ️ New York (Hybrid) $200,000 + Significant Equity + BonusThe company is a leading provider of virtual care to help tackle substance use. ‍ Responsibilities:Develop and maintain data pipelines for extracting, transforming and loading data from various sources into our data warehouses using tools like dbt,...

  • Senior Data Engineer

    4 weeks ago

    New York, United States VeracityID Full time

    Job DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Grid Dynamics Full time

    Description Position at Grid Dynamics  Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic...

  • Senior Data Engineer

    1 week ago

    New York, United States IT America Inc Full time

    Job DescriptionJob DescriptionSENIOR Data Engineer Location: NYC, NYUS Citizens and GC Holders 3 days a. week onsite Pyspark expertise, Scala, Databricks and AWS are a must have.Qualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. Expert-level expertise in SQL, Python, Scala or similar; other...

  • Data Engineer

    1 month ago

    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Senior Data Architect Engineer

    1 month ago

    New York, New York, United States domunus Full time

    Senior Data Architect EngineerJob Overview***This position is a partner position and based within a start-up environment and the compensation will initially be on a handsome equity basis. Upon launch, a monthly fee will be paid.*Domunus is a web-based application for private residential real estate. It resolves the tedious transaction process and provides an...

  • Sr Data Engineer

    2 weeks ago

    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Sr Data Engineer

    3 weeks ago

    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...