Software Engineer, Data Platform

14 hours ago

New York, United States Middesk Full time
About Middesk

Our goal is to make it easier for businesses to work together. Since 2018, we have been a leading disruptor in the business identity market. While consumer identity technology has seen significant modernization and digitization over the past decade, business identity and verification largely continues to be a manual process, specifically in the context of onboarding businesses to receive access to financial products and services. Our best-in-class business identity platform provides access to complete, up-to-date information that financial services institutions and fintechs need to make educated decisions about their customers and facilitate rapid onboarding and transacting. Our vision is that every company can instantly gain access to all the data, products, and services they need to establish and grow their business with ease. Middesk came out of Y Combinator, is backed by Sequoia Capital and Accel Partners, and was recently named to Forbes Fintech 50 List and cited as an industry leader in business verification by digital identity strategy firm, Liminal.

About Middesk Engineering

"Velocity" is the rate at which we effect realized value for our customers, not the rate at which we ship code. We believe that great products result when technical excellence and craft is combined with deep understanding of our customers and the problems we can help them solve. We're a humble, self-motivated team that seeks to ship early and ship often; we pride ourselves with being willing to roll up our sleeves to solve even the messiest problems our customers present to us. Middesk Engineering is customer-first engineering.

The Role

Middesk is, at its core, a data company. We live and die by the quality of our data asset and the engine that powers it. We're on a mission to build a comprehensive and complete business dataset for every business in the world. As part of the Foundation team at Middesk, you'll collaborate with Data Science, Infrastructure and Data Engineering to build and maintain our own proprietary Entity Resolution system used to power the Middesk business identity platform, scaling our system to resolve millions of business identities across hundreds of data sources and thousands of distinct data sets. You'll often work with and support product engineers looking to launch new products and features.

The ideal candidate is ready to learn relentlessly, eager to learn a wide-breadth of technologies and software stacks, build and scale our data infrastructure and data pipelines and connect them into our core business verification products.

What You'll Do:
  • Build the batch and streaming data pipelines critical to Middesk's data infrastructure using Airflow, BigQuery, Dataflow, Dataproc and VertexAI.
  • Build reliable, scalable, maintainable, and cost-efficient systems across the stack.
  • Build, scale and extend existing web scraping platforms and capabilities used for real-time data acquisition.
  • Build, update and maintain our interface layer between our application and data platform stack to improve performance and as we continue to scale our platform and datasets.
What We're Looking For:
  • 3+ years of experience working in a data engineering or backend engineering role
  • Strong programming skills in at least one backend language and web application framework
  • Knowledge of SQL and experience with RDMS like postgresql, mySQL, etc.
Nice to Haves:
  • Fluency with Ruby, Python or Go
  • Experience building and designing collections stored on ElasticSearch
  • Experience working with Airflow or other orchestration platforms
  • Experience working on data pipelines and data streaming with tools like Spark or Kafka
  • Experience building machine learning systems
  • Experience with Terraform, Datadog, or Kubernetes
  • Experience with scraper technologies, including agentic AI

  • Software Engineer, Data Platform

    2 weeks ago

    New York, United States Middesk Full time

    About Middesk Our goal is to make it easier for businesses to work together. Since 2018, we have been a leading disruptor in the business identity market. While consumer identity technology has seen significant modernization and digitization over the past decade, business identity and verification largely continues to be a manual process, specifically in the...

  • Software Engineer, Data Enablement Platform

    4 weeks ago

    New York, United States Brex Full time

    Why join us Brex is the AI-powered spend platform. We help companies spend with confidence with integrated corporate cards, banking, and global payments, plus intuitive software for travel and expenses. Tens of thousands of companies from startups to enterprises - including DoorDash, Flexport, and Compass - use Brex to proactively control spend, reduce...

  • Software Engineer, Data Enablement Platform

    8 hours ago

    New York, United States Brex Full time

    Why join us Brex is the AI-powered spend platform. We help companies spend with confidence with integrated corporate cards, banking, and global payments, plus intuitive software for travel and expenses. Tens of thousands of companies from startups to enterprises - including DoorDash, Flexport, and Compass - use Brex to proactively control spend, reduce...

  • Principal Software Engineer

    4 weeks ago

    New York, United States NextDoor Full time

    #TeamNextdoor Nextdoor is where you connect to the neighborhoods that matter to you so you can belong. Our purpose is to cultivate a kinder world where everyone has a neighborhood they can rely on. Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those...

  • Platform Data Engineer

    1 day ago

    New York, United States RIT Solutions, Inc. Full time

    Vendors - I have a role with Meta in New York City with a healthy rate and solid referral fee. Title: Platform Data Engineer VMS #/Title: 55707-1 - Software Engineer V Duration: 1 Year+ Contract Location: 225 Park Ave S, New York, NY 10003 (5 days' onsite required) Must Have's Ability to work on-site 5 days' a week at Meta New York City HQ's (225 Park Ave S,...

  • Senior Data Platform Engineer

    14 hours ago

    New York, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join...

  • Senior Data Platform Engineer

    1 day ago

    New York, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join...

  • Senior Data Platform Engineer

    11 hours ago

    New York, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join...

  • Senior Software Architect for Data Platforms

    3 weeks ago

    New York, New York, United States Arcesium Full time

    Arcesium seeks a seasoned senior software architect to lead the development of its data platform. This individual will design and implement cutting-edge technologies that power the company's data-intensive applications.Key ResponsibilitiesArchitect and implement the next-generation data platformDesign and develop innovative data productsDrive solutions for...

  • Senior Data Platform Engineer

    5 months ago

    New York, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hrIt's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join their...

  • Senior Data Platform Engineer

    1 month ago

    new york city, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hrIt's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join their...

  • Senior Data Platform Engineer

    1 month ago

    new york city, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hrIt's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join their...

  • Backend Software Developer

    4 days ago

    New York, New York, United States Kunai Full time

    Kunai is a fast-growing digital consultancy focused on banking, payments and fintech. We are powered by a global network that attracts talented individuals from diverse backgrounds and cultures, driven by innovation and experimentation.Over the past decade, we've delivered over 150 products for clients like Visa, American Express, Capital One, WEX, Wells...

  • Software Engineer, Platform

    3 weeks ago

    New York, United States Applecart Full time

    Job DescriptionJob DescriptionApplecart is the leading technology company creating a new category of "Decision Maker Marketing". The most important decisions are made by the hardest people to reach and influence. Historically, C-suite leaders have lacked the tools to reach the stakeholders that matter most to their business. The C-suites of hundreds of...

  • Senior Software Engineer

    2 weeks ago

    New York, United States Bloomberg Full time

    The Bloomberg API Platform's mission is to offer data and services over high-quality APIs to our customers. The API Platform team supports hundreds of API products that unlock financial data for clients across the global capital markets. Our engineers are responsible for enabling connectivity between OpenAPI and GraphQL products, and diverse sets of data...

  • Data Platform Engineer

    1 day ago

    New York, United States Figure Markets Full time

    About Figure Markets Figure Markets is democratizing finance through blockchain. We're building the exchange for everything - a decentralized custody marketplace for crypto, stocks, bonds, credit and more. We're bringing best in class leverage, margining and liquidity to our exchange, while offering our members extensive borrowing options and unique...

  • Data Platform Engineer

    1 day ago

    New York, United States Figure Markets Full time

    About Figure Markets Figure Markets is democratizing finance through blockchain. We're building the exchange for everything - a decentralized custody marketplace for crypto, stocks, bonds, credit and more. We're bringing best in class leverage, margining and liquidity to our exchange, while offering our members extensive borrowing options and unique...

  • Data Platform Engineer

    15 hours ago

    New York, United States Figure Markets Full time

    About Figure Markets Figure Markets is democratizing finance through blockchain. We're building the exchange for everything - a decentralized custody marketplace for crypto, stocks, bonds, credit and more. We're bringing best in class leverage, margining and liquidity to our exchange, while offering our members extensive borrowing options and unique...

  • Senior Software Engineer

    2 weeks ago

    New York, United States Bloomberg Full time

    Bloomberg Enterprise Data provides financial institutions a platform to make millions of requests per day for a wide range of financial data. Whether it's ESG, Company, Pricing, Corporate Actions, Regulatory or Reference Data, the Data License department is the one-stop-shop for our clients' most demanding data and analytical needs. We offer thousands of...

  • Engineering Director

    1 month ago

    New York, New York, United States Elysium Health Full time

    About the RoleElysium Health is seeking an experienced Engineering Director to lead our platform and data engineering team. This role involves overseeing sprint planning and management, data engineering and architecture, platform engineering and DevOps, and team leadership and development. The ideal candidate will have a strong background in software...