Senior Data Engineer

2 weeks ago


New York, New York, United States Aura Intel Full time

We are looking for an engineer to join our team and help us unlock the full potential of our most critical asset: our data. You will have direct impact on our revenue and delivering value to our customers by ensuring that our systems can handle the complex relationship between our entities.

We are looking for someone who is constantly looking for ways to increase the effectiveness of the team through the use of technology, and who shares our values of being low ego, obsessed, curious, and collaborative. If this sounds like you, we would love to hear from you

What you will do

You'll define the processes and ETL infrastructure to transform and make data readily available across the product
You'll help in executing the roadmap for data infrastructure and systems to power high volume product features using Aura's data.
Design and implement robust data pipelines, guaranteeing data quality and timely data delivery across our product.
You'll determine the best ways to handle Aura's unique data model and usage patterns to derive insights and bring intelligence to product features like search.
You'll partner with data scientists and other internal stakeholders to understand their needs and then design, build and monitor pipelines that meet today's requirements but can gracefully scale with our growing data size
You'll implement automated workflows that lower manual/operational cost for stakeholders, define and uphold SLAs for timely delivery of data, move the company closer to democratizing data and a self-serve model (query exploration, dashboards, data catalog, data discovery)

Qualifications

Track record of building highly performant, highly observable, and highly scalable systems.
5+ years of experience building data intensive applications
Experience building systems with good abstractions and scalable architecture
Solid architectural vision: You have strong intuition around long-term system design and continuous improvements to performance and scaling
Proven expertise in cloud computing, particularly AWS
Skill in containerization and orchestration technologies, like Docker and Kubernetes (EKS preferred)
Experience with Snowflake,
Knowledge of orchestration tools, preferably Airflow
Building and maintaining ETL/ELT pipelines
Utilization of cloud monitoring and administration tools
Understanding of data warehouse maintenance, including data wrangling, model integration, anomaly detection, and comprehensive documentation.
Awareness of CI/CD practices
Be passionate about analytics use cases, data models, and solving complex data problems, then this is the team for you

Preferred Qualifications

2+ years of experience in an early-stage startup.
Proven track record migrating systems in a changing environment that allows for little to no downtime to meet increasing demand.
Obsessed about your craft and share your knowledge (tech talks, articles, open source, etc).
Experience in working in Python/strongly typed languages.

The Process
Our recruitment strategy deviates from traditional software engineering interviews to focus on the practical aspects of the job.

Our Interview Process:

Introduction Chat

Take-home Assignment

Engineering Call

Product Partner Call

CEO Chat

Referral Check

Aura Intel focuses on Enterprise Software, Big Data, and Artificial Intelligence / Machine Learning. Their company has offices in New York City. They have a small team that's between 11-50 employees.

You can view their website at


  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States The Cypress Group Full time

    Location: Fully Remote (Must live in the US)We are seeking a Senior Data Engineer to join our team and play a crucial role in scaling out our healthcare marketing platform.As a key member of our engineering team, you will be working with Scala, Apache Spark, and Databricks to develop and maintain our data infrastructure.Develop and maintain scalable data...


  • New York, New York, United States domunus Full time

    Senior Data Architect EngineerJob Overview***This position is a partner position and based within a start-up environment and the compensation will initially be on a handsome equity basis. Upon launch, a monthly fee will be paid.*Domunus is a web-based application for private residential real estate. It resolves the tedious transaction process and provides an...

  • Data Engineer

    2 weeks ago


    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...


  • New York, New York, United States Iris Software Inc Full time

    Senior AWS Cloud Data EngineerStrong expertise in designing, and developing metadata-driven Data Lake solutions for ingesting historic and near real-time structured/semi-structured/unstructured data.Experience with Databricks Products.AWS services including CloudFormation, Lambda, API Gateway, S3, DynamoDB/ any NoSQL, Relational Database Service (RDS), Glue...


  • New York, New York, United States Atechstar Full time

    BASIC QUALIFICATIONS7 years of relevant(data) engineering experience 2 years of people management experience managing data engineers Experience in partnering with product and program management teams Bachelors degree in Engineering Computer Science or a related technical field 2 years of experience owning a program/product/feature scoping requirements...


  • New York, New York, United States Domino Data Lab Full time

    Who we areDomino Data Lab powers model-driven businesses with its leading Enterprise AI platform trusted by over 20% of the Fortune 100. Domino accelerates the development and deployment of data science work while increasing collaboration and governance. With Domino, enterprises worldwide can develop better medicines, grow more productive crops, build better...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States Atechstar Full time

    What Youll Do Collaborate with and across Agile teams to design develop test implement and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning distributed microservices and full stack systems Utilize programming languages like Java Scala Python and Open Source...


  • New York, New York, United States Atechstar Full time

    Job description 0-2 years of demonstrable experience designing technological solutions to complex data problems developing & testing modular reusable efficient and scalable code to implement those solutions. Ideally this would include work on the following technologies Expert-level proficiency in at-least one of Java C++ or Python (preferred)/Scala knowledge...


  • New York, New York, United States re:collect Full time

    At re:collect, we are building an AI-powered thought partner that helps you ideate and create without breaking flow. Designed to mimic how your mind works, we use machine learning to connect and retrieve your digital information effortlessly. No tagging, organizing, or linking is required. We enable our customers to move beyond managing information to...


  • New York, New York, United States Selby Jennings Full time

    This role is with one of the more established multi-strategy firms here in NYC, which has been trading for over 2 decades.This is a Senior Software Engineer on the their Core Data Platform, which is used by data analysts, data scientists, and quantitative researchers for ingestion and access of investment datasets.Responsibilities:Design and development of...

  • Data Engineer

    2 weeks ago


    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Senior Data Consultant

    11 hours ago


    New York, New York, United States Artefact (artefact) Full time

    About The JobDo you think like a management consultant, thrive in a startup environment, and can't stop thinking about the intersection of data, technology, and AI?With over 1300 employees, offices on five continents, and world-class clients like Samsung, L'Oreal, and LVMH, Artefact is a consulting firm that transforms data into value and business impact....

  • Data Engineer

    5 days ago


    New York, New York, United States ASCENDING LLC Full time

    Full-time, Remote - Location Requirement: MUST be located in the Eastern Time ZoneAvailable for W-2 or 1099 Individual. Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a true Mid level Big Data Engineer to contribute to join their team of technologists to build and contribute to large-scale, innovative...

  • Data Engineer

    3 weeks ago


    New York, New York, United States Esvee Technologies Full time

    Data Engineer (Netezza / Teradata / BigQuery/ GCP) New York City. Job description This role requires reengineering of the existing DW (Netezza/Teradata) and migrate the data to BQ. Whiteboarding and discussing with client leadership explaining architecture options and recommendations for data migration to BQ. 1. Successful background as an architect for...

  • AWS Data Engineer

    1 week ago


    New York, New York, United States symplore inc Full time

    JD AWS Data EngineerVisa Status ALL ARE OKAY Location Must Be Local To New Jersey and NYC and the General VicinityContract Length Long Term Years Experience 3+ Years of ExperienceKey Responsibilities Coding Proficiency Mandatory skills in SQL Python and PySpark. Desired expertise in Unix scripting. AWS Data Engineering Hands-on experience in designing and...

  • Data Engineer

    3 weeks ago


    New York, New York, United States Strata Infosys Full time

    Requirements Must have 5 years minimum hands-on experience with the following Writes complex SQL queries required to perform Data Acquisition and Ingestion required for Data pipelines Builds Data pipelines and does data engineering activities using technologies like Python Hadoop Spark etc. Ensures the upkeep of the Hadoop Data Lake Platform by monitoring...


  • New York, New York, United States RWA Full time

    About is a data provider and analytics dashboard for the next big wave in DeFi: Real-World Assets. DeFi today exists in an insular bubble, but RWAs present the chance for the vast efficiency and transparency benefits of DeFi to impact the outside world. We build tools to help investors effectively navigate this new paradigm.We're backed by top VCs in the...


  • New York, New York, United States Finch Full time

    As the Senior Backend Engineer, you will be a technical leader of our engineering team, responsible for the technical design and development of strategically important products and features and team leadership.The primary goal will be to develop and deliver products and features that provide value to both customers and our business.We seek an experienced...


  • New York, New York, United States Selby Jennings Full time

    Selby Jennings is seeking a proactive senior engineer to join our client's Treasury Technology team in a hands-on capacity. In this position, your main responsibility will involve analyzing business needs and devising automated solutions for our firm's treasury operations. Additionally, you'll contribute to enhancing platform functionalities to meet evolving...

  • Staff Data Engineer

    6 days ago


    New York, New York, United States ASAPP Full time

    Join our team at ASAPP, where we're developing transformative Vertical AI designed to improve customer experience. Recognized by Forbes AI 50, ASAPP designs generative AI solutions that transform the customer engagement practices of Fortune 500 companies. With our automation and simplified work processes, we empower people to reach their full potential and...