Senior Data Engineer

1 month ago

New York, United States Aura Intelligence Full time
Job DescriptionJob Description

We are looking for an engineer to join our team and help us unlock the full potential of our most critical asset: our data. You will have direct impact on our revenue and delivering value to our customers by ensuring that our systems can handle the complex relationship between our entities.

We are looking for someone who is constantly looking for ways to increase the effectiveness of the team through the use of technology, and who shares our values of being low ego, obsessed, curious, and collaborative. If this sounds like you, we would love to hear from you setareh@auraintel.com

What you will do

  • You'll define the processes and ETL infrastructure to transform and make data readily available across the product
  • You’ll help in executing the roadmap for data infrastructure and systems to power high volume product features using Aura’s data.
  • Design and implement robust data pipelines, guaranteeing data quality and timely data delivery across our product.
  • You'll determine the best ways to handle Aura’s unique data model and usage patterns to derive insights and bring intelligence to product features like search.
  • You'll partner with data scientists and other internal stakeholders to understand their needs and then design, build and monitor pipelines that meet today's requirements but can gracefully scale with our growing data size
  • You'll implement automated workflows that lower manual/operational cost for stakeholders, define and uphold SLAs for timely delivery of data, move the company closer to democratizing data and a self-serve model (query exploration, dashboards, data catalog, data discovery)

Qualifications

  • Track record of building highly performant, highly observable, and highly scalable systems.
  • 5+ years of experience building data intensive applications
  • Experience building systems with good abstractions and scalable architecture
  • Solid architectural vision: You have strong intuition around long-term system design and continuous improvements to performance and scaling
  • Proven expertise in cloud computing, particularly AWS
  • Skill in containerization and orchestration technologies, like Docker and Kubernetes (EKS preferred)
  • Experience with Snowflake,
  • Knowledge of orchestration tools, preferably Airflow
  • Building and maintaining ETL/ELT pipelines
  • Utilization of cloud monitoring and administration tools
  • Understanding of data warehouse maintenance, including data wrangling, model integration, anomaly detection, and comprehensive documentation.
  • Awareness of CI/CD practices
  • Be passionate about analytics use cases, data models, and solving complex data problems, then this is the team for you

Preferred Qualifications

  • 2+ years of experience in an early-stage startup.
  • Proven track record migrating systems in a changing environment that allows for little to no downtime to meet increasing demand.
  • Obsessed about your craft and share your knowledge (tech talks, articles, open source, etc).
  • Experience in working in Python/strongly typed languages.
Our stack

The Process

Our recruitment strategy deviates from traditional software engineering interviews to focus on the practical aspects of the job.

Our Interview Process

  • Senior Data Engineer

    1 week ago

    New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    20 hours ago

    New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Systems Engineer

    2 weeks ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Systems Engineer

    2 days ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer

    1 month ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    1 month ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    20 hours ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 days ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Data Engineer

    20 hours ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Data Engineer

    4 weeks ago

    New York, United States Stott and May Full time

    Senior Data EngineerFull-TimeHybrid (NYC)Base Salary - $140-170k DOEMy client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    1 week ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    20 hours ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    1 day ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    2 months ago

    New York, United States Storm3 Full time

    ⚡ Senior Data Engineer Series B, Startup ️ New York (Hybrid) $200,000 + Significant Equity + BonusThe company is a leading provider of virtual care to help tackle substance use. ‍ Responsibilities:Develop and maintain data pipelines for extracting, transforming and loading data from various sources into our data warehouses using tools like dbt,...

  • Senior Data Engineer

    2 days ago

    New York, United States Storm3 Full time

    ⚡ Senior Data Engineer Series B, Startup ️ New York (Hybrid) $200,000 + Significant Equity + BonusThe company is a leading provider of virtual care to help tackle substance use. ‍ Responsibilities:Develop and maintain data pipelines for extracting, transforming and loading data from various sources into our data warehouses using tools like dbt,...

  • Senior Data Engineer

    1 month ago

    New York, United States VeracityID Full time

    Job DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...

  • Senior Data Engineer

    22 hours ago

    New York, United States VeracityID Full time

    Job DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...

  • Senior Data Engineer

    2 days ago

    New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...