Senior Cloud Data Engineer for High-Volume Production Environments

6 days ago


New York, New York, United States VORKIS knows what employer wants Full time
Job Overview

About VORKIS:

VORKIS knows what employers want, and we are looking for a skilled Senior Software Engineer with expertise in data engineering to join our team.

We pride ourselves on being an independent, accountable, and organized company in the dynamic space of cutting-edge trade surveillance technology that protects investors, enhances transparency, and ensures regulatory compliance across traditional financial assets and crypto markets.

Key Responsibilities
  • We are seeking a strong Senior Software Engineer with experience in designing and developing robust, scalable, maintainable, and thoroughly monitored data pipelines on cloud environments.
  • The successful candidate will be responsible for tackling data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
  • This role involves developing, designing, and maintaining end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.
  • You will enrich financial data through third-party data integrations.
  • Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.
  • Plan and communicate integrations with other teams that consume the data and use it for insights creation.
  • Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.
Requirements
  • Bachelor's degree in Computer Science from a top university or equivalent.
  • Strong background as a software engineer with at least 2+ years of experience with Java.
  • At least 8+ years of experience in data engineering, and data pipeline development on high-volume production environments.
Desirable Skills
  • Experience with monitoring systems such as Prometheus, Grafana, Zabbix, and Datadog.
  • Experience in object-oriented development and strong software engineering foundations.
  • Experience with data-engineering cloud technologies such as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies, and Kafka.
  • Experience with relational and non-relational DBs and proficient in SQL and query optimizations.
  • Experience with designing infrastructure to maintain high availability SLAs.
  • Experience with monitoring and managing production environments.
  • Strong communication skills.

Estimated annual salary: $140,000 - $160,000 based on location and industry standards.



  • New York, New York, United States VORKIS knows what employer wants Full time

    About VORKISWe provide cutting-edge trade surveillance technology to protect investors, enhance transparency, and ensure regulatory compliance across traditional financial assets and crypto markets.Salary RangeThe estimated salary for this role is $120,000 - $180,000 per year, depending on experience and qualifications.Job DescriptionWe are seeking a strong...


  • New York, New York, United States Perennial Resources International Full time

    Job Title: Senior Data and Cloud EngineerJob Summary:Perennial Resources International seeks a Senior Data and Cloud Engineer to lead data engineering lifecycle, manage database services, and design scalable data pipelines in cloud environments. The ideal candidate will have 4-5 years of experience in data engineering, strong programming skills in SQL and...


  • New York, New York, United States Eliassen Group Full time

    Hybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...


  • New York, New York, United States Harrington Starr Full time

    Job OverviewHarrington Starr is seeking a highly skilled Senior Software Engineer - Cloud and Data to join our team in Manhattan.About the RoleWe are looking for an experienced software engineer with expertise in cloud-based technologies, particularly AWS.The successful candidate will work closely with the CTO to design, develop, test, and maintain...


  • New York, New York, United States Capital One Full time

    OverviewCapital One is a dynamic financial institution that seeks to hire experienced Senior Data Engineers. Our ideal candidate will be passionate about building and pioneering in the technology space, with expertise in marrying data with emerging technologies.Estimated Salary: $173,300 - $198,100 per year, depending on location and experience. Job...


  • New York, New York, United States Prophecy Full time

    We are seeking an experienced Cloud Data Transformation Expert to join our team at Prophecy.About ProphecyProphecy is a data transformation copilot company that helps Fortune 500 enterprises accelerate AI and analytics by delivering clean, trusted, and timely data. We enable all data users and make them productive by helping develop, deploy, and observe data...

  • Cloud Data Engineer

    3 weeks ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a Senior Data Engineer to join our team at Capital One. This role is responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.About the JobThis position requires collaboration with Agile teams to design, develop, test, implement, and support...


  • New York, New York, United States Point72 Full time

    Job OverviewAs a Senior Data Engineer at Point72, you will lead the design and development of data pipelines and infrastructure using cloud-based technologies. You will collaborate closely with our investment professionals, researchers, and data scientists to deliver robust solutions that extract valuable insights from large datasets.

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States NYC IT Inc Full time

    We are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...


  • New York, New York, United States New York Life Insurance Company Full time

    Transforming Enterprise Data ArchitectureIn the heart of New York Life Insurance Company, we're seeking an exceptionally skilled Senior Cloud Data Architect to spearhead our company's modern data management strategy. This pivotal role will require you to collaborate with cross-functional teams, including Data Product Owners, Data Scientists, and end-users,...


  • New York, New York, United States Lorven Technologies Full time

    We are seeking a skilled Senior Cloud Data Specialist to join our team at Lorven Technologies. In this role, you will be responsible for designing and implementing cloud-based data solutions using Azure cloud services.Job Summary:The successful candidate will have 10+ years of experience in software development using Python, PySpark, and its frameworks, with...


  • New York, New York, United States Tech Tammina Full time

    About the RoleWe are seeking a highly experienced Cloud Data Engineering Lead to join our team at Tech Tammina. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and implement data ingestion, transformation, and...


  • New York, New York, United States Capital One Full time

    About the Role:Capital One is seeking a Senior Data Engineer to join our team, responsible for designing, developing, and implementing data engineering solutions using Python, Spark, and AWS. As a key member of our team, you will work on complex business problems in a fast-paced environment, collaborating with Agile teams to deliver robust cloud-based...


  • New York, New York, United States Inizio Partners Full time

    About the JobData Engineers at Inizio Partners design, build, and maintain large-scale data systems. We are seeking a highly skilled Data Engineer to join our team. Key Responsibilities:Design and implement scalable data architectures using cloud-based platforms (i.e., Azure, GCP, AWS)Develop and maintain real-time data pipelines using technologies like...

  • Senior Data Engineer

    2 months ago


    New York, New York, United States TechnoGen Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...


  • New York, New York, United States Tennr Full time

    Company Overview:Tennr is a NYC-based tech company that launched out of Y-Combinator and is backed by top investors. Our mission is to improve patient processing in the US healthcare system using state-of-the-art document reading models.About the Role:We're looking for a Cloud Engineer to enable our product engineering team's rapid expansion into new product...


  • New York, New York, United States PSG Global Solutions Careers Full time

    Our ClientWe are PSG Global Solutions Careers, a leading agile consulting and staffing firm. For 30 years, we have helped organizations fulfill their most important initiatives and opportunities.We are seeking a highly skilled Senior Python Engineer to join our team in the Media and Entertainment industry. This is an exciting opportunity to work on strategic...


  • New York, New York, United States Capital One Full time

    Capital One seeks a Cloud Data Engineer Leader to pioneer in the technology space, building and driving a major transformation within the company. With a passion for marrying data with emerging technologies, you will have the opportunity to be on the forefront of innovation.About UsWe are a big group of makers, breakers, doers and disruptors who solve real...


  • New York, New York, United States Capital One Full time

    Capital One OverviewCapital One is a leading financial institution that empowers millions of Americans to achieve financial freedom. We are committed to innovation, diversity, and inclusion in the workplace.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team in Chicago, Illinois. As a key member of our data engineering team,...