Systems Engineer

2 months ago


New York, United States TDA Full time

Position: Systems Engineer - Big Data

Location: New York

Model: Hybrid

Salary: Annual base salary of up to $500000. Pay (base and bonus) may vary depending on job-related skills and experience. A sign-on and discretionary performance bonus may be provided as part of the total compensation package, in addition to company-paid medical and/or other benefits.


Summary:

Our client brings a scientific approach to trading financial products. They have built one of the world's most sophisticated computing environments for research and development. The researchers are at the forefront of innovation in the world of algorithmic trading. They welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. They’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. They value openness and transparency, and celebrate great ideas from veterans and new hires alike.

Our client is looking for Systems Engineers to join their growing Research & Development team. This team builds and maintains an exceptionally large and growing distributed compute cluster, many-PB-scale storage systems, operating systems, automation software, and development tools.

We are seeking a highly skilled engineer with expertise in Linux administration and experience with Big Data technologies, particularly Kafka, Trino, and Elasticsearch. As a Big Data Systems Engineer, you will play a critical role in ensuring our data infrastructure is robust, scalable, and reliable. You will work closely with our engineering and research teams to design, deploy, and maintain systems that support our research and trading activities.


Responsibilities:

  • Trino Administration: Set up and manage Trino clusters for large-scale data analytics. Optimize and troubleshoot query performance and ensure data integrity across the system
  • Kafka Administration: Design, deploy, and maintain Apache Kafka clusters. Implement and monitor Kafka-based data pipelines to ensure efficient and reliable data flow
  • Elasticsearch Administration: Configure and maintain Elasticsearch clusters on managed compute platforms such as Kubernetes
  • System Monitoring: Develop and implement monitoring solutions to ensure high system uptime and reliability; utilize tools to detect and resolve issues proactively
  • Linux Administration: Maintain and manage a large-scale Linux-based infrastructure; ensure system stability, security, and performance through best practices in system administration
  • Collaboration: Work closely with development and research teams to understand their requirements and provide robust data infrastructure solutions, participating in cross-functional projects as needed
  • Documentation: Create and maintain comprehensive documentation for system architecture, processes, and best practices


Requirements:

  • Bachelor's degree in computer science, information technology, or a related field
  • Minimum of 3-5 years of experience in systems engineering, with a focus on Linux administration
  • Experience with large scale, big data query engines and technologies such as Trino, Presto, Iceberg, and Hive
  • Experience with operating and managing large scale Kafka clusters, including design, deployment, and capacity management
  • Experience with operating and managing large scale Elasticsearch clusters
  • Experience with container orchestration platforms and technologies such as Kubernetes, Terraform, and Helm
  • Proficiency in scripting languages such as Python or Bash
  • Strong problem-solving skills and the ability to work in a fast-paced environment
  • Excellent communication and collaboration skills


Interested?

Please send your resume to Andrea@wearetda.io



  • New York, New York, United States BAE Systems Full time

    Job Description System Architecture & Design EngineerBAE Systems wants your Systems Engineering talent to develop complex system architectures and perform system design activities such as developing and managing system, hardware and software requirements, performing system level integration/test and assisting in validation for complex avionics control...


  • New York, New York, United States Open Systems Technologies Full time

    Financial Systems Software Engineer PositionCompany Compensation Range: $150,000 - $200,000Key Qualifications: Minimum of 7 years in a sophisticated application development setting with complex data architectures At least 5 years in the finance sector; familiarity with Interest Rate Swaps is highly advantageous Proficient in OpenText MBPM (Metastorm) Strong...

  • Systems Engineer

    3 weeks ago


    New York, United States GEM Technologies Full time

    Job DescriptionJob DescriptionGEM Technologies is a leading Managed Service Provider (MSP) headquartered in the heart of New York City. With a commitment to delivering exceptional IT solutions and services, we serve a diverse range of clients across various industries. Our team of skilled professionals is dedicated to providing top-notch technology solutions...

  • Systems Engineer

    1 month ago


    New York, United States GEM Technologies Full time

    Job DescriptionJob DescriptionGEM Technologies is a leading Managed Service Provider (MSP) headquartered in the heart of New York City. With a commitment to delivering exceptional IT solutions and services, we serve a diverse range of clients across various industries. Our team of skilled professionals is dedicated to providing top-notch technology solutions...

  • Systems Engineer

    2 months ago


    New York, United States ITE MGMT Full time

    ITE Management, a leading investment manager and private equity firm specializing in the acquisition of transportation equipment and asset operating platforms in the infrastructure sector, is seeking a Systems Engineer to join the IT team in New York. Founded in 2014, ITE targets real asset investment opportunities that are cash yielding with downside...

  • Systems Engineer

    3 months ago


    New York, United States ITE MGMT Full time

    ITE Management, a leading investment manager and private equity firm specializing in the acquisition of transportation equipment and asset operating platforms in the infrastructure sector, is seeking a Systems Engineer to join the IT team in New York. Founded in 2014, ITE targets real asset investment opportunities that are cash yielding with downside...

  • System Engineer

    2 months ago


    New York, United States TDA Full time

    Position: Systems Engineer – Low Latency TradingLocation: New YorkModel: HybridSalary: Annual base salary of up to $500000. Pay (base and bonus) may vary depending on job-related skills and experience. A sign-on and discretionary performance bonus may be provided as part of the total compensation package, in addition to company-paid medical and/or other...

  • Systems Engineer

    2 days ago


    New York, United States Kforce Inc Full time

    RESPONSIBILITIES:Kforce has a client that is seeking a Systems Engineer in New York, NY.Summary:The Systems Engineer is a trusted resource who will work collaboratively with IT infrastructure and Information Security team to design, configure, troubleshoot, and maintain systems infrastructure ensuring the availability of production and test systems. This...

  • System Test Engineer

    1 month ago


    New York, United States Allen Rose Group Full time

    Job Description Position: System Test Engineer Location: NYC Rate: $85.00/hour Type: Contract (Corp to Corp only) We are looking for an experienced System Test Engineer to be part of a multi-functional design environment with individual responsibility in the following areas: •Individual responsibility as to create, modify, or use automated test systems....

  • Systems Engineer

    3 weeks ago


    New York, United States ITE MGMT Full time

    Job DescriptionJob DescriptionITE Management, a leading investment manager and private equity firm specializing in the acquisition of transportation equipment and asset operating platforms in the infrastructure sector, is seeking a Systems Engineer to join the IT team in New York. Founded in 2014, ITE targets real asset investment opportunities that are cash...

  • Systems Engineer

    1 month ago


    New York, United States ITE MGMT Full time

    Job DescriptionJob DescriptionITE Management, a leading investment manager and private equity firm specializing in the acquisition of transportation equipment and asset operating platforms in the infrastructure sector, is seeking a Systems Engineer to join the IT team in New York. Founded in 2014, ITE targets real asset investment opportunities that are cash...

  • Lead Systems Engineer

    6 hours ago


    New York, New York, United States SAIC Full time

    Position OverviewSAIC is seeking a Systems Engineer to enhance our Aircraft Launch and Recovery Equipment (ALRE) team. This role is pivotal in devising solutions for the integration of system-level components while tackling intricate problem-solving challenges that arise from merging legacy systems with cutting-edge technologies.An active Secret clearance is...

  • Lead Systems Engineer

    3 hours ago


    New York, New York, United States SAIC Full time

    Position OverviewSAIC is seeking a Systems Engineer to join our Aircraft Launch and Recovery Equipment (ALRE) team. This role is crucial for developing innovative solutions that integrate system-level components while addressing intricate problem-solving challenges to merge legacy systems with cutting-edge technologies.An active Secret clearance is...


  • New York, New York, United States BAE Systems Full time

    Job Description BAE Systems is seeking a Manufacturing Engineer for the Amphibious Combat Vehicle (ACV) program, located in York, PA.In this onsite role, you will support production in a team-based manufacturing environment. In this highly hands on role, you will spend the majority of your time, up to 90%, on the shop floor resolving manufacturing related...

  • IT Systems Engineer

    1 month ago


    New York, United States City of New York Full time

    Job Description The Bronx County District Attorney’s Office seeks a well-qualified staff whose diverse backgrounds contribute to serve the 1.4 million members of the Bronx County community and to pursue a safer Bronx through fair justice. The Bronx County District Attorney’s Office is seeking an IT Systems Engineer. The System Engineer will be...

  • Systems Engineer

    2 months ago


    New York, United States Albert Bow Full time

    Systems Engineer I New York I Salary + Bonus I am currently working with a leading quantitative investment company who focus on computer-driven trading in global financial markets. With a team of professionals including researchers and engineers, they are looking for a Systems Engineer to join the Infrastructure team who are responsible for all layers of...


  • New York, New York, United States Socotec Full time

    Job DescriptionCompany Overview:SOCOTEC Engineering, Inc. serves as the specialized engineering division of SOCOTEC USA, providing exceptional technical expertise in the realms of testing, inspection, and certification. Established in 1885, our consulting group is celebrated for its proficiency in failure analysis, advanced testing methodologies,...

  • System Engineer

    1 month ago


    New York, United States MedReview Full time

    Job DescriptionJob DescriptionWorking Conditions: Full time (M-F), Office Business Settings. This is an On-Premises position. Monday through Thursday (9-5) and remote on Fridays only (No exceptions).Position Summary –The System Engineer is responsible for the day-to-day operation and maintenance of Servers and infrastructure systems that are located on...

  • System Engineer

    3 months ago


    New York, United States MedReview Inc. Full time

    Working Conditions: Full time (M-F), Office Business Settings. This is an On-Premises position. Monday through Thursday (9-5) and remote on Fridays only (No exceptions).Position Summary –The System Engineer is responsible for the day-to-day operation and maintenance of Servers and infrastructure systems that are located on premise and in the cloud. The...

  • System Engineer

    2 weeks ago


    New York, United States MedReview Full time $135,000 - $145,000

    Job DescriptionJob DescriptionWorking Conditions: Full time (M-F), Office Business Settings. This is an On-Premises position. Monday through Thursday (9-5) and remote on Fridays only (No exceptions).Position Summary –The System Engineer is responsible for the day-to-day operation and maintenance of Servers and infrastructure systems that are located on...