We have other current jobs related to this field that you can find below
-
Senior Data Engineer
1 week ago
New York, United States Harnham Full timeSenior Data EngineerHybrid (1 day in office in NYC)6-Month Contract-to-Hire$60-$75/hrUp to $140,000 AnnualOur client seeking a skilled Senior Data Engineer to join the Data & AI Platforms team, responsible for maintaining and advancing a comprehensive data ecosystem that supports B2B SaaS products. Their focus is on developing a robust platform that...
-
Senior Data Engineer
1 week ago
New York, United States Harnham Full timeSenior Data EngineerHybrid (1 day in office in NYC)6-Month Contract-to-Hire$60-$75/hrUp to $140,000 AnnualOur client seeking a skilled Senior Data Engineer to join the Data & AI Platforms team, responsible for maintaining and advancing a comprehensive data ecosystem that supports B2B SaaS products. Their focus is on developing a robust platform that...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Tickets Full time, an MLB company, delivers innovative, cutting-edge technologies to enable frictionless and unforgettable fan experiences in venues across the globe. Together with MLB, is changing the landscape of the live sports and entertainment industry, delivering new digital venue and ticketing experiences to millions of fans. Our Technology team builds platforms and...
-
Senior Data Architect/Engineer
2 days ago
New York, New York, United States Oakridge Staffing Full timeAbout Oakridge StaffingWe are partnering with a leading buy-side firm to build out their data function and team. This is a unique opportunity to join a greenfield project and shape the future of their data platform.Key ResponsibilitiesDesign and implement cloud-based data pipelines for portfolio teams and data scientistsDevelop and maintain data...
-
Senior Software Engineer, Data Mesh Platform
1 month ago
New York, United States MarketAxess Full timeAbout Us MarketAxess is on a journey to digitally transform one of the world’s largest financial markets, enabling the shift from analog, phone-based trading to a fully electronic marketplace. Why does this matter? Because our platform makes trading fixed-income more accessible, ultimately improving transparency, efficiency, and competition in the...
-
Senior Data Engineer
2 weeks ago
New York, United States Tech Tammina LLC Full timeJob DescriptionJob DescriptionJob Title: Senior Data Engineer (Mid-Level) - AnalyticsLocation: NYC (Hybrid - 3 days onsite)Position: Full-Time PermanentJob Description: Join a leading organization as a Senior Data Engineer in the Analytics team. In this hybrid role, you will design, develop, and maintain data pipelines to support data-driven initiatives....
-
Senior Software Platform Engineer
6 days ago
New York, New York, United States MTA, Inc. Full timeSenior Software Platform EngineerThe Senior Software Platform Engineer plays a crucial role in the architecture, development, upkeep, troubleshooting, and automation of frameworks that support the entire application lifecycle, encompassing build, testing, and deployment processes.Core Responsibilities:Middleware and Platform updatesCloud Solutions, Container...
-
Sr. Manager, Data Platform Engineering
1 week ago
New York, United States Vimeo Full timeJob DescriptionJob DescriptionAt Vimeo, our mission is to help businesses drive impact through video. With a vibrant community of video professionals and the vast volume of video consumption and uploads on our platform, data plays a crucial role in our success. Vimeo supports about 200 million registered video creators, billions of monthly video views, and...
-
Senior Software Engineer-Data
2 weeks ago
New York, United States hackajob Full timehackajob has partnered with a global platform that helps advertisers, publishers, and media platforms improve results through media measurement and optimization. We are looking for a Senior Software Engineer, Data to lead the design, development, and integration of ad verification, analytics, and reporting solutions.Role: Senior Software EngineerLocation:...
-
Senior Data Engineer
3 days ago
New York, United States Roots Automation Full timeSenior Data Engineer Company Overview: At Roots, our mission is to make work more human. We are developing fully autonomous, AI-powered Digital Coworkers that streamline tedious and repetitive tasks for the enterprise. By tackling core challenges in natural language understanding and computer vision, we are building an automation product that embodies the...
-
Senior Data Engineer
24 hours ago
New York, United States Roots Automation Full timeSenior Data Engineer Company Overview: At Roots, our mission is to make work more human. We are developing fully autonomous, AI-powered Digital Coworkers that streamline tedious and repetitive tasks for the enterprise. By tackling core challenges in natural language understanding and computer vision, we are building an automation product that embodies the...
-
Senior Data Engineer
3 months ago
New York, United States Quilt Software LLC Full timeJob DescriptionJob DescriptionAbout Quilt Software: Quilt LLC is PSG Equity's latest vertical software and integrated payments platform, similar to their successful EverCommerce investment which recently went public. Quilt provides specialty inventory and POS software through a family of vertically focused, independently managed subsidiaries. See...
-
Data Engineer III, Data Platform Core
2 months ago
New York, New York, United States Hinge Full timeHinge is the dating app designed to be deletedIn today's digital world, finding genuine relationships is tougher than ever. At Hinge, we're on a mission to inspire intimate connection to create a less lonely world. We're obsessed with understanding our users' behaviors to help them find love, and our success is defined by one simple metric– setting up...
-
Senior Data Engineer
3 weeks ago
New York, United States Epik Solutions Full timeJob DescriptionJob DescriptionSenior Data EngineerNew York, NY (Remote)About the PositionAs a Senior Data Engineer you will be a major contributor to the tech future for Formation Bio as we expand into an AI enabled world. You would be responsible for contributing to our fundamental Data Infrastructure by building data pipelines, integrations, and tools that...
-
Senior Data Engineer
2 months ago
New York, New York, United States Hulu Full timeJob Posting Title:Senior Data Engineer - Identity DataReq ID:Job Description:Disney Entertainment & ESPN TechnologyOn any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future.Whether that's evolving...
-
Data Engineer III, Data Platform Core
4 weeks ago
New York, United States Hinge Full timeHinge is the dating app designed to be deleted In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a less lonely world. We’re obsessed with understanding our users’ behaviors to help them find love, and our success is defined by one simple metric–...
-
Senior ML Platform Engineer
2 months ago
New York, New York, United States Hinge Full timeHinge is the dating app designed to be deletedIn today's digital world, finding genuine relationships is tougher than ever. At Hinge, we're on a mission to inspire intimate connection to create a less lonely world. We're obsessed with understanding our users' behaviors to help them find love, and our success is defined by one simple metric– setting up...
-
Senior Data Engineer
2 months ago
New York, United States Harnham Full timeIn this opportunity, you will work with a large-scale Media company that partners with some of the biggest firms across the globe. They are looking for a Senior Data Engineer to join their Engineering team.Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes using Apache Spark.Collaborate closely with data scientists,...
-
Senior Data Engineer
1 month ago
New York, New York, United States Hulu Full timeJob Posting Title:Senior Data EngineerReq ID:Job Description:Disney Entertainment & ESPN TechnologyOn any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future.Whether that's evolving our streaming...
-
Senior Data Engineer
3 months ago
New York, United States VeracityID Full timeJob DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...
Senior Data Platform Engineer
1 month ago
Our company is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains a large and expanding distributed compute cluster, many-PB-scale storage systems, operating systems, automation software, and development tools.
We are seeking a highly skilled engineer with expertise in Linux administration and experience with Big Data technologies, particularly Kafka, Trino, and Elasticsearch. As a Big Data Systems Engineer, you will play a critical role in ensuring our data infrastructure is robust, scalable, and reliable. You will work closely with our engineering and research teams to design, deploy, and maintain systems that support our research and trading activities.
Responsibilities
- Trino Administration: Set up and manage Trino clusters for large-scale data analytics. Optimize and troubleshoot query performance and ensure data integrity across the system.
- Kafka Administration: Design, deploy, and maintain Apache Kafka clusters. Implement and monitor Kafka-based data pipelines to ensure efficient and reliable data flow.
- Elasticsearch Administration: Configure and maintain Elasticsearch clusters on managed compute platforms such as Kubernetes.
- System Monitoring: Develop and implement monitoring solutions to ensure high system uptime and reliability; utilize tools to detect and resolve issues proactively.
- Linux Administration: Maintain and manage a large-scale Linux-based infrastructure; ensure system stability, security, and performance through best practices in system administration.
- Collaboration: Work closely with development and research teams to understand their requirements and provide robust data infrastructure solutions, participating in cross-functional projects as needed.
- Documentation: Create and maintain comprehensive documentation for system architecture, processes, and best practices.
Skills
- Bachelor's degree in computer science, information technology, or a related field.
- Minimum of 3-5 years of experience in systems engineering, with a focus on Linux administration.
- Experience with large-scale, big data query engines and technologies such as Trino, Presto, Iceberg, and Hive.
- Experience with operating and managing large-scale Kafka clusters, including design, deployment, and capacity management.
- Experience with operating and managing large-scale Elasticsearch clusters.
- Experience with container orchestration platforms and technologies such as Kubernetes, Terraform, and Helm.
- Proficiency in scripting languages such as Python or Bash.
- Strong problem-solving skills and the ability to work in a fast-paced environment.
- Excellent communication and collaboration skills.
