Real-Time Data Engineering Director
6 days ago
As a key member of the Unreal Gigs team, you will play a crucial role in driving the development and implementation of our real-time data engineering strategy.
About UsWelcome to Unreal Gigs, a leading innovator at the forefront of data-driven solutions. Our company is committed to harnessing the power of real-time data to drive transformative change and solve complex problems across industries.
Job OverviewThe Real-Time Data Engineer will lead initiatives in designing, building, and optimizing scalable, reliable, and efficient systems for ingesting, processing, and analyzing real-time data streams.
Key Responsibilities:- Technical Leadership: Provide strategic guidance, mentorship, and technical leadership to a team of real-time data engineers, fostering a culture of excellence, innovation, and collaboration.
- Real-Time Data Architecture: Lead the design and implementation of architecture for real-time data processing and analytics, encompassing data ingestion, processing, and serving layers.
- Streaming Data Pipelines: Architect and develop robust real-time data streaming pipelines using technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming, ensuring low-latency and high-throughput processing.
- Event-Driven Architecture: Design event-driven systems to enable real-time processing of data events and triggers, supporting use cases such as real-time monitoring, anomaly detection, and alerting.
- Data Integration: Lead efforts to integrate real-time data streams from diverse sources and systems into the real-time data infrastructure, ensuring data consistency, integrity, and quality.
- Real-Time Analytics: Develop real-time analytics systems and dashboards to enable timely insights and decision-making, leveraging technologies such as Apache Druid, Elasticsearch, or Grafana.
- Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in real-time data environments.
- Performance Optimization: Optimize real-time data pipelines and processing workflows for performance, scalability, and efficiency, leveraging distributed computing and streaming processing techniques.
- Monitoring and Alerting: Implement robust monitoring and alerting solutions to track the performance and health of real-time data infrastructure and pipelines, proactively identifying and resolving issues.
- Documentation and Best Practices: Define and promote best practices for real-time data engineering, ensuring clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate closely with cross-functional teams, including data scientists, software engineers, and business analysts, to understand requirements and deliver real-time data solutions that meet business needs.
- Mentorship and Development: Mentor and coach junior engineers, providing guidance, support, and opportunities for skill development and career growth, and foster a culture of continuous learning and improvement within the team.
We offer a competitive salary range of $250,000-$350,000 per year, depending on experience and qualifications. Additional benefits include a comprehensive benefits package, flexible work arrangements, generous vacation and paid time off, professional development opportunities, state-of-the-art technology environment, and a vibrant and inclusive company culture with opportunities for growth and advancement.
-
Real-Time Data Engineering Innovator
1 month ago
San Francisco, California, United States Unreal Gigs Full timeJob SummaryWe are seeking a highly skilled Real-Time Data Engineering Innovator to lead our initiatives in designing, building, and optimizing real-time data infrastructure.About Unreal GigsWelcome to Unreal Gigs, where we are at the forefront of leveraging real-time data to drive transformative change and solve complex problems across industries. Our...
-
Real-Time Data Architect Lead
1 month ago
San Francisco, California, United States Unreal Gigs Full timeUnlock the Power of Real-Time Data EngineeringWelcome to Unreal Gigs, where we harness the potential of real-time data to drive innovation and solve complex problems. As a key member of our team, you'll be responsible for designing and implementing cutting-edge real-time data infrastructure that enables timely insights and actions.About the Role:Technical...
-
Technical Director of Data Engineering
2 weeks ago
San Francisco, California, United States Perplexity AI Full timeAs a technical director of data engineering at Perplexity AI, you will be responsible for leading the growth and development of our data engineering team. This includes overseeing the design, creation, and deployment of systems that power product experiences across our tech stack.With the exponential increase in data at Perplexity AI, we are investing in a...
-
Data Engineer for Real-Time Analytics
5 days ago
San Jose, California, United States Tik Tok Full timeRole OverviewTikTok is a leading platform for short-form mobile video. As a Software Engineer, Data Streaming, you will play a key role in building state-of-the-art streaming and batch data processing solutions that support both the TikTok ads platform and internal business intelligence platform.Key Responsibilities:1. Develop and optimize TikTok's...
-
Real-Time Data Engineering Lead
2 weeks ago
San Jose, California, United States Tik Tok Full timeAre you passionate about building scalable and efficient data systems? Do you want to make a meaningful impact on a global platform? As a Real-Time Data Engineering Lead at TikTok, you will design and develop high-performance data pipelines that drive real-time insights and inform business decisions.ResponsibilitiesDevelop and optimize TikTok's commercial...
-
San Francisco, California, United States CLevelCrossing Full timeOverview">At CLevelCrossing, we are seeking a highly skilled Senior Engineering Director of Data Platforms to lead our engineering organization. This role will be based in the US and will be responsible for delivering industry-leading product innovation, technical scale, and simplicity for partner integrations, customer data pipeline & platform, real-time...
-
Real-Time Data Pipeline Specialist
2 weeks ago
San Francisco, California, United States Fintool Full timeJob DescriptionWe're seeking a highly skilled Financial Data Engineer to join our team in San Francisco. As a key member of our engineering team, you'll be responsible for building real-time data pipelines to process millions of financial documents, leveraging Spark/Databricks and Python to drive business growth. Your expertise in ML-based parsing and...
-
Data Engineering Director
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeAbout the Role:We're seeking an experienced Data Engineering Director to join our team at Unreal Gigs. As a key member of our data engineering team, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines.Responsibilities:Lead Data Engineering Efforts:...
-
San Francisco, California, United States Braintrust Data Full timeAbout Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...
-
Data Platform Systems Architect
3 weeks ago
San Francisco, California, United States VAST Data Full timeAbout VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...
-
San Francisco, California, United States Plutus Full timeAt Plutus, we're seeking a highly skilled Senior Frontend Engineer to own and build our modern user experience from the ground up. As a member of our team, you'll have the autonomy to design and deliver an amazing user interface that scales with our users' needs.We're building a real-time stream processing application on top of Apache Flink, running on...
-
Data Engineering Director
2 weeks ago
San Francisco, California, United States Windfall Full timeAt Windfall, we are seeking a highly skilled Data Engineering Director to lead our core data team. This is an exciting opportunity to build out the core data asset that everything else at Windfall is built on top of. As a key member of our team, you will work closely with our product, data science, and other engineering teams to design and build pipelines...
-
Senior Backend Software Engineer
4 weeks ago
San Jose, California, United States Real Full timeJob OverviewReal, a fast-growing national real estate brokerage, is seeking an experienced Senior Backend Software Engineer to join its R&D team. As a key member of the team, you will be responsible for leading the technical vision for all things back end, implementing features, and improving our Java Spring Microservices. About UsFounded in 2014, Real is a...
-
San Francisco, California, United States Discord Full timeReal Time Infrastructure TeamWe're a multiplatform, multigenerational and multiplayer platform that helps people deepen their friendships around games and shared interests. Our tech stack is Elixir, Python and Rust.The estimated salary for this role in the US is around $175,000 - $225,000 per year.About the RoleThis position is part of the Real Time...
-
Commercial Real Estate Project Director
1 week ago
San Francisco, California, United States Turner & Townsend Full timeJob OverviewCommercial Real Estate Project Director for Turner & TownsendWe are seeking a seasoned and experienced Commercial Real Estate Project Director to oversee the successful delivery of large-scale commercial real estate construction projects.Lead multiple complex construction programs, ensuring timely completion within budget and quality...
-
Real-Time Workflow Architect
2 weeks ago
San Francisco, California, United States Pylon Full timeCompany OverviewPylon is a technology company based in downtown San Francisco. We're building a real-time customer operations platform to help businesses shift from email to chat platforms like Slack, Microsoft Teams, and Discord.Job SummaryWe're looking for a skilled software engineer to join our team as a Customer Operations Engineer. This role will be...
-
Data Engineering Team Lead
1 week ago
San Francisco, California, United States Perplexity AI Full timePerplexity AI is seeking a seasoned technical director to oversee the growth and scalability of our data engineering team. The ideal candidate will lead the design, creation, and deployment of systems that power product experiences across a growing tech stack.The exponential increase in data at Perplexity AI necessitates the investment in a robust data...
-
San Francisco, California, United States AirGarage Full timeUnlock the Potential of Data-Driven Urban DevelopmentAirGarage is revolutionizing the way we think about real estate use in our cities, and we're looking for a talented Data Engineering Expert to join our team. As a key member of our data-driven organization, you will play a critical role in helping us unlock the full potential of our parking database.About...
-
Real-Time Data Architect, Ad Platform
2 weeks ago
San Jose, California, United States Tik Tok Full timeJob DescriptionReal-Time Data Architect, Ad Platform is a key position in our ad data platform team. You will work closely with product managers and data analysts to design and develop state-of-the-art streaming and batch data processing solutions that support both the TikTok ads platform and our internal business intelligence platform.You will have...
-
Data Engineering Lead for Real-Time Analytics
4 weeks ago
San Francisco, California, United States Amplitude Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at Amplitude. As a Staff Software Engineer, you will play a key role in designing, building, and operating our query engine, which powers our core analytics product.Key Responsibilities:Product Development: Take product ideas from ideation to implementation, developing...
