Current jobs related to Senior Real-Time Data Engineer - San Francisco - Unreal Gigs

  • Senior Data Engineer

    3 days ago

    San Jose, California, United States Tik Tok Full time

    Job Title: Senior Data Engineer - Real-Time Data WarehouseAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our commercial real-time data warehouse team. As a Senior Data Engineer, you will be responsible for designing, developing, and optimizing our real-time data warehouse solution.Key Responsibilities:Design and develop a...

  • Real-Time Data Engineer

    7 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Data Engineer for Real-Time Solutions to join our team. As a key member of our data engineering team, you will play a pivotal role in designing, building, and optimizing our real-time data infrastructure and systems.**Key Responsibilities:*** Design and develop real-time data pipelines to ingest, process, and analyze...

  • Real-Time Data Engineer

    2 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewAt Unreal Gigs, we're pushing the boundaries of real-time data engineering. As a key member of our team, you'll play a pivotal role in designing, building, and optimizing our real-time data infrastructure and systems.As a Real-Time Data Engineer, you'll work closely with cross-functional teams of data scientists, software engineers, and business...

  • Senior Data Engineer

    3 days ago

    San Jose, California, United States Tik Tok Full time

    Job SummaryAt TikTok, we're looking for a skilled Senior Data Engineer - Real-Time Data Warehouse to join our team. As a key member of our commercial data platform, you will be responsible for the development and optimization of our real-time data warehouse. This is a unique opportunity to work on a large-scale streaming data computing project, leveraging...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States Gridware Full time

    Job Title: Senior Data EngineerGridware is a leading provider of advanced sensing systems for the electrical grid. Our team is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems.The Senior Data Engineer will be responsible for handling large-scale sensor data, ensuring data...

  • Senior Software Engineer

    4 weeks ago

    Market St #, San Francisco, CA , USA, United States Goswift Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our cross-functional product team focused on real-time data ingestion and processing. As a key member of our team, you will design, build, and deliver features and functionality that solve real customer problems.Responsibilities include contributing technically to Swiftly's...

  • Senior Software Engineer, Real-Time Data Processing

    1 week ago

    San Francisco, California, United States Cisco Full time

    About the RoleCisco is seeking a highly skilled Lead Software Engineer to join our Events team. As a key member of this team, you will be responsible for building a highly scalable stream processing platform to detect anomalies and provide actionable insights to our customers.We are looking for a talented engineer with expertise in designing and building...

  • Senior Data Engineer

    1 week ago

    San Jose, California, United States Tik Tok Full time

    Job DescriptionTikTok is a leading destination for short-form mobile video, and our mission is to inspire creativity and bring joy. We're looking for a talented Data Streaming Engineer to join our team and help us achieve this goal.As a Data Streaming Engineer, you will be responsible for developing and optimizing TikTok's commercial real-time data...

  • Real-Time Data Solutions Architect

    1 month ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Real-Time Data EngineerCompany Overview:Welcome to Unreal Gigs, a leading company in the field of real-time data engineering. We're dedicated to harnessing the power of real-time data to drive insights and enable real-time decision-making. Our mission is to develop scalable and efficient real-time data solutions that empower organizations to...

  • Lead Real-Time Data Architect

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Real-Time Data EngineerCompany OverviewWelcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. We're committed to harnessing the power of real-time data to drive transformative change and solve complex problems across industries.Job DescriptionAs the Lead Real-Time Data Engineer, you'll play a pivotal role in...

  • Lead Real-Time Data Architect

    1 week ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewWelcome to Unreal Gigs, where we're pushing the boundaries of data-driven innovation. As the Lead Real-Time Data Architect, you'll be at the forefront of designing, building, and optimizing real-time data infrastructure. Your expertise in real-time data technologies will enable timely insights and actions, driving transformative change across...

  • Senior Data Engineer

    7 days ago

    San Francisco, California, United States Gridware Full time

    Job OverviewGridware is a pioneering company that aims to enhance and protect the electrical grid, a critical infrastructure that underpins modern society. As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems.The ideal candidate will have...

  • Senior Data Engineer

    1 week ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:* Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large...

  • Senior Data Engineer

    4 days ago

    San Francisco, California, United States EliseAI Full time

    About EliseAIEliseAI is a cutting-edge conversational AI technology company that focuses on developing innovative solutions for industries fundamental to our lives: housing and healthcare. Our mission is to leverage data as a strategic asset to drive decision-making processes. We're seeking a skilled Senior Data Engineer to join our Engineering team and play...

  • Senior Data Engineer

    1 week ago

    San Francisco, California, United States Capital One Full time

    Transformative Data Engineer Role at Capital OneAre you passionate about harnessing data to drive business growth? Do you thrive in a collaborative environment where innovation meets technical expertise? At Capital One, we're seeking a seasoned Data Engineer to join our team of pioneers in the technology space.Key Responsibilities:Collaborate with Agile...

  • Senior Data Engineer

    1 week ago

    San Francisco, United States Neon Redwood Full time

    About Neon Redwood Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities. ...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, California, United States ZoomInfo Technologies LLC Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at ZoomInfo Technologies LLC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems to support our business needs.Key Responsibilities:Design and implement data pipelines using...

  • Data Engineer

    4 days ago

    San Francisco, California, United States Fintool Full time

    About FintoolFintool is an AI Equity Research Copilot for institutional investors. We're building the AI Warren Buffett. Our team is on the fastest growing LLM vertical applications, with thousands of investors signed up for Fintool. We're backed by Y Combinator and entrepreneurs such as the co-founders of Datadog, Vercel, HuggingFace, or domain experts from...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:Design and implement scalable and efficient data pipelines for ingesting, processing, and...

Senior Real-Time Data Engineer

2 months ago

San Francisco, United States Unreal Gigs Full time
Job DescriptionJob Description

Company Overview: Welcome to the forefront of data-driven innovation Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join us and be part of a dynamic team shaping the future of real-time data engineering.

Position Overview: As a Senior Real-Time Data Engineer, you'll play a crucial role in designing, building, and optimizing our real-time data infrastructure. You'll work on challenging projects, from architecting data streaming pipelines to developing real-time analytics systems, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in real-time data technologies and a passion for building scalable and reliable systems, we want you on our team.

Requirements

Key Responsibilities:

  1. Real-Time Data Architecture: Design and implement scalable and reliable architecture for real-time data processing and analytics, including data ingestion, processing, and serving layers.
  2. Streaming Data Pipelines: Develop and maintain real-time data streaming pipelines using technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming, ensuring low-latency and high-throughput data processing.
  3. Event-Driven Architecture: Design event-driven systems to enable real-time processing of data events and triggers, supporting use cases such as real-time monitoring, anomaly detection, and alerting.
  4. Data Integration: Integrate real-time data streams from diverse sources and systems into the real-time data infrastructure, ensuring data consistency, integrity, and quality.
  5. Real-Time Analytics: Develop real-time analytics systems and dashboards to enable real-time insights and decision-making, leveraging technologies such as Apache Druid, Elasticsearch, or Grafana.
  6. Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in real-time data environments.
  7. Performance Optimization: Optimize real-time data pipelines and processing workflows for performance, scalability, and efficiency, leveraging distributed computing and streaming processing techniques.
  8. Monitoring and Alerting: Implement monitoring and alerting solutions to track the performance and health of real-time data infrastructure and pipelines, proactively identifying and resolving issues.
  9. Documentation and Best Practices: Document real-time data architecture, pipelines, and best practices, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  10. Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business analysts, to understand requirements and deliver real-time data solutions that meet business needs.
  11. Mentorship and Development: Mentor junior engineers, sharing expertise and best practices in real-time data engineering, and facilitate knowledge sharing sessions within the team.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 5+ years of experience in data engineering, with a focus on real-time data technologies.
  • Proficiency in real-time data streaming technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming.
  • Strong programming skills in languages such as Python, Java, or Scala, with experience in distributed computing frameworks.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and services like AWS Kinesis, Azure Stream Analytics, or Google Cloud Dataflow.
  • Strong understanding of event-driven architecture and stream processing concepts, with experience building event-driven systems.
  • Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex real-time data solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits

  • Competitive salary: The industry standard salary for Senior Real-Time Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

Join Us: Ready to shape the future of real-time data engineering? Apply now to join our team and be part of the data revolution