Lead Real-Time Data Architect

1 week ago

San Francisco, California, United States Unreal Gigs Full time
Job Overview

Welcome to Unreal Gigs, where we're pushing the boundaries of data-driven innovation. As the Lead Real-Time Data Architect, you'll be at the forefront of designing, building, and optimizing real-time data infrastructure. Your expertise in real-time data technologies will enable timely insights and actions, driving transformative change across industries.

Key Responsibilities:

  1. Technical Leadership: Provide strategic guidance, mentorship, and technical leadership to a team of real-time data engineers, fostering a culture of excellence, innovation, and collaboration.
  2. Real-Time Data Architecture: Lead the design and implementation of scalable and reliable architecture for real-time data processing and analytics, encompassing data ingestion, processing, and serving layers.
  3. Streaming Data Pipelines: Architect and develop robust real-time data streaming pipelines using technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming, ensuring low-latency and high-throughput processing.
  4. Event-Driven Architecture: Design event-driven systems to enable real-time processing of data events and triggers, supporting use cases such as real-time monitoring, anomaly detection, and alerting.
  5. Data Integration: Lead efforts to integrate real-time data streams from diverse sources and systems into the real-time data infrastructure, ensuring data consistency, integrity, and quality.
  6. Real-Time Analytics: Develop real-time analytics systems and dashboards to enable timely insights and decision-making, leveraging technologies such as Apache Druid, Elasticsearch, or Grafana.
  7. Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in real-time data environments.
  8. Performance Optimization: Optimize real-time data pipelines and processing workflows for performance, scalability, and efficiency, leveraging distributed computing and streaming processing techniques.
  9. Monitoring and Alerting: Implement robust monitoring and alerting solutions to track the performance and health of real-time data infrastructure and pipelines, proactively identifying and resolving issues.
  10. Documentation and Best Practices: Define and promote best practices for real-time data engineering, ensuring clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  11. Collaboration: Collaborate closely with cross-functional teams, including data scientists, software engineers, and business analysts, to understand requirements and deliver real-time data solutions that meet business needs.
  12. Mentorship and Development: Mentor and coach junior engineers, providing guidance, support, and opportunities for skill development and career growth, and foster a culture of continuous learning and improvement within the team.

Requirements:

  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 8+ years of experience in data engineering, with a focus on real-time data technologies.
  • Proven leadership experience, with a track record of successfully leading real-time data engineering teams and delivering complex projects.
  • Expertise in real-time data streaming technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming.
  • Strong programming skills in languages such as Python, Java, or Scala, with experience in distributed computing frameworks.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and services like AWS Kinesis, Azure Stream Analytics, or Google Cloud Dataflow.
  • Strong understanding of event-driven architecture and stream processing concepts, with experience building event-driven systems.
  • Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex real-time data solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits:

  • Competitive salary: The industry standard salary for Lead Real-Time Data Engineers typically ranges from $200,000 to $300,000 per year, depending on experience and qualifications.
  • Comprehensive benefits package, including health insurance, retirement plans, and wellness programs.
  • Flexible work arrangements, including remote work options and flexible hours.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

  • Lead Real-Time Data Architect

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Real-Time Data EngineerCompany OverviewWelcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. We're committed to harnessing the power of real-time data to drive transformative change and solve complex problems across industries.Job DescriptionAs the Lead Real-Time Data Engineer, you'll play a pivotal role in...

  • Lead Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a seasoned Lead Data Architect to lead our data architecture initiatives and drive the design, implementation, and optimization of our data architecture solutions. As a key member of our team, you will provide technical leadership, guidance, and mentorship to a team of data architects and engineers, fostering a culture of excellence...

  • Lead Data Architect

    5 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a seasoned Data Architecture Visionary to lead our data architecture initiatives and drive the design, implementation, and optimization of our data architecture solutions.As the Lead Data Architect, you will play a pivotal role in shaping the future of data architecture and collaborating closely with cross-functional teams to deliver...

  • Real-Time Data Solutions Architect

    1 month ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Real-Time Data EngineerCompany Overview:Welcome to Unreal Gigs, a leading company in the field of real-time data engineering. We're dedicated to harnessing the power of real-time data to drive insights and enable real-time decision-making. Our mission is to develop scalable and efficient real-time data solutions that empower organizations to...

  • Senior Data Architect

    2 weeks ago

    San Francisco, California, United States Storm3 Full time

    Data Architect/Engineering Lead - AI/MLStorm3 is seeking an experienced Data Architect/Engineering Lead to join their fast-growing AI/ML team. This role will design and develop data model/lakehouse and work alongside ML architects/scientists to scale data curation and pipelines for ML on a modern tech stack.Responsibilities:Design, implement, and support...

  • Senior Data Architect

    2 weeks ago

    San Francisco, California, United States Storm3 Full time

    Data Architect/Engineering Lead - MLAI Drug Discovery PioneerRemote OpportunityCompetitive Compensation PackageStorm3 is a HealthTech recruitment firm partnering with a cutting-edge start-up in the field of deep learning and generative AI. This innovative company is merging advanced models with biology research to accelerate disease treatment and drug...

  • Big Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a visionary Big Data Architect to spearhead the design and construction of our cutting-edge data solutions. As a key member of our team, you will be responsible for crafting the blueprint for tomorrow's innovations, leveraging colossal data sets to solve real-world problems.Key Responsibilities:Architect and refine our big...

  • Senior Lead Software Architect

    5 days ago

    San Francisco, California, United States TEGNA Full time

    About TEGNATEGNA Inc. is a leading media company that serves the greater good of our communities. Across platforms, TEGNA tells empowering stories, conducts impactful investigations, and delivers innovative marketing solutions. With 64 television stations in 51 U.S. markets, TEGNA is the largest owner of top 4 network affiliates in the top 25 markets among...

  • Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data ArchitectAt Unreal Gigs, we're seeking a skilled Data Architect to join our team. As a Data Architect, you'll play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet business...

  • Data Architect

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data ArchitectUnreal Gigs is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet...

  • Data Architect

    1 week ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Data Architect to join our team. As a key member of our data architecture team, you will be responsible for designing, building, and maintaining our data architecture to support the needs of our organization.Your primary focus will be on designing and architecting scalable and efficient data architecture solutions to...

  • Data Architect

    3 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data ArchitectAt Unreal Gigs, we're seeking a highly skilled Data Architect to join our team. As a Data Architect, you'll play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Data Architecture Design: Design and architect scalable and efficient data...

  • Real-Time Data Engineer

    1 week ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Data Engineer for Real-Time Solutions to join our team. As a key member of our data engineering team, you will play a pivotal role in designing, building, and optimizing our real-time data infrastructure and systems.**Key Responsibilities:*** Design and develop real-time data pipelines to ingest, process, and analyze...

  • Data Architect

    1 week ago

    San Francisco, California, United States PamTen Full time

    Mandatory QualificationsAs a Data Architect at PamTen, you will be responsible for managing data migration planning, development, and testing. You must have a minimum of five years' experience within the last ten years performing data analysis, design, configuration, testing, and implementation, with at least three years in a lead role.You must have a...

  • Data Architect

    4 days ago

    San Francisco, California, United States PamTen Full time

    Mandatory QualificationsFor this role at PamTen, we require a highly skilled Data Architect with a strong background in data analysis, design, configuration, testing, and implementation. The ideal candidate will have at least five years of experience in a lead role and a bachelor's degree in an IT-related or engineering field from an accredited college or...

  • Senior Data Architect

    5 days ago

    San Francisco, California, United States Unity Technologies Full time

    Job SummaryWe are seeking a highly skilled Senior Data Architect to lead our data engineering efforts and drive the development of our data pipelines for machine learning models. The ideal candidate will have a strong background in machine learning and a proven track record in the AdTech sector.Key Responsibilities Lead the design, implementation, and...

  • Big Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Big Data ArchitectAt Unreal Gigs, we're seeking a highly skilled Big Data Architect to join our team. As a key member of our data engineering team, you'll be responsible for designing and building scalable and reliable big data infrastructure and platforms.Key Responsibilities:Design and architect big data infrastructure and platforms, including...

  • Data Architect

    1 week ago

    San Francisco, California, United States Unreal Gigs Full time

    Company Overview: At Unreal Gigs, we're pushing the boundaries of data architecture. Our mission is to craft scalable and efficient data solutions that empower organizations to unlock their data's full potential. As a Data Architect, you'll play a pivotal role in designing, building, and maintaining our data architecture to support our organization's needs....

  • Data Architect Lead

    5 days ago

    San Diego, California, United States Photon Full time

    Job Title: Data Architect LeadAt Photon, we are seeking an experienced Data Architect Lead to join our team. The ideal candidate will have a deep understanding of Capsenta and a proven track record of designing, implementing, and optimizing data solutions.Key Responsibilities: Lead the design and development of data architectures using Capsenta's...

  • Big Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Shape the Future of DataWe're not just collecting data; we're crafting the blueprint for tomorrow's innovations. As a Big Data Architect, you'll spearhead our efforts to design and construct the infrastructure that underpins our cutting-edge data solutions.Your vision will pave the way for breakthroughs that leverage colossal data sets to solve real-world...