Lead Real-Time Data Architect

2 weeks ago

San Francisco, California, United States Unreal Gigs Full time
Job Title: Lead Real-Time Data EngineerCompany Overview

Welcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. We're committed to harnessing the power of real-time data to drive transformative change and solve complex problems across industries.

Job Description

As the Lead Real-Time Data Engineer, you'll play a pivotal role in shaping our real-time data engineering strategy and team. Your expertise will be instrumental in designing, building, and optimizing scalable, reliable, and efficient real-time data infrastructure.

Key Responsibilities
  1. Technical Leadership: Provide strategic guidance, mentorship, and technical leadership to a team of real-time data engineers, fostering a culture of excellence, innovation, and collaboration.
  2. Real-Time Data Architecture: Lead the design and implementation of scalable and reliable architecture for real-time data processing and analytics, encompassing data ingestion, processing, and serving layers.
  3. Streaming Data Pipelines: Architect and develop robust real-time data streaming pipelines using technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming, ensuring low-latency and high-throughput processing.
  4. Event-Driven Architecture: Design event-driven systems to enable real-time processing of data events and triggers, supporting use cases such as real-time monitoring, anomaly detection, and alerting.
  5. Data Integration: Lead efforts to integrate real-time data streams from diverse sources and systems into the real-time data infrastructure, ensuring data consistency, integrity, and quality.
  6. Real-Time Analytics: Develop real-time analytics systems and dashboards to enable timely insights and decision-making, leveraging technologies such as Apache Druid, Elasticsearch, or Grafana.
  7. Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in real-time data environments.
  8. Performance Optimization: Optimize real-time data pipelines and processing workflows for performance, scalability, and efficiency, leveraging distributed computing and streaming processing techniques.
  9. Monitoring and Alerting: Implement robust monitoring and alerting solutions to track the performance and health of real-time data infrastructure and pipelines, proactively identifying and resolving issues.
  10. Documentation and Best Practices: Define and promote best practices for real-time data engineering, ensuring clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  11. Collaboration: Collaborate closely with cross-functional teams, including data scientists, software engineers, and business analysts, to understand requirements and deliver real-time data solutions that meet business needs.
  12. Mentorship and Development: Mentor and coach junior engineers, providing guidance, support, and opportunities for skill development and career growth, and foster a culture of continuous learning and improvement within the team.
Qualifications
  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 8+ years of experience in data engineering, with a focus on real-time data technologies.
  • Proven leadership experience, with a track record of successfully leading real-time data engineering teams and delivering complex projects.
  • Expertise in real-time data streaming technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming.
  • Strong programming skills in languages such as Python, Java, or Scala, with experience in distributed computing frameworks.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and services like AWS Kinesis, Azure Stream Analytics, or Google Cloud Dataflow.
  • Strong understanding of event-driven architecture and stream processing concepts, with experience building event-driven systems.
  • Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex real-time data solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
  • Competitive salary: The industry standard salary for Lead Real-Time Data Engineers typically ranges from $200,000 to $300,000 per year, depending on experience and qualifications.
  • Comprehensive benefits package, including health insurance, retirement plans, and wellness programs.
  • Flexible work arrangements, including remote work options and flexible hours.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

  • Chief Architect

    4 weeks ago

    San Francisco, California, United States Revinate Full time

    About RevinateWe are a leading provider of specialized technology solutions for the hotel industry, empowering hoteliers to transform their guest data into revenue and make smarter decisions. Our team is composed of hard-working and passionate individuals committed to surprising and delighting our customers with every new innovation and disruption.Our...

  • Real-Time Data Solutions Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Real-Time Data EngineerCompany Overview:Welcome to Unreal Gigs, a leading company in the field of real-time data engineering. We're dedicated to harnessing the power of real-time data to drive insights and enable real-time decision-making. Our mission is to develop scalable and efficient real-time data solutions that empower organizations to...

  • Senior Data Architect

    3 weeks ago

    San Francisco, California, United States Storm3 Full time

    {"title": "Data Architect/Engineer Lead - ML", "company": "Storm3", "location": "Remote within US", "job_type": "Full-time", "industry": "HealthTech", "job_description": "Principal QM Research Scientist / EngineerAI Drug Discovery Unicorn (Series B)Competitive base + hefty equityThis start-up is a leader in deep learning & generative AI, merging cutting-edge...

  • Senior Data Architect

    4 weeks ago

    San Francisco, California, United States Storm3 Full time

    Job DescriptionCompany OverviewStorm3 is a leading HealthTech recruitment firm, serving clients across major Tech hubs in Europe, APAC, and North America.Job SummaryWe are seeking an experienced Data Architect/Engineer Lead - ML to join our fast-growing AI/ML team. This Lead will design and develop data model/lakehouse and work alongside ML architects &...

  • Data Architect

    3 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data ArchitectUnreal Gigs is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet...

  • Lead Data Systems Architect

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Data Systems EngineerUnreal Gigs is seeking a highly skilled and experienced Lead Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design, implementation, and optimization of our data systems infrastructure.Key Responsibilities:Technical Leadership: Provide strategic...

  • Principal Data Architect

    2 weeks ago

    San Francisco, California, United States SmithRx Full time

    Transforming Pharmacy Benefit Management with Data Engineering ExpertiseAt SmithRx, we're revolutionizing the pharmacy benefit management industry with cutting-edge technology and innovative solutions. As a Principal Data Engineer, you'll play a pivotal role in driving this transformation by designing and developing robust data architectures that support...

  • Senior Data Architect

    3 weeks ago

    San Francisco, California, United States Storm3 Full time

    Principal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a HealthTech recruitment firm that connects top talent with innovative companies. We're seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop data lakehouse...

  • Senior Data Architect

    2 weeks ago

    San Francisco, California, United States Storm3 Full time

    Principal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a leading HealthTech recruitment firm, partnering with innovative companies across the globe. We are seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop a...

  • Lead Data Systems Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Data Systems EngineerUnreal Gigs is seeking a highly skilled and experienced Lead Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design, implementation, and optimization of our data systems infrastructure.Key Responsibilities:Provide technical leadership and...

  • Lead Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Data EngineerCompany Overview:Welcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics,...

  • Cloud Data Engineering Lead

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Lead Cloud Data EngineerUnreal Gigs is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms.Position OverviewAs the Lead Cloud Data Engineer, you'll...

  • Cloud Data Engineering Lead

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Cloud Data Engineering LeadUnreal Gigs is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms.Position OverviewAs the Cloud Data Engineering Lead, you'll...

  • Data Architect

    3 days ago

    San Jose, California, United States PayPal Full time

    Job Title: Data ArchitectPayPal is seeking a highly skilled Data Architect to design and implement secure, scalable data solutions. As a key member of our Data Architecture team, you will partner with business units to architect data solutions for key initiatives, working across the entire data lifecycle from design to deployment.Key Responsibilities:Design...

  • Cloud Data Engineering Lead

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Lead Cloud Data EngineerUnreal Gigs is seeking a highly skilled and experienced Lead Cloud Data Engineer to spearhead our cloud data engineering initiatives. As a key member of our team, you will be responsible for designing, building, and optimizing cloud data solutions that drive business growth and innovation.Key Responsibilities:Technical Leadership:...

  • Cloud Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Cloud Data EngineerAt Unreal Gigs, we're seeking a highly skilled Cloud Data Engineer to join our team. As a key member of our data engineering team, you'll play a pivotal role in designing, building, and maintaining our cloud-based data infrastructure and systems.Key Responsibilities:Cloud Data Infrastructure Design: Design and architect scalable and...

  • Commercial Real Estate Sales Professional

    2 weeks ago

    San Francisco, California, United States Starboard Commercial Real Estate Full time

    Job OpportunityStarboard Commercial Real Estate, a leading commercial real estate firm in San Francisco, is seeking a skilled Licensed Commercial Real Estate Sales Agent to join their team.Key ResponsibilitiesEvaluate potential deals and conduct market research to identify opportunitiesNegotiate contracts with clients and facilitate transactionsDevelop a...

  • Cloud Data Architect-Director: Lead Cloud Data Platform Development

    4 weeks ago

    San Francisco, California, United States Cedent Consulting Inc Full time

    Job Description:Job Title: Cloud Data Architect-DirectorCompany: Cedent Consulting IncJob Type: Full-timeLocation: Remote (with occasional travel)About the Role:We are seeking an experienced Cloud Data Architect-Director to lead the development of our cloud data platform. As a key member of our team, you will be responsible for designing and implementing...

  • Cloud Data Architect Director

    3 weeks ago

    San Francisco, California, United States Cedent Consulting Full time

    Job Title: Cloud Data Architect DirectorAt Cedent Consulting, we are seeking a highly skilled Cloud Data Architect Director to lead the development of our cloud-based data analytics platform.About the RoleAs a Cloud Data Architect Director, you will be responsible for designing and implementing a scalable and secure cloud-based data platform that meets the...

  • Commercial Real Estate Sales Professional

    6 days ago

    San Francisco, California, United States Starboard Commercial Real Estate Full time

    Job OpportunityStarboard Commercial Real Estate, a leading commercial real estate firm in San Francisco, is seeking a skilled Licensed Commercial Real Estate Sales Agent to join their team. The ideal candidate will possess extensive knowledge of the local market, a proven track record in contract closures, and a strong understanding of modern technology.Key...