Lead Real-Time Data Engineer
2 weeks ago
Company Overview: Welcome to the forefront of data-driven innovation Our company is at the cutting edge of leveraging real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join us and lead our efforts in shaping the future of real-time data engineering.
Position Overview: As the Lead Real-Time Data Engineer, you'll lead our initiatives in designing, building, and optimizing real-time data infrastructure. You'll spearhead the development of scalable, reliable, and efficient systems for ingesting, processing, and analyzing real-time data streams. If you're a seasoned engineer with expertise in real-time data technologies and a proven track record of leadership in delivering successful projects, we invite you to lead our team in this exciting opportunity.
Requirements
Key Responsibilities:
- Technical Leadership: Provide strategic guidance, mentorship, and technical leadership to a team of real-time data engineers, fostering a culture of excellence, innovation, and collaboration.
- Real-Time Data Architecture: Lead the design and implementation of scalable and reliable architecture for real-time data processing and analytics, encompassing data ingestion, processing, and serving layers.
- Streaming Data Pipelines: Architect and develop robust real-time data streaming pipelines using technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming, ensuring low-latency and high-throughput processing.
- Event-Driven Architecture: Design event-driven systems to enable real-time processing of data events and triggers, supporting use cases such as real-time monitoring, anomaly detection, and alerting.
- Data Integration: Lead efforts to integrate real-time data streams from diverse sources and systems into the real-time data infrastructure, ensuring data consistency, integrity, and quality.
- Real-Time Analytics: Develop real-time analytics systems and dashboards to enable timely insights and decision-making, leveraging technologies such as Apache Druid, Elasticsearch, or Grafana.
- Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in real-time data environments.
- Performance Optimization: Optimize real-time data pipelines and processing workflows for performance, scalability, and efficiency, leveraging distributed computing and streaming processing techniques.
- Monitoring and Alerting: Implement robust monitoring and alerting solutions to track the performance and health of real-time data infrastructure and pipelines, proactively identifying and resolving issues.
- Documentation and Best Practices: Define and promote best practices for real-time data engineering, ensuring clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate closely with cross-functional teams, including data scientists, software engineers, and business analysts, to understand requirements and deliver real-time data solutions that meet business needs.
- Mentorship and Development: Mentor and coach junior engineers, providing guidance, support, and opportunities for skill development and career growth, and foster a culture of continuous learning and improvement within the team.
Qualifications:
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
- 8+ years of experience in data engineering, with a focus on real-time data technologies.
- Proven leadership experience, with a track record of successfully leading real-time data engineering teams and delivering complex projects.
- Expertise in real-time data streaming technologies such as Apache Kafka, Apache Flink, or Apache Spark Streaming.
- Strong programming skills in languages such as Python, Java, or Scala, with experience in distributed computing frameworks.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and services like AWS Kinesis, Azure Stream Analytics, or Google Cloud Dataflow.
- Strong understanding of event-driven architecture and stream processing concepts, with experience building event-driven systems.
- Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex real-time data solutions.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
- Competitive salary: The industry standard salary for Lead Real-Time Data Engineers typically ranges from $200,000 to $300,000 per year, depending on experience and qualifications.
- Comprehensive benefits package, including health insurance, retirement plans, and wellness programs.
- Flexible work arrangements, including remote work options and flexible hours.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with opportunities for growth and advancement.
- Exciting projects with real-world impact at the forefront of data-driven innovation.
Join Us: Ready to lead the charge in real-time data engineering? Apply now to join our team and be part of the data revolution
-
Real-Time Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of real-time data engineering! At our company, we're dedicated to harnessing the power of real-time data to drive insights and enable real-time decision-making. Our mission is to develop scalable and efficient real-time data solutions that empower organizations to leverage data in...
-
Senior Real-Time Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join...
-
Lead Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...
-
Technical Lead, Data Engineering
7 days ago
San Francisco, California, United States Verantos Full timeOverviewVerantos ) is a leading provider of high-accuracy Real-World Evidence (RWE) generation services. Our RWE platform seamlessly integrates diverse real-world data sources and harnesses the precision required for regulatory and reimbursement purposes. Leveraging data science, artificial intelligence, and advanced data sources, such as Electronic Health...
-
Lead Cloud Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...
-
Lead Cloud Data Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms. Join us and lead...
-
Lead Cloud Data Engineer
7 days ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...
-
Lead Data Warehouse Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting, and business intelligence. Join us...
-
Lead Data Warehouse Engineer
7 days ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting, and business intelligence. Join us...
-
Lead Data Systems Engineer
6 days ago
San Francisco, United States Unreal Gigs Full timeJob Description Job Description Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join...
-
Lead Data Warehouse Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...
-
Lead Data Warehouse Engineer
9 hours ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...
-
Lead Data Systems Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....
-
Lead Data Systems Engineer
2 weeks ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and lead our efforts in...
-
Data Engineer
6 days ago
San Francisco, California, United States teamworkonline Full timeCompany OverviewSwish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for...
-
Senior Data Engineer
7 days ago
San Francisco, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
-
Lead Data Systems Engineer
3 days ago
San Francisco, CA, United States Unreal Gigs Full timeJob Description Job Description Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and...
-
Lead Data Engineer
5 days ago
San Francisco, United States Candid Health Full timeThe Role At Candid Health, we’re searching for our founding Lead Data Engineer to design, build, and support our next generation of data infrastructure. As a key strategic investment for the company and product, you will be working on highly impactful and visible outcomes. This is an opportunity to get in at the ground floor of designing and building...
-
Lead Data Engineer
6 days ago
San Francisco, California, United States Candid Health Full timeThe RoleAt Candid Health, we're searching for our founding Lead Data Engineer to design, build, and support our next generation of data infrastructure. As a key strategic investment for the company and product, you will be working on highly impactful and visible outcomes. This is an opportunity to get in at the ground floor of designing and building...
-
Lead Data Architect
5 days ago
San Francisco, United States Unreal Staffing, Inc Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data architecture solutions that enable efficient data management, storage, and analytics. Join us and lead our...
