Lead Data Architect
2 weeks ago
Company Overview:
Welcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence.
Position Overview:
As the Lead Data Engineer, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines. You'll lead a team of talented data engineers and collaborate closely with cross-functional teams to deliver end-to-end data solutions that support the needs of our data-driven organization.
Key Responsibilities:
- Technical Leadership: Provide guidance, mentorship, and technical leadership in data engineering best practices and technologies to a team of data engineers.
- Data Infrastructure Design: Lead the design and architecture of our data infrastructure, including data warehouses, data lakes, and data pipelines, ensuring scalability, reliability, and performance.
- Data Pipeline Development: Lead the development of scalable and efficient data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources.
- Data Modeling: Lead the design and implementation of data models and schemas to support analytical and operational requirements, ensuring data integrity, consistency, and performance.
- Data Governance: Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance with regulatory requirements.
- Performance Optimization: Lead efforts to optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
- Monitoring and Alerting: Lead the implementation of monitoring and alerting systems to track data pipeline performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
- Documentation and Best Practices: Define and promote best practices for data engineering, documentation, and usage, ensuring clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver data solutions that meet business needs.
- Mentorship and Development: Mentor junior engineers, providing guidance, support, and opportunities for growth and development in their data engineering careers.
Qualifications:
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
- 7+ years of experience in data engineering, with a focus on designing, building, and maintaining data infrastructure and pipelines.
- Leadership experience, with a demonstrated ability to lead and mentor a team of engineers.
- Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering frameworks and tools such as Apache Spark, Apache Kafka, Apache Airflow, or similar.
- Strong understanding of data modeling concepts and techniques, with experience designing and implementing data models and schemas for relational and non-relational databases.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based data services such as Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
- Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
- Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits:
- Competitive salary: The industry standard salary for Lead Data Engineers typically ranges from $200,000 to $300,000 per year, depending on experience and qualifications.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work hours and remote work options.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with opportunities for growth and advancement.
- Exciting projects with real-world impact at the forefront of data-driven innovation.
-
Lead Data Systems Architect
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Lead Data Systems EngineerUnreal Gigs is seeking a highly skilled and experienced Lead Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design, implementation, and optimization of our data systems infrastructure.Key Responsibilities:Provide technical leadership and...
-
Data Architect
3 days ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Data ArchitectUnreal Gigs is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet...
-
Lead Data Systems Architect
3 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Lead Data Systems EngineerUnreal Gigs is seeking a highly skilled and experienced Lead Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design, implementation, and optimization of our data systems infrastructure.Key Responsibilities:Technical Leadership: Provide strategic...
-
Senior Data Architect
3 weeks ago
San Francisco, California, United States Storm3 Full time{"title": "Data Architect/Engineer Lead - ML", "company": "Storm3", "location": "Remote within US", "job_type": "Full-time", "industry": "HealthTech", "job_description": "Principal QM Research Scientist / EngineerAI Drug Discovery Unicorn (Series B)Competitive base + hefty equityThis start-up is a leader in deep learning & generative AI, merging cutting-edge...
-
Cloud Data Architect Director
3 weeks ago
San Francisco, California, United States Cedent Consulting Full timeJob Title: Cloud Data Architect DirectorAt Cedent Consulting, we are seeking a highly skilled Cloud Data Architect Director to lead the development of our cloud-based data analytics platform.About the RoleAs a Cloud Data Architect Director, you will be responsible for designing and implementing a scalable and secure cloud-based data platform that meets the...
-
Data Architect DBT
7 days ago
San Francisco, California, United States CriticalRiver Inc Full timeJob Title: Data Architect DBTWe are seeking a highly skilled Data Architect DBT to join our team at CriticalRiver Inc. As a key player in shaping our data architecture strategies, you will drive innovative solutions and lead the charge in transforming data into actionable insights.Key Responsibilities:Implement and deploy net new pipelines in dbt for...
-
San Francisco, California, United States Cedent Consulting Inc Full timeJob Description:Job Title: Cloud Data Architect-DirectorCompany: Cedent Consulting IncJob Type: Full-timeLocation: Remote (with occasional travel)About the Role:We are seeking an experienced Cloud Data Architect-Director to lead the development of our cloud data platform. As a key member of our team, you will be responsible for designing and implementing...
-
Principal Data Architect
2 weeks ago
San Francisco, California, United States SmithRx Full timeTransforming Pharmacy Benefit Management with Data Engineering ExpertiseAt SmithRx, we're revolutionizing the pharmacy benefit management industry with cutting-edge technology and innovative solutions. As a Principal Data Engineer, you'll play a pivotal role in driving this transformation by designing and developing robust data architectures that support...
-
Senior Data Architect
4 weeks ago
San Francisco, California, United States Storm3 Full timeJob DescriptionCompany OverviewStorm3 is a leading HealthTech recruitment firm, serving clients across major Tech hubs in Europe, APAC, and North America.Job SummaryWe are seeking an experienced Data Architect/Engineer Lead - ML to join our fast-growing AI/ML team. This Lead will design and develop data model/lakehouse and work alongside ML architects &...
-
Cloud Data Architect Director
2 weeks ago
San Francisco, California, United States Cedent Consulting Full timeJob Title: Cloud Data Architect DirectorWe are seeking a highly skilled Cloud Data Architect Director to lead the architecture and build-out of our data analytics platform components using cloud technologies.Key Responsibilities:Architect and lead the build-out of platform on Azure & migration from on-prem systems.Understand the existing on-prem technology...
-
Cloud Data Architect Director
4 weeks ago
San Francisco, California, United States Cedent Consulting Full timeJob Summary:Cedent Consulting is seeking an experienced Cloud Data Architect Director to lead the build-out of our platform on Azure and migration from on-prem systems. The ideal candidate will have a strong understanding of cloud data platforms and services, as well as expertise in data modeling and data stores.Key Responsibilities:Architect and lead the...
-
Cloud Data Architect-Director
4 weeks ago
San Francisco, California, United States Cedent Consulting Inc Full timeJob DescriptionJob Title: Cloud Data Architect-DirectorCompany: Cedent Consulting IncJob Type: Full-timeDepartment: Direct ClientsJob SummaryWe are seeking a highly skilled Cloud Data Architect-Director to lead the architecture and build-out of our data analytics platform components using cloud technologies. As a key member of our team, you will work closely...
-
Azure Cloud Data Architect Director
2 weeks ago
San Francisco, California, United States Cedent Consulting Full timeCloud Data Architect DirectorCedent Consulting is seeking a highly skilled Cloud Data Architect Director to lead the build-out of our platform on Azure and migration from on-prem systems.Key Responsibilities:Architect and lead the build-out of our platform on AzureMigrate from on-prem systems to AzureUnderstand the existing on-prem technology landscape and...
-
Data Architect
3 weeks ago
San Francisco, California, United States Net2Source Inc. Full timeJob SummaryWe are seeking a highly skilled Data Architect to join our team at Net2Source Inc. as a Cloud Data Engineer. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems on the cloud.Key ResponsibilitiesDesign and implement data architectures that meet the needs of our...
-
Lead Real-Time Data Architect
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Lead Real-Time Data EngineerCompany OverviewWelcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. We're committed to harnessing the power of real-time data to drive transformative change and solve complex problems across industries.Job DescriptionAs the Lead Real-Time Data Engineer, you'll play a pivotal role in...
-
Azure Cloud Data Architect Director
3 weeks ago
San Francisco, California, United States Cedent Consulting Full timeCloud Data Architect DirectorWe are seeking a highly skilled Cloud Data Architect Director to lead the build-out of our platform on Azure and migration from on-prem systems. The ideal candidate will have a deep understanding of cloud data platforms and services, as well as expertise in data modeling and data storage solutions.Key Responsibilities:Design and...
-
Senior Data Architect
2 weeks ago
San Francisco, California, United States Storm3 Full timePrincipal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a leading HealthTech recruitment firm, partnering with innovative companies across the globe. We are seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop a...
-
Azure Cloud Data Architect-Director
4 weeks ago
San Francisco, California, United States Cedent Consulting Inc Full timeAzure Cloud Data Architect-Director Position at Cedent Consulting IncWe are seeking a highly skilled Azure Cloud Data Architect-Director to lead our cloud data strategy and implementation.Key Responsibilities:Design and implement large-scale data storage, compute, and distribution systems on Azure.Evaluate and recommend cloud data platforms and services,...
-
Lead Data Product Engineer
2 weeks ago
San Francisco, California, United States Jobot Full timeJob Title: Lead Data Product EngineerWe are seeking a highly skilled Lead Data Product Engineer to join our team at Jobot. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Job Summary:The Lead Data Product Engineer will lead the development of data products...
-
Azure Cloud Data Architect-Director
4 weeks ago
San Francisco, California, United States Cedent Consulting Inc Full timeAzure Cloud Data Architect-Director PositionCedent Consulting Inc is seeking a highly skilled Azure Cloud Data Architect-Director to lead the development of our cloud data platform.Key Responsibilities:Design and implement large-scale data storage, compute, and distribution systems on Azure.Evaluate and recommend cloud data platforms and services, such as...
