Senior Data Architect
2 days ago
At Unreal Gigs, we're committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines.
Key Responsibilities:- Big Data Infrastructure Design: Design, architect, and implement scalable and efficient big data infrastructure, including data lakes, data warehouses, and streaming data platforms, leveraging technologies such as Hadoop, Spark, Kafka, and more.
- Data Pipeline Development: Develop, deploy, and manage data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources, ensuring reliability, scalability, and performance.
- Data Modeling: Design and implement data models and schemas to support analytical and operational requirements, ensuring data integrity, consistency, and performance in a distributed environment.
- Data Integration: Integrate data from disparate sources and systems, ensuring data consistency, quality, and completeness throughout the data lifecycle.
- Performance Optimization: Optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
- Monitoring and Alerting: Implement monitoring and alerting systems to track big data platform performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
- Security and Compliance: Implement security controls and data governance policies to ensure data security, privacy, and compliance with regulatory requirements.
- Documentation and Best Practices: Document big data infrastructure and pipelines, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver big data solutions that meet business needs.
- Mentorship and Leadership: Mentor junior engineers, providing guidance, support, and technical leadership in big data engineering best practices and technologies.
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
- 5+ years of experience in big data engineering, with a focus on designing, building, and maintaining big data infrastructure and pipelines.
- Proficiency in programming languages such as Java, Scala, or Python, and experience with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, and more.
- Strong understanding of distributed systems and parallel processing, with experience designing and optimizing data pipelines for performance and scalability.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based big data services such as Amazon EMR, Azure HDInsight, or Google Dataproc.
- Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
- Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
- Competitive salary: The industry standard salary for Senior Big Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work hours and remote work options.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with opportunities for growth and advancement.
- Exciting projects with real-world impact at the forefront of big data innovation.
-
Senior Data Architect
15 hours ago
San Francisco, California, United States Futran Tech Solutions Pvt. Ltd. Full timeJob Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have a strong background in data engineering and a proven track record of designing and implementing large-scale data architectures.Key Responsibilities:* Design and implement data architectures...
-
Senior Data Architect
15 hours ago
San Francisco, California, United States Storm3 Full timeData Architect/Engineering Lead - AI/MLStorm3 is seeking an experienced Data Architect/Engineering Lead to join their fast-growing AI/ML team. This role will design and develop data model/lakehouse and work alongside ML architects/scientists to scale data curation and pipelines for ML on a modern tech stack.Responsibilities:Design, implement, and support...
-
Senior Data Systems Architect
3 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Senior Data Systems EngineerCompany Overview:Welcome to Unreal Gigs, a leading company at the forefront of data-driven innovation. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management,...
-
Senior Data Architect
1 month ago
San Francisco, California, United States Storm3 Full time{"title": "Data Architect/Engineer Lead - ML", "company": "Storm3", "location": "Remote within US", "job_type": "Full-time", "industry": "HealthTech", "job_description": "Principal QM Research Scientist / EngineerAI Drug Discovery Unicorn (Series B)Competitive base + hefty equityThis start-up is a leader in deep learning & generative AI, merging cutting-edge...
-
Senior Data Architect
3 days ago
San Francisco, California, United States Storm3 Full timeData Architect/Engineering Lead - MLAI Drug Discovery PioneerRemote OpportunityCompetitive Compensation PackageStorm3 is a HealthTech recruitment firm partnering with a cutting-edge start-up in the field of deep learning and generative AI. This innovative company is merging advanced models with biology research to accelerate disease treatment and drug...
-
Senior Data Systems Architect
4 weeks ago
San Francisco, California, United States Unreal Gigs Full timeUnreal GigsWelcome to the forefront of data-driven innovation. Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries.Job OverviewAs a Senior Data Systems Engineer, you'll play a critical role in designing, building, and optimizing our data systems infrastructure. You'll work on...
-
Senior Data Systems Architect
1 day ago
San Francisco, California, United States Unreal Gigs Full timeCompany OverviewWelcome to Unreal Gigs, a leading innovator in data-driven solutions. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries.We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Our team of experts is dedicated to...
-
Senior Data Systems Architect
3 weeks ago
San Francisco, California, United States Unreal Gigs Full timeCompany OverviewWelcome to Unreal Gigs, a leading innovator in data-driven solutions. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries.We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Our team of experts is dedicated to...
-
Senior Data Systems Architect
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeSenior Data Systems EngineerUnreal Gigs is seeking a highly skilled Senior Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and optimizing our data systems infrastructure.Key Responsibilities:Design and implement scalable and reliable data systems architecture to support...
-
Senior Data Architect
2 days ago
San Jose, California, United States DESIGNLIBRO INC Full timeJob DescriptionWe are seeking a highly skilled Senior Data Engineer/Data Engineering Architect to join our team at DESIGNLIBRO INC.Key ResponsibilitiesDesign and implement robust data systems that collect, process, and store large volumes of data from IoT devices.Collaborate with product owners to translate data requirements into actionable data engineering...
-
Senior Data Architect
2 days ago
San Francisco, California, United States Veterans Sourcing Group Full time{"title": "Data Engineer", "description": "Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data pipelines to extract,...
-
Data Architect
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Data ArchitectUnreal Gigs is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet...
-
Senior Big Data Architect
18 hours ago
San Francisco, California, United States Unreal Gigs Full timeUnlock the Power of Big DataWelcome to Unreal Gigs, where we're harnessing the potential of big data to drive innovation and solve complex problems. As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Big Data Infrastructure Design: Design, architect,...
-
Senior Field Architect
4 weeks ago
San Francisco, California, United States Cyod Full timeSenior Field ArchitectAt Cyod, we're seeking a highly skilled Senior Field Architect to join our team. As a Senior Field Architect, you will play a critical role in driving business growth and delivering exceptional customer experiences.Key Responsibilities:Develop and maintain strong technical relationships with pre-assigned accounts.Collaborate with...
-
Data Architect
24 hours ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Data ArchitectAt Unreal Gigs, we're seeking a skilled Data Architect to join our team. As a Data Architect, you'll play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet business...
-
Senior Data Architect
3 weeks ago
San Francisco, California, United States Storm3 Full timePrincipal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a leading HealthTech recruitment firm, partnering with innovative companies across the globe. We are seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop a...
-
Senior Systems Architect
3 weeks ago
San Francisco, California, United States VAST Data Full timeAbout the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry.As a key member of our team, you will play a crucial role in shaping the future of data storage solutions.Key...
-
Senior Field Architect
3 weeks ago
San Francisco, California, United States Insight Enterprises, Inc. Full timeJob Title: Senior Field ArchitectAt Insight Enterprises, we're seeking a highly skilled Senior Field Architect to join our team. As a Senior Field Architect, you will play a critical role in helping our clients navigate complex digital decisions and achieve extraordinary results.Key Responsibilities:Develop proposals and high-level designs with input from...
-
Senior Data Architect
4 weeks ago
San Francisco, California, United States Storm3 Full timePrincipal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a HealthTech recruitment firm that connects top talent with innovative companies. We're seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop data lakehouse...
-
Senior Field Architect
4 weeks ago
San Francisco, California, United States Insight Enterprises Inc Full timeUnlock Your Potential as a Senior Field ArchitectAt Insight Enterprises Inc, we're on a mission to accelerate transformation by unlocking the power of people and technology. As a Senior Field Architect, you'll play a critical role in helping our clients achieve extraordinary results.Key Responsibilities:Develop and maintain technical relationships with key...