Senior Data Architect

2 days ago

San Francisco, California, United States Unreal Gigs Full time
Senior Big Data Engineer

At Unreal Gigs, we're committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines.

Key Responsibilities:
  • Big Data Infrastructure Design: Design, architect, and implement scalable and efficient big data infrastructure, including data lakes, data warehouses, and streaming data platforms, leveraging technologies such as Hadoop, Spark, Kafka, and more.
  • Data Pipeline Development: Develop, deploy, and manage data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources, ensuring reliability, scalability, and performance.
  • Data Modeling: Design and implement data models and schemas to support analytical and operational requirements, ensuring data integrity, consistency, and performance in a distributed environment.
  • Data Integration: Integrate data from disparate sources and systems, ensuring data consistency, quality, and completeness throughout the data lifecycle.
  • Performance Optimization: Optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
  • Monitoring and Alerting: Implement monitoring and alerting systems to track big data platform performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
  • Security and Compliance: Implement security controls and data governance policies to ensure data security, privacy, and compliance with regulatory requirements.
  • Documentation and Best Practices: Document big data infrastructure and pipelines, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  • Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver big data solutions that meet business needs.
  • Mentorship and Leadership: Mentor junior engineers, providing guidance, support, and technical leadership in big data engineering best practices and technologies.
Qualifications:
  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 5+ years of experience in big data engineering, with a focus on designing, building, and maintaining big data infrastructure and pipelines.
  • Proficiency in programming languages such as Java, Scala, or Python, and experience with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, and more.
  • Strong understanding of distributed systems and parallel processing, with experience designing and optimizing data pipelines for performance and scalability.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based big data services such as Amazon EMR, Azure HDInsight, or Google Dataproc.
  • Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
  • Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits:
  • Competitive salary: The industry standard salary for Senior Big Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of big data innovation.

  • Senior Data Architect

    15 hours ago

    San Francisco, California, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have a strong background in data engineering and a proven track record of designing and implementing large-scale data architectures.Key Responsibilities:* Design and implement data architectures...

  • Senior Data Architect

    15 hours ago

    San Francisco, California, United States Storm3 Full time

    Data Architect/Engineering Lead - AI/MLStorm3 is seeking an experienced Data Architect/Engineering Lead to join their fast-growing AI/ML team. This role will design and develop data model/lakehouse and work alongside ML architects/scientists to scale data curation and pipelines for ML on a modern tech stack.Responsibilities:Design, implement, and support...

  • Senior Data Systems Architect

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Senior Data Systems EngineerCompany Overview:Welcome to Unreal Gigs, a leading company at the forefront of data-driven innovation. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management,...

  • Senior Data Architect

    1 month ago

    San Francisco, California, United States Storm3 Full time

    {"title": "Data Architect/Engineer Lead - ML", "company": "Storm3", "location": "Remote within US", "job_type": "Full-time", "industry": "HealthTech", "job_description": "Principal QM Research Scientist / EngineerAI Drug Discovery Unicorn (Series B)Competitive base + hefty equityThis start-up is a leader in deep learning & generative AI, merging cutting-edge...

  • Senior Data Architect

    3 days ago

    San Francisco, California, United States Storm3 Full time

    Data Architect/Engineering Lead - MLAI Drug Discovery PioneerRemote OpportunityCompetitive Compensation PackageStorm3 is a HealthTech recruitment firm partnering with a cutting-edge start-up in the field of deep learning and generative AI. This innovative company is merging advanced models with biology research to accelerate disease treatment and drug...

  • Senior Data Systems Architect

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal GigsWelcome to the forefront of data-driven innovation. Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries.Job OverviewAs a Senior Data Systems Engineer, you'll play a critical role in designing, building, and optimizing our data systems infrastructure. You'll work on...

  • Senior Data Systems Architect

    1 day ago

    San Francisco, California, United States Unreal Gigs Full time

    Company OverviewWelcome to Unreal Gigs, a leading innovator in data-driven solutions. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries.We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Our team of experts is dedicated to...

  • Senior Data Systems Architect

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Company OverviewWelcome to Unreal Gigs, a leading innovator in data-driven solutions. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries.We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Our team of experts is dedicated to...

  • Senior Data Systems Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Senior Data Systems EngineerUnreal Gigs is seeking a highly skilled Senior Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and optimizing our data systems infrastructure.Key Responsibilities:Design and implement scalable and reliable data systems architecture to support...

  • Senior Data Architect

    2 days ago

    San Jose, California, United States DESIGNLIBRO INC Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer/Data Engineering Architect to join our team at DESIGNLIBRO INC.Key ResponsibilitiesDesign and implement robust data systems that collect, process, and store large volumes of data from IoT devices.Collaborate with product owners to translate data requirements into actionable data engineering...

  • Senior Data Architect

    2 days ago

    San Francisco, California, United States Veterans Sourcing Group Full time

    {"title": "Data Engineer", "description": "Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data pipelines to extract,...

  • Data Architect

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data ArchitectUnreal Gigs is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet...

  • Senior Big Data Architect

    18 hours ago

    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of Big DataWelcome to Unreal Gigs, where we're harnessing the potential of big data to drive innovation and solve complex problems. As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Big Data Infrastructure Design: Design, architect,...

  • Senior Field Architect

    4 weeks ago

    San Francisco, California, United States Cyod Full time

    Senior Field ArchitectAt Cyod, we're seeking a highly skilled Senior Field Architect to join our team. As a Senior Field Architect, you will play a critical role in driving business growth and delivering exceptional customer experiences.Key Responsibilities:Develop and maintain strong technical relationships with pre-assigned accounts.Collaborate with...

  • Data Architect

    24 hours ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data ArchitectAt Unreal Gigs, we're seeking a skilled Data Architect to join our team. As a Data Architect, you'll play a critical role in designing, building, and maintaining our data architecture to support the needs of our organization.Key Responsibilities:Design and architect scalable and efficient data architecture solutions to meet business...

  • Senior Data Architect

    3 weeks ago

    San Francisco, California, United States Storm3 Full time

    Principal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a leading HealthTech recruitment firm, partnering with innovative companies across the globe. We are seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop a...

  • Senior Systems Architect

    3 weeks ago

    San Francisco, California, United States VAST Data Full time

    About the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry.As a key member of our team, you will play a crucial role in shaping the future of data storage solutions.Key...

  • Senior Field Architect

    3 weeks ago

    San Francisco, California, United States Insight Enterprises, Inc. Full time

    Job Title: Senior Field ArchitectAt Insight Enterprises, we're seeking a highly skilled Senior Field Architect to join our team. As a Senior Field Architect, you will play a critical role in helping our clients navigate complex digital decisions and achieve extraordinary results.Key Responsibilities:Develop proposals and high-level designs with input from...

  • Senior Data Architect

    4 weeks ago

    San Francisco, California, United States Storm3 Full time

    Principal QM Research Scientist / EngineerAI Drug Discovery ExpertRemote OpportunityCompetitive CompensationStorm3 is a HealthTech recruitment firm that connects top talent with innovative companies. We're seeking an experienced Data Architect/Engineer Lead to join our client's fast-growing AI/ML team.Key Responsibilities:Design and develop data lakehouse...

  • Senior Field Architect

    4 weeks ago

    San Francisco, California, United States Insight Enterprises Inc Full time

    Unlock Your Potential as a Senior Field ArchitectAt Insight Enterprises Inc, we're on a mission to accelerate transformation by unlocking the power of people and technology. As a Senior Field Architect, you'll play a critical role in helping our clients achieve extraordinary results.Key Responsibilities:Develop and maintain technical relationships with key...