Data Architecture Specialist

3 weeks ago

San Francisco, California, United States ZipRecruiter Full time
Job Summary

We are seeking a highly skilled Data Architecture Specialist to join our team at ZipRecruiter. The successful candidate will be responsible for designing and implementing high-performance data systems that empower analytics and support advanced data processing needs.

This is an exceptional opportunity for a motivated individual with a passion for big data technologies, distributed systems, and cloud infrastructure. As a Data Architecture Specialist, you will collaborate with data scientists, analysts, and software engineers to align big data architecture with analytics goals.

Key Responsibilities:
  • Data Pipeline Design and Development: Architect and implement scalable data pipelines for ETL processes using tools like Apache Spark, Kafka, and Hadoop. Create data workflows that handle high-volume, high-velocity data and ensure seamless integration across systems.
  • Optimization of Big Data Storage and Processing: Develop and manage data storage solutions (e.g., HDFS, S3, Cassandra) that are optimized for performance and cost-efficiency. Configure distributed processing systems to support efficient data retrieval and transformation.
  • Data Strategy and Integration: Work closely with data scientists, analysts, and other engineers to align big data architecture with analytics goals. Ensure data availability and integrity across systems to support business objectives.
  • Data Quality and Governance Standards: Develop processes and tools to monitor data quality and enforce data governance policies. Ensure data is accurate, reliable, and secure through regular checks and validation processes.
  • Automation of Data Workflows: Use tools like Apache Airflow or AWS Glue to automate data workflows and reduce manual processing. Implement scripts and automation that streamline data handling and improve efficiency.
  • System Monitoring and Troubleshooting: Use monitoring tools to track system performance and address issues proactively. Troubleshoot and resolve any bottlenecks or failures to maintain optimal data processing capabilities.
RequirementsRequired Skills and Qualifications:
  • Big Data Platform Proficiency: Extensive experience with big data technologies such as Apache Spark, Hadoop, Kafka, and Hive. Skilled at handling high-volume data and distributed processing.
  • Data Pipeline and ETL Knowledge: Proven ability to design, build, and maintain ETL processes for massive datasets. Can handle both real-time and batch data processing requirements.
  • Programming and Scripting: Proficiency in programming like Python, Java, or Scala for data processing and automation. Experience with SQL for data querying and manipulation is essential.
  • Cloud Data Services Expertise: Familiarity with cloud platforms such as AWS, GCP, or Azure, including their big data and storage services (e.g., S3, BigQuery, Azure Data Lake).
  • Data Quality and Governance: Strong understanding of data quality standards and governance practices, with experience in implementing data validation and monitoring frameworks.
Educational Requirements:
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field. Equivalent experience in data engineering or big data management may be considered.
  • Certifications in big data or cloud technologies (e.g., Cloudera Certified Data Engineer, AWS Certified Big Data – Specialty, Google Professional Data Engineer) are a plus.
Experience Requirements:
  • 5+ years of experience in data engineering, with at least 3+ years focusing on big data technologies and high-scale data environments.
  • Experience in distributed systems and large-scale data storage management.
  • Familiarity with containerization (Docker, Kubernetes) for deploying data processing environments is advantageous.
Benefits and Perks:
  • Competitive Salary: $140,000 - $160,000 per year, depending on experience.
  • Health and Wellness: Comprehensive medical, dental, and vision insurance plans with low co-pays and premiums.
  • Paid Time Off: Competitive vacation, sick leave, and 20 paid holidays per year.
  • Work-Life Balance: Flexible work schedules and telecommuting options.
  • Professional Development: Opportunities for training, certification reimbursement, and career advancement programs.
  • Wellness Programs: Access to wellness programs, including gym memberships, health screenings, and mental health resources.
  • Life and Insurance: Life insurance and short-term/long-term coverage.
  • Employee Assistance Program (EAP): Confidential counseling and support services for personal and professional challenges.
  • Tuition Reimbursement: Financial assistance for continuing education and professional development.
  • Community Engagement: Opportunities to participate in community service and volunteer activities.
  • Recognition Programs: Employee recognition programs to celebrate achievements and milestones.

  • Data Architectural Specialist

    2 weeks ago

    San Francisco, California, United States Hasura Inc. Full time

    Job OverviewWe are seeking an experienced Data Architectural Specialist to join our team at Hasura Inc.This role involves working on the future of data-access and GraphQL, helping developers build great products, and contributing to a globally distributed network of API and data connectivity servers.

  • Data Architecture Specialist

    4 weeks ago

    San Francisco, California, United States Saxon Global Full time

    About Saxon GlobalSaxon Global is a leading provider of enhanced IT consulting and engineering solution services. With 16 years of experience, the company specializes in Business Intelligence, Mobility, Big Data & Cloud solutions.Job OverviewWe are seeking a highly skilled Architect/Senior Engineer to join our team on a 6+ month contract basis. The...

  • Director of Enterprise Data Architecture

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Description: Unreal Gigs is seeking an experienced Director of Enterprise Data Architecture to lead our data architecture initiatives and drive the design, implementation, and optimization of our data architecture solutions.As a seasoned professional with expertise in data architecture technologies, you will provide technical leadership to a team of...

  • Data Architecture Leader

    2 weeks ago

    San Francisco, California, United States Meltwater Full time

    Data Architecture LeadershipMeltwater seeks a seasoned Senior/Lead Data Solution Engineer to drive the design and implementation of scalable data solutions, leveraging expertise in Snowflake, AWS RDS, and data modeling.Key Responsibilities:Design and implement innovative, scalable data solutions using cloud platforms.Oversee data integration with third-party...

  • Data Architecture Expert

    3 weeks ago

    San Francisco, California, United States USM Business Systems Full time

    Job DescriptionSenior Data Modeler/Data Architect + Big Data/HadoopAbout the RoleThis highly technical and hands-on position is an integral part of the Digital Insights & Architecture team within USM Business Systems. The successful candidate will lead the design, implementation, and support of data architecture deliverables for multiple projects.The role...

  • Healthcare Architectural Specialist

    4 weeks ago

    San Francisco, California, United States SmithGroup Full time

    We are committed to creating exceptional design solutions that meet the unique needs of our clients. Our teams work collaboratively to develop innovative designs that incorporate cutting-edge research, data-driven insights, and technological advancements. At SmithGroup, we believe in fostering a culture of creativity, experimentation, and continuous...

  • Data Architecture Leader

    3 weeks ago

    San Francisco, California, United States Rippling Full time

    About RipplingRippling revolutionizes the way businesses manage their workforce by bringing together HR, IT, and Finance in one platform. The Data Platform team is at the forefront of this innovation, designing high-performance systems that enable advanced HR applications.The role of a Senior Staff Software Engineer at Rippling is to lead the charge in...

  • Senior Data Infrastructure Specialist

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Senior Data Infrastructure SpecialistOverview: Unreal Gigs is seeking a senior data infrastructure specialist to lead our data architecture initiatives. As the Senior Data Infrastructure Specialist, you'll drive the design, implementation, and optimization of our data architecture solutions. This is a unique opportunity to join a forward-thinking...

  • Distributed Architecture Specialist

    3 weeks ago

    San Francisco, California, United States WEX Full time

    Role SummaryWe are seeking a Distributed Architecture Specialist to join our team at WEX. As a senior Java software engineer, you will design, develop, and maintain highly scalable microservices and event-driven architectures for our high-volume systems.Key ResponsibilitiesDesign and develop high-throughput and low-latency microservices in a cloud-native...

  • Data Architecture Developer

    3 weeks ago

    South San Francisco, California, United States Cellares Full time

    About this Role:Join Cellares as a key member of our team and contribute to the development of our cutting-edge cell therapy manufacturing platform.Design and implement robust data pipelines and architectures using cloud-based technologiesDevelop scalable and efficient data solutions in collaboration with cross-functional teamsLeverage expertise in data...

  • Data Platform Systems Architect

    1 month ago

    San Francisco, California, United States VAST Data Full time

    About VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...

  • Data Engineering Specialist

    3 weeks ago

    San Francisco, California, United States United Software Group Full time

    Job Description: Data Engineering SpecialistUnited Software Group is seeking a highly experienced Data Engineering Specialist to join our team in San Francisco, CA. As a key member of our engineering team, you will be responsible for designing and implementing data pipelines and architectures that support our AI solutions.Estimated Salary: $120,000 -...

  • Distinguished Data Architecture Lead

    3 weeks ago

    San Francisco, California, United States Rippling Full time

    Data Architectural Visionary - Scalable Engineering SolutionsAbout the Future of WorkRippling revolutionizes the way businesses manage their workforce by integrating HR, IT, and Finance in a single platform. Our cutting-edge technology streamlines employee onboarding, payroll, benefits, and computer setup, making it easier for companies to thrive...

  • Enterprise Data Infrastructure Leader

    4 days ago

    San Francisco, California, United States VAST Data Full time

    Company Overview:VAST Data is a leading provider of data management solutions for the AI era. Our mission is to revolutionize data infrastructure by providing real-time data analysis and AI training capabilities.We are looking for a talented Sales Director to join our team and drive growth through strategic partnerships. The ideal candidate will have a...

  • Software Architecture Specialist

    3 weeks ago

    San Francisco, California, United States Mem Protocol Full time

    At Mem Protocol, we are seeking a highly skilled Software Architecture Specialist to join our team.As a key member of our team, you will be responsible for designing and implementing efficient networked systems that meet the highest standards of uptime, efficiency, and latency.About this roleThis is a unique opportunity to work with our experienced team of...

  • Data Architecture Strategist

    3 days ago

    San Diego, California, United States Slalom Consulting Full time

    As a modern technology company, Slalom Consulting enables organizations to redefine what's possible and build the future. We blend design, engineering, and analytics expertise to deliver practical solutions that drive meaningful impact.About the RoleWe are seeking a skilled Data Sales Solution Leader with demonstrated proficiency in cloud platforms, data...

  • Architectural Development Specialist

    5 days ago

    San Francisco, California, United States Rapt Studio Full time

    Design Expertise:Rapt Studio is a design and strategy studio that partners with leading brands to create innovative solutions that drive business growth and success. As an Architectural Development Specialist, you will be responsible for developing and implementing architectural designs that meet our clients' needs and exceed their expectations.Your Key...

  • Technical Architecture Specialist

    3 days ago

    San Francisco, California, United States Salesforce Inc Full time

    Salesforce is a company that's passionate about making a positive impact on the world. As a Technical Architecture Specialist, you'll have the opportunity to work on some of the most exciting and challenging projects in the industry.You'll partner with service teams to understand and address their challenges, actively participating in meetings, sprint...

  • Data Integration Specialist

    3 weeks ago

    San Francisco, California, United States unitQ Full time

    About the RoleAs a Data Integration Specialist at unitQ, you will play a critical role in empowering companies to revolutionize their approach to product quality management. You will work directly with customers to integrate our platform into existing workflows, coordinating with Engineering & Operations teams to ensure timely delivery of data connectors.The...

  • Senior Data Infrastructure Specialist

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    About the Role">We are seeking a highly skilled Senior Data Infrastructure Specialist to join our team at Unreal Gigs. As a key member of our data architecture team, you will be responsible for designing and implementing scalable, high-performance data infrastructure solutions that meet the needs of our business analytics, data science, and operational...