Data Infrastructure Architect

13 hours ago

San Francisco, California, United States Unreal Gigs Full time
Job Title: Data Infrastructure Architect

We're seeking a skilled Data Infrastructure Architect to design, develop, and optimize our data systems. As a key member of our team, you'll be responsible for constructing efficient, scalable data pipelines, ensuring data is accessible and usable for analysts, data scientists, and business stakeholders.

Key Responsibilities:

  • Design and Develop Data Pipelines:
    • Build and maintain robust, scalable, and efficient data pipelines to ingest, process, and store data from a variety of sources.
  • Data Warehouse Management:
    • Architect and maintain data warehouses or data lakes using cloud platforms (e.g., AWS Redshift, Google BigQuery, or Snowflake) to organize and store large-scale datasets.
  • Collaborate with Data Scientists and Analysts:
    • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver datasets that meet business needs.
  • Data Quality and Governance:
    • Implement data quality checks and monitoring systems to ensure the accuracy, completeness, and consistency of data across the pipeline.
  • Performance Optimization:
    • Optimize the performance of data systems, ensuring fast and reliable data access.
  • Automation and Monitoring:
    • Automate data workflows, pipeline deployments, and data quality checks to minimize manual intervention.
  • Data Security and Compliance:
    • Implement security protocols to protect sensitive data, ensuring compliance with relevant regulations such as GDPR, HIPAA, or SOC2.

Requirements:

Required Skills:

  • Data Engineering Expertise: Strong experience building and maintaining data pipelines, ETL processes, and data warehouses using cloud platforms (AWS, GCP, Azure).
  • Programming and Scripting: Proficiency in languages such as Python, SQL, or Scala, and experience with data engineering tools like Apache Spark, Airflow, or Kafka.
  • Data Warehousing and Storage: Expertise in managing and optimizing data warehouses or data lakes (e.g., Redshift, BigQuery, Snowflake).
  • Database and Query Optimization: Strong knowledge of database design and query optimization for performance.
  • Data Governance and Security: Solid understanding of data governance practices, security protocols, and compliance regulations.

Educational Requirements:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • Certifications in cloud platforms (AWS, GCP, Azure) or data engineering technologies (e.g., Apache Hadoop, Apache Spark) are a plus.

Experience Requirements:

  • 3+ years of experience in data engineering, with hands-on experience building and managing data pipelines, data warehouses, and cloud-based storage solutions.
  • Proven experience working with big data technologies and distributed systems, optimizing data flows and processes to handle large datasets.
  • Familiarity with data quality, data governance, and data security best practices is highly desirable.

Benefits:

  • Health and Wellness: Comprehensive medical, dental, and vision insurance plans with low co-pays and premiums.
  • Paid Time Off: Competitive vacation, sick leave, and 20 paid holidays per year.
  • Work-Life Balance: Flexible work schedules and telecommuting options.
  • Professional Development: Opportunities for training, certification reimbursement, and career advancement programs.
  • Wellness Programs: Access to wellness programs, including gym memberships, health screenings, and mental health resources.
  • Life and Disability Insurance: Life insurance and short-term/long-term disability coverage.
  • Employee Assistance Program (EAP): Confidential counseling and support services for personal and professional challenges.
  • Tuition Reimbursement: Financial assistance for continuing education and professional development.
  • Community Engagement: Opportunities to participate in community service and volunteer activities.
  • Recognition Programs: Employee recognition programs to celebrate achievements and milestones.

  • Data Infrastructure Engineer

    1 month ago

    San Francisco, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a highly skilled Data Infrastructure Engineer to join our team at Acceler8 Talent. As a key member of our data infrastructure team, you will play a crucial role in designing, implementing, and optimizing scalable systems to handle vast amounts of data for AI training.This role demands close collaboration with our data research...

  • Data Infrastructure Architect

    3 weeks ago

    San Francisco, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a highly skilled Data Infrastructure Engineer to join our team at Acceler8 Talent. As a key member of our organization, you will play a pivotal role in designing and building a robust infrastructure that can handle and process petabytes of data efficiently.This role demands a proactive approach to developing scalable systems that...

  • Database Infrastructure Architect

    4 weeks ago

    San Francisco, California, United States Unum Full time

    About UnumWe're a deep-tech startup revolutionizing data management for extreme scale and AI applications.Job DescriptionWe're seeking a skilled Database Infrastructure Architect to join our team and design next-generation data infrastructure.Key ResponsibilitiesOrchestrate software development and hardware management for our cutting-edge data...

  • Database Infrastructure Architect

    3 weeks ago

    San Francisco, California, United States Unum Full time

    About UnumWe're a deep-tech startup revolutionizing data management for extreme scale and AI applications.Job DescriptionWe're seeking a skilled Database Infrastructure Architect to join our team and design next-generation data infrastructure.Key ResponsibilitiesOrchestrate software development and hardware management for our cutting-edge data...

  • Data Infrastructure Architect

    2 days ago

    San Francisco, California, United States Replicate Full time

    About the RoleWe're seeking a talented Data Engineer to join our team at Replicate. As a key member of our data infrastructure team, you'll be responsible for designing, building, and maintaining our data systems.Key ResponsibilitiesDesign and implement scalable data infrastructure to support our business needsDevelop and maintain high-quality data pipelines...

  • Machine Learning Infrastructure Architect

    19 hours ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Machine Learning Infrastructure ArchitectAt Unreal Gigs, we're seeking a highly skilled Machine Learning Infrastructure Architect to join our team. As a key member of our infrastructure team, you'll be responsible for designing, building, and optimizing our machine learning infrastructure to support the needs of our organization.Key...

  • Big Data Architect

    23 hours ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Big Data ArchitectAt Unreal Gigs, we're seeking a highly skilled Big Data Architect to join our team. As a key member of our data engineering team, you'll be responsible for designing and building scalable and reliable big data infrastructure and platforms.Key Responsibilities:Design and architect big data infrastructure and platforms, including...

  • Data Systems Architect

    12 hours ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data Systems ArchitectAt Unreal Gigs, we're seeking a highly skilled Data Systems Architect to join our team. As a key member of our data engineering team, you'll be responsible for designing and architecting scalable and resilient data systems infrastructure to meet business requirements and support data processing and analytics needs.Key...

  • Senior Infrastructure Architect

    2 months ago

    San Francisco, California, United States Inngest Inc Full time

    About the RoleInngest Inc is revolutionizing the way developers approach queueing, event-driven systems, and step functions. As a Senior Infrastructure Architect, you'll play a critical role in shaping the company's infrastructure and architecture.Key ResponsibilitiesCollaborate with engineers to design and architect core systems, including message streams,...

  • Data Infrastructure Engineer

    11 hours ago

    San Francisco, California, United States Acceler8 Talent Full time

    Job Overview:We are a technology company focused on enhancing the partnership between humans and computers to achieve groundbreaking advancements. Our approach spans from user experience to model optimization, aiming to maximize user value per computational effort.About the Company:We are a small, driven team committed to making significant strides in...

  • Principal Enterprise Architect

    1 month ago

    San Francisco, California, United States Equinix, Inc. Full time

    About the RoleWe are seeking a highly skilled Principal Enterprise Architect to join our team at Equinix, Inc. The ideal candidate will have a strong understanding of digital infrastructure and go-to-market solutions, with a proven track record of designing and implementing end-to-end solutions.Key ResponsibilitiesEstablish the role of the Enterprise...

  • IT Infrastructure Architect

    3 weeks ago

    San Francisco, California, United States TRUGlobal Full time

    Job Title: Windows ArchitectWe are seeking a skilled Windows Architect to join our team at TRUGlobal. As a key member of our IT department, you will play a crucial role in designing and implementing IT architecture solutions that align with our business goals.Key Responsibilities:Assist in the design and implementation of IT architecture solutions that meet...

  • IT Infrastructure Architect

    3 weeks ago

    San Diego, California, United States Inocras Inc. Full time

    Job Title: IT Infrastructure ArchitectWe are seeking an experienced IT Infrastructure Architect to join our team at Inocras Inc. in San Diego, CA.About the Role:The successful candidate will be responsible for designing, implementing, and managing our company's IT infrastructure, including network, server, and cloud systems. This is a critical role that...

  • Cloud Infrastructure Architect

    1 month ago

    San Francisco, California, United States Equinix, Inc. Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Architect to join our team at Equinix, Inc. As a key member of our Edge Infra team, you will be responsible for driving the innovation, design, implementation, and improvement of large-scale systems with critical uptime requirements.Key ResponsibilitiesDrive execution of at least one major...

  • Cloud Infrastructure Architect

    1 month ago

    San Francisco, California, United States Equinix, Inc. Full time

    About the RoleWe are seeking a highly skilled and experienced Cloud Infrastructure Architect to join our team at Equinix, Inc. As a key member of our Edge Infra team, you will be responsible for driving the innovation, design, implementation, and improvement of large-scale systems with critical uptime requirements.Key ResponsibilitiesDrive execution of at...

  • Infrastructure Connectivity Architect

    4 weeks ago

    San Francisco, California, United States Cloudflare Inc Full time

    About CloudflareCloudflare is a mission-driven company that helps build a better Internet. We run one of the world's largest networks, powering millions of websites and Internet properties for customers ranging from individual bloggers to Fortune 500 companies. Our network protects and accelerates any Internet application online without adding hardware,...

  • Senior Data Architect

    11 hours ago

    San Francisco, California, United States Storm3 Full time

    Data Architect/Engineering Lead - AI/MLStorm3 is seeking an experienced Data Architect/Engineering Lead to join their fast-growing AI/ML team. This role will design and develop data model/lakehouse and work alongside ML architects/scientists to scale data curation and pipelines for ML on a modern tech stack.Responsibilities:Design, implement, and support...

  • Big Data Architect

    13 hours ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a visionary Big Data Architect to spearhead the design and construction of our cutting-edge data solutions. As a key member of our team, you will be responsible for crafting the blueprint for tomorrow's innovations, leveraging colossal data sets to solve real-world problems.Key Responsibilities:Architect and refine our big...

  • Cloud Infrastructure Architect

    1 month ago

    San Francisco, California, United States CloudFlare Full time

    About the RoleCloudflare is seeking an experienced Cloud Infrastructure Architect to join our team. As a key member of our Infrastructure Team, you will be responsible for designing and implementing scalable, secure, and highly available cloud infrastructure solutions to support our rapidly growing business.Key ResponsibilitiesDesign and implement cloud...

  • Cloud Infrastructure Architect

    1 month ago

    San Francisco, California, United States Sigmaways Inc Full time

    About the RoleSigmaways Inc is seeking a highly skilled Cloud Infrastructure Architect to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud-based infrastructure systems.Key ResponsibilitiesDevelop and maintain Infrastructure as Code (IaC) using Terraform to launch server...