Hadoop Infrastructure Architect

5 days ago


Foster City, California, United States Maintec Technologies Full time
Job Description:

Hadoop Infrastructure Architect - Foster City, CA

About the Role:
Responsible for implementation and ongoing administration of Hadoop infrastructure. This includes cluster maintenance, troubleshooting, monitoring, and backup and recovery strategies. The ideal candidate will have experience with EMR and EKS clusters, as well as Prometheus, Grafana, and Splunk for infrastructure monitoring and logging.

Responsibilities:
• Provisioning and managing the life cycle of multiple clusters
• Infrastructure monitoring, logging, and alerting
• Performance tuning of Hadoop clusters and workloads
• Responsible for memory management, queue allocation, and distribution experience in Hadoop/Cloud era environments
• Investigates and analyzes new technical possibilities, tools, and techniques that reduce complexity and create better technical solutions
• Collaborating with application teams to install operating system and Hadoop updates, patches, and version upgrades
• Maintaining central dashboards for system, data, utilization, and availability metrics

Requirements:
• 8-12 years of total experience with at least 5 years of work experience in developing, maintaining, optimization, issue resolution of Hadoop clusters
• Strong knowledge of programming languages, including Python, Scala, and Java
• Experience in Hadoop security, including Kerberos and Knox
• Hands-on experience in SQL and NoSQL databases, including HBase, with performance optimization
• Excellent oral and written communication and presentation skills, analytical and problem-solving skills

  • Foster City, California, United States Zoox Full time

    Data Storage Engineer RoleWe are seeking a skilled Senior Data Storage Engineer to join our team at Zoox. As a key member of our engineering organization, you will be responsible for designing, implementing, and maintaining our petabyte-scale storage systems. Your expertise in software-defined storage systems, such as Ceph and Quobyte, will enable you to...


  • Foster City, California, United States Venturi Full time

    About the RoleThis is an exciting opportunity to join a fast-growing and highly successful healthtech/wellbeing startup based in California. As a Principal Full Stack Engineer, you will play a key role in driving the creation of our platform and ensuring its scalability.ResponsibilitiesDevelop and implement technical architecture for the platformCollaborate...


  • Foster City, California, United States Zoox Full time

    At Zoox, our mission is to push the boundaries of autonomy and transform the future of transportation. As a Full Stack Software Engineer on our Autonomy Safety Assurance team, you will play a critical role in designing, prototyping, and productionizing novel methods and tools for efficient modeling and simulations of complex systems at scale. These tools aid...


  • Foster City, California, United States Zoox Full time

    Zoox is seeking a talented Software Engineer to join our team and contribute to the development of novel architectures for classifying and understanding complex urban environments. As a key member of our Prediction team, you will have access to the best sensor data in the world and an incredible infrastructure for testing, validating, and deploying your...


  • Redwood City, California, United States Oracle Full time

    Oracle, a leader in enterprise software solutions, is seeking a highly skilled Technical Architect to join its Fusion Applications Technical Architecture team. This role plays a crucial part in defining the next generation architecture, codenamed Spectra, based on cloud native principles running in Oracle Cloud Infrastructure (OCI). As a member of this team,...


  • Redwood City, California, United States C3, Inc. Full time

    C3.ai, Inc. is a leading provider of Enterprise AI software solutions for accelerating digital transformation.As a highly skilled and experienced Senior Software Architect, you will be responsible for developing infrastructure and tools to improve the state-of-the-art in Generative AI technology and enable its use in our enterprise applications.You will...


  • Redwood City, California, United States Check Point Software Technologies Full time

    Company OverviewCheck Point Software Technologies is a global leader in the field of Cyber Security, with a strong focus on innovation and customer satisfaction.We are committed to providing cutting-edge technologies and services that meet the real-time needs of our customers, while also ensuring the security and stability of their systems.Salary RangeThe...


  • Redwood City, California, United States Poshmark Full time

    About PoshmarkPoshmark is a leading fashion resale marketplace that empowers its sellers to turn their closet into a thriving business. With over 130 million users and $10 billion in GMV, the company has disrupted the industry by combining social connections with e-commerce through data-driven solutions and the latest technology.Job OverviewWe are seeking a...

  • Software Architect

    4 days ago


    Redwood City, California, United States Karius Full time

    About KariusKarius is a pioneering life science startup transforming the field of infectious disease diagnostics. By harnessing the power of microbial cell-free DNA, our innovative platform empowers doctors to solve complex cases efficiently, provides industry partners with unparalleled access to biomarkers for accelerated clinical trials, and facilitates...


  • Daly City, California, United States Care Dynamics, LLC Full time

    Full Stack Engineer PositionWe are Care Dynamics, LLC, a recruitment agency specializing in delivering customized solutions to our diverse portfolio of clients. Our focus on innovation and excellence has led us to expand our team and seek experienced Full Stack Engineers to join a cutting-edge data infrastructure and analytics company.Key...


  • Redwood City, California, United States Bear Robotics, Inc. Full time

    Bear Robotics, Inc. is a cutting-edge robotics company focused on developing innovative automation solutions for various industries. Our products, including robot devices, cloud services, and public APIs, are designed to help businesses operate more efficiently and effectively.We are seeking an experienced Data Engineering Technical Lead to lead the design,...


  • Redwood City, California, United States Check Point Software Technologies Full time

    About Our TeamAt Check Point Software Technologies, we're redefining the security landscape by meeting our customers' real-time needs and providing cutting-edge technologies and services to an ever-growing customer base.We've been recognized by Forbes as one of the World's Best Places to Work four years in a row (2020-2023), ranking among the top 50...


  • Redwood City, California, United States Karius Full time

    Transforming Infectious Disease Diagnostics with KariusKarius is a pioneering life science startup revolutionizing the way pathogens and microbes are observed in the human body. By unlocking the information present in microbial cell-free DNA, we empower doctors to quickly solve complex cases, provide industry partners with access to thousands of biomarkers...


  • Redwood City, California, United States Equinix Full time

    Job SummaryWe are seeking an experienced Digital Transformation Leader to join our team at Equinix, a leading global provider of digital infrastructure solutions. This is a unique opportunity to drive the transformation of our Quote-to-Cash (QTC) systems, enabling scalability, efficiency, and business growth.About EquinixEquinix is the world's digital...


  • Redwood City, California, United States Karius Full time

    About KariusKarius is revolutionizing infectious disease diagnostics by leveraging cutting-edge genomic sequencing and machine learning technologies. We're transforming the way pathogens are observed throughout the body, providing unprecedented insights into the microbial landscape.Position SummaryIn this critical engineering role, you will collaborate...

  • Lead Hadoop Admin

    1 week ago


    Foster City, United States Maintec Technologies Full time

    ROLE: - Lead Hadoop Admin LOCATION: - Foster City, CA DURATION: - Long term contract Job Description Responsible for implementation and ongoing administration of Hadoop infrastructure. Responsible for Cluster maintenance, trouble shooting, Monitoring and followed proper backup & Recovery strategies. Provisioning and managing the life cycle of multiple...


  • Foster City, United States Georgia IT Inc Full time

    Lead Hadoop Admin Foster City, CA, (Onsite from Day 1) Max Rate: DOE Interview Process: 3 Rounds of Zoom Video Interview USC & GC Preferred. No Third-party C2C available for this job Job Description Responsible for implementation and ongoing administration of Hadoop infrastructure. Responsible for Cluster maintenance, trouble shooting,...


  • Jersey City, New Jersey, United States Dyania Health Full time

    Job SummaryWe are seeking an experienced Cloud Infrastructure Architect to join our team at Dyania Health. As a key member of our infrastructure team, you will be responsible for designing, implementing, and optimizing cloud-based infrastructure to support the continued growth and success of our company.

  • Enterprise Architect

    4 weeks ago


    Jersey City, United States Group Nine LLC Full time

    We have a new requirement for an Enterprise Architect and would appreciate your prompt support in identifying suitable candidates for this role. Pls. review the job details below and share profiles that match the requirements. Position Details: Job Title: Enterprise Architect Bill Rate: $90-110/hr Visa Type: USC, GC, GC EAD Location: NY, NJ (Hybrid) End...


  • Jersey City, New Jersey, United States Fidelity Investments Full time

    Job OverviewFidelity Investments is a leading financial services company seeking an experienced Cloud Infrastructure Architect to join our team. In this role, you will play a key part in designing and implementing scalable and secure cloud infrastructure solutions for our enterprise-grade platform.About the RoleWe are looking for a skilled Cloud...


  • Jersey City, New Jersey, United States Veterans Sourcing Group, LLC Full time

    OverviewVeterans Sourcing Group, LLC is seeking an experienced Cloud Infrastructure Architect to lead our infrastructure department in regards to the Bank's Cloud environment.


  • Jersey City, New Jersey, United States Dexian Full time

    We are seeking a highly skilled Cloud Infrastructure Architect to join our team at Dexian. As a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide, we offer a unique opportunity to work with cutting-edge technology and drive innovation in the industry.Estimated Salary: $120,000 - $180,000 per...


  • Jersey City, New Jersey, United States Fidelity Investments Full time

    Job Overview:We are seeking an experienced Cloud Infrastructure Architect to join our team. As a key member of the Technical Operations group, you will be responsible for designing and implementing scalable, secure, and highly available cloud infrastructure solutions on Amazon Web Services (AWS).About the Role:This is a critical role in shaping the future of...


  • Oklahoma City, Oklahoma, United States Addison Group Full time

    Job DescriptionWe are seeking an experienced Senior Infrastructure Architect to join our dynamic team at Addison Group.This is a direct-hire opportunity offering the chance to work on exciting projects and make a significant impact in a forward-thinking organization located in Oklahoma City.Key Responsibilities:Design, architect, and administer solutions in...


  • Maryland City, Maryland, United States Secure Innovations LLC Full time

    Secure Innovations LLC is a cutting-edge company that focuses exclusively on cybersecurity. As a Cyber Security Architect, you will be working with a massively parallel enterprise platform built with Java and Open Source Software products, including Kubernetes, Hadoop, and Accumulo. The platform enables the execution of data-intensive analytics on a managed...


  • Texas City, Texas, United States The University of Texas at Austin Full time

    The University of Texas at Austin is seeking a Cloud Infrastructure Architect to lead the development and maintenance of cloud-based data systems. This role involves designing, implementing, and optimizing scalable infrastructure in support of the university's data ecosystem.Job DescriptionThis position reports to the Director of IT Services and is...


  • Jersey City, New Jersey, United States ST2 ManTech Advanced Systems Intl Full time

    Secure Our Nation, Ignite Your FutureAt ST2 ManTech Advanced Systems Intl, we're committed to protecting our nation's security while igniting our employees' futures. As a Senior Cloud Infrastructure Architect, you'll be part of a diverse team working on innovative projects that offer opportunities for advancement.We're seeking a motivated, career, and...


  • Jersey City, New Jersey, United States Diverse Lynx Full time

    At Diverse Lynx LLC, we're seeking a highly skilled AWS DevOps Architect to join our team. As an ideal candidate, you'll have expertise in designing and implementing robust DevOps pipelines within an AWS environment.About the RoleThis is a full-time position that offers a competitive salary of approximately $140,000 - $170,000 per year, depending on...


  • Jersey City, New Jersey, United States ApTask Full time

    Job Title: Infrastructure Monitoring Solutions ArchitectAbout Us:ApTask is a cutting-edge organization that provides innovative solutions for monitoring and analyzing infrastructure, applications, and business services.Salary: $120,000 - $180,000 per yearJob Description:We are seeking an experienced Technical Architect-Splunk to lead our global end-to-end...

  • Sr. Data Architect

    6 months ago


    Jersey City, United States Inizio Partners Full time

    About the job Sr. Data Architect Role Overview: Expected to work in close collaboration with the internal team and client on data transformation, data engineering and data technology projects Work with client to understand company needs to define architecture and build data solutions Plan and design the structure of a technology solution Understanding of...


  • Jersey City, United States Experis Full time

    Our client, a leading financial services company, is seeking an Application Architect to join their team. As an Application Architect, you will be part of the Global Risk Analytics department supporting multiple projects. The ideal candidate will have strong analytical, organizational, communication, and functional documentation capabilities, along with...

  • Sr Solution Architect

    4 weeks ago


    Jersey City, United States Birlasoft Full time

    Job Description: AWS Tech Lead with Databricks Knowledge Overview: An AWS Tech Lead with Databricks SME (Subject Matter Expert) knowledge is responsible for designing, deploying, and managing cloud-based infrastructure on AWS and supporting data solutions using Databricks. The role involves leading a team to ensure scalable, secure, and cost-efficient cloud...

  • Data Architect

    2 weeks ago


    Jersey City, United States Saransh Inc Full time

    Data ArchitectJersey City, NJ (Hybrid - 3 days a week onsite)ContractNote:Candidate from Deloitte or Accenture or some big companies.Snowflake extensive exp is must.Mandatory Skills: Data Modeling Snow Flake Accounts payable and Capital markets ArchitectWhat client is looking for:These architects are going to be the primary person(s) who need to own entire...


  • Kansas City, United States Databricks Full time

    FEQ425R190This role can be remote and fluent-proficiency in English and Spanish is required.As a Specialist Solutions Architect (SSA) - Data Engineering, you will guide in building big data solutions on Databricks that span a large variety of use cases. You will be in a customer-facing role, working with and supporting Solution Architects, that requires...


  • Kansas City, United States Databricks Full time

    FEQ425R190This role can be remote and fluent-proficiency in English and Spanish is required.As a Specialist Solutions Architect (SSA) - Data Engineering, you will guide in building big data solutions on Databricks that span a large variety of use cases. You will be in a customer-facing role, working with and supporting Solution Architects, that requires...