Big Data DevOps Lead

2 weeks ago


Remote, Oregon, United States Zeta Global Full time

Summary:
As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.


Main Responsibilities:

• Driving improvement of the efficiency of Big Data infrastructure.

  • Coordinating cross-team infrastructure and Big Data initiatives.
  • Leading Big Data – related architecture and design efforts.
  • Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
  • Building and supporting tools for operational tasks.

    • Evaluating, designing, deploying monitoring tools.
  • Design and implementation of DR/BC practices and procedures.
  • On-call support of production systems.


Requirements:

• 7+ years of experience working with Hadoop, preferably Open Source.

  • 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
  • Experience setting up and running Hadoop clusters of 1000+ nodes.
  • Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
  • Experience running and troubleshooting Kafka.
  • Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.

    • Proficiency in shell scripting.


Nice to have:

• Experience with Prometheus.

  • Experience managing Showflake.

    • Solid knowledge of Graphite and Grafana.
  • Python or Perl scripting skills.
  • Experience with installing and managing Aerospike.
  • DBA experience with one of: PostgreSQL, MySQL, MariaDB.

  • DevOps Lead

    7 days ago


    Remote, Oregon, United States Eco Full time

    At Eco, our mission is to make people's money work for them — making it easier to hold, move and earn with your money, on your terms, than ever before. Our end vision challenges what people expect from money itself.We believe crypto is simply a better way to hold and move money. We build products like Beam to make that a reality, and make it accessible to...


  • Remote, Oregon, United States PublicSquare Full time

    PublicSquare Company Values1. We are united in our commitment to freedom and truth - that's what makes us Americans.2. We will always protect the family unit and celebrate the sanctity of every life.3. We believe small business and the communities who support them are the backbone of our economy.4. We believe in the greatness of this Nation and will always...


  • Remote, Oregon, United States Bordo AI Full time

    We are an early-stage AI startup dedicated to creating a Context-aware and Explainable AI platform. Our mission is to deliver insights through conversational interfaces, making AI's power both accessible and understandable. As a Senior Devops Engineer, you will lead the architecture, deployment and maintenance of the cloud infrastructure and continuous...


  • Remote, Oregon, United States SailPoint Full time

    Join a team of results-driven individuals who are constantly innovating at SailPoint! Our Engineering team merges high-quality professional engineering with individual impact. We create products on a mature, cloud-native event-driven microservices architecture in AWS.We are seeking a DevOps Manager with experience leading teams for SaaS products. You should...


  • Remote, Oregon, United States Vidmob Full time

    Vidmob is the creative data company. Its scoring software and analytics have become an essential ingredient in the creative and media decisions of the world's largest marketers and agencies, as they strive to drive business results through improved creative effectiveness. As the leader in creative data, Vidmob's influence lies in its partnerships and...


  • Remote, Oregon, United States Health-E Commerce Full time

    About the Role: We are seeking an experienced Senior Data Engineer to join our growing IT team. This role will be responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support our organization's data needs. Specific responsibilities:Design, develop, and maintain robust data pipelines and infrastructure to support...

  • Devops Enineer

    2 months ago


    Remote, Oregon, United States SConcept Full time

    As a Lead DevOps Engineer you will be part of a team that is responsible for managing and maintaining our private and public cloud infrastructure. This person will assist our efforts to leave manual labor-intensive processes behind and reach our goal of automation and managing infrastructure as code. The DevOps Engineer will be an integral part of the...

  • DevOps Engineer

    4 weeks ago


    Remote, Oregon, United States UltraViolet Cyber Full time

    Make a difference here.UltraViolet Cyber is a leading platform-enabled unified security operations company providing a comprehensive suite of security operations solutions. Founded and operated by security practitioners with decades of experience, the UltraViolet Cyber security-as-code platform combines technology innovation and human expertise to make...

  • Manager DevOps

    5 days ago


    Remote, Oregon, United States Breeze Airways Full time

    Working at Breeze Airways is an exciting endeavor and a serious commitment to bring "The World's Nicest Airline" to life. We work cross-functionally with truly awesome Team Members to deliver on our mission: "To make the world of travel simple, affordable, and convenient. Improving our guests travel experience using technology, ingenuity and kindness."Breeze...

  • Lead Data Scientist

    3 weeks ago


    Remote, Oregon, United States Protecht Full time

    Protecht is reinventing refunds, aiming to make every experience refundable. Our core strength lies in our proprietary Software-as-a-Service embedded refund protection platform, which delivers massive distribution and a best-in-class digital purchase experience to insurance carriers, event, booking, and ticketing platforms, and consumers.Role Overview:As the...


  • Remote, Oregon, United States Duetto Full time

    THE COMPANYDuetto offers an open and collaborative work environment and believes that by cultivating a team with diverse backgrounds, perspectives, and experiences, it will continue to lead the industry with its cutting-edge platform-based hospitality technology. POSITION SUMMARY AND OPPORTUNITY We are an ambitious, well-funded, high-growth global technology...

  • DevOps Engineer

    2 weeks ago


    Remote, Oregon, United States FinTek Full time

    Hello All Greetings for the day We are currently looking to hire CPT/OPT graduates and EAD candidates. Our direct relations with Fortune 500 clients across USA gives us the access to the immediate career opportunities with them. We have a strong technical team that will work closely with you to market your profile within our client base and beyond get you...


  • Remote, Oregon, United States OpenTeams Full time

    Who We AreOpenTeams is the services marketplace where open source software users can find, vet, and contract with service providers. At OpenTeams we believe in a culture of do-ers, learners, and collaborators. We are looking for people who are motivated, humble, curious, and respectful of others. In order to meet the demands of our high growth business, we...

  • DevOps Engineer

    5 days ago


    Remote, Oregon, United States Altoida Full time

    Altoida is a pioneer in developing digital biomarkers of neurological disease using augmented reality and machine learning. Our technology platform is designed to enable an objective evaluation of an individual's neurological health, allowing for more accurate patient selection and stratification for clinical trials, as well as sensitive monitoring of...

  • Data Engineer

    3 weeks ago


    Remote, Oregon, United States AbbVie Full time

    Job DescriptionCome to work each day with an inclusive and collaborative technology team. As an HCP Marketing Automation Data Engineer in the AbbVie Business Technology Solutions (BTS) team, you'll have opportunities to contribute to the digital transformation of a leading biopharma company, helping to support solutions that impact patients and their...

  • DevOps Engineer SR

    5 days ago


    Remote, Oregon, United States Sagent Full time

    Why you'll LOVE Sagent: You could work anywhere. We know you are talented and looking for something inspiring and impactful. A place where you will make a difference and have a great time doing it By choosing Sagent, you can be part of our mission to make loans and homeownership simpler and safer for all consumers. Sagent powers servicers and consumers. You...

  • Senior Data Engineer

    1 month ago


    Remote, Oregon, United States eSimplicity Full time

    eSimplicity is modern digital services company that delivers innovative federal and commercial IT solutions designed to improve the health and lives of millions of Americans while defending our national interests. Our solutions and services improve healthcare for 100+ million Americans, protect our borders, and defend our country by supporting and innovating...


  • Remote, Oregon, United States MachineFi Lab Full time

    Our Vision: Machines Will Be Our Future WorkforceAt MachineFi Lab, we're not just envisioning the future; we're actively building it—today. We power the new reward economy by fostering a fairer, safer, and more rewarding Internet of Things (IoT). Central to our mission is the concept of Decentralized Physical Infrastructure Networks (DePIN), a paradigm...


  • Remote, Oregon, United States Big Health Full time

    Our MissionAt Big Health, our mission is to help millions back to good mental health by providing fully digital, non-drug options for the most common mental health conditions. Our digital therapeutics — Sleepio for insomnia, Daylight for anxiety, and SparkRx for depression — provide treatment anytime, anywhere. In pursuit of our mission, we've pioneered...

  • Consultants

    1 month ago


    Remote, Oregon, United States TransUnion Full time

    We'd Love to See:Job Description Consultants for various and unanticipated worksites throughout the US (HQ:Chicago, IL). Independently plan and deliver database data warehouse and storage architecture. Maintain and manage design services, provide sizing and configuration assistance and perform needs assessments. Analyze current business practices, processes...