Hadoop Engineer/Dev Ops Engineer

1 month ago

Dallas, United States Snipebridge Full time
Job DescriptionJob Description

CLIENT

As the market leader in decision management software, our client helps the world's largest companies in digitally transforming their integrated business planning, revenue management and supply chain management functions. It's platform puts the right information in front of the right people at the right time, so that everyone in a company can make smarter decisions, faster. They offer a cloud-based platform that connects the supply chain end-to-end through use of technologies like AI/ML and NLP. With a global presence across NA, Europe and Asia-Pac, the company provides services in multiple industries and to some of the biggest brands in the world. It runs as a flat organization with a very strong entrepreneurial culture (and no corporate politics).


POSITION SUMMARY



ROLE & RESPONSIBILITIES

  • Work with customers/technical consultants to devise and recommend big data solution architecture based on requirements
  • Analyze complex distributed production deployments, and make recommendations to optimize performance
  • Able to document and present complex architectures for the customers technical teams
  • Work closely with o9 Dev, Devops and project teams at all levels to help ensure the success of projects
  • Help design and implement Hadoop architectures and configurations for customers working with Cloud deployments
  • Write and produce technical documentation and manual to be provided to customer
  • Keep current with the Hadoop Big Data ecosystem technologies



EXPERIENCE, EXPERTISE & EDUCATION REQUIREMENTS

  • More than three years of DevOps experience, architecting large scale storage, data center and /or globally distributed solutions
  • Experience designing and deploying production large-scale Hadoop solutions
  • Ability to understand and translate customer requirements into technical requirements
  • Experience designing data queries against data in a Hadoop environment using tools such as Apache Hive, Apache Druid, Apache Phoenix or others.
  • Experience installing, administering and tuning multi-node Hadoop clusters
  • Strong experience implementing software and/or solutions in Cloud (Azure, AWS, GCP)
  • Strong understanding with various enterprise security solutions such as LDAP and/or Kerberos
  • Strong understanding of network configuration, devices, protocols, speeds and optimizations
  • Strong understanding of the Java development, debugging & profiling
  • Significant previous work writing to network-based APIs, preferably REST/JSON or XML/SOAP
  • Experience designing data queries against data in the HDFS environment using tools such as Apache Hive
  • Experience implementing MapReduce jobs
  • Solid background in Database administration and design, along with Data Modelling.
  • Experience in architecting data centre solutions properly selecting server and storage hardware based on performance, availability and ROI requirements
  • Demonstrated experience implementing big data use-cases, understanding of standard design patterns commonly used in Hadoop-based deployments.
  • Excellent verbal and written communications
  • Demonstrable experience using R and the algorithms.

  • Azure Dev Ops Engineer

    3 hours ago

    Dallas, United States Saxon Global Full time

    Role: Typical Azure devops position. Hands on with technologies like docker and kubernetes to monitor container runtime and managing containers from many container runtimes. Working directly with cloud technologies to monitor and develop the software life cycle. And also development of the full life cycle of software or applications with automation tools...

  • Dev Ops Engineer

    3 weeks ago

    Dallas, United States Eagl Technology Full time

    Job DescriptionJob DescriptionThis is not a remote job. This job will require you to relocate to Albuquerque, NM. We offer a $3,000 relocation bonus. We are looking for an experienced Devops engineer to join our team and help us launch an innovative SAAS security platform.What you will be doingDesigning and building CI/CD pipelines in Jenkins to support our...

  • Mechanical Engineering Co-op

    6 days ago

    Dallas, United States Jordan & Skala Engineers Full time

    Are you a Mechanical Engineering student with a passion for building design? Mechanical systems and design are an integral part of building design. We are looking for top notch talent to join our cooperative education program. *If you are interested in our Atlanta, Dallas, Houston and Charlotte locations, please utilize this application. If you are...

  • Big Data/Hadoop Engineer

    1 month ago

    Dallas, United States Tekstrom Inc Full time

    Job DescriptionJob DescriptionBig Data/ Hadoop Engineer - (Ideal candidate will be a Sr. java Developer currently working in Big Data and AWS cloud platform) Responsibilities:Work with big data analytics engineers to develop automated testing systems.Develop testing software that will generate and validate test data for big data systems.Develop testing...

  • DevOps Lead with Hadoop Cluster and Python experience

    6 days ago

    Dallas, United States Synechron Full time

    At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data,...

  • Hashicorp Engineer

    6 days ago

    Dallas, United States HireTeq Full time

    Job Title - Vault Engineering and Operations - DevSecOpsLocation Mc Lean VA or Dallas TX or Tampa FL or Jersey City NJ (Hybrid 3 Days Office 2 Days Remote)Job Type - Full-time Responsibilities:Architect, deploy, and sustain a cutting-edge HashiCorp Vault platform that prioritizes reliability and scalability.Spearhead daily operations, maintenance, and...

  • Senior Data Engineer

    3 weeks ago

    Dallas, United States Mitchell Martin Inc. Full time

    Senior Data EngineerOur mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data technology vision. This role reports directly to the VP of Enterprise Architecture and...

  • Senior Data Engineer

    3 weeks ago

    Dallas, United States Mitchell Martin Inc. Full time

    Senior Data EngineerOur mortgage client is looking to hire a Senior Data Engineer with some data architecture experience to develop and implement Data Engineering strategies, lead architecture function of the Data Engineering team, and influence the overall Enterprise Data technology vision. This role reports directly to the VP of Enterprise Architecture and...

  • Site Reliability Engineer

    6 days ago

    Dallas, United States Tecktiva Full time

    Job Title: Site Reliability EngineerLocation: Phoenix, AZ / dallas, TX Duration: 6 Months+ Responsibilities: Expert in Observability & SRE principles, SLI, SLO and SLA definition and managementExperienced in Grafana stack and other Application performance management tools and frameworks like Elastic stack, AppD, etc.Expert in SRE observability...

  • Data Engineer

    2 weeks ago

    Dallas, United States Zendr Full time

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division.This opportunity is perfect for experienced data engineers looking for a more client-facing role and to widen their skillset with diverse technologies.This is a full-time position. At this time our client is...

  • Data Engineer

    2 weeks ago

    Dallas, United States Zendr Full time

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division.This opportunity is perfect for experienced data engineers looking for a more client-facing role and to widen their skillset with diverse technologies.This is a full-time position. At this time our client is...

  • Data Engineer

    1 week ago

    Dallas, United States Zendr Full time

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division.This opportunity is perfect for experienced data engineers looking for a more client-facing role and to widen their skillset with diverse technologies.This is a full-time position. At this time our client is...

  • Machine Learning Engineer

    1 month ago

    Dallas, United States Cat America Full time

    Job DescriptionJob DescriptionREQUIRED SKILLS (2-4YEARS)Experience with ARIMAExperience with FB ProphetExperience with Python Experienced ML engineer to work on universal forecasting models GluonHADOOPSeasonal Naive The application architecture is represented by OpenShift, linux, Oracle, SQL Server, Hadoop, MongoDB, APIs and a great deal of Python...

  • Analytics Platform Engineer

    3 weeks ago

    Dallas, United States G-Research Full time

    Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips?G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to nurture their talent in a dynamic, flexible and highly stimulating culture where...

  • Reservoir Engineer

    2 weeks ago

    Dallas, United States X4 Group Full time

    A Dallas based Privately funded Oil and Gas firm, are on the lookout for a Reserves Manager to join their growing team. The role will see you working closely with the team on acquisitions and continued management of existing assets. The client focus on non-ops and mineral interests. This role will need you to be based in Dallas, so please only apply if this...

  • Reservoir Engineer

    6 days ago

    Dallas, United States X4 Group Full time

    A Dallas based Privately funded Oil and Gas firm, are on the lookout for a Reserves Manager to join their growing team. The role will see you working closely with the team on acquisitions and continued management of existing assets. The client focus on non-ops and mineral interests.This role will need you to be based in Dallas, so please only apply if this...

  • Reservoir Engineer

    2 weeks ago

    Dallas, United States X4 Group Full time

    A Dallas based Privately funded Oil and Gas firm, are on the lookout for a Reserves Manager to join their growing team. The role will see you working closely with the team on acquisitions and continued management of existing assets. The client focus on non-ops and mineral interests.This role will need you to be based in Dallas, so please only apply if this...

  • Reservoir Engineer

    2 weeks ago

    Dallas, United States X4 Group Full time

    A Dallas based Privately funded Oil and Gas firm, are on the lookout for a Reserves Manager to join their growing team. The role will see you working closely with the team on acquisitions and continued management of existing assets. The client focus on non-ops and mineral interests.This role will need you to be based in Dallas, so please only apply if this...

  • Senior Machine Learning Engineer

    4 days ago

    Dallas, United States SSI People Full time

    Note: Looking for a ML Engineer with extensive experience with Forecasting My client will not work on C2C/C2H My client will not sponsor any type of Visa Will not consider any Data Scientist Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks. Job Description: Summary: The main...

  • Senior Machine Learning Engineer

    4 weeks ago

    Dallas, United States SSi People Full time

    Note: Looking for a ML Engineer with extensive experience with ForecastingMy client will not work on C2C/C2HMy client will not sponsor any type of Visa Will not consider any Data ScientistJob Description: Summary:The main function of a machine learning engineer is to design, develop, implement, test, and maintain multi-platform machine learning software...