Senior Big Data Engineer

2 days ago


San Antonio, Texas, United States Rackspace Full time
About the Role

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). This role involves working in Java, and working on Machine Learning pipelines for data collection or batch inference. This is a remote position, requiring excellent communication skills and the ability to solve complex problems independently and creatively.

Key Responsibilities
  • Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase
  • Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
  • Leverage GCP for scalable big data processing and storage solutions
  • Implementing automation/DevOps best practices for CI/CD, IaC, etc.
Requirements
  • Proficiency in in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm
  • Strong programming skills with Java, Python, and Spark
  • Knowledge in public cloud services, particularly in GCP.
  • Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
  • Ability to tackle complex challenges and devise effective solutions. Use critical thinking to approach problems from various angles and propose innovative solutions.
  • Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.
  • Proven experience in engineering batch processing systems at scale.
  • Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.
Preferred Qualifications
  • Familiarity with Terraform
  • Familiarity with Python
  • 5+ years of experience building, and operating solutions built on GCP
Pay Transparency

The anticipated starting pay range for Colorado is: $116,100 - $170,280. The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $123,600 - $181,280. The anticipated starting pay range for California, New York City and Washington is: $135,300 - $198,440.

Unless already included in the posted pay range and based on eligibility, the role may include variable compensation in the form of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time. Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location.

Information on benefits offered is here.

#LI-MF1 #LI-Remote

#LI-VM1 #Rackspace #LI-Rackspace #LI-USA #LI-Canada #LI-Remote

About Rackspace Technology

We are the multicloud solutions experts. We combine our expertise with the world's leading technologies - across applications, data and security - to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.

More on Rackspace Technology

Though we're all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.



  • San Antonio, Texas, United States Rackspace Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in Oozie, the Apache Hadoop ecosystem, Airflow, and a solid understanding of public cloud technologies, especially GCP.Key...


  • San Antonio, Texas, United States Raso360 Full time

    Sr. Data Reliability EngineerRaso360 is seeking a highly skilled Data Reliability Engineer to ensure the highest standards of data reliability and system performance.Key Responsibilities:Design and Maintain Infrastructure: Develop scalable, efficient, and cost-effective data solutions leveraging AWS technologies and big data tools like Databricks, Airflow,...


  • San Antonio, Texas, United States Microsoft Corporation Full time

    Job Title: Senior Electrical EngineerMicrosoft Corporation is seeking a highly skilled Senior Electrical Engineer to join our Cloud Operations & Innovation (CO+I) team. As a key member of our team, you will be responsible for designing, developing, and testing new products and solutions that improve the performance, efficiency, and reliability of our data...


  • San Antonio, Texas, United States Expedite Technology Solutions Full time

    Job Title: Data Visualization EngineerExpedite Technology Solutions is seeking a skilled Data Visualization Engineer to lead the effort in gathering, analyzing, and modeling client data to develop business insights and improve decision-making.Key Responsibilities:Requirements gathering, design, development, and implementation of Power BI reports for a big...


  • San Antonio, Texas, United States H-E-B Full time

    About the RoleH-E-B is seeking a highly skilled Software Engineer II to join our Digital Technology team. As a key member of our team, you will be responsible for designing, developing, and implementing scalable and secure data platforms using hybrid cloud services.Key ResponsibilitiesImplement infrastructure as code, security, and CI/CD for data...

  • Solar Engineer

    16 hours ago


    San Antonio, Texas, United States Big Sun Solar Full time

    About the RoleWe are seeking a highly skilled Solar Engineer to join our team at Big Sun Solar. As a key member of our engineering team, you will be responsible for designing and developing solar PV systems for commercial and industrial clients in Texas.Key ResponsibilitiesDesign preliminary layouts and final permit packages for solar PV systemsPerform...

  • Senior DevSecOps Engineer

    10 minutes ago


    San Antonio, Texas, United States Omni Federal Full time

    Job Title: Senior DevSecOps EngineerWe are seeking a highly skilled Senior DevSecOps Engineer to join our team at Omni Federal. As a key member of our team, you will be responsible for designing, building, and operating data-rich applications leveraging advanced data modeling, machine learning, and data visualization techniques.The ideal candidate will have...


  • San Antonio, Texas, United States Omni Federal Full time

    About the RoleWe are seeking a highly skilled Senior DevSecOps Engineer to join our team at Omni Federal. As a key member of our team, you will be responsible for designing, building, and operating data-rich applications leveraging advanced data modeling, machine learning, and data visualization techniques.This is an exciting opportunity to work on modern...


  • San Antonio, Texas, United States Expedite Technology Solutions Full time

    Job Summary:Expedite Technology Solutions is seeking a highly skilled Data Visualization Engineer to lead the effort in gathering, analyzing, and modeling client data to develop business insights and improve decision-making.Key Responsibilities:Requirements gathering, design, development, and implementation of Power BI reports for a big data application.Lead...


  • San Antonio, Texas, United States Omni Federal Full time

    About the RoleWe are seeking a highly skilled Senior DevSecOps Engineer to join our team at Omni Federal. As a key member of our team, you will be responsible for designing, building, and operating data-rich applications leveraging advanced data modeling, machine learning, and data visualization techniques.This is an exciting opportunity to work on modern...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    Exciting Opportunity: Senior Systems Engineer in Aerospace InnovationsBecome a vital part of our team at Southwest Research Institute, a premier provider of advanced aerospace solutions for defense applications. Our focus lies in the creation of sophisticated avionics, mission payloads, ground aerospace systems, and pioneering AI/ML technologies.Core...


  • San Antonio, Texas, United States Bexar County, TX Full time

    About the RoleWe are seeking a highly skilled Senior Database Engineer- Supervisor to join our team at Bexar County, TX. As a key member of our IT department, you will be responsible for leading the design, development, and implementation of databases to support our business operations.Key ResponsibilitiesLead the development of database architectures to...


  • San Antonio, Texas, United States Bexar County, TX Full time

    About the RoleWe are seeking a highly skilled Senior Database Engineer- Supervisor to join our team at Bexar County, TX. As a key member of our IT department, you will be responsible for leading the design, development, and implementation of databases to support our business operations.Key ResponsibilitiesLead a team of database engineers in the design,...


  • San Antonio, Texas, United States GOLDEN WOLF LLC Full time

    Job OverviewPosition: Senior Mechanical Engineer, PEEmployment Type: Full-timeCompany Overview:GoldenWolf LLC is a distinguished Woman-Owned, Service-Disabled Veteran Owned Small Business dedicated to providing exceptional engineering and technical services. Our mission is to deliver innovative solutions that enhance facilities management for our...


  • San Antonio, Texas, United States Diverse Lynx Full time

    Data Engineer - ETL DeveloperWe are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. As a Data Engineer, you will be responsible for designing, developing, and deploying high-quality, fault-tolerant data pipelines using distributed data movement technologies and approaches.Key Responsibilities:Develop and deploy data pipelines...


  • San Antonio, Texas, United States Applied Research Solutions Full time

    Join Our Team as a Senior Systems EngineerApplied Research Solutions is in search of a dedicated Senior Systems Engineer to contribute to our mission of delivering exceptional technical solutions. Why Choose Applied Research Solutions?At Applied Research Solutions (ARS), we pride ourselves on being a leading provider of integrated technical solutions. Our...


  • San Antonio, Texas, United States First Resort Global Recruitment Full time

    Become a Senior Reservoir Engineering Specialist with UsFirst Resort Global Recruitment is seeking a highly skilled individual to join a leading organization in the Oil, Gas, and Petroleum sector, known for its esteemed reputation in the industry.We are looking for a talented professional at the Senior Level to play a pivotal role in our client’s...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    About the RoleThis is a senior-level position that requires a strong background in AI research and development. The successful candidate will lead a team of engineers in the design, development, and deployment of AI systems for various applications.Key ResponsibilitiesDevelop and implement AI algorithms and models for various applications, including...


  • San Antonio, Texas, United States GoldenWolf Full time

    Senior Mechanical Systems EngineerLocation: San Antonio, TX - duties performed ON SITEJob Type: Full-timeAbout GoldenWolf:GoldenWolf is a Woman-Owned, Service-Disabled Veteran Owned Small Business dedicated to providing exceptional engineering and strategic services to our clients. Our mission is to create innovative and practical solutions that enhance...


  • San Antonio, Texas, United States SWRI Full time

    Job SummaryAs a Senior Electronics Design Engineer at SWRI, you will be responsible for leading the design, analysis, and development of high-reliability electronics hardware for space applications. This includes defining requirements, writing specifications, performing analysis, and implementing designs from concept to hardware. You will also lead and work...