Senior Big Data Engineer

2 days ago


Austin, Texas, United States JobRialto Full time
About the Job

JobRialto is seeking an experienced Big Data Technical Lead with over 10 years of experience designing and implementing large-scale data warehouse solutions. This is a unique opportunity to leverage your expertise in big data technologies like Spark, Scala, and PySpark to drive business growth and innovation.

The ideal candidate will possess strong problem-solving and architecting skills, especially in cases where requirements may be unclear. You will work closely with cross-functional teams to define technical requirements and deliver solutions that meet business needs.

Main Responsibilities

• Design and implement scalable and robust data warehouse solutions using big data technologies like HBase and Hive.

• Develop and optimize big data pipelines using Spark, Scala, and PySpark for efficient data processing.

• Collaborate with cross-functional teams to define technical requirements and deliver solutions that meet business needs.

• Troubleshoot and resolve issues related to data processing and performance in large-scale data systems.

• Provide technical leadership and mentoring to junior team members in data engineering and architecture.

Requirements

• Minimum of 10+ years of experience in data engineering, data warehousing, or big data development.

• Strong experience with Spark, Scala, and PySpark programming languages for data processing and automation.

• Experience with big data databases such as HBase, Hive, and other cloud-based data solutions like AWS.

• Proficiency in Python for data processing and orchestration tools like Airflow for efficient data pipeline management.

• Familiarity with data warehouse architecture and implementation, including data integration, ETL processes, and big data processing frameworks.

Estimated Salary: $180,000 per year

This is a full-time position offering competitive compensation and benefits.

  • Austin, Texas, United States Indotronix International Corporation Full time

    Job RequirementsWe are seeking a highly skilled Senior Big Data Specialist to join our team at Indotronix International Corporation. The ideal candidate will have extensive experience in designing, developing, and maintaining large-scale big data systems.Key requirements include:8+ years of experience in data engineering, data science, or a related...


  • Austin, Texas, United States Kaygen Full time

    Kaygen - A Leader in Technology-Based Staffing Services">We specialize in delivering high-volume contingent staffing, direct hire staffing, and project-based solutions to companies worldwide. Our team of experts works closely with clients to understand their needs and deliver tailored solutions.">Senior Big Data Administrator Job Description">This role...


  • Austin, Texas, United States JobRialto Full time

    Job Summary:We are seeking an experienced Big Data Technical Lead with over 10 years of experience designing and implementing large-scale data warehouse solutions. The ideal candidate will have a minimum of six years of experience developing with Spark and Scala, and will possess strong problem-solving and architecting skills, especially in cases where...

  • Data Science Engineer

    2 weeks ago


    Austin, Texas, United States United Software Group Full time

    We are seeking an experienced Data Science Engineer to join our team at United Software Group in Austin, TX or Sunnyvale, CA. As a Data Science Engineer, you will be responsible for leading big data testing requirements and developing test automation scripts for Ad platforms applications.Key Responsibilities:Communicate project status and relevant details on...

  • Big Data Architect

    3 hours ago


    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data ArchitectAbout the Role:We are looking for a seasoned Big Data Architect to lead the design and implementation of our big data platform at United Software Group. The successful candidate will have extensive experience in architecting scalable and secure data systems.Key Responsibilities:Design and implement big data architectures using...


  • Austin, Texas, United States Info Way Solutions Full time

    Job Title: Core Java Engineer with Big Data ExperienceAbout Us: Info Way Solutions is a leading provider of software development services, and we are seeking a talented Core Java Engineer with Big Data Experience to join our team in Austin, TX.Salary: The estimated annual salary for this position is $180,000 - $220,000 depending on experience.Job Summary: We...


  • Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    **Job Overview**Futran Tech Solutions Pvt. Ltd. is seeking an experienced Big Data Engineer with Java to join our team. This role involves working on various aspects of big data, including Hadoop, Python, and HDFS.**Role Responsibilities**We are looking for a skilled individual who can work on production support, enhancements, bug fixes, and new feature...


  • Austin, Texas, United States Info Way Solutions Full time

    Job Title: Core Java with Big DataJob Overview:Seeking an experienced Java professional with a strong background in big data technologies. The ideal candidate should have a minimum of 10 years of experience in software development, with a focus on Java and big data. They should be proficient in working with Kafka, MongoDB, and Springboot, as well as having...


  • Austin, Texas, United States Info Way Solutions Full time

    At Info Way Solutions, we are seeking a highly skilled Senior Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining a scalable cloud data platform using Python and related technologies.">We offer a competitive salary of $120,000 - $180,000 per year, depending on...

  • Senior Data Architect

    4 weeks ago


    Austin, Texas, United States AMZ Advisers Full time

    About AMZ AdvisersAMZ Advisers is a cutting-edge digital media marketing agency with a focus on developing and implementing strategic marketing plans for global Amazon marketplaces. By joining our team, you'll have the opportunity to apply your skills, expertise, and passions directly to impact the lives and businesses of entrepreneurs worldwide.About the...


  • Austin, Texas, United States ApTask Full time

    About ClientApTask is a leading provider of workforce solutions and talent acquisition services. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management.Job DescriptionDevelopment & Design: Design,...


  • Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    We are seeking a skilled Big Data Developer to join our team at Futran Tech Solutions Pvt. Ltd.The ideal candidate will have experience working with Spark, Scala, and AWS technologies, as well as proficiency in Python and Kafka.This full-time position is based in Austin, TX, and comes with an estimated salary of $120,000 per year.About the JobFutran Tech...


  • Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Company OverviewFutran Tech Solutions Pvt. Ltd. is a leading technology firm that specializes in providing innovative solutions to businesses worldwide.Salary InformationThe salary for this position is estimated to be around ₹12,00,000 per annum, commensurate with experience and qualifications.Job DescriptionWe are seeking an experienced Big Data Engineer...


  • Austin, Texas, United States United Software Group Full time

    Job Title: Data Warehouse Architect with Spark and Big Data DatabasesJob Summary:We are seeking a highly skilled Data Warehouse Architect with expertise in Spark and Big Data Databases to join our team at United Software Group. As a key member of our data engineering team, you will be responsible for designing and implementing full-scale data warehouse...


  • Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Senior Data Solutions Specialist Job DescriptionWe are seeking a highly experienced Senior Data Solutions Specialist to join our team at Futran Tech Solutions Pvt. Ltd. As a Senior Data Solutions Specialist, you will be responsible for designing, developing, and implementing scalable and reliable data solutions to support our business needs.Compensation...

  • Big Data Specialist

    8 hours ago


    Austin, Texas, United States Applied Materials Full time

    Data Engineer Role at Applied MaterialsAs a Data Engineer at Applied Materials, you will play a critical role in shaping the company's data architecture to support our next-generation products and data initiatives. This involves creating and maintaining optimal data pipeline architecture, assembling large, complex data sets, and building analytics tools that...

  • Data Architect

    2 weeks ago


    Austin, Texas, United States Info Way Solutions Full time

    Job Requirements- We are seeking an experienced Senior Data Engineer with expertise in Scala, Spark, and Oracle, to work on our regular cluster and Spark on AWS environments.- Excellent communication skills are required as the position involves regular interactions with our business team.- Knowledge of Java or Python will be considered an...


  • Austin, Texas, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Data Center Design Engineer to join our team in Seattle, WA; Herndon, VA; Austin, TX; or Columbus, OH. This role will be responsible for designing and delivering resilient data center infrastructure that meets the highest standards of safety, security, and efficiency.The ideal candidate will have 7+ years...


  • Austin, Texas, United States Perfict Global, Inc. Full time

    About Us:Perfict Global is a leading IT consulting services provider that delivers innovative business workforce solutions to Fortune 500 companies.Our professionals combine the best technologies to manage clients' complex business and technology needs, participate in implementation activities, and collaborate to meet client demands.We offer excellent...


  • Austin, Texas, United States Apple Full time

    As a senior DevOps engineer at Apple, you will be part of the Applied Machine Learning team.Job DescriptionWe are looking for a talented and dedicated senior engineer to join our team. The successful candidate should have a passion for infrastructure and distributed systems, as well as a strong desire to automate and document processes.You will work with...