Senior Big Data Engineer

3 weeks ago


Austin, Texas, United States AgileEngine Full time
About the Role
We are seeking an experienced Senior Big Data Engineer to join our team in the US. As a Senior Big Data Engineer, you will play a key role in designing, building, and supporting big data infrastructure and tools. Your primary responsibility will be to architect, build, and operate cloud and on-premises enterprise data infrastructure and tools using cloud-native architecture, ETL/ELT, and data integration. You will also design and build robust, reusable, and scalable data-driven solutions and data pipeline frameworks to automate the ingestion, processing, and delivery of structured and unstructured batch and real-time streaming data.

Key Responsibilities
Some of your key responsibilities will include working collaboratively with other engineers, architects, data scientists, analytics teams, and business product owners in an agile environment. You will also be responsible for building data APIs and data delivery services to support critical operational processes, analytical models, and machine learning applications. Additionally, you will assist in selecting and integrating data-related tools, frameworks, and applications required to expand platform capabilities. You will also ensure that best practices are followed in the management of enterprise data, including master data, reference data, metadata, data quality, and lineage.

Requirements
Experience with Python or Java (Python preferably), building data lakes and cloud data platforms leveraging cloud-native architecture, ETL/ELT, and data integration, and experience with distributed data processing and streaming frameworks and architectures like Apache Spark and Apache Beam. Also, experience with Snowflake, NoSQL database technologies, and containerized microservices. Advance understanding of software development and research tools, attention to detail, and results-oriented skills. Upper-intermediate English language proficiency required. Estimated salary: $120,000 - $180,000 per year depending on experience.

  • Austin, Texas, United States TalentBurst Full time

    We are seeking an experienced Senior Big Data Engineer to join our team at TalentBurst. As a senior member of our engineering team, you will be responsible for designing and implementing high-performance big data systems.The ideal candidate should have extensive experience with big data technologies such as Redshift, Hive/EMR, Spark, SNS, SQS, Kinesis and be...


  • Austin, Texas, United States JobRialto Full time

    About the JobJobRialto is seeking an experienced Big Data Technical Lead with over 10 years of experience designing and implementing large-scale data warehouse solutions. This is a unique opportunity to leverage your expertise in big data technologies like Spark, Scala, and PySpark to drive business growth and innovation.The ideal candidate will possess...


  • Austin, Texas, United States Indotronix International Corporation Full time

    Job RequirementsWe are seeking a highly skilled Senior Big Data Specialist to join our team at Indotronix International Corporation. The ideal candidate will have extensive experience in designing, developing, and maintaining large-scale big data systems.Key requirements include:8+ years of experience in data engineering, data science, or a related...


  • Austin, Texas, United States ShiftCode Analytics Full time

    About Our CompanyShiftCode Analytics is a forward-thinking organization that uses data-driven insights to drive innovation.We are currently seeking an experienced Senior Big Data Specialist to join our team and help us build the next generation of data systems.Job OverviewThe successful candidate will have a deep understanding of big data technologies,...


  • Austin, Texas, United States Kaygen Full time

    Kaygen - A Leader in Technology-Based Staffing Services">We specialize in delivering high-volume contingent staffing, direct hire staffing, and project-based solutions to companies worldwide. Our team of experts works closely with clients to understand their needs and deliver tailored solutions.">Senior Big Data Administrator Job Description">This role...

  • Big Data Engineer

    4 weeks ago


    Austin, Texas, United States University of Texas at Austin Full time

    The successful candidate will have a strong background in big data engineering and a passion for innovative technologies. As a Big Data Engineer, you will work closely with clinicians, cognitive and behavioral therapists, physiologists, and other stakeholders to develop ETL procedures and automate data cleansing, preparation, and validation processes.

  • Big Data Engineer

    3 weeks ago


    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data EngineerWe are looking for a highly skilled Big Data Engineer to join our team at United Software Group. The ideal candidate will have a strong background in big data processing and experience with cloud platforms.Estimated Salary: $100,000 - $160,000 per yearThe successful candidate will be responsible for designing and developing...


  • Austin, Texas, United States United Software Group Full time

    About the Role: We are seeking a Big Data Engineering Lead to join our team at United Software Group. This is a great opportunity to lead a team of engineers in designing and building large-scale data processing systems using Big Data and Python technologies.The ideal candidate will have experience with designing and implementing data pipelines, as well as...

  • Big Data Engineer

    4 weeks ago


    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    **Job Title:** Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in Austin, TX (Day 1 Onsite). This is a full-time position that requires expertise in designing, building, and maintaining large-scale data processing systems using the Hadoop ecosystem.The ideal candidate will have at least 3...

  • Data Engineer

    3 weeks ago


    Austin, Texas, United States ApTask Full time

    About Client: Client is a leading provider of technology and consulting services. They offer a range of solutions, including software development, IT management, and business process improvement. With expertise across industries like healthcare, finance, retail, and more, they help businesses leverage technology to enhance their operations.Rate Range:...


  • Austin, Texas, United States Technogen International Company Full time

    **About Us**At Technogen International Company, we are passionate about revolutionizing the data landscape with cutting-edge solutions. Our team of experts is dedicated to harnessing the power of big data and cloud architecture to drive business growth.**Job Summary**We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer for Big...


  • Austin, Texas, United States JobRialto Full time

    Job Summary:We are seeking an experienced Big Data Technical Lead with over 10 years of experience designing and implementing large-scale data warehouse solutions. The ideal candidate will have a minimum of six years of experience developing with Spark and Scala, and will possess strong problem-solving and architecting skills, especially in cases where...


  • Austin, Texas, United States United Software Group Full time

    **About the Role:**We are looking for a seasoned Big Data Engineer to join our Snowflake team. In this role, you will be responsible for architecting and implementing scalable data solutions using Snowflake as the core technology.**Responsibilities:**Design and develop high-performance data pipelines using Snowflake and SparkWork closely with...

  • Data Architect

    3 weeks ago


    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Architect - Big Data SpecialistFutran Tech Solutions Pvt. Ltd. seeks an experienced Data Architect to spearhead the design and implementation of our big data strategy. This senior-level position requires a deep understanding of big data technologies, including relational databases, NoSQL databases, and data warehouses. The successful candidate will have...

  • Big Data Engineer

    3 weeks ago


    Austin, Texas, United States Kaygen Full time

    At Kaygen, we are seeking a highly skilled Sr. Hadoop Administrator to join our team of talented IT professionals. This role involves performing Big Data Administration and Engineering activities on multiple open-source platforms such as Hadoop, Kafka, HBase, and Spark.About the JobThe successful candidate will possess strong troubleshooting and debugging...


  • Austin, Texas, United States Kaygen Full time

    About the Job: We are looking for a highly experienced Lead Big Data Engineer to manage and administer our Hadoop clusters. The ideal candidate will have a strong background in big data engineering, DevOps, and scripting languages such as Python. This is a full-time, long-term contract opportunity with a salary of $145,000 - $165,000 per year, depending on...


  • Austin, Texas, United States Info Way Solutions Full time

    Job Title: Senior Java Developer for Big Data ProjectsAbout the Company: Info Way Solutions is a leading provider of software development services, and we are seeking a senior Java Developer for Big Data Projects to join our team in Austin, TX.Salary: The estimated annual salary for this position is $200,000 - $250,000 depending on experience.Job Summary: We...


  • Austin, Texas, United States Info Way Solutions Full time

    Job Overview  Info Way Solutions is seeking a highly skilled Data Engineer for Big Data Solutions to play an important role in creating high-level design artifacts and delivering high-quality code deliverables. The ideal candidate will have proficiency across different stages of the Software Development Life Cycle, including requirements elicitation,...


  • Austin, Texas, United States Info Way Solutions Full time

    Job Title: Core Java Engineer with Big Data ExperienceAbout Us: Info Way Solutions is a leading provider of software development services, and we are seeking a talented Core Java Engineer with Big Data Experience to join our team in Austin, TX.Salary: The estimated annual salary for this position is $180,000 - $220,000 depending on experience.Job Summary: We...

  • Big Data Specialist

    4 weeks ago


    Austin, Texas, United States Diverse Lynx Full time

    Job Title: Big Data SpecialistWe are seeking a skilled Big Data Specialist to join our team at Diverse Lynx LLC. This is an exciting opportunity for a talented individual to work on complex data engineering projects and contribute to the growth of our organization.Key Responsibilities:Analyze and process large datasets using Python, pyspark, and ETL...