Senior Big Data Developer

4 weeks ago


Austin, Texas, United States Maintec Technologies Full time
Job Summary:

As a seasoned Sr. Big Data Developer at Maintec Technologies, you will be responsible for designing and implementing large-scale data processing systems using Python programming, Pandas, NumPy, and PySpark. Your expertise in ETL testing, AWS glue, ec2, and lambda will be crucial in ensuring the smooth operation of our data pipelines. Additionally, you will work closely with our team to develop test automation utilities for data reconciliation validation using Python data science libraries. If you have 10+ years of experience in Python programming, hands-on experience in big data technology, and proficiency in writing complex SQL queries, we encourage you to apply for this exciting opportunity.

Key Responsibilities:

  • Design and implement large-scale data processing systems using Python programming, Pandas, NumPy, and PySpark
  • Develop test automation utilities for data reconciliation validation using Python data science libraries
  • Work closely with the team to ensure the smooth operation of data pipelines
  • Collaborate with cross-functional teams to identify and prioritize project requirements

Requirements:

  • 10+ years of experience in Python programming
  • Hands-on experience in big data technology
  • Proficiency in writing complex SQL queries
  • 8+ years of experience in handling resources like AWS glue, ec2, and lambda


  • Austin, Texas, United States Info Way Solutions Full time

    Job Title: Senior Java Developer with Big Data ExpertiseLocation: Not specifiedType: ContractJob Description:10+ years of experience in software developmentProficient in Java programming languageExpertise in Big Data technologies, including Kafka and MongoDBStrong coding skills and experience with Spring BootProficient in writing SQL queriesInfo Way...

  • Big Data Developer

    3 weeks ago


    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data DeveloperJob Description:We are seeking a skilled Big Data Developer to join our team at United Software Group. The ideal candidate will have expertise in Spark, Scala, and AWS, with a strong understanding of data processing and analysis.Key Responsibilities:Design and develop scalable data processing pipelines using Spark and ScalaWork...

  • Big Data Developer

    1 month ago


    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at United Software Group Inc. The ideal candidate will have expertise in Spark, Scala, and AWS, with a strong understanding of data architecture and processing.Key Responsibilities:Design and develop scalable data pipelines using Spark and ScalaImplement data...


  • Austin, Texas, United States Info Way Solutions Full time

    Job Description:As a seasoned Java developer with expertise in big data, you will be responsible for designing and implementing scalable data processing systems using Java and big data technologies such as Kafka and MongoDB.Key Responsibilities: 10+ years of experience in Java development Good knowledge of Java and big data technologies Proficiency in Spring...


  • Austin, Texas, United States ApTask Full time

    About ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management....

  • Big Data Engineer

    1 month ago


    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Big Data DeveloperFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Big Data Developer to join our team.Key Responsibilities:Design and develop scalable big data architectures using Apache Hadoop, Apache Spark, and other MPP databases.Develop and implement data processing pipelines using Apache Beam, Kafka, and Spark Structured...

  • Data Engineer

    4 weeks ago


    Austin, Texas, United States Diverse Lynx Full time

    Job Summary:We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Big Data processing technologiesDevelop and maintain ETL processes to extract,...

  • Senior Data Engineer

    4 weeks ago


    Austin, Texas, United States SHI GmbH Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our innovative team at SHI GmbH. This role is crucial in driving data infrastructure and analytics integration within our organization.The ideal candidate will have a strong background in data engineering, software development, and data science, with a passion for solving complex...


  • Austin, Texas, United States LMG Technology Services LLC Full time

    Job SummaryWe are seeking a highly skilled Data Scientist and Big Data Engineer Specialist to join our team at LMG Technology Services LLC. The ideal candidate will have expertise in big data, AI/ML, and data science workflows and automation.Key Responsibilities:* Assessment, analysis, planning, remediation, and fraud analytics road mapping services*...

  • Senior Data Scientist

    4 weeks ago


    Austin, Texas, United States Omega Solutions Inc Full time

    Job Requirements:For the position of Senior Data Scientist at Omega Solutions Inc, we are seeking a highly experienced professional with a strong background in big data development. The ideal candidate will have at least 8 years of experience in working with Hadoop, Spark, and Hive, as well as 6+ years of hands-on experience with AWS cloud and 6+ years of...

  • Data Engineer

    3 weeks ago


    Austin, Texas, United States Info Way Solutions Full time

    Job Description for Data Engineer:At Info Way Solutions, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing high-quality data systems that meet the needs of our business.Key Responsibilities:Design and implement data pipelines using Hadoop and SparkDevelop and maintain...

  • Senior Data Engineer

    4 weeks ago


    Austin, Texas, United States SHI International Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to drive data infrastructure and analytics integration within our organization. This role is crucial in developing and deploying data pipelines, data lakes, and databases, working closely with machine learning engineers, software development engineers, and stakeholders.About the RoleThis...

  • Senior Data Engineer

    4 weeks ago


    Austin, Texas, United States 2K Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at 2K Games. As a Senior Data Engineer, you will be responsible for designing and building data models to support Data Science, Business Intelligence, and downstream data sets.You will work closely with business partners and developers to ensure proper requirements are...


  • Austin, Texas, United States SRI Tech Solutions Inc. Full time

    Job Title: Hadoop/Big Data Systems AdministratorJob Summary:We are seeking a highly skilled Hadoop/Big Data Systems Administrator to join our team at SRI Tech Solutions Inc. The ideal candidate will have experience in monitoring and debugging Hadoop platforms, as well as automating manual tasks using Ansible or Python.Key Responsibilities:Monitor and debug...

  • Senior Data Architect

    4 weeks ago


    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Data Engineering OpportunitiesWe are seeking a skilled Senior Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. and contribute to the design, development, and implementation of scalable and reliable data solutions.Key Responsibilities:Design and develop data pipelines and architectures using cloud computing platforms such as AWS, Azure, or...

  • Senior Data Engineer

    4 weeks ago


    Austin, Texas, United States Branch Metrics Full time

    About the RoleWe're seeking a highly skilled Senior Data Engineer to join our team at Branch Metrics. As a Senior Data Engineer, you will design, build, and manage components of our highly available real-time data platform handling petabytes of data.Our platform is designed to ingest and process billions of events per day, and make the resulting aggregations...

  • Senior Data Architect

    4 weeks ago


    Austin, Texas, United States Electronic Arts Full time

    About the Role:We are seeking a highly skilled Data Architect to lead our Sports analytics architecture forward and deliver value to the business. As part of the Adrenaline Architecture team, you will engage with a wider range of team members, including analytics leaders, analysts, game studios, data engineering, data science partners, and other teams.Key...


  • Austin, Texas, United States The University of Texas at Austin Full time

    Job Title:Senior Data Architect and Analytics LeadJob Summary:The University of Texas at Austin is seeking a highly skilled Senior Data Architect and Analytics Lead to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data structures and advanced analytics projects.Key Responsibilities:Design...

  • Senior Data Engineer

    4 weeks ago


    Austin, Texas, United States Saxon Global Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our Data and Analytics team. As a key member of our team, you will be responsible for designing and building secure and resilient architectures to provide actionable insights to our Advisors.Key Responsibilities:Design and develop data pipelines to extract data from various sources...


  • Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    About the Role:Futran Tech Solutions Pvt. Ltd. is seeking a highly skilled Senior Data Analytics Project Manager to lead our engineering projects in support of data analytics. The ideal candidate will have strong project management skills, excellent communication skills, and the ability to handle fast-paced and ambiguously defined projects with multiple...