Current jobs related to Senior Big Data Engineer with Scala/Python Expertise - Austin, Texas - Infosys

  • Senior Data Engineer with Spark and Scala Expertise

    2 weeks ago

    Austin, Texas, United States United Software Group Full time

    Job Title: Senior Data Engineer with Spark and Scala ExpertiseJob Summary:United Software Group is seeking a highly skilled Senior Data Engineer with expertise in Spark and Scala to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing full-scale data warehouse solutions using Spark and Scala. Key...

  • Senior Data Engineer

    1 month ago

    Austin, Texas, United States Info Way Solutions Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Info Way Solutions. The ideal candidate will have expertise in Scala, Spark, and Unix, with experience working on regular clusters and AWS environments.Key Responsibilities:Design and develop scalable data processing pipelines using Spark and...

  • Senior Data Engineer

    1 week ago

    Austin, Texas, United States Info Way Solutions Full time

    Job Requirements: We are seeking a highly skilled Senior Data Engineer with expertise in Scala and Spark to work on our regular cluster and AWS-based Spark environments. Strong communication skills are essential as the position requires regular interaction with the business team. Optional experience in Java or Python is a plus.Key Responsibilities: Design,...

  • Senior Python Developer with DevOps Expertise

    2 weeks ago

    Austin, Texas, United States Info Way Solutions Full time

    Job Summary:Info Way Solutions is seeking a highly skilled Senior Python Developer with DevOps expertise to join our team. As a key member of our Data Engineering team, you will be responsible for engineering, integrating, and maintaining an analytics data platform based on a hybrid cloud infrastructure.Key Responsibilities:Collaborate with our Data...

  • Big Data Engineer

    2 weeks ago

    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Big Data DeveloperFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Big Data Developer to join our team.Primary Responsibilities:Design and develop scalable data architectures using Spark, Scala, and AWS.Develop and implement data processing pipelines using Apache Beam, Kafka, and Spark Structured Streaming.Work with relational...

  • Big Data Developer

    3 weeks ago

    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at United Software Group. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using technologies such as Apache Spark, Scala, and AWS.Key Responsibilities:Design and develop data...

  • Big Data Engineer

    2 weeks ago

    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Big Data DeveloperFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Big Data Developer to join our team.Key Responsibilities:Design and develop scalable big data architectures using Apache Hadoop, Apache Spark, and other MPP databases.Develop and implement data processing pipelines using Apache Beam, Kafka, and Spark Structured...

  • Senior Data Engineer

    4 weeks ago

    Austin, Texas, United States Apple Full time

    Job Title: Senior Data EngineerAt Apple, we're seeking a highly skilled Senior Data Engineer to join our Ad Platforms Data Products Engineering team. As a key member of our team, you'll play a crucial role in developing the next generation of data products and analytical solutions that empower our business teams.Key Responsibilities:Design and implement...

  • Data Engineer

    7 days ago

    Austin, Texas, United States Info Way Solutions Full time

    Job Description for Data Engineer:At Info Way Solutions, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing high-quality data systems that meet the needs of our business.Key Responsibilities:Design and implement data pipelines using Hadoop and SparkDevelop and maintain...

  • Senior Data Engineer

    4 weeks ago

    Austin, Texas, United States Apple Full time

    Job Title: Senior Data Engineer - Data Products, Ad PlatformsAt Apple, we're seeking a highly skilled Senior Data Engineer to join our Ad Platforms team. As a key member of our team, you'll be responsible for designing, developing, and deploying scalable data architectures and pipelines to support our advertising platforms.Key Responsibilities:Design and...

  • Senior Data Engineer

    2 weeks ago

    Austin, Texas, United States Apple Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Ad Platforms Data Products Engineering team. As a key member of the team, you will be responsible for developing the next generation of data products and analytical solutions that empower our Algo, Product, Data Insights, Sales, Marketing, and Executive teams.Key...

  • Senior Python Developer with Data Expertise

    2 weeks ago

    Austin, Texas, United States Omni Inclusive Full time

    Job Requirements:As a senior-level developer, you will have approximately 10+ years of programming experience and be an expert-level Python developer. You should have 5+ years of actual Python experience, with skills current on the latest Python versions 3.9+.Key Responsibilities:Architect and develop high-quality code using object-oriented programming, code...

  • Big Data Developer

    7 days ago

    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data DeveloperJob Description:We are seeking a skilled Big Data Developer to join our team at United Software Group. The ideal candidate will have expertise in Spark, Scala, and AWS, with a strong understanding of data processing and analysis.Key Responsibilities:Design and develop scalable data processing pipelines using Spark and ScalaWork...

  • Data Engineer

    2 weeks ago

    Austin, Texas, United States Diverse Lynx Full time

    Job Summary:We are seeking a highly skilled Data Engineer with expertise in Python and big data processing to join our team at Diverse Lynx LLC. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and pyspark. Your experience in ETL and feature engineering will be crucial in...

  • Big Data Developer

    2 weeks ago

    Austin, Texas, United States United Software Group Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at United Software Group Inc. The ideal candidate will have expertise in Spark, Scala, and AWS, with a strong understanding of data architecture and processing.Key Responsibilities:Design and develop scalable data pipelines using Spark and ScalaImplement data...

  • Data Architect

    4 weeks ago

    Austin, Texas, United States Expedia Partner Solutions Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Customer Data Platform team at Expedia Group. As a Senior Data Engineer, you will be responsible for designing and implementing big data applications, data ingestion, real-time data processing, and batch analytics using technologies such as Spark Streaming, Kafka,...

  • Senior Data Engineer

    6 days ago

    Austin, Texas, United States Collabera Full time

    Data Engineering Role at CollaberaWe are seeking a highly skilled Data Engineer to join our team at Collabera. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Python, PySpark, and ScalaDevelop and maintain data warehouses and ETL...

  • Senior Java Developer with Big Data Expertise

    6 days ago

    Austin, Texas, United States Info Way Solutions Full time

    Job Title: Senior Java Developer with Big Data ExpertiseLocation: Not specifiedType: ContractJob Description:10+ years of experience in software developmentProficient in Java programming languageExpertise in Big Data technologies, including Kafka and MongoDBStrong coding skills and experience with Spring BootProficient in writing SQL queriesInfo Way...

  • Senior Data Engineer with Spark

    1 week ago

    Austin, Texas, United States United Software Group Full time

    Job Title: Senior Data Engineer with SparkAt United Software Group, we are seeking a highly skilled Senior Data Engineer with expertise in Spark and Scala to join our team.Key Responsibilities:* Design and implement full-scale data warehouse solutions* Develop and maintain large-scale data processing systems using Spark and Scala* Collaborate with...

  • Data Engineer with Java Expertise

    1 week ago

    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Data Engineer with Java ExpertiseRole Description:Data Engineer - Hadoop with Java and Python skills required. The ideal candidate will have experience with Hdfs, Hadoop, and nice-to-have skills in AWS, Airflow, and Oozie. Key responsibilities include production support, enhancements, bug fixes, and new feature development.Key Responsibilities:Big...

Senior Big Data Engineer with Scala/Python Expertise

2 months ago

Austin, Texas, United States Infosys Full time
About the Role

We are seeking a highly skilled Senior Big Data Engineer to join our team at Infosys. As a key member of our data engineering team, you will play a critical role in designing and developing large-scale data processing systems using Hadoop and Spark.

Key Responsibilities
  • Design and develop high-quality data processing systems using Hadoop and Spark
  • Collaborate with cross-functional teams to identify business requirements and develop data solutions
  • Develop and maintain large-scale data processing pipelines using Scala/Python
  • Work with data engineers to design and implement data architectures
  • Participate in code reviews and ensure high-quality code deliverables
  • Lead validation for all types of testing and support activities related to implementation, transition, and warranty
Requirements
  • Bachelor's degree or foreign equivalent required from an accredited institution
  • At least 4 years of experience in Information Technology
  • At least 3 years of hands-on experience with Hadoop distributed frameworks while handling large amounts of big data using Spark and Hadoop Ecosystems
  • At least 2 years of experience with Spark required
  • At least 2 years of experience with Scala/Python/Java required
  • U.S. citizens and those authorized to work in the U.S. are encouraged to apply
Preferred Qualifications
  • At least 1 year of AWS development experience is preferred
  • At least 1 year of hands-on experience with Scala
  • Ability to work within deadlines and effectively prioritize and execute on tasks
  • Strong communication skills (verbal and written) with ability to communicate across teams, internal and external at all levels
  • Experience in Drive automations
  • DevOps Knowledge is an added advantage
  • Proficient knowledge of SQL with any RDBMS