Data Engineer with Spark

3 weeks ago

Austin, United States ApTask Full time
About Client:
Client is a company that helps other businesses with technology and consulting services. They offer various services like developing software, managing computer systems, and providing advice on how to improve business processes. Client works with different industries like healthcare, finance, retail, and more. They help these businesses by using technology to make their operations smoother and more efficient. For example, they might create a mobile app for a retail store to make it easier for customers to shop online, or they might help a hospital manage patient records using computer systems.
Overall, Client is like a trusted partner that businesses can rely on to solve their technology-related challenges and make their operations better. They have experts who understand the business needs and use technology to find the right solutions.

Salary Range: $125K-$135K/Annum

Job Description:
Requirements:
  • Spark
  • Scala
  • Big data databases - like HBase etc
  • PySpark
  • Python
  • Knowledge of Airflow , Hive etc.. would be good
  • Datawarehouse
  • AWS - good to have
  • Good communication skill
Qualification:
  • Minimum of 10+ year of experience designing and implementing a full-scale data warehouse solution.
  • A minimum of Six years' experience in developing using Spark, Scala .
  • A highly effective communicator, both orally and in writing
  • Problem-solving and architecting skills in cases of unclear requirements.


About ApTask:
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.

If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.com .

  • Data Engineer with Spark

    4 weeks ago

    Austin, United States Talent Groups Full time

    We are looking for a Full-Time Data Engineer with expertise in Apache Spark and Scala. The ideal candidate should have more than 11 years of experience in IT.Requirements:SparkScalaBig data databases - like HBase etcPySparkPythonKnowledge of Airflow , Hive etc.. would be goodDatawarehouseAWS – good to haveGood communication skill Role and...

  • Speech-Language Pathologist at Spark Learning

    2 weeks ago

    Austin, Texas, United States Spark Learning Full time

    Exciting Opportunity for a Speech-Language Pathologist Are you passionate about enhancing the communication skills of children? At Spark Learning, we are dedicated to making a positive impact in the lives of young individuals. Located in the dynamic Austin area, Spark Learning is a locally owned organization led by BCBAs, specializing in Applied Behavior...

  • Data Engineer

    1 week ago

    Austin, United States Purple Drive Full time

    Greetings from Purple Drive Technologies Role: C Location: Austin Sunnyvale Remote working PST hours Hire Type: Full Time opportunity Description Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities Design implement optimize and maintain data pipelines and...

  • Data Engineer

    3 weeks ago

    Austin, United States Talent Groups Full time

    Role :Data engineer with Spark & Scala Location: Sunnyvale, CA / Austin, TX Full time Requirements: Spark Scala Big data databases - like HBase etc PySpark Python Knowledge of Airflow , Hive etc.. would be good Datawarehouse AWS - good to have

  • Data Engineer

    4 weeks ago

    Austin, United States Talent Groups Full time

    Role :Data engineer with Spark & ScalaLocation: Sunnyvale, CA / Austin, TX Full timeRequirements:•Spark•Scala•Big data databases - like HBase etc•PySpark•Python•Knowledge of Airflow , Hive etc.. would be good•Datawarehouse•AWS – good to have

  • Data Engineer

    4 weeks ago

    Austin, United States Talent Groups Full time

    Role :Data engineer with Spark & ScalaLocation: Sunnyvale, CA / Austin, TX Full timeRequirements:•Spark•Scala•Big data databases - like HBase etc•PySpark•Python•Knowledge of Airflow , Hive etc.. would be good•Datawarehouse•AWS – good to have

  • Machine Learning Engineer with Data Engineering

    2 hours ago

    Austin, United States Talent Groups Full time

    Job Description: We are seeking a skilled Machine Learning Engineer with a strong background in data engineering. The ideal candidate should be proficient in Python, Spark, Scala and experienced in building scalable data pipelines and ML models. 5+ years of relevant experience in machine learning and data engineering.Qualifications:Proficiency in Python,...

  • Data Engineer

    3 weeks ago

    Austin, United States Tata Consultancy Services Full time

    #LI-AS3 - Graph DB, ETL Framework, DataWarehousing, NoSQL, PySpark & Apache Spark experience - Python - Airflow DAGs with Flink - Cloud -AWS , S3, Iceberg experience - A background in computer science, engineering, mathematics, or similar quantitative field with a minimum of 2 years professional experience •Experience using Spark, Kafka, Hadoop, or similar...

  • Data Engineer

    3 weeks ago

    Austin, United States GMS Advisors Full time

    We are looking for creative and enthusiastic Data Engineers to join our team in building the best Data Platform on the street. We're responsible for managing the flow of data into the firm, maintaining the data lake, creating analytics-ready datasets, and building the APIs that make everything accessible to our clients. Our singular goal is to help our...

  • Full Time

    4 weeks ago

    Austin, United States Talent Groups Full time

    Data Engineer with Spark & ScalaSunnyvale, CA / Austin, TX (Day one on site)Full Time Role and QualificationMinimum of 10+ year of experience designing and implementing a full-scale data warehouse solution.A minimum of Six years’ experience in developing using Spark, Scala.SparkScalaBig data databases - like HBase etcData warehouseAWS – good to have

  • Scala/Python Spark Engineer

    2 weeks ago

    Austin, Texas, United States Infosys Full time

    Position Overview:As a Spark Developer with Scala/Python, you will engage with essential stakeholders and leverage your technical expertise throughout various phases of the Software Development Life Cycle. This includes gathering requirements, defining application architecture, and designing solutions. Your contributions will be vital in crafting high-level...

  • Scala/Python Spark Engineer

    2 weeks ago

    Austin, Texas, United States Infosys Full time

    Position Overview:As a Spark Developer with Scala/Python, you will engage with essential stakeholders and leverage your technical expertise throughout various phases of the Software Development Life Cycle. This includes requirements gathering, application architecture formulation, and design.Key Responsibilities:Contribute to the creation of high-level...

  • Scala/Python Spark Engineer

    2 weeks ago

    Austin, Texas, United States Infosys Full time

    Position Overview:As a Spark Developer with Scala/Python, you will engage with key stakeholders and leverage your technical expertise throughout various phases of the Software Development Life Cycle. This includes Requirements Gathering, Application Architecture formulation, and Design. Your contributions will be vital in crafting high-level design...

  • Scala/Python Spark Engineer

    2 weeks ago

    Austin, Texas, United States Infosys Full time

    Position Overview:As a Spark Developer with Scala/Python, you will engage with essential stakeholders and leverage your technical expertise throughout various phases of the Software Development Life Cycle. This includes gathering requirements, defining application architecture, and designing solutions. Your contributions will be vital in crafting high-level...

  • Scala/Python Spark Engineer

    3 weeks ago

    Austin, Texas, United States Infosys Full time

    Position Overview:As a Spark Developer with Scala/Python, you will engage with essential stakeholders and leverage your technical expertise throughout various phases of the Software Development Life Cycle. This includes gathering requirements, defining application architecture, and designing solutions. Your contributions will be pivotal in developing...

  • Scala/Python Spark Engineer

    2 weeks ago

    Austin, Texas, United States Infosys Full time

    Position Overview:As a Spark Developer with Scala/Python, you will engage with essential stakeholders and leverage your technical expertise throughout various phases of the Software Development Life Cycle. This includes Requirements Gathering, Application Architecture formulation, and Design. Your contributions will be pivotal in developing high-level design...

  • Data Engineer

    3 weeks ago

    Austin, United States Tata Consultancy Services Full time

    #LI-AS3 Description Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities •Design, implement, optimize, and maintain data pipelines and reports using Python, SQL, Java, Spark, PySpark, Java •Collaborate with data analysts, and engineering teams to gather requirements,...

  • Data Engineer Python PySpark Java

    1 week ago

    Austin, United States Purple Drive Full time

    Description Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities Design implement optimize and maintain data pipelines and reports using Python SQL Java Spark PySpark Java Collaborate with data analysts and engineering teams to gather requirements and build...

  • Senior Big Data Engineer with Scala/Python Expertise

    1 week ago

    Austin, Texas, United States Infosys Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Infosys. As a key member of our data engineering team, you will play a critical role in designing and developing large-scale data processing systems using Hadoop and Spark.Key ResponsibilitiesDesign and develop high-quality data processing systems using Hadoop and...

  • Platform Data Engineer

    3 weeks ago

    Austin, United States Info Way Solutions Full time

    Job Description for Data Engineer: proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for...