PySpark Engineer Lead

1 day ago


Dallas, Texas, United States Photon Full time
Job Title: PySpark Engineer Lead

Job Description:
At Photon, we are seeking a highly skilled PySpark Engineer Lead to oversee the development of our data processing applications. The successful candidate will be responsible for designing, implementing, and maintaining scalable and efficient data processing solutions using PySpark and related big data technologies. A strong background in data engineering, excellent leadership skills, and experience working with cross-functional teams are essential for this role.

Key Responsibilities:
  • Data Engineering Leadership:
  • Lead a team of developers in designing, developing, and testing data processing applications using PySpark.
  • Collaborate with data analysts and scientists to understand data processing requirements and deliver high-quality data solutions.
  • Oversee the implementation of data integration and ETL processes to ensure consistency, accuracy, and performance.

  • Data Analysis and Transformation:
  • Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
  • Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.

Salary: $150,000 - $220,000 per year, depending on experience and qualifications.

  • Dallas, Texas, United States Tek Ninjas Full time

    Job DescriptionEstimated Salary: $120,000 - $180,000 per year in Dallas, TXWe are seeking a highly skilled Lead Data Processing Engineer to join our team at Tek Ninjas.About the Role:This is a challenging and rewarding role that involves designing and implementing data processing workflows using PySpark and Spark Pyspark.The ideal candidate will have...

  • Software Engineer

    2 weeks ago


    Dallas, Texas, United States Expedite Technology Solutions LLC Full time

    Job DescriptionHiring for a skilled Software Engineer to join our team at Expedite Technology Solutions LLC.Compensation:$135,000 - $160,000 per year, depending on experience.About the RoleWe are seeking an experienced Software Engineer with expertise in designing and developing scalable, efficient, and testable cloud-based systems using AWS, Python, and...


  • Dallas, Texas, United States Tiger Analytics Full time

    About UsTiger Analytics is a pioneering AI and analytics consulting firm with a global presence. Our mission is to harness the power of data and technology to drive transformative solutions that impact millions worldwide.Career OpportunitiesThis role presents an exceptional opportunity for growth in a dynamic, entrepreneurial environment with high individual...


  • Dallas, Texas, United States Photon Full time

    Job Title: Senior Big Data DeveloperCompany Overview:Photon is a leading organization in the field of data processing and analytics. We are seeking a skilled Senior Big Data Developer to join our team and drive the development of robust data processing solutions within our data platform.Job Description:We are looking for an experienced developer with strong...


  • Dallas, Texas, United States eTek IT Services, Inc. Full time

    Job Title: Big Data EngineerAbout eTek IT Services, Inc.eTek IT Services, Inc. is a leading provider of innovative technology solutions.Salary:$120,000 - $150,000 per yearJob Description:Data Engineer PositionThe ideal candidate will have extensive experience in big data engineering, with a strong background in Google Cloud Platform (GCP) technologies such...


  • Dallas, Texas, United States Photon Full time

    Job Title: Data Processing Solutions ArchitectCompany Overview:Photon is a leader in the field of data processing and analytics. We are seeking a talented Data Processing Solutions Architect to design and implement scalable and efficient data processing solutions using PySpark and related big data technologies. The ideal candidate will possess a strong...


  • Dallas, Texas, United States H-E-B Full time

    H-E-B is a leading grocery retailer seeking an experienced Director of Digital Engineering, Customer Data Strategy. The ideal candidate will have 4+ years of experience as a Data Engineer with a focus on customer data and identity resolution.This is an exciting opportunity to join a rapidly growing digital engineering organization, delivering modern,...

  • AWS Data Engineer

    2 weeks ago


    Dallas, Texas, United States Inizio Partners Full time

    About the JobWe are expanding our Data Engineering team and looking for an experienced AWS, Python, and SQL Data Engineer to design and implement our new data pipelines using AWS and train other team members.Key Responsibilities:Implement and manage AWS tools and environment.Build and write complex scripts to transform ingested data using Python/Pyspark in...


  • Dallas, Texas, United States Diverse Lynx Full time

    About the PositionWe are seeking a highly experienced Data Scientist to lead our machine learning efforts. The successful candidate will have a strong background in NLP, Machine Learning, Deep Learning, Optimization, Algorithm, and Software development.The ideal candidate will have prior knowledge of Search/Recommendation Systems related technology and...


  • Dallas, Texas, United States Anblicks Full time

    Senior Data Engineer PositionWe are seeking an experienced Data Engineering Solutions Architect to join our team at Anblicks.About the Role:This is a senior-level position that requires in-depth expertise in designing, developing, and implementing data engineering solutions using next-generation data techniques. The ideal candidate will have extensive...


  • Dallas, Texas, United States SoftPathTechnologies Full time

    Job OverviewGreetings from SoftPath Technologies, a leading provider of innovative software solutions. We are currently seeking an experienced Senior Automation Quality Assurance Specialist to join our team.Estimated Salary: $45/hourLocation: Dallas, TX (Hybrid - Local Only)Visa Requirements: USC, GC, EADJob DescriptionAs a Senior Automation Quality...


  • Dallas, Texas, United States Pan Asia Resources Full time

    Job Title: Data Engineer ArchitectLocation: Remote OpportunityJob Type: Full-TimeDepartment: Data EngineeringWe are seeking a skilled Data Engineer Architect to design and implement scalable data pipelines and architecture that facilitate data ingestion, processing, and analysis.Key Responsibilities:Design and implement robust data architectures using...


  • Dallas, Texas, United States Diverse Lynx Full time

    About the Role:We are searching for a seasoned Data Pipeline Architect with expertise in GCP services to lead our data engineering efforts at Diverse Lynx LLC. In this role, you will be responsible for designing, implementing, and maintaining large-scale data pipelines that drive business growth and insights. Your primary responsibilities will include...


  • Dallas, Texas, United States DirectViz Solutions, LLC Full time

    Job Summary:The Solutions Engineering Lead will oversee program integration and provide support for technical analyses and reviews. Key responsibilities include process improvement, data compilation, and program integration support.Key Responsibilities:Lead solution engineering projects and ensure alignment with project goals and timelines.Conduct technical...


  • Dallas, Texas, United States Tiger Analytics Full time

    Tiger Analytics is a pioneering AI and analytics consulting firm that revolutionizes businesses with data-driven solutions. As a global organization, we have delivery centers across the globe and offices in multiple cities across India, the US, UK, Canada, and Singapore. Our culture is centered around expertise and respect with a team-first mindset.We are...

  • Lead QA Engineer

    1 day ago


    Dallas, Texas, United States United Software Group Full time

    **Job Title:** Lead QA Engineer**Company Overview:** United Software Group is seeking a highly skilled Lead QA Engineer to join our team. The ideal candidate will have strong experience in driving proper Client change management process and change methodology across lending project releases, as well as expertise in auditing metrics and resolving...


  • Dallas, Texas, United States Tiger Analytics Full time

    Tiger Analytics is a global AI and analytics consulting firm that empowers businesses to drive meaningful change. With data and technology at the heart of our solutions, we are solving complex problems that impact millions globally. Our culture is built around expertise and respect with a team-first mindset, modeled after the principles of Silicon Valley...

  • Data Engineering Lead

    2 weeks ago


    Dallas, Texas, United States Resource Informatics Group Inc Full time

    Job Title: Senior Data EngineerJob Description:At Resource Informatics Group Inc, we are seeking a highly skilled Senior Data Engineer to lead our data engineering projects.The ideal candidate will have a strong background in data engineering and experience in mentoring team members.Key Responsibilities:• Manage and deliver ETL solutions by working closely...


  • Dallas, Texas, United States Brillio Full time

    Job OverviewAs a Software Engineering Lead at Brillio, you will be responsible for leading the design, development, and implementation of robust and scalable .NET Core APIs. You will work closely with cross-functional teams to gather requirements and architect solutions. The ideal candidate will have extensive experience in developing .NET APIs using C#,...

  • Lead Engineer

    2 days ago


    Dallas, Texas, United States Disability Solutions Full time

    About the RoleThis exciting opportunity is part of our Electronic Systems division, where we develop and deliver cutting-edge electronic systems that make a real difference in the world. As Lead Engineer - RF Systems, you will be responsible for setting the engineering vision for our growing Eclipse RF portfolio and leading the development of complex...