Senior Big Data Developer

1 day ago


Dallas, Texas, United States Photon Full time
Job Title: Senior Big Data Developer

Company Overview:
Photon is a leading organization in the field of data processing and analytics. We are seeking a skilled Senior Big Data Developer to join our team and drive the development of robust data processing solutions within our data platform.

Job Description:
We are looking for an experienced developer with strong PySpark skills to design, implement, and maintain data processing applications that handle complex data tasks, ensure data quality, and integrate with diverse data sources. The ideal candidate will possess hands-on experience with big data technologies, excellent analytical and problem-solving skills, and the ability to work effectively with cross-functional teams.

Key Responsibilities:
  • Data Engineering Development:
  • Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources.
  • Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
  • Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
  • Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.

  • Data Analysis and Transformation:
  • Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
  • Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.

  • Data Integration and ETL:
  • Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
  • Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms.

Salary: $120,000 - $180,000 per year, depending on experience and qualifications.

  • Dallas, Texas, United States Tekstrom Inc Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Analytics Developer to join our team at Tekstrom Inc. This is an exciting opportunity to work with big data analytics engineers, develop automated testing systems, and contribute to building a flexible and scalable data testing automation solution.Key Responsibilities:Collaborate with...


  • Dallas, Texas, United States Resource Informatics Group Inc Full time

    Job OverviewWe are seeking a highly skilled Senior Big Data Architect to join our team at Resource Informatics Group Inc. in Dallas, TX.This is a 3-month all-inclusive contract position with the opportunity to work on complex distributed modern data platforms and contribute to the design, planning, and governance of implementing projects in Big...


  • Dallas, Texas, United States Primoris Services Corporation Full time

    Job OverviewWe are seeking an experienced Senior Data Architect and Big Data Engineer to lead our team in designing, implementing, and maintaining large-scale distributed systems using the Databricks Lakehouse platform.


  • Dallas, Texas, United States VIZIO Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer - Cloud Architect to join our team. As a key member of our organization, you will be responsible for designing, building, and launching new data extraction, transformation, and loading processes in production.

  • Big Data Engineer

    1 day ago


    Dallas, Texas, United States Hunt Corporation Full time

    About the PositionHunt Corporation is seeking an experienced Big Data Engineer to join our team. This is a highly competitive role with a salary range of $150,000 - $200,000 per year.In this position, you'll be responsible for designing and developing scalable data pipelines, implementing strong data security measures, and partnering with data scientists and...

  • Big Data Specialist

    2 weeks ago


    Dallas, Texas, United States IT Vision Group Full time

    Job DescriptionTitle: Big Data SpecialistLocation: RemoteDuration: 12 Months+Client: TCS/PrudentialJob Description :Azure-based Data Engineer or Architect is needed to drive business growth with cutting-edge data solutions. As a Big Data Specialist, you will design, develop, and implement scalable data architectures that meet the client's needs.We are...


  • Dallas, Texas, United States eTek IT Services, Inc. Full time

    Job Title: Big Data EngineerAbout eTek IT Services, Inc.eTek IT Services, Inc. is a leading provider of innovative technology solutions.Salary:$120,000 - $150,000 per yearJob Description:Data Engineer PositionThe ideal candidate will have extensive experience in big data engineering, with a strong background in Google Cloud Platform (GCP) technologies such...


  • Dallas, Texas, United States Likewize Full time

    Job Title: Senior Data ArchitectWe are searching for a skilled Senior Data Architect to lead our data infrastructure team at Likewize. This role requires expertise in designing, developing, and maintaining scalable data platforms that empower teams with actionable insights. Our ideal candidate will have at least 10 years of experience in big data...


  • Dallas, Texas, United States Databricks Full time

    Unlock Your Potential with DatabricksWe are Databricks, the data and AI company that empowers organizations to unlock their full potential by providing a unified platform for data, analytics, and AI. Our customers include Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500. We are seeking an experienced pre-sales professional to join our team as...


  • Dallas, Texas, United States Lorven Technologies Full time

    Lorven Technologies is hiring a Lead Big Data Engineer to join our team. In this role, you will be responsible for designing, constructing, installing, testing, and maintaining large-scale data management systems using your expertise in Snowflake, PostgreSQL, and Snap logic. You will also work closely with our product teams to prioritize features and manage...


  • Dallas, Texas, United States Alcority Full time

    Alcority is seeking an experienced Data Engineering Team Lead to join our team. As a Data Engineering Team Lead, you will be responsible for leading a team of data engineers in designing, developing, and maintaining scalable data pipelines, ETL/ELT processes, and data models.Responsibilities:Team Leadership: Lead a team of data engineers in designing,...

  • Big Data Specialist

    2 days ago


    Dallas, Texas, United States CloudBC Labs Full time

    Job Description:    CloudBC Labs is seeking a highly skilled Data Architect - BigQuery Expert to join our team. This long-term contract position offers a competitive salary of $180,000 per year.In this role, you will work with our team to design, implement, and maintain large-scale data architectures using BigQuery. You will also be responsible for...


  • Dallas, Texas, United States CV Library Full time

    Job Title: Senior Data Solutions ArchitectEstimated Salary: $140,000 - $180,000 per year.About CV LibraryWe are a dynamic and innovative company based in Dallas, TX, seeking a highly skilled Senior Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data...


  • Dallas, Texas, United States Saxon Global Full time

    Key Responsibilities:As a Senior Systems Data Architect at Saxon Global, you will be responsible for designing a data strategy that aligns with our business processes. This includes experience with RDBMS databases such as Teradata, Oracle, or SQL Server, and Hadoop Big Data Platform.Technical Requirements:Expertise in SQLInformaticaData/Dimensional Modeling...


  • Dallas, Texas, United States TechnoGen Full time

    Job DescriptionWe are looking for a talented Senior Data Infrastructure Developer to join our team at TechnoGen. In this role, you will be responsible for designing, implementing, and managing robust data pipelines using Python, PySpark, and SQL. Your expertise in AWS services such as DMS, Glue, Step Functions, S3, Redshift, RDS, EMR, IAM, and Lambda will...


  • Dallas, Texas, United States Jacobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Jacobs. This team member will lead data engineering projects to develop and maintain data pipelines for our product, as well as help productize those data products and algorithms into our scalable StreetLight InSight analytics platform.Key ResponsibilitiesBuild and...


  • Dallas, Texas, United States Freddie Mac Full time

    About the RoleWe are seeking an experienced Senior Data Governance Developer to join our IT Data Solutions team. As a key member of our Agile team, you will work closely with multiple divisions across the organization to develop and implement data governance solutions.In this role, you will be responsible for designing, developing, testing, and managing...

  • Program Coordinator

    2 weeks ago


    Dallas, Texas, United States Big Thought Full time

    About the Role:">We are seeking a highly motivated and organized Program Coordinator to join our team at Big Thought. As a Program Coordinator, you will play a vital role in ensuring the success of our youth development programs by providing support to Site Specialists and Instructors with planning, supervision, and activities for elementary...


  • Dallas, Texas, United States Big D Metalworks Full time

    About the RoleWe are seeking an experienced Senior Metal Installation Manager to lead our team of metal installation professionals at Big D Metalworks in Dallas, Texas.This is a rewarding opportunity for someone with strong leadership skills and a passion for delivering exceptional customer service. As a Senior Metal Installation Manager, you will be...


  • Dallas, Texas, United States Anblicks Full time

    Senior Data Engineer PositionWe are seeking an experienced Data Engineering Solutions Architect to join our team at Anblicks.About the Role:This is a senior-level position that requires in-depth expertise in designing, developing, and implementing data engineering solutions using next-generation data techniques. The ideal candidate will have extensive...