Data Processing Solutions Architect

4 days ago


Dallas, Texas, United States Photon Full time
Job Title: Data Processing Solutions Architect

Company Overview:
Photon is a leader in the field of data processing and analytics. We are seeking a talented Data Processing Solutions Architect to design and implement scalable and efficient data processing solutions using PySpark and related big data technologies. The ideal candidate will possess a strong background in data engineering, excellent analytical and problem-solving skills, and the ability to work effectively with cross-functional teams.

Job Description:
The Data Processing Solutions Architect will be responsible for designing, implementing, and maintaining data processing applications that handle complex data tasks, ensure data quality, and integrate with diverse data sources. Key responsibilities include:

Key Responsibilities:
  • Data Engineering Development:
  • Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources.
  • Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
  • Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
  • Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.

  • Data Analysis and Transformation:
  • Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
  • Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.

  • Data Integration and ETL:
  • Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
  • Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms.

Salary: $180,000 - $250,000 per year, depending on experience and qualifications.

  • Dallas, Texas, United States Saxon Global Full time

    Job Summary:This role is for a highly skilled Data Solutions Architect to join Saxon Global in a 12 month contract with Comerica Bank. The successful candidate will be based in Dallas, TX and will be required to work onsite from day one. The working arrangement will be 2 days in the office and 3 days remote.The ideal candidate will have significant...


  • Dallas, Texas, United States CV Library Full time

    Job Title: Senior Data Solutions ArchitectEstimated Salary: $140,000 - $180,000 per year.About CV LibraryWe are a dynamic and innovative company based in Dallas, TX, seeking a highly skilled Senior Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data...


  • Dallas, Texas, United States Cays Inc Full time

    Job OverviewCays Inc is seeking a highly skilled Senior Data Solutions Architect to join our team in Dallas, TX.Estimated Salary Range$120,000 - $180,000 per year, depending on experience.Job DescriptionWe are looking for a talented individual who can design and implement data solutions that drive business growth and improve operational efficiency. As a...


  • Dallas, Texas, United States IT Vision Group Full time

    Job OverviewWe are seeking a highly skilled Data Solutions Architect to lead our cloud native engineering efforts.


  • Dallas, Texas, United States Compunnel Inc. Full time

    About the RoleWe are seeking a skilled Data Analysis and MDM Solutions Architect to join our team at Compunnel Inc.Job Description:This role involves performing in-depth data analysis and mapping requirements to Stibo MDM functionality, ensuring seamless integration with our systems.The ideal candidate will support the technical team during implementation,...


  • Dallas, Texas, United States Anblicks Full time

    Senior Data Engineer PositionWe are seeking an experienced Data Engineering Solutions Architect to join our team at Anblicks.About the Role:This is a senior-level position that requires in-depth expertise in designing, developing, and implementing data engineering solutions using next-generation data techniques. The ideal candidate will have extensive...


  • Dallas, Texas, United States Compunnel Inc. Full time

    Job OverviewCompunnel Inc. is seeking a highly skilled Data Analyst and Architect to join our team. This individual will play a crucial role in analyzing data requirements, designing solutions using Stibo MDM functionality, and supporting the technical implementation team.

  • Data Architect Lead

    2 weeks ago


    Dallas, Texas, United States Anblicks Full time

    About AnblicksAnblicks is a leading technology consulting firm that helps businesses drive innovation and growth through data-driven insights.Salary Range: $120,000 - $180,000 per yearData Solutions Architect Job DescriptionWe are seeking a highly skilled Data Solutions Architect to join our team in Dallas, Texas. As a key member of our data architecture...


  • Dallas, Texas, United States The Options Clearing Corporation Full time

    Job SummaryThe Options Clearing Corporation is seeking a skilled Senior Associate, Software Engineering to join our team. As a key member of our technical staff, you will be responsible for designing and developing scalable and resilient hybrid and cloud-based data solutions that support critical financial market clearing and risk activities.In this role,...


  • Dallas, Texas, United States TechnoGen Full time

    Techngen is looking for an experienced Data Pipeline Architect to lead the design and development of our data infrastructure components on GCP. As a key member of the team, you will work closely with cross-functional teams to understand data requirements, implement data models, and ensure data integrity and reliability throughout the entire data...


  • Dallas, Texas, United States Brown & Brown Insurance Full time

    Brown & Brown Insurance, a leading independent insurance intermediary, is seeking an exceptional Digital Solutions Architect to join its team.About Us:We are a company built on meritocracy, where self-starters and those committed to customer satisfaction thrive. With over 75 years of continuous service, we have established ourselves as one of the largest and...


  • Dallas, Texas, United States Syntricate Technologies Full time

    At Syntricate Technologies, we are seeking a skilled Cloud Solutions Architect to join our team. This is an excellent opportunity for an experienced professional to leverage their expertise in cloud architecture, containerization, and data processing to drive innovation and growth.About the Role:We are looking for a highly motivated and collaborative...


  • Dallas, Texas, United States Pronix - US Full time

    Pronix - US is seeking a Senior Enterprise Architect to lead the design and implementation of our cloud and data solutions. This role will involve developing and maintaining the technical architecture of our enterprise systems, ensuring alignment with business goals and strategic objectives.The ideal candidate will have expertise in cloud computing, data...


  • Dallas, Texas, United States BuzzClan Full time

    Job DescriptionCompany DescriptionJob Title: Data Engineer (Fulltime/W2)Location: Dallas, TxFulltimeJob Description:We are seeking a highly skilled Data Engineer with expertise in the Microsoft environment to join our team. The ideal candidate will have strong hands-on experience in version control and related tools, along with a deep understanding of the...

  • Senior Data Architect

    2 weeks ago


    Dallas, Texas, United States Anblicks Full time

    We are seeking a Senior Data Architect to join our team at Anblicks.The estimated salary for this position is $180,000 - $220,000 per year.As a Senior Data Architect, you will be responsible for designing and implementing Snowflake data pipelines and data warehouses to support business intelligence, analytics, and machine learning initiatives.You will...

  • Cloud Data Architect

    2 weeks ago


    Dallas, Texas, United States Resource Informatics Group Inc Full time

    Job Title: Cloud Data ArchitectEstimated Salary: $140,000 - $180,000 per yearThis is a remote role for an experienced AWS Big Data Specialist who can design and implement cloud-based data storage solutions using S3, AWS Glue, and Apache Spark. The ideal candidate will have at least 5 years of experience with cloud-based big data processing and ETL/ELT...


  • Dallas, Texas, United States Inficare Full time

    About the RoleWe are seeking a highly skilled Enterprise Architect to join our team at Inficare. As an Enterprise Architect, you will be responsible for designing and implementing end-to-end solutions that meet the business needs of our organization. This is an exciting opportunity to work with a talented team of professionals who are passionate about...

  • Senior Data Architect

    3 weeks ago


    Dallas, Texas, United States Anblicks Full time

    About AnblicksWe are a leading provider of data engineering services, and we're looking for an experienced Senior Data Architect to join our team.Salary: $175,000 - $225,000 per yearJob Description:As a Senior Data Architect at Anblicks, you will be responsible for designing and implementing scalable data pipelines and warehouses that support business...


  • Dallas, Texas, United States InfoVision Inc. Full time

    About the RoleWe are seeking an experienced Profisee Master Data Management (MDM) Data Architect to join our InfoVision Inc. team in Dallas, TX.Key Responsibilities:Design and develop Profisee MDM solutions to meet business requirements, ensuring data integrity and enhancing data management processes.Implement MDM best practices and standards, integrating...


  • Dallas, Texas, United States Likewize Full time

    Job Title: Senior Data ArchitectWe are searching for a skilled Senior Data Architect to lead our data infrastructure team at Likewize. This role requires expertise in designing, developing, and maintaining scalable data platforms that empower teams with actionable insights. Our ideal candidate will have at least 10 years of experience in big data...