Data Processing Solutions Architect
4 days ago
Company Overview:
Photon is a leader in the field of data processing and analytics. We are seeking a talented Data Processing Solutions Architect to design and implement scalable and efficient data processing solutions using PySpark and related big data technologies. The ideal candidate will possess a strong background in data engineering, excellent analytical and problem-solving skills, and the ability to work effectively with cross-functional teams.
Job Description:
The Data Processing Solutions Architect will be responsible for designing, implementing, and maintaining data processing applications that handle complex data tasks, ensure data quality, and integrate with diverse data sources. Key responsibilities include:
Key Responsibilities:
- Data Engineering Development:
- Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources.
- Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
- Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
- Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.
- Data Analysis and Transformation:
- Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
- Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.
- Data Integration and ETL:
- Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
- Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms.
Salary: $180,000 - $250,000 per year, depending on experience and qualifications.
-
Data Solutions Architect
2 weeks ago
Dallas, Texas, United States Saxon Global Full timeJob Summary:This role is for a highly skilled Data Solutions Architect to join Saxon Global in a 12 month contract with Comerica Bank. The successful candidate will be based in Dallas, TX and will be required to work onsite from day one. The working arrangement will be 2 days in the office and 3 days remote.The ideal candidate will have significant...
-
Senior Data Solutions Architect
2 weeks ago
Dallas, Texas, United States CV Library Full timeJob Title: Senior Data Solutions ArchitectEstimated Salary: $140,000 - $180,000 per year.About CV LibraryWe are a dynamic and innovative company based in Dallas, TX, seeking a highly skilled Senior Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data...
-
Senior Data Solutions Architect
2 weeks ago
Dallas, Texas, United States Cays Inc Full timeJob OverviewCays Inc is seeking a highly skilled Senior Data Solutions Architect to join our team in Dallas, TX.Estimated Salary Range$120,000 - $180,000 per year, depending on experience.Job DescriptionWe are looking for a talented individual who can design and implement data solutions that drive business growth and improve operational efficiency. As a...
-
Data Solutions Architect
2 weeks ago
Dallas, Texas, United States IT Vision Group Full timeJob OverviewWe are seeking a highly skilled Data Solutions Architect to lead our cloud native engineering efforts.
-
Data Analysis and MDM Solutions Architect
2 weeks ago
Dallas, Texas, United States Compunnel Inc. Full timeAbout the RoleWe are seeking a skilled Data Analysis and MDM Solutions Architect to join our team at Compunnel Inc.Job Description:This role involves performing in-depth data analysis and mapping requirements to Stibo MDM functionality, ensuring seamless integration with our systems.The ideal candidate will support the technical team during implementation,...
-
Data Engineering Solutions Architect
2 weeks ago
Dallas, Texas, United States Anblicks Full timeSenior Data Engineer PositionWe are seeking an experienced Data Engineering Solutions Architect to join our team at Anblicks.About the Role:This is a senior-level position that requires in-depth expertise in designing, developing, and implementing data engineering solutions using next-generation data techniques. The ideal candidate will have extensive...
-
Data Analyst and Architect for MDM Solutions
4 days ago
Dallas, Texas, United States Compunnel Inc. Full timeJob OverviewCompunnel Inc. is seeking a highly skilled Data Analyst and Architect to join our team. This individual will play a crucial role in analyzing data requirements, designing solutions using Stibo MDM functionality, and supporting the technical implementation team.
-
Data Architect Lead
2 weeks ago
Dallas, Texas, United States Anblicks Full timeAbout AnblicksAnblicks is a leading technology consulting firm that helps businesses drive innovation and growth through data-driven insights.Salary Range: $120,000 - $180,000 per yearData Solutions Architect Job DescriptionWe are seeking a highly skilled Data Solutions Architect to join our team in Dallas, Texas. As a key member of our data architecture...
-
Cloud Data Solutions Architect
2 days ago
Dallas, Texas, United States The Options Clearing Corporation Full timeJob SummaryThe Options Clearing Corporation is seeking a skilled Senior Associate, Software Engineering to join our team. As a key member of our technical staff, you will be responsible for designing and developing scalable and resilient hybrid and cloud-based data solutions that support critical financial market clearing and risk activities.In this role,...
-
Data Pipeline Architect
2 days ago
Dallas, Texas, United States TechnoGen Full timeTechngen is looking for an experienced Data Pipeline Architect to lead the design and development of our data infrastructure components on GCP. As a key member of the team, you will work closely with cross-functional teams to understand data requirements, implement data models, and ensure data integrity and reliability throughout the entire data...
-
Digital Solutions Architect
3 weeks ago
Dallas, Texas, United States Brown & Brown Insurance Full timeBrown & Brown Insurance, a leading independent insurance intermediary, is seeking an exceptional Digital Solutions Architect to join its team.About Us:We are a company built on meritocracy, where self-starters and those committed to customer satisfaction thrive. With over 75 years of continuous service, we have established ourselves as one of the largest and...
-
Dallas, Texas, United States Syntricate Technologies Full timeAt Syntricate Technologies, we are seeking a skilled Cloud Solutions Architect to join our team. This is an excellent opportunity for an experienced professional to leverage their expertise in cloud architecture, containerization, and data processing to drive innovation and growth.About the Role:We are looking for a highly motivated and collaborative...
-
Dallas, Texas, United States Pronix - US Full timePronix - US is seeking a Senior Enterprise Architect to lead the design and implementation of our cloud and data solutions. This role will involve developing and maintaining the technical architecture of our enterprise systems, ensuring alignment with business goals and strategic objectives.The ideal candidate will have expertise in cloud computing, data...
-
Data Solutions Architect
2 weeks ago
Dallas, Texas, United States BuzzClan Full timeJob DescriptionCompany DescriptionJob Title: Data Engineer (Fulltime/W2)Location: Dallas, TxFulltimeJob Description:We are seeking a highly skilled Data Engineer with expertise in the Microsoft environment to join our team. The ideal candidate will have strong hands-on experience in version control and related tools, along with a deep understanding of the...
-
Senior Data Architect
2 weeks ago
Dallas, Texas, United States Anblicks Full timeWe are seeking a Senior Data Architect to join our team at Anblicks.The estimated salary for this position is $180,000 - $220,000 per year.As a Senior Data Architect, you will be responsible for designing and implementing Snowflake data pipelines and data warehouses to support business intelligence, analytics, and machine learning initiatives.You will...
-
Cloud Data Architect
2 weeks ago
Dallas, Texas, United States Resource Informatics Group Inc Full timeJob Title: Cloud Data ArchitectEstimated Salary: $140,000 - $180,000 per yearThis is a remote role for an experienced AWS Big Data Specialist who can design and implement cloud-based data storage solutions using S3, AWS Glue, and Apache Spark. The ideal candidate will have at least 5 years of experience with cloud-based big data processing and ETL/ELT...
-
Architect of Enterprise Solutions
3 weeks ago
Dallas, Texas, United States Inficare Full timeAbout the RoleWe are seeking a highly skilled Enterprise Architect to join our team at Inficare. As an Enterprise Architect, you will be responsible for designing and implementing end-to-end solutions that meet the business needs of our organization. This is an exciting opportunity to work with a talented team of professionals who are passionate about...
-
Senior Data Architect
3 weeks ago
Dallas, Texas, United States Anblicks Full timeAbout AnblicksWe are a leading provider of data engineering services, and we're looking for an experienced Senior Data Architect to join our team.Salary: $175,000 - $225,000 per yearJob Description:As a Senior Data Architect at Anblicks, you will be responsible for designing and implementing scalable data pipelines and warehouses that support business...
-
Profisee MDM Data Architect
2 weeks ago
Dallas, Texas, United States InfoVision Inc. Full timeAbout the RoleWe are seeking an experienced Profisee Master Data Management (MDM) Data Architect to join our InfoVision Inc. team in Dallas, TX.Key Responsibilities:Design and develop Profisee MDM solutions to meet business requirements, ensuring data integrity and enhancing data management processes.Implement MDM best practices and standards, integrating...
-
Senior Data Architect
2 days ago
Dallas, Texas, United States Likewize Full timeJob Title: Senior Data ArchitectWe are searching for a skilled Senior Data Architect to lead our data infrastructure team at Likewize. This role requires expertise in designing, developing, and maintaining scalable data platforms that empower teams with actionable insights. Our ideal candidate will have at least 10 years of experience in big data...