Senior Big Data Developer
1 day ago
Company Overview:
Photon is a leading organization in the field of data processing and analytics. We are seeking a skilled Senior Big Data Developer to join our team and drive the development of robust data processing solutions within our data platform.
Job Description:
We are looking for an experienced developer with strong PySpark skills to design, implement, and maintain data processing applications that handle complex data tasks, ensure data quality, and integrate with diverse data sources. The ideal candidate will possess hands-on experience with big data technologies, excellent analytical and problem-solving skills, and the ability to work effectively with cross-functional teams.
Key Responsibilities:
- Data Engineering Development:
- Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources.
- Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
- Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
- Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.
- Data Analysis and Transformation:
- Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
- Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.
- Data Integration and ETL:
- Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
- Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms.
Salary: $120,000 - $180,000 per year, depending on experience and qualifications.
-
Senior Big Data Analytics Developer
2 weeks ago
Dallas, Texas, United States Tekstrom Inc Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Analytics Developer to join our team at Tekstrom Inc. This is an exciting opportunity to work with big data analytics engineers, develop automated testing systems, and contribute to building a flexible and scalable data testing automation solution.Key Responsibilities:Collaborate with...
-
Dallas, Texas, United States Resource Informatics Group Inc Full timeJob OverviewWe are seeking a highly skilled Senior Big Data Architect to join our team at Resource Informatics Group Inc. in Dallas, TX.This is a 3-month all-inclusive contract position with the opportunity to work on complex distributed modern data platforms and contribute to the design, planning, and governance of implementing projects in Big...
-
Senior Data Architect and Big Data Engineer
7 days ago
Dallas, Texas, United States Primoris Services Corporation Full timeJob OverviewWe are seeking an experienced Senior Data Architect and Big Data Engineer to lead our team in designing, implementing, and maintaining large-scale distributed systems using the Databricks Lakehouse platform.
-
Senior Big Data Engineer
2 weeks ago
Dallas, Texas, United States VIZIO Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer - Cloud Architect to join our team. As a key member of our organization, you will be responsible for designing, building, and launching new data extraction, transformation, and loading processes in production.
-
Big Data Engineer
1 day ago
Dallas, Texas, United States Hunt Corporation Full timeAbout the PositionHunt Corporation is seeking an experienced Big Data Engineer to join our team. This is a highly competitive role with a salary range of $150,000 - $200,000 per year.In this position, you'll be responsible for designing and developing scalable data pipelines, implementing strong data security measures, and partnering with data scientists and...
-
Big Data Specialist
2 weeks ago
Dallas, Texas, United States IT Vision Group Full timeJob DescriptionTitle: Big Data SpecialistLocation: RemoteDuration: 12 Months+Client: TCS/PrudentialJob Description :Azure-based Data Engineer or Architect is needed to drive business growth with cutting-edge data solutions. As a Big Data Specialist, you will design, develop, and implement scalable data architectures that meet the client's needs.We are...
-
Big Data Engineering Expert
2 weeks ago
Dallas, Texas, United States eTek IT Services, Inc. Full timeJob Title: Big Data EngineerAbout eTek IT Services, Inc.eTek IT Services, Inc. is a leading provider of innovative technology solutions.Salary:$120,000 - $150,000 per yearJob Description:Data Engineer PositionThe ideal candidate will have extensive experience in big data engineering, with a strong background in Google Cloud Platform (GCP) technologies such...
-
Senior Data Architect
1 day ago
Dallas, Texas, United States Likewize Full timeJob Title: Senior Data ArchitectWe are searching for a skilled Senior Data Architect to lead our data infrastructure team at Likewize. This role requires expertise in designing, developing, and maintaining scalable data platforms that empower teams with actionable insights. Our ideal candidate will have at least 10 years of experience in big data...
-
Big Data Transformation Expert
1 day ago
Dallas, Texas, United States Databricks Full timeUnlock Your Potential with DatabricksWe are Databricks, the data and AI company that empowers organizations to unlock their full potential by providing a unified platform for data, analytics, and AI. Our customers include Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500. We are seeking an experienced pre-sales professional to join our team as...
-
Lead Big Data Engineer
1 day ago
Dallas, Texas, United States Lorven Technologies Full timeLorven Technologies is hiring a Lead Big Data Engineer to join our team. In this role, you will be responsible for designing, constructing, installing, testing, and maintaining large-scale data management systems using your expertise in Snowflake, PostgreSQL, and Snap logic. You will also work closely with our product teams to prioritize features and manage...
-
Senior Big Data Engineer
1 day ago
Dallas, Texas, United States Alcority Full timeAlcority is seeking an experienced Data Engineering Team Lead to join our team. As a Data Engineering Team Lead, you will be responsible for leading a team of data engineers in designing, developing, and maintaining scalable data pipelines, ETL/ELT processes, and data models.Responsibilities:Team Leadership: Lead a team of data engineers in designing,...
-
Big Data Specialist
2 days ago
Dallas, Texas, United States CloudBC Labs Full timeJob Description: CloudBC Labs is seeking a highly skilled Data Architect - BigQuery Expert to join our team. This long-term contract position offers a competitive salary of $180,000 per year.In this role, you will work with our team to design, implement, and maintain large-scale data architectures using BigQuery. You will also be responsible for...
-
Senior Data Solutions Architect
2 weeks ago
Dallas, Texas, United States CV Library Full timeJob Title: Senior Data Solutions ArchitectEstimated Salary: $140,000 - $180,000 per year.About CV LibraryWe are a dynamic and innovative company based in Dallas, TX, seeking a highly skilled Senior Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data...
-
Senior Systems Architect
2 weeks ago
Dallas, Texas, United States Saxon Global Full timeKey Responsibilities:As a Senior Systems Data Architect at Saxon Global, you will be responsible for designing a data strategy that aligns with our business processes. This includes experience with RDBMS databases such as Teradata, Oracle, or SQL Server, and Hadoop Big Data Platform.Technical Requirements:Expertise in SQLInformaticaData/Dimensional Modeling...
-
Senior Data Infrastructure Developer
1 day ago
Dallas, Texas, United States TechnoGen Full timeJob DescriptionWe are looking for a talented Senior Data Infrastructure Developer to join our team at TechnoGen. In this role, you will be responsible for designing, implementing, and managing robust data pipelines using Python, PySpark, and SQL. Your expertise in AWS services such as DMS, Glue, Step Functions, S3, Redshift, RDS, EMR, IAM, and Lambda will...
-
Senior Data Scientist and Engineer
2 weeks ago
Dallas, Texas, United States Jacobs Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Jacobs. This team member will lead data engineering projects to develop and maintain data pipelines for our product, as well as help productize those data products and algorithms into our scalable StreetLight InSight analytics platform.Key ResponsibilitiesBuild and...
-
Senior Data Governance Developer
2 weeks ago
Dallas, Texas, United States Freddie Mac Full timeAbout the RoleWe are seeking an experienced Senior Data Governance Developer to join our IT Data Solutions team. As a key member of our Agile team, you will work closely with multiple divisions across the organization to develop and implement data governance solutions.In this role, you will be responsible for designing, developing, testing, and managing...
-
Program Coordinator
2 weeks ago
Dallas, Texas, United States Big Thought Full timeAbout the Role:">We are seeking a highly motivated and organized Program Coordinator to join our team at Big Thought. As a Program Coordinator, you will play a vital role in ensuring the success of our youth development programs by providing support to Site Specialists and Instructors with planning, supervision, and activities for elementary...
-
Senior Metal Installation Manager
2 weeks ago
Dallas, Texas, United States Big D Metalworks Full timeAbout the RoleWe are seeking an experienced Senior Metal Installation Manager to lead our team of metal installation professionals at Big D Metalworks in Dallas, Texas.This is a rewarding opportunity for someone with strong leadership skills and a passion for delivering exceptional customer service. As a Senior Metal Installation Manager, you will be...
-
Data Engineering Solutions Architect
2 weeks ago
Dallas, Texas, United States Anblicks Full timeSenior Data Engineer PositionWe are seeking an experienced Data Engineering Solutions Architect to join our team at Anblicks.About the Role:This is a senior-level position that requires in-depth expertise in designing, developing, and implementing data engineering solutions using next-generation data techniques. The ideal candidate will have extensive...