Data Engineer Architect

11 hours ago


Dallas, Texas, United States Pan Asia Resources Full time
Job Title:
Data Engineer Architect (PySpark)

Location:
Dallas, TX

Job Type:
Full-Time

Department:
Data Engineering

We are seeking a talented Data Engineer Architect with expertise in PySpark to design and implement scalable data pipelines and architecture that facilitate data ingestion, processing, and analysis.

Key Responsibilities:

  • Design and implement robust data architectures using PySpark that support ETL processes, data warehousing, and analytics platforms.
  • Build, optimize, and maintain data pipelines for large-scale data processing, ensuring data quality, reliability, and performance.
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical specifications.
  • Identify and implement best practices for data processing and storage, including performance tuning and resource optimization.
  • Evaluate and recommend data engineering tools and technologies, keeping abreast of industry trends and advancements.
  • Create and maintain comprehensive documentation for data architecture, pipelines, and processes.

Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field
5+ years of experience in data engineering or related roles, with a strong focus on big data technologies.
Proven expertise in PySpark and experience with Apache Spark frameworks.
Proficiency in data modeling, ETL processes, and data warehousing concepts.
Experience with cloud platforms (AWS, Azure, GCP) and associated data services.
Strong programming skills in Python, with familiarity in other languages such as Scala or Java being a plus.
Knowledge of SQL and experience with relational and NoSQL databases.
Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
Strong communication skills, with the ability to articulate technical concepts to non-technical stakeholders.

Preferred Skills:
Experience with containerization technologies (Docker, Kubernetes).
Familiarity with machine learning frameworks and libraries.
Understanding of data governance, security, and compliance best practices.

We are a forward-thinking organization looking for a talented Data Engineer Architect to join our team.
  • Data Architect

    4 weeks ago


    Dallas, Texas, United States Photon Full time

    Job Title: Data ArchitectWe are seeking a skilled Data Architect to join our team at Photon, a leading Digital Agency. As a Data Architect, you will be responsible for designing and implementing robust data reconciliation solutions within our financial systems.Key Responsibilities:Design and develop Java-based applications to automate data reconciliation...

  • Data Architect

    4 weeks ago


    Dallas, Texas, United States Hexaware Technologies Full time

    Data Architect Job DescriptionWe are seeking a highly skilled Data Architect to join our team at Hexaware Technologies. As a Data Architect, you will play a key role in designing and implementing our data lake and data warehouse platforms.Key Responsibilities:Analyze current data lake and data warehouse implementations and document findingsPropose data...

  • Data Architect

    1 day ago


    Dallas, Texas, United States Noblesoft Technologies Full time

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Noblesoft Technologies. As a Data Architect, you will be responsible for designing and implementing data architectures that meet the business needs of our organization.Key Responsibilities:Design and implement data architectures that meet business requirementsDevelop...

  • Data Architect

    3 weeks ago


    Dallas, Texas, United States Anblicks Full time

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Anblicks. As a Data Architect, you will be responsible for designing and implementing cloud-based data platforms leveraging Azure services and MuleSoft integration for data flow orchestration and API management.Key Responsibilities:Lead the end-to-end design of...

  • Data Architect

    4 weeks ago


    Dallas, Texas, United States Photon Full time

    Financial Data Reconciliation EngineerWe're seeking a skilled Java developer to drive the development of robust data reconciliation solutions within our financial systems.Key Responsibilities:Design, develop, and test Java-based applications to automate data reconciliation processes across various financial data sources.Implement efficient data...

  • Data Architect

    4 weeks ago


    Dallas, Texas, United States Photon Full time

    Financial Data Reconciliation EngineerWe're seeking a skilled Java developer to drive the development of robust data reconciliation solutions within our financial systems.Key Responsibilities:Design, develop, and test Java-based applications to automate data reconciliation processes across various financial data sources.Implement efficient data...

  • Data Architect

    16 hours ago


    Dallas, Texas, United States Noblesoft Technologies Full time

    Job DescriptionSeeking a seasoned Data Architect to spearhead the development of our Modern Data Platform. This role will be instrumental in designing, implementing, and maintaining enterprise data models, as well as leading the technical strategy and initiatives within the team.Key Responsibilities:Drive Modern Data Platform maturity and...


  • Dallas, Texas, United States Glow Networks Full time

    Job Title: Data Platform ArchitectGlow Networks is seeking an experienced Data Platform Architect to lead the design and implementation of scalable data solutions.Key Responsibilities:Design and implement data architectures that prioritize scalability, performance, and support for advanced analytics and data science workloads.Collaborate with Cloud...

  • Data Engineer

    3 weeks ago


    Dallas, Texas, United States Axis Data Full time

    Job OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer at Axis Data, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key ResponsibilitiesCollaborate with senior engineers and clients to understand data...

  • Lead Data Architect

    4 weeks ago


    Dallas, Texas, United States InfoVision Full time

    Job Title:Lead Power BI Engineer/ArchitectJob Summary:InfoVision is seeking a highly experienced Lead Power BI Engineer/Architect to lead our team in designing and implementing data warehousing solutions. The ideal candidate will have a strong background in BI & Data Warehousing and in-depth knowledge of Power BI.Key Responsibilities:Design and implement...

  • Data Architect

    20 hours ago


    Dallas, Texas, United States IT Vision Group Full time

    Job DescriptionAs a Data Architect at IT Vision Group, you will be responsible for designing and implementing cloud native solutions across multiple B2B and B2B2C data domains.Key Responsibilities:Architecting cloud native solutions to meet business requirementsDeveloping a plan to migrate on-premise transactional and warehousing solutions to a cloud native...

  • Data Engineer

    1 month ago


    Dallas, Texas, United States NTT DATA Full time

    Job DescriptionNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement efficient data pipelines to extract, transform, and...

  • Data Engineer

    4 weeks ago


    Dallas, Texas, United States NTT DATA Full time

    Job DescriptionNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement efficient and scalable data pipelines to extract,...


  • Dallas, Texas, United States Delta System & Software, Inc. Full time

    Job Title: Data Architect with Azure ExpertiseDelta System & Software, Inc. is seeking a highly skilled Data Architect with extensive experience in Azure and Databricks to join our team.Job Responsibilities:Lead the migration to Databricks and design data pipelines using SQL and Python.Collaborate with the technical team to establish technical standards and...

  • Data Engineer

    16 hours ago


    Dallas, Texas, United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...


  • Dallas, Texas, United States Resource Informatics Group Inc Full time

    Job OverviewResource Informatics Group Inc is seeking a highly skilled Senior Data Engineer to lead our data engineering and ETL projects. As a key member of our team, you will be responsible for architecting and developing ETL solutions, mentoring junior staff members, and ensuring development standards are maintained.Key Responsibilities:Manage and deliver...

  • Lead Data Architect

    2 weeks ago


    Dallas, Texas, United States InfoVision Full time

    Job Title:Lead Power BI Engineer/ArchitectJob Summary:InfoVision is seeking a highly experienced Lead Power BI Engineer/Architect to join our team. The successful candidate will have a strong background in business intelligence and data warehousing, with a proven track record of delivering complex data solutions.Key Responsibilities:Design and implement data...


  • Dallas, Texas, United States V-Soft Consulting Group, Inc. Full time

    Big Data/Hadoop Solution ArchitectWe are seeking a highly skilled Big Data/Hadoop Solution Architect to join our team at V-Soft Consulting Group, Inc.The ideal candidate will have a strong background in data engineering, with at least 3 years of experience in architecture design and development. They will work closely with our development team to design and...

  • Senior Data Architect

    13 hours ago


    Dallas, Texas, United States Optimize Search Group Full time

    Job Title: Senior Data ArchitectDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Senior Data Architect to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of...


  • Dallas, Texas, United States Glow Networks Full time

    Job OverviewGlow Networks is seeking a seasoned Data Platform Architect to spearhead the design and implementation of scalable data solutions. The ideal candidate will possess a strong background in data architecture, data integration, and data processing frameworks, with expertise in Databricks and a passion for optimizing diverse workloads.Key...