PySpark Architect

6 days ago


Charlotte, North Carolina, United States Cynet Systems Full time
Job Title: PySpark Architect

We are seeking a highly skilled PySpark Architect to join our team at Cynet Systems in Charlotte, NC.

Job Summary

The successful candidate will lead the architecture, design, and implementation of large-scale distributed data systems using PySpark. They will collaborate with business stakeholders, technology teams, and data engineers to gather requirements, define objectives, and build scalable data pipelines.

Key Responsibilities
  • Lead the Architecture: Design and implement large-scale distributed data systems using PySpark.
  • Collaborate with Stakeholders: Work with business stakeholders, technology teams, and data engineers to gather requirements and define objectives.
  • Build Scalable Pipelines: Develop and implement scalable data pipelines using PySpark.
  • Optimize Performance: Ensure low-latency and high-throughput data flows in big data processing systems.
  • Ensure Compliance: Align with industry best practices and compliance standards in data security and privacy.
  • Mentor and Guide: Mentor and guide a team of developers and engineers, promoting best practices in coding, architecture, and design patterns.
  • Evaluate New Tools: Evaluate new tools and technologies, identifying opportunities for innovation and driving their implementation.
  • Cross-Functional Collaboration: Collaborate closely with cross-functional teams, including finance and enterprise functions, to ensure solutions meet business objectives.
Qualifications
  • 10+ Years of Experience: 10+ years of experience in software architecture, with a strong focus on PySpark and big data processing systems.
  • Proficient in Distributed Computing: Proficient in Apache Spark, Hadoop, and other distributed computing frameworks.
  • Deep Understanding of Data Architecture: Deep understanding of data architecture, ETL/ELT processes, and cloud-based data platforms.
  • Proven Experience in Finance Technology: Proven experience in Finance Technology or Enterprise Functions is highly desirable.
  • Strong Knowledge of Relational Databases: Strong knowledge of relational databases, NoSQL databases, and data warehousing solutions.
  • Solid Experience in Cloud Platforms: Solid experience in working with cloud platforms such as AWS, Azure, or Google Cloud.
  • Hands-on Experience with Streaming Technologies: Hands-on experience with streaming technologies like Kafka and real-time data processing.
  • Excellent Problem-Solving Skills: Excellent problem-solving skills, strategic thinking, and a results-oriented approach.
  • Proven Leadership Abilities: Proven leadership abilities, with experience managing technical teams in a fast-paced environment.
  • Strong Communication Skills: Strong communication skills, capable of presenting ideas clearly to both technical and non-technical stakeholders.
Preferred Skills
  • Experience with Financial Systems: Experience with financial systems or enterprise applications.
  • Familiarity with Machine Learning Frameworks: Familiarity with machine learning frameworks and AI-driven data insights.
  • Experience with DevOps Practices: Experience with DevOps practices and CI/CD pipelines in data engineering.

  • PySpark Architect

    5 days ago


    Charlotte, North Carolina, United States Lorven technologies Full time

    Job Title: PySpark ArchitectLorven Technologies is seeking a highly skilled PySpark Architect to lead the design and implementation of large-scale distributed data systems.Key Responsibilities:Design and implement high-performance, distributed data processing systems using PySpark.Collaborate with cross-functional teams to gather requirements and build...

  • PySpark Architect

    6 days ago


    Charlotte, North Carolina, United States Lorven Technologies, Inc. Full time

    Job Title: Data Engineering LeaderLocation: Charlotte, NCDuration: ContractJob Description:The ideal candidate will have 10+ years of experience in software architecture, data engineering, and large-scale data processing systems, with a strong focus on PySpark. Experience in Finance Technology or Enterprise Function technology domains will be a significant...


  • Charlotte, North Carolina, United States Syntricate Technologies Full time

    Job Summary:We are seeking a highly skilled Pyspark Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have a strong background in Pyspark, Hadoop, and SQL, with experience in ingesting data from various sources and migrating databases to MS SQL Server/Hadoop.Key Responsibilities:Design and implement Pyspark data pipelines to...


  • Charlotte, North Carolina, United States Infojini Inc Full time

    Job DescriptionRole Title: Senior Cloud Architect with AI ExpertiseLocation: HybridType: Full Time OnlyJob Description:Key skills: Architectural Design, Data Lake implementation, SQL, Snowflake GenAI, Microservices, API Development, AWS, Python, PySpark, and Serverless Architectures.Experience- 10+ YearsRequired Skills:8+ years of experience in solution...


  • Charlotte, North Carolina, United States Lorven technologies Full time

    Job DescriptionLorven technologies is seeking a highly skilled Solution Architect to lead the design and development of scalable, secure, and high-performance architectures, integrating GenAI solutions with existing systems.Key Responsibilities:Architectural Design: Lead the design and development of scalable, secure, and high-performance architectures,...

  • Data Architect

    4 days ago


    Charlotte, North Carolina, United States TechnoGen Full time

    Job Summary: As a Data Architect at TechnoGen, you will be responsible for designing and developing data applications using big data technologies to ingest, process, and analyze large disparate datasets. You will work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilities. Key...

  • Big Data Architect

    21 hours ago


    Charlotte, North Carolina, United States Collabera Full time

    Key Responsibilities:As a Big Data Engineer at Collabera, you will be responsible for designing, developing, and implementing big data architectures using Hadoop and related technologies. Your expertise in MapR, Scala, PySpark, and Java will be crucial in delivering ETL, data warehouse, and data analytics capabilities.Requirements:* 3+ years of experience in...

  • AWS Data Engineer

    2 days ago


    Charlotte, North Carolina, United States Eliassen Group Full time

    Job DescriptionOur client, a leader in their industry, has an excellent opportunity for an AWS Data Engineer to work on a 36-month contract position in Charlotte, NC.Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision...


  • Charlotte, North Carolina, United States Regions Bank Full time

    Job Description:At Regions Bank, we're looking for a skilled Software Engineer Team Leader to join our team. As a key member of our Technology department, you'll be responsible for leading the development, modification, and maintenance of our software applications.Key Responsibilities:Assign and direct the work of team membersEstimate team-level timelines...


  • Charlotte, North Carolina, United States Pyramid Consulting Full time

    Job Title: Tech LeadWe are seeking a highly skilled Tech Lead to join our team at Pyramid Consulting, Inc. in the Utility Industry.Job Summary:The Tech Lead will provide technical direction, guide the team on key technical aspects, and be responsible for product tech delivery. This is a 12+ months contract opportunity with long-term potential and is located...

  • AWS Data Engineer

    6 days ago


    Charlotte, North Carolina, United States Brooksource Full time

    Job Title: AWS Data EngineerWe are seeking an experienced AWS Data Engineer to join our team at Brooksource. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.Responsibilities:Design and implement data pipelines using AWS services such as S3, EMR, Glue...

  • AWS Data Engineer

    5 days ago


    Charlotte, North Carolina, United States Brooksource Full time

    Job Title: AWS Data EngineerLocation: Charlotte, NC (Hybrid 2-3 days a week on site)Contract Details: 3-year contract with opportunity for extension or full-time hireEmployment Type: W-2 Only, No Corp-to-Corp or 1099Brooksource is seeking an experienced AWS Data Engineer to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • Pyspark Architect

    1 week ago


    Charlotte, United States Cynet Systems Full time

    We are looking for Pyspark Architect for our client in Charlotte, NC Job Title: Pyspark Architect Job Location: Charlotte, NC Job Type: Contract Job Description: Responsibilities:Lead the architecture, design, and implementation of large-scale distributed data systems using PySpark.Collaborate with business stakeholders, technology teams, and data engineers...

  • PySpark Architect

    10 hours ago


    charlotte, United States RED Global Full time

    RED Global – PySpark Architect - Long term Project – W2RED Global are working with a large consulting company based in the US that is looking for a PySpark Architect that has experience within the Fraud space.Project details:Start: ASAPDuration: 6 months (+ option to extend further)Workload: 5 days a week working on a W2 basis.Location: Some travel to...

  • PySpark Architect

    18 hours ago


    Charlotte, United States RED Global Full time

    RED Global – PySpark Architect - Long term Project – W2RED Global are working with a large consulting company based in the US that is looking for a PySpark Architect that has experience within the Fraud space.Project details:Start: ASAPDuration: 6 months (+ option to extend further)Workload: 5 days a week working on a W2 basis.Location: Some travel to...

  • PySpark Architect

    1 week ago


    Charlotte, United States Lorven Technologies, Inc. Full time

    Job Title: PySpark Architect Location: Charlotte, NC Duration: Contract Job Description: The ideal candidate will have 10+ years of experience in software architecture, data engineering, and large-scale data processing systems, with a strong focus on PySpark. Experience in Finance Technology or Enterprise Function technology domains will be a significant...

  • Solutions Architect

    3 days ago


    Charlotte, United States Smart IT Frame LLC Full time

    Tittle: - GEN AI ArchitectLocation: - Charlotte, NC(Onsite)Type: - ContractKey ResponsibilitiesArchitectural Design: Lead the design and development of scalable, secure, and high-performance architectures, integrating GenAI solutions with existing systems.GenAI Integration: Develop and implement solutions leveraging Generative AI to enhance business...

  • Solutions Architect

    3 days ago


    Charlotte, United States Smart IT Frame LLC Full time

    Tittle: - GEN AI ArchitectLocation: - Charlotte, NC(Onsite)Type: - ContractKey ResponsibilitiesArchitectural Design: Lead the design and development of scalable, secure, and high-performance architectures, integrating GenAI solutions with existing systems.GenAI Integration: Develop and implement solutions leveraging Generative AI to enhance business...

  • Solutions Architect

    2 days ago


    charlotte, United States Smart IT Frame LLC Full time

    Tittle: - GEN AI ArchitectLocation: - Charlotte, NC(Onsite)Type: - ContractKey ResponsibilitiesArchitectural Design: Lead the design and development of scalable, secure, and high-performance architectures, integrating GenAI solutions with existing systems.GenAI Integration: Develop and implement solutions leveraging Generative AI to enhance business...

  • Solutions Architect

    2 days ago


    Charlotte, United States Smart IT Frame LLC Full time

    Tittle: - GEN AI ArchitectLocation: - Charlotte, NC(Onsite)Type: - ContractKey ResponsibilitiesArchitectural Design: Lead the design and development of scalable, secure, and high-performance architectures, integrating GenAI solutions with existing systems.GenAI Integration: Develop and implement solutions leveraging Generative AI to enhance business...


  • Charlotte, United States Tekvivid Inc Full time

    Hello Hope you are doing well This is Bheem from Tekvivid INC I just wanted to check if you or someone you know may be interested in the following position. Please go through the below requirement and please share me an updated resume at your earliest convenience so that we may support your candidacy for the role. I sincerely appreciate you referring this...

  • Tech Lead

    2 weeks ago


    Charlotte, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Tech Lead. This is a 12+ Months Contract opportunity with long-term potential and is located in Charlotte, NC(Remote). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45080Pay Range: $90 - $105/hour. Employee benefits include, but are not limited to, health insurance (medical, dental,...

  • Tech Lead

    2 weeks ago


    Charlotte, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Tech Lead. This is a 12+ Months Contract opportunity with long-term potential and is located in Charlotte, NC(Remote). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45080Pay Range: $90 - $105/hour. Employee benefits include, but are not limited to, health insurance (medical, dental,...

  • Tech Lead

    2 days ago


    charlotte, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Tech Lead. This is a 12+ Months Contract opportunity with long-term potential and is located in Charlotte, NC(Remote). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45080Pay Range: $90 - $105/hour. Employee benefits include, but are not limited to, health insurance (medical, dental,...

  • Tech Lead

    2 weeks ago


    Charlotte, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Tech Lead. This is a 12+ Months Contract opportunity with long-term potential and is located in Charlotte, NC(Remote). Please review the job description below and contact me ASAP if you are interested.Job ID:24-45080Pay Range: $90 - $105/hour. Employee benefits include, but are not limited to, health insurance (medical, dental,...

  • AWS Data Engineer

    1 week ago


    Charlotte, United States Brooksource Full time

    Location: Charlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099 Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...


  • Charlotte, United States Deloitte Full time

    Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical...

  • AWS Data Engineer

    2 days ago


    charlotte, United States Brooksource Full time

    Location: Charlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099 Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...

  • AWS Data Engineer

    1 week ago


    Charlotte, United States Brooksource Full time

    Location: Charlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099 Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...

  • AWS Data Engineer

    1 week ago


    charlotte, United States Brooksource Full time

    Location: Charlotte, NC (Hybrid 2-3 days a week on site) 3-year contract with opportunity for extension or full-time hire W-2 Only, No Corp-to-Corp or 1099 Brooksource is searching for an AWS Data Engineer with experience in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte, NC. RESPONSIBILITIES: Provides...

  • AWS Data Engineer

    1 week ago


    Charlotte, United States Brooksource Full time

    Location: Charlotte, NC (hybrid, 2-3 days/week in office)3- year contract with opportunity for extension or full-time hireW-2 only (cannot accommodate Corp-to-Corp or 1099) Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte,...

  • AWS Data Engineer

    1 week ago


    Charlotte, United States Brooksource Full time

    Location: Charlotte, NC (hybrid, 2-3 days/week in office)3- year contract with opportunity for extension or full-time hireW-2 only (cannot accommodate Corp-to-Corp or 1099) Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift to join our Fortune 500 Energy & Utilities client in Charlotte,...