Python PySpark Developer

1 month ago

Plano, United States ApTask Full time
About Client:
The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare, manufacturing, government, transportation, communications, and consumer and retail industries.

Rate Range: $65- $72/hr C2C Without Benifits
Salary: $130k per annum + benefits

Job Description:
  • Collaborate with the team to build out features for the data platform and consolidate data
  • assets
  • Build, maintain and optimize data pipelines built using Spark
  • Advise, consult, and coach other data professionals on standards and practices
  • Work with the team to define company data assets
  • Migrate CMS' data platform into Chase's environment
  • Partner with business analysts and solutions architects to develop technical
  • architectures for strategic enterprise projects and initiatives
  • Build libraries to standardize how we process data
  • Loves to teach and learn, and knows that continuous learning is the cornerstone of every
  • successful engineer
  • Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and
  • is able to intelligently convey such knowledge
  • Implement automation on applicable processes
Mandatory Skills:
  • 5+ Years experience in a data engineering position
  • Proficiency is Python (or similar) and SQL
  • Strong experience building data pipelines with Spark
  • Experience with relational datastores, NoSQL datastores and cloud object stores
  • Experience building data processing infrastructure in AWS
  • Bonus: Experience with infrastructure as code solutions, preferably Terraform
  • Bonus: Cloud certification
  • Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or
  • Delta Lake
  • Bonus: Familiar with data observability solutions, data governance frameworks
Responsibilities:
  • Your experience in public cloud migrations of complex systems, anticipating problems, and finding ways to mitigate risk, will be key in leading numerous public cloud initiatives
  • Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  • Own end-to-end platform issues & help provide solutions to platform build and performance issues on the AWS Cloud & ensure the deliverables are bug free
  • Drive, support, and deliver on a strategy to build broad use of Amazon's utility computing web services (e.g., AWS EC2, AWS S3, AWS RDS, AWS CloudFront, AWS EFS, AWS DynamoDB, CloudWatch, EKS, ECS, MFTS, ALB, NLB)
  • Measure and optimize system performance, with an eye toward pushing our capabilities forward, getting ahead of customer needs, and innovating to continually improve
  • Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services
Required qualifications, capabilities, and skills:
  • Formal training or certification on software engineering concepts and 10+ years applied experience
  • Hands-on practical experience delivering system design, application development, testing, and operational stability
  • Advanced in one or more programming language(s) - Java, Python, Go
  • A strong understanding of business technology drivers and their impact on architecture design, performance and monitoring, best practices
  • Design and building web environments on AWS, which includes working with services like EC2, ALB, NLB, Aurora Postgres, DynamoDB, EKS, ECS fargate, MFTS, SQS/SNS, S3 and Route53
  • Advanced in modern technologies such as: Java version 8+, Spring Boot, Restful Microservices, AWS or Cloud Foundry, Kubernetes.
  • Experience using DevOps tools in a cloud environment, such as Ansible, Artifactory, Docker, GitHub, Jenkins, Kubernetes, Maven, and Sonar Qube
  • Experience and knowledge of writing Infrastructure-as-Code (IaC) and Environment-as-Code (EaC), using tools like CloudFormation or Terraform
  • Preferred qualifications, capabilities, and skills
  • Expert in one or more programming language(s) preferably Java
  • AWS Associate level certification in Developer, Solutions Architect or DevOps
  • Experience in building the AWS infrastructure like EKS, EC2, ECS, S3, DynamoDB, RDS, MFTS, Route53, ALB, NLB
  • Experience with high volume, mission critical applications, and building upon messaging and or event-driven architectures using Apache Kafka
  • Experience with logging, observability and monitoring tools including Splunk, Datadog, Dynatrace. CloudWatch or Grafana
  • Experience in automation and continuous delivery methods using Shell scripts, Gradle, Maven, Jenkins, Spinnaker


About ApTask:
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.

If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.com .

  • Python Pyspark Developer

    2 weeks ago

    Plano, United States JobRialto Full time

    Job Description: Overview: We are looking for an experienced Python Pyspark Developer with over 9 years of experience. The ideal candidate will have hands-on experience in object-oriented programming using Python and professional experience in building real-time data streams using Spark. This role requires knowledge of architectural best practices for...

  • Python Pyspark Developer

    2 weeks ago

    Plano, United States JobRialto Full time

    Job Description: Overview: We are looking for an experienced Python Pyspark Developer with over 9 years of experience. The ideal candidate will have hands-on experience in object-oriented programming using Python and professional experience in building real-time data streams using Spark. This role requires knowledge of architectural best practices for...

  • Python Pyspark Developer

    1 month ago

    Plano, United States JobRialto Full time

    Job Description: Overview: We are looking for an experienced Python Pyspark Developer with over 9 years of experience. The ideal candidate will have hands-on experience in object-oriented programming using Python and professional experience in building real-time data streams using Spark. This role requires knowledge of architectural best practices for...

  • Pyspark ML Engineer

    2 weeks ago

    Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Pyspark ML Engineer Location: Plano, TX [ (Day one Onsite) Job Description: PySpark ML Model development experience. The project includes conversion of some of our existing models from pure python to pyspark and deploying them. MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models...

  • Pyspark ML Engineer

    2 weeks ago

    Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Pyspark ML Engineer Location: Plano, TX [ (Day one Onsite) Job Description: PySpark ML Model development experience. The project includes conversion of some of our existing models from pure python to pyspark and deploying them. MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models...

  • Pyspark ML Engineer

    1 month ago

    Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Pyspark ML Engineer Location: Plano, TX [ (Day one Onsite) Job Description: PySpark ML Model development experience. The project includes conversion of some of our existing models from pure python to pyspark and deploying them. MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models...

  • Java/Python Developer

    4 weeks ago

    Plano, United States Amtex Systems Inc. Full time

    Job Title: Java/Python Developer with some Golang experience Location: Plano, TX (4 Days Onsite)Duration: 12 months Contract Job Summary:Full stack developer who is has strong Java OR Python with (Some Golang exposure) experience plus working exposure with data and analytics platforms. Looking for someone who is familiar with technologies like Glue, Pyspark,...

  • Data Engineering Specialist

    2 weeks ago

    Plano, Texas, United States JobRialto Full time

    Job Overview:We are seeking an experienced Data Engineering Specialist to join our team at JobRialto. As a key member of our engineering team, you will be responsible for building and maintaining large-scale data pipelines using Python and Spark.About the Role:This is an excellent opportunity for a skilled Python Pyspark Developer to take their career to the...

  • Amtex Systems Inc. | Java/Python Developer | plano, tx

    4 weeks ago

    plano, United States Amtex Systems Inc. Full time

    Job Title: Java/Python Developer with some Golang experience Location: Plano, TX (4 Days Onsite)Duration: 12 months Contract Job Summary:Full stack developer who is has strong Java OR Python with (Some Golang exposure) experience plus working exposure with data and analytics platforms. Looking for someone who is familiar with technologies like Glue, Pyspark,...

  • Python Pyspark with AWS

    1 month ago

    Plano, United States ApTask Full time

    About Client: The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare,...

  • Python developer

    1 month ago

    Plano, United States Diverse Lynx Full time

    Pennington, NJ / Jersey City/ NY City / Plano, TX Role - Python Developer Location - Jersey City, NJ Duration: Full Time Job Description Solid experience as Python Developer (5+ Years). Experience with Python frameworks (e.g. Django, Flask, Bottle). Understanding of Oracle DB and SQL. Should have used python as a main programming language to...

  • Python developer

    2 weeks ago

    Plano, United States Diverse Lynx Full time

    Job Title: - Python developer Location: NEW YORK 2, NY/ Dallas, TX / Jersey City / Brokerage, NJ / Plano, TX Position Type: Contract JD Role Description: Python developers with knowledge on Airflow, EKS, Spark and AWS SDK Competencies: Digital : Python, Digital : Apache Spark Experience (Years): 6-8 Keywords: Python, Airflow, EKS, Spark and AWS SDK ...

  • Python Developer

    4 weeks ago

    Plano, United States Cygnus Professionals Inc. Full time

    W2 Hiring onlyRole: AWS Python DeveloperLocation: Plano, TX or Chicago, IL (Day 1 Onsite)Position: ContractPrimary Skills:Programming Languages:Proficiency in PythonExperience with tool development and integration using these languagesGitHub Integration:Experience with integrating tools and applications with GitHubUnderstanding of GitHub APIs and...

  • Sr. Python Developer(Quartz)

    2 months ago

    plano, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Sr. Python Developer(Quartz)

    3 months ago

    plano, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Sr. Python Developer(Quartz)

    4 months ago

    Plano, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Data warehouse Developer

    2 weeks ago

    Plano, United States RIT Solutions, Inc. Full time

    Data warehouse Developer Python, SQL, NoSQL, Airflow, Spark/PySpark, REST API, AWS (Lambda, S3, RDS, Fargate, EC2, ECS, EMR, etc.) Data pipeline development, movement and maintenance Location: Plano TX (hybrid & local)/ Richmond, VA or McLean, VA hybrid 1 hour zoom video interview Must be able to share screen incase of coding demonstration - tbd

  • Python Developer

    1 month ago

    Plano, United States Tata Consultancy Services Full time

    Job Title: Python Developer with Azure CloudLocation: Richmond, VA/ Plano, TXRoles and Responsibilities:Python Developer with Azure Cloud We are looking for a Python developer with Azure cloud knowledge to bring Purview classification results to On-Prem and load it to data mart for data sensitivity reporting.Position required building applications in On-Prem...

  • Python Developer

    1 month ago

    Plano, United States Tata Consultancy Services Full time

    Job Title: Python Developer with Azure CloudLocation: Richmond/PlanoSalary: 7+ exp Pay Range -100-110KRoles and Responsibilities:Python Developer with Azure Cloud We are looking for a Python developer with Azure cloud knowledge to bring Purview classification results to On-Prem and load it to data mart for data sensitivity reporting.Position required...

  • Python Developer

    1 month ago

    Plano, United States Tata Consultancy Services Full time

    Roles and Responsibilities:Python Developer with Azure Cloud We are looking for a Python developer with Azure cloud knowledge to bring Purview classification results to On-Prem and load it to data mart for data sensitivity reporting.Position required building applications in On-Prem and connect to EventHub and Purview API’s in Azure to bring in...