Current jobs related to SR. DATA ENGINEER with DATABRICKS, AWS, PYSPARK/ SPARK, PYTHON - Plano - Excelon Solutions

  • Python PySpark Developer

    4 weeks ago

    Plano, United States Compunnel Inc. Full time

    Role: Python PySpark DeveloperLocation: Plano, TX / Wilmingtom, DEType: [Full-time/Contract]Experience Level: 10+ Years Overview:We are seeking a skilled Python PySpark Developer to join our data engineering team. The ideal candidate will be responsible for building and maintaining scalable data processing pipelines using PySpark and Python. This role...

  • Python PySpark Developer

    4 weeks ago

    Plano, United States Compunnel Inc. Full time

    Role: Python PySpark DeveloperLocation: Plano, TX / Wilmingtom, DEType: [Full-time/Contract]Experience Level: 10+ Years Overview:We are seeking a skilled Python PySpark Developer to join our data engineering team. The ideal candidate will be responsible for building and maintaining scalable data processing pipelines using PySpark and Python. This role...

  • PySpark Engineer with AWS

    2 weeks ago

    Plano, United States Ccube Full time

    Job DescriptionJob DescriptionJob Title: Python PySpark Engineer with AWSLocation : Plano, TX/ Wilmington, DE  (Hybrid 3 Days a Week)W2/Full Time Highly PreferredExperience – 6+ years MinimumDuties and responsibilities:● Collaborate with the team to build out features for the data platform and consolidate data assets● Build, maintain and...

  • Databricks Engineer

    5 days ago

    Plano, United States NTT DATA Services Full time

    Req ID: 297507  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Engineer to join our team in Plano, Texas (US-TX), United States (US). Job Duties: Key...

  • Databricks Engineer

    6 days ago

    Plano, United States NTT DATA Services Full time

    Req ID: #NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Engineer to join our team remotely in the United States.  Key Responsibilities-Design and implement tailored...

  • AWS Cloud engineer with knowledge of Spark

    4 weeks ago

    Plano, United States Compunnel Inc. Full time

    Role: AWS Cloud Engineer with Knowledge of Spark/PythonLocation: Plano, TX / Wilmington, DE Type: Contract / Full time Key Responsibilities:Cloud Architecture & Infrastructure:Design, implement, and manage scalable and reliable cloud infrastructure on AWS.Utilize AWS services such as EC2, S3, Lambda, EMR, RDS, and Redshift to build and maintain data...

  • AWS Cloud engineer with knowledge of Spark

    4 weeks ago

    Plano, United States Compunnel Inc. Full time

    Role: AWS Cloud Engineer with Knowledge of Spark/PythonLocation: Plano, TX / Wilmington, DE Type: Contract / Full time Key Responsibilities:Cloud Architecture & Infrastructure:Design, implement, and manage scalable and reliable cloud infrastructure on AWS.Utilize AWS services such as EC2, S3, Lambda, EMR, RDS, and Redshift to build and maintain data...

  • Manager of Software Engineering

    2 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONThis is your chance to change the path of your career and guide multiple teams to success at one of the world's leading financial institutions.As a Manager of Software Engineering at JPMorgan Chase within the Corporate Sector, you lead multiple teams and manage day-to-day implementation activities by identifying and...

  • Manager of Software Engineering

    3 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONThis is your chance to change the path of your career and guide multiple teams to success at one of the world's leading financial institutions.As a Manager of Software Engineering at JPMorgan Chase within the Corporate Sector, you lead multiple teams and manage day-to-day implementation activities by identifying and escalating...

  • Manager of Software Engineering

    2 weeks ago

    plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONThis is your chance to change the path of your career and guide multiple teams to success at one of the world's leading financial institutions.As a Manager of Software Engineering at JPMorgan Chase within the Corporate Sector, you lead multiple teams and manage day-to-day implementation activities by identifying and escalating...

  • AWS PySpark Developer

    1 month ago

    Plano, United States Cognizant Full time

    We are Cognizant Artificial Intelligence Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply...

  • Lead Software Engineer

    3 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...

  • Lead Software Engineer

    2 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...

  • Lead Software Engineer

    2 weeks ago

    plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...

  • Lead Software Engineer

    3 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the CORPORATE SECTOR, ENTERPRISE TECHNOLOGY, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading...

  • Lead Software Engineer

    2 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the CORPORATE SECTOR, ENTERPRISE TECHNOLOGY, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading...

  • Lead Software Engineer

    3 weeks ago

    Plano, United States JPMorgan Chase Full time

    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the CORPORATE SECTOR, ENTERPRISE TECHNOLOGY, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure,...

  • Lead Software Engineer

    2 weeks ago

    plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the CORPORATE SECTOR, ENTERPRISE TECHNOLOGY, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading...

  • Senior Data Engineer

    1 week ago

    Plano, United States NTT DATA Services Full time

    Req ID: 294856  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our team in Plano, Texas (US-TX), United States (US). Job Duties: Key...

  • Lead Software Engineer

    2 weeks ago

    Plano, TX, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...

SR. DATA ENGINEER with DATABRICKS, AWS, PYSPARK/ SPARK, PYTHON

4 months ago

Plano, United States Excelon Solutions Full time
Job DescriptionJob Description

Must have skills: DATABRICKS, AWS, PYSPARK/ SPARK, PYTHON

Databricks should be strong.

Minimum Industry experience: 10 years

Job Description:

1. Bachelor's degree or equivalent work experience

2. Must have experience implementing atleast 2 end to end projects with Databricks which includes components like

- Delta lake

- Unity Catalog

- Databricks Connect

- DataBricks API

- Databricks workflow Orchestration

3. Must be well-versed with Databricks Lakehouse concepts and its implementation in large scale enterprise environments

4. Must have good understanding to create complex data pipelines and use of data ingestion tools like nifi

5. Must be well versed in using Apache Spark framework and strong in SQL and spark-sql

6. Must have excellent coding skills in Python(and/or Scala), preferably Python

7. Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing

8. Must have worked on AWS and should have working experience of AWS services like S3, Lambda, DynamoDB, SQS, CloudWatch

9. Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirements

10. Must have strong written and verbal communication skills

11. Must have experience in an Agile environment

12. Data engineering background is a plus