Need- Python Developer with Data Engineering @ Plano, TX

3 weeks ago

Plano, United States Avacend Full time
Job DescriptionJob Description

Our client is looking for a Python Developer with Data Engineering @ Plano, TX. I am reaching you for a new job opportunity. Please let me know if you are interested, please share your updated resume and the following information.

Responsibilities

  • 2-4 years of experience developing Data engineering, and ad-hoc transformation of unstructured raw data
  • Use of orchestration tools
  • Design, build, and maintain workflows/pipelines to process continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.
  • Expected to work closely with other data engineers and business intelligence engineers across teams to create data integrations and ETL pipelines to drive projects from initial concept to production deployment
  • Maintaining and supporting incoming data feed into the data pipeline from multiple sources, including external customer feeds in CSV or XML file format to Publisher/Subscriber model automatic feeds.
  • Knowledge of database structures, theories, principles and practices (both SQL and NoSQL).
  • Active development of ETL processes using Python, PySpark, Spark or other highly parallel technologies, and implementing ETL/data pipelines
  • Experience with Data Engineering technologies and tools such as Spark, Kafka, Hive, Ookla, NiFi, Impala, SQL, NoSQL etc
  • Understanding of Map Reduce and other Data Query Processing and Aggregation models
  • Understanding of challenges of transforming data across distributed clustered environment
  • Experience with techniques for consuming, holding and aging out continuous data streams
  • Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
  • Ability to provide quick ingestion tools and corresponding access API's for continuously changing data schema, working closely with Data Engineers around specific transformation and access need

Qualifications

  • 1-2 years experience developing applications with Relational Databases, preferably with experience in SQLServer and/or MySQL.
  • Some exposure to database optimization techniques for speed, complexity, normalization etc
  • Ability to have effective working relationships with all functional units of the organization
  • Excellent written, verbal and presentation skills
  • Excellent interpersonal skills
  • Ability to work as part of a cross-cultural team
  • Self-starter and Self-motivated
  • Ability to work without lots of supervision
  • Works under pressure and is able to manage competing priorities.
  • 3-7 years in development using Java, Python, PySpark, Spark, Scala, and object-oriented approaches in designing, coding, testing, and debugging programs
  • Ability to create simple scripts and tools, using Linux, Perl, Bash
  • Development of cloud based, distributed applications
  • Understanding of clustering and cloud orchestration tools
  • Working knowledge of database standards and end user applications
  • Working knowledge of data backup, recovery, security, integrity and SQL
  • Familiarity with database design, documentation and coding
  • Previous experience with DBA case tools (frontend/backend) and third party tools
  • Understanding of distributed file systems, and their optimal use in the commercial cloud (HDFS, S3, Google File System, Databricks)
  • Familiarity with programming languages API
  • Problem solving skills and ability to think algorithmically
  • Working Knowledge on RDBMS/ORDBMS like MariaDb, Oracle and PostgreSQL

  • Lead Python Engineer

    1 week ago

    Plano, United States Diverse Lynx Full time

    Job Role: Lead Python Engineer (Python +AWS hands on must) Location: Plano, TX (Hybrid) Duration: Contract Job Description: Required skills: 1.Python 2.AWS 3. CICD Coordinating with development teams to determine application requirements. Writing scalable code using Python programming language. Testing and debugging applications. Developing back-end...

  • Java or Python Developer

    1 week ago

    Plano, United States Infinity Consulting Solutions Full time

    We have partnered with our clients in their search for a Java or Python Developer with AWS experience for one of our clients in Plano, TX. Overview: This role is in a co-located agile development team which forms part of a larger global development group. You will be responsible for all aspects of software development and delivery with a particular focus on...

  • PySpark SME

    2 days ago

    Plano, United States ApTask Full time

    Job Title: PySpark SMELocation: Plano, Tx ( Candidates within 55 Miles)Pay Rate: $65/hr C2CDay 1 HybridJob Description Hands-on Pyspark SME with multiple project experience with Data planforms comprising of Hadoop, Teradata Data Warehouse, Ab Initio, Informatica, Java Spark (DPL), SSIS, AWS Lake Formation (S3), SnowflakeAbility to design, build and unit test...

  • Python Deployment Engineer

    1 week ago

    Plano, United States Indotronix International Corporation Full time

    Position: Python - Deployment Engineer Location: Plano, TX (Hybrid work (2-3 days in office)) Duration: 6+ Months • Strong hands-on experience with Linux, Windows, Active Directory, VMWare and ESXi. • Demonstrated in-depth knowledge of LAN/WAN/Compute/Storage technologies • Experience with configuration and support experience in a complex multi-layered...

  • Senior DevOps Engineer

    3 days ago

    Plano, United States Optomi Full time

    Senior DevOps Engineer - (AWS, ArgoCD, Kubernetes) - Hybrid in Plano, TX Optomi, in partnership with a leading entertainment technology company, is seeking a Senior DevOps Engineer to fulfill a long-term contract opportunity with a client based in Plano, TX. We are seeking an experienced Senior DevOps Engineer with a strong background in AWS EKS,...

  • Java - AWS Developer@Plano- TX

    1 week ago

    Plano, United States Diverse Lynx Full time

    Role: Java - AWS Developer Location: Plano- TX Onsite- Hybrid - 3 days Required Skills: Java, Spring boot, Python, AWS, docker, Kafka, RESTAPIs, Postgres, Mongo DB, Dynamo DB, SQL, Snowflake, Serverless - Fargate, Lambda, Step functions Roles/Responsibilities : • Develop AWS deployment automation services for various security related applications and...

  • Java - AWS Developer@Plano- TX

    2 weeks ago

    Plano, United States Diverse Lynx Full time

    Role: Java - AWS Developer Location: Plano- TX Onsite- Hybrid - 3 days Required Skills: Java, Spring boot, Python, AWS, docker, Kafka, RESTAPIs, Postgres, Mongo DB, Dynamo DB, SQL, Snowflake, Serverless - Fargate, Lambda, Step functions Roles/Responsibilities : •Develop AWS deployment automation services for various security related applications and...

  • Sr.Java Developer

    2 days ago

    Plano, United States TWO95 International Full time

    Sr.Java Developer – Plano, TX Title – Java Developer Position – Fulltime Location – Plano, TX Salary- $Open(Best Possible) Primary Responsibilities: Experience and proficient in hands on working knowledge in Java 8 . Good fundamental knowledge in Core JAVA , REST API & Spring Boot. Good knowledge on AWS , SQL ,Hibernate . Note: If interested...

  • Senior DevOps Engineer

    6 days ago

    Plano, United States Optomi Full time

    Senior DevOps Engineer - (AWS, ArgoCD, Kubernetes) - Hybrid in Plano, TXOptomi, in partnership with a leading entertainment technology company, is seeking a Senior DevOps Engineer to fulfill a long-term contract opportunity with a client based in Plano, TX.We are seeking an experienced Senior DevOps Engineer with a strong background in AWS EKS, Kubernetes,...

  • Senior DevOps Engineer

    6 days ago

    Plano, United States Optomi Full time

    Senior DevOps Engineer - (AWS, ArgoCD, Kubernetes) - Hybrid in Plano, TXOptomi, in partnership with a leading entertainment technology company, is seeking a Senior DevOps Engineer to fulfill a long-term contract opportunity with a client based in Plano, TX.We are seeking an experienced Senior DevOps Engineer with a strong background in AWS EKS, Kubernetes,...

  • Senior DevOps Engineer

    5 days ago

    Plano, United States Optomi Full time

    Senior DevOps Engineer - (AWS, ArgoCD, Kubernetes) - Hybrid in Plano, TXOptomi, in partnership with a leading entertainment technology company, is seeking a Senior DevOps Engineer to fulfill a long-term contract opportunity with a client based in Plano, TX.We are seeking an experienced Senior DevOps Engineer with a strong background in AWS EKS, Kubernetes,...

  • Java Developer

    2 weeks ago

    Plano, United States AIT Global inc. Full time

    Job DescriptionJob DescriptionJob Title: Java Developer Location: Plano, TXMandatory Skills Required: Core Java, Spring, REST API, Microservices, AWSRequired Skills:BS in computer science, engineering, or an equivalent field/experience12 years of professional software engineering experience with JavaGood at writing clean, modular, readable, and testable Java...

  • Senior DevOps Engineer

    4 days ago

    Plano, United States Optomi Full time

    Senior DevOps Engineer - (AWS, ArgoCD, Kubernetes) - Hybrid in Plano, TX A variety of soft skills and experience may be required for the following role Please ensure you check the overview below carefully. Optomi, in partnership with a leading entertainment technology company, is seeking a Senior DevOps Engineer to fulfill a long-term contract opportunity...

  • AWS and Python and Java

    1 week ago

    Plano, United States Diverse Lynx Full time

    Role: AWS and Python and Java (Microservices) Developer Location - Plano TX, Northern VA (3 Days Office 2 Days remote) Experience: 10+ Year Duration: Long Term Mandatory Skills: AWS and Python and Java (Microservices) Job Description: • Strong working Python, AWS experience, web Application, UI experience (JSP, Angular), Java, Spring, Springboot, Databases...

  • Data Engineer

    1 month ago

    Plano, Texas, United States Promantus Inc Full time

    Data Engineer Location Plano Texas (Remote until COVID) Duration Long-term Job Description Develops Python/PySpark HQL queries. Develops new data models as necessary with Lead Backend Developer and Architect. Performs data visualization and analysis. Produces data samples for UI/UX Designer. Communicates insights to Architect Lead Backend Developer Lead...

  • Data Engineer

    1 month ago

    Plano, United States Promantus Inc Full time

    Data Engineer Location Plano Texas (Remote until COVID) Duration Long-term Job Description Develops Python/PySpark HQL queries. Develops new data models as necessary with Lead Backend Developer and Architect. Performs data visualization and analysis. Produces data samples for UI/UX Designer. Communicates insights to Architect Lead Backend Developer ...

  • Full Stack Developer

    1 day ago

    Plano, United States CG Infinity Full time

    This position is for our Plano, TX office. Get to Know Us: CG Infinity, Inc. is a software consulting firm that was founded in 1998. We offer solutions that are tailored to the needs of each individual client that we work with instead of offering standard, run-of-the-mill solutions to everyone. We work closely with our clients throughout the entire process...

  • Full Stack Developer

    2 weeks ago

    Plano, United States CG Infinity Full time

    Job DescriptionJob DescriptionThis position is for our Plano, TX office.Get to Know Us:CG Infinity, Inc. is a software consulting firm that was founded in 1998. We offer solutions that are tailored to the needs of each individual client that we work with instead of offering standard, run-of-the-mill solutions to everyone. We work closely with our clients...

  • Sr.Java Developer

    1 month ago

    Plano, Texas, United States Two95 International Inc. Full time

    Sr.Java Developer – Plano, TX Title – Java Developer Position – Fulltime Location – Plano, TX Salary- $Open(Best Possible) Primary Responsibilities: Experience and proficient in hands on working knowledge in Java 8 . Good fundamental knowledge in Core JAVA , REST API & Spring Boot. Good knowledge on AWS ,...

  • ServiceNow ITOM Developer

    2 days ago

    Plano, United States Millennium Global Technologies Full time

    Title ServiceNow ITOM Developer Location Plano, TX // McLean, VA (Hybrid Mode 3 days Onsite & 2 days Remote)Duration Contract Position Job Description: 4+ years of experience with ServiceNow required. 8+ years of experience with the IT Industry required. Experienced in implementation of ITOM solution using industry best practices. Hands-on development to...