Big Data Engineer- Lead

4 weeks ago


Woodlyn, Pennsylvania, United States QData Full time

Looking for Data Technical Lead experienced to design build and maintain Big Data workflows/pipelines for collecting storing processing and analyzing huge sets of data into and out of AWS data lake.

Engage in application design and data modeling discussions Guide team with design specifications and development Build and test data workflows/pipelines Troubleshoot and resolve application and data processing issues Code optimization and fine-tune application performanceQualifications BS/BA degree in Computer Science Information Systems or related field At least 8 years' experience in Big Data Hadoop technology area specifically in Cloudera and AWS Must have led a team of data engineers to deliver data integration projects in these technology areas Highly skilled in Spark and Scala Experienced in Databricks platform Worked in AWS environment in storing processing data on S3 and transforming data with complex computing into other data models Strong knowledge in SQL and Unix/Linux scripts Exposure to other Hadoop Ecosystem technologies like YARN Zookeeper HDFS Avro Parquet etc.

Connecting to various data sources such as RDBMS NoSQL FTP/SFTP etc. and troubleshooting connection issues Experience with designing and developing pipelines in cleansing preparing large complex data
  • BI Engineer

    3 weeks ago


    Woodlyn, Pennsylvania, United States QData Full time

    The primary role for the Business Intelligence Engineer is to provide technical and business expertise in integrating data from a variety of source systems and presenting it through an array of self-service applications. The BI Engineer will support all development efforts including data analysis data modeling and data design tasks as well as the creation of...


  • Woodlyn, Pennsylvania, United States QData Full time

    MInimum 5 years of experience is required Provide guidance and aid in critical design decisions to create a public/private cloud hybrid solution for Wawa systems between cloud and store. Hands on experience with AWS cloud networking including VPCs Subnets Security Groups ACLs Transit Gateways ALB/NLB Route53 ACM API Gateway and related technologies....


  • Woodlyn, Pennsylvania, United States QData Full time

    Required Skills & Experiences Infrastructure Automation Engineer(IAE) is essentially a Software Developer who has skills on a Cloud Platform Cloud Domain Specific Language (DSL) (like Pulumi Cloud Formation etc) Cloud API's Source Code repositories Orchestration Frameworks like (Jenkins CodeFresh etc) Networking Cloud Security Infrastructures to configure...

  • Senior Technical Lead

    4 weeks ago


    Woodlyn, Pennsylvania, United States QData Full time

    Required Skills & Experience Must have transitioned from a Developer to a DevOps engineer 5+ J2EE / Java background (resources with scripting python coding DOT NET coding etc IS NOT considered as DEVELOPMENT background) 3+ years Microservices development 3+ years of Spring Boot development Strong Build engineering (MAVEN ) ISTIO / ServiceMesh if you find...


  • Woodlyn, Pennsylvania, United States QData Full time

    Required Expertise 10+ J2EE / Java background (certification years Microservices development 5+ years of Spring Boot development Strong Build engineering working knowledge (MAVEN ) API Security OAUTH SAML API Security (CA Layer 7 Apigee etc) AWS or Azure


  • Woodlyn, Pennsylvania, United States QData Full time

    The Information Security Cloud & Automation Contractor is responsible for designing developing and implementing highly available secure cloud environments utilizing automated configuration management (Infrastructure as Code (IaC) methodologies while maintaining compliance to Customer's Information Security policies and standards. This role is responsible for...


  • Woodlyn, United States QData Full time

    Looking for Data Technical Lead experienced to design build and maintain Big Data workflows/pipelines for collecting storing processing and analyzing huge sets of data into and out of AWS data lake. Engage in application design and data modeling discussions Guide team with design specifications and development Build and test data workflows/pipelines...

  • BI Engineer

    4 weeks ago


    Woodlyn, United States QData Full time

    The primary role for the Business Intelligence Engineer is to provide technical and business expertise in integrating data from a variety of source systems and presenting it through an array of self-service applications. The BI Engineer will support all development efforts including data analysis data modeling and data design tasks as well as the creation...


  • Woodlyn, United States QData Full time

    MInimum 5 years of experience is required Provide guidance and aid in critical design decisions to create a public/private cloud hybrid solution for Wawa systems between cloud and store. Hands on experience with AWS cloud networking including VPCs Subnets Security Groups ACLs Transit Gateways ALB/NLB Route53 ACM API Gateway and related technologies....


  • Woodlyn, United States QData Full time

    Required Skills & Experiences Infrastructure Automation Engineer(IAE) is essentially a Software Developer who has skills on a Cloud Platform Cloud Domain Specific Language (DSL) (like Pulumi Cloud Formation etc) Cloud API’s Source Code repositories Orchestration Frameworks like (Jenkins CodeFresh etc) Networking Cloud Security Infrastructures...

  • Senior Technical Lead

    4 weeks ago


    Woodlyn, United States QData Full time

    Required Skills & Experience Must have transitioned from a Developer to a DevOps engineer 5+ J2EE / Java background (resources with scripting python coding DOT NET coding etc IS NOT considered as DEVELOPMENT background) 3+ years Microservices development 3+ years of Spring Boot development Strong Build engineering (MAVEN ) ISTIO / ServiceMesh if you...


  • Woodlyn, United States QData Full time

    Required Expertise 10+ J2EE / Java background (certification +++) 5+ years Microservices development 5+ years of Spring Boot development Strong Build engineering working knowledge (MAVEN ) API Security OAUTH SAML API Security (CA Layer 7 Apigee etc) AWS or Azure


  • Woodlyn, United States QData Full time

    The Information Security Cloud & Automation Contractor is responsible for designing developing and implementing highly available secure cloud environments utilizing automated configuration management (Infrastructure as Code (IaC) methodologies while maintaining compliance to Customer’s Information Security policies and standards. This role is responsible...