Etl Big Data Tester

3 weeks ago


Scottsdale, United States DVG TECH Full time

**Role : ETL Big data Tester**

**Location : Scottsdale AZ (Day 1 Onsite)**

**Contract: Long term**

**Must have : Automation, java, AWS, ETL, Scala, Spark**
- 8 years of IT experience focusing on Testing and Automation experience using Java and Groovy.
- Rest assured app concepts in automation.
- Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required
- Experience with Spark Scala and Java programming
- Data Lake concepts such as time travel and schema evolution and optimization
- Experience leading and architecting enterprise-wide initiatives specifically in automation testing for ETL testing and several phases of testing, data migration, transformation.
- understanding of streaming data pipelines and how they differ from batch systems
- understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
- Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
- Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
- Indexing and partitioning strategy experience
- Debug, troubleshoot, and implement solutions to complex technical issues
- Architecture experience in AWS environment a bonus
- Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
- Experience with Gitlab and CloudWatch and ability to write and maintain Gitlab for supporting CI/CD pipelines
- Experience working with AWS Lambdas for configuration and optimization and experience with S3
- Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.
- Ability to thrive in a team-based environment
- Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management.

**Job Type**: Contract

Pay: $50.00 - $60.00 per hour

Experience level:

- 11+ years

Schedule:

- 8 hour shift

Work Location: In person


  • Big Data Tester

    1 month ago


    Scottsdale, United States Laiba Technologies Full time

    **Role : SDET with Data or Big data Tester** **Location : Scottsdale AZ (Onsite)** - Automation experience with groovy and Java coding skills - Experience in AWS - SQL query skills - Spark,S3, dynamo db, red shift testing skills. - Git lab, CI/CD experience - Jira x-ray tool experience - Collaborating with dev and delivery **Job Type**: Contract Pay:...


  • Scottsdale, United States Zortech Solutions Full time

    Role: SDET with Data/Big Data Tester Location: Scottsdale AZ-Onsite Duration: 6+ Months Job Description: Automation experience with groovy and Java coding skills SQL query skills Spark,S3, dynamo db, red shift testing skills Git lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and delivery


  • Scottsdale, United States Zortech Solutions Full time

    Role: SDET with Data/Big Data Tester Location: Scottsdale AZ-Onsite Duration: 6+ Months Job Description: Automation experience with groovy and Java coding skills SQL query skills Spark,S3, dynamo db, red shift testing skills Git lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and delivery


  • Scottsdale, United States Zortech Solutions Full time

    Role: SDET with Data/Big Data Tester Location: Scottsdale AZ-Onsite Duration: 6+ Months Job Description: Automation experience with groovy and Java coding skills SQL query skills Spark,S3, dynamo db, red shift testing skills Git lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and delivery


  • Scottsdale, United States Zortech Solutions Full time

    Role: SDET with Data/Big Data Tester Location: Scottsdale AZ-Onsite Duration: 6+ Months Job Description: Automation experience with groovy and Java coding skills SQL query skills Spark,S3, dynamo db, red shift testing skills Git lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and delivery


  • Scottsdale, United States Zodiac Solutions Full time

    **Role: SDET with Data or Big data Tester** **Location: Scottsdale AZ: onsite** **Contract** **Must have : AWS, Glue, (DynamoDB and/or S3) and Groovy** - Automation experience with groovy and Java coding skills - Experience in AWS - SQL query skills - Spark,S3, dynamo db, red shift testing skills. - Git lab, CI/CD experience - Jira x-ray tool experience -...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data Tester Location: Scottsdale AZ(Onsite) Duration: Contract Must have skills: AWS, Groovy, Glue, S3 or Dynamo DB. Job description: Automation experience with groovy and Java coding skills SQL query skills Spark,S3, dynamo db, red shift testing skills Git lab, CI/CD experience Jira x-ray tool experience Collaborating...


  • Scottsdale, United States RIT Solutions, Inc. Full time

    Role: SDET with Data/Big Data Tester Location: Scottsdale AZ-Onsite Duration: 6+ Months Job Description: Must have : AWS , Glue, (DynamoDB and/or S3) and Groovy Automation experience with groovy and Java coding skills Experience in AWS SQL query skills Spark,S3, dynamo db, red shift testing skills. Git lab, CI/CD experience Jira x-ray tool experience ...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data TesterLocation: Scottsdale AZ(Onsite)Duration: ContractMust have skills: AWS, Groovy, Glue, S3 or Dynamo DB.Job description:Automation experience with groovy and Java coding skillsSQL query skills Spark,S3, dynamo db, red shift testing skillsGit lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data TesterLocation: Scottsdale AZ(Onsite)Duration: ContractMust have skills: AWS, Groovy, Glue, S3 or Dynamo DB.Job description:Automation experience with groovy and Java coding skillsSQL query skills Spark,S3, dynamo db, red shift testing skillsGit lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data TesterLocation: Scottsdale AZ(Onsite)Duration: ContractMust have skills: AWS, Groovy, Glue, S3 or Dynamo DB.Job description:Automation experience with groovy and Java coding skillsSQL query skills Spark,S3, dynamo db, red shift testing skillsGit lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data TesterLocation: Scottsdale AZ(Onsite)Duration: ContractMust have skills: AWS, Groovy, Glue, S3 or Dynamo DB.Job description:Automation experience with groovy and Java coding skillsSQL query skills Spark,S3, dynamo db, red shift testing skillsGit lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data TesterLocation: Scottsdale AZ(Onsite)Duration: ContractMust have skills: AWS, Groovy, Glue, S3 or Dynamo DB.Job description:Automation experience with groovy and Java coding skillsSQL query skills Spark,S3, dynamo db, red shift testing skillsGit lab, CI/CD experience Jira x-ray tool experience Collaborating with dev and...


  • Scottsdale, United States E-Solutions Full time

    Position: SDET with Data or Big data Tester Location: Scottsdale AZ(Onsite) Duration: Contract Do not wait to apply after reading this description a high application volume is expected for this opportunity. Must have skills: AWS, Groovy, Glue, S3 or Dynamo DB. Job description: Automation experience with groovy and Java coding skills SQL query skills ...


  • Scottsdale, United States Hudson Manpower Full time

    Hello, I'm Shailesh from Hudson Manpower, reaching out to discuss an exciting opportunity with our client. Would you kindly review the job description and inform me of your comfort level with it? Additionally, could you please share an updated copy of your resume? Role : SDET with Data or Big data Tester Location : Scottsdale AZ : onsite Duration : Contract...

  • Indepth Big Data

    1 week ago


    Scottsdale, United States APEX Full time

    Job Details : Must Have Skills Indepth Big Data, Hadoop, Hive Queries in AWS Groovy Scripting, testing, test automation, debugging REST API testing in AWS, Spark Scala jobs testing Nice to have skills AWS Databricks Delta Lake, Delta Live tables Detailed Job Description 6-8 years of IT experience focusing on Testing and Automation experience using...


  • Scottsdale, Arizona, United States Cognizant Technology Solutions Full time

    Practice - AIA - Artificial Intelligence and Analytics About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their...


  • Scottsdale, Arizona, United States Cognizant Technology Solutions Full time

    Practice - AIA - Artificial Intelligence and Analytics About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their...


  • Scottsdale, Arizona, United States Cognizant Technology Solutions Full time

    Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process outsourcing services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.). Cognizant is a member of the NASDAQ-100, the S&P 500, the Forbes Global 1000, and the Fortune 500 and we are...


  • Scottsdale, Arizona, United States Cognizant Technology Solutions Full time

    Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process outsourcing services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.). Cognizant is a member of the NASDAQ-100, the S&P 500, the Forbes Global 1000, and the Fortune 500 and we are...