![Zortech Solutions](https://media.trabajo.org/img/noimg.jpg)
Lead Data Engineer-AWS, Python
1 week ago
Role: Lead Data Engineer-AWS, Python
Location: Scottsdale AZ (100% onsite)
Duration:: FTE and CTH
Job Description:
Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp
6-8 years of IT experience focusing on enterprise data architecture and management.
Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling
Experience with Databricks & on Prem , Structured Streaming, Delta Lake concepts, and Delta Live Tables required
Experience with Spark scala
Data Lake concepts such as time travel and schema evolution and optimization
Structured Streaming and Delta Live Tables with Databricks a bonus
Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation / support
Advanced level understanding of streaming data pipelines and how they differ from batch systems
Formalize concepts of how to handle late data, defining windows, and data freshness
Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.
Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
Indexing and partitioning strategy experience
Debug, troubleshoot, design and implement solutions to complex technical issues
Experience with large-scale, high-performance enterprise big data application deployment and solution
Architecture experience in AWS environment a bonus
Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines
Experience working with AWS Lambdas for configuration and optimization and experience with S3
Familiarity with Schema Registry, message formats such as Avro, ORC, etc.
Ability to thrive in a team-based environment
Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management
-
Data Engineer
1 week ago
Fountain Hills, Arizona, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Data Engineer (Data Masking) Location: Scottsdale AZ (100% Onsite) Duration: 6+ Months Job Description: Must have : Python , Scala , Spark , SQL (Aerospike or Solr) Should be a having good hands-on working experience in Python and Scala Should be having good hands-on working knowledge on spark framework, spark SQL, spark...
-
Data Engineer
1 week ago
Fountain Hills, Arizona, United States Siri InfoSolutions Inc Full timeJob DescriptionJob DescriptionHi ,Hope you are doing well My name is Arun from Siri Info Solutions. I am sharing one urgent job opportunity with you, kindly go through it and let me know if suitable for you. Title: Data Engineer (Data Masking)Location: Scottsdale AZ/OnsiteDuration : Long term Contract RoleJob Description:Should be a having good hands-on...
-
Industrial Engineer II AZ
1 week ago
Fountain Hills, Arizona, United States Cencora Full timeOur team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join our innovative company and help us improve the lives of people and animals...
-
RS Service Team Lead-A&P
1 week ago
Fountain Hills, Arizona, United States Gulfstream Aerospace Corporation Full timeRS Service Team Lead-A&P - Mesa, AZ inGAC MesaUnique Skills:Skilled A&P mechanic with demonstrated leadership on Gulfstream large or mid cabin aircraft. (Required)Education and Experience RequirementsHigh School Diploma or GED required. 6 years of inspection and heavy maintenance experience on large and/or mid-size aircraft to include three (3) years of...
-
HAAAIB-Procurement Coordinator B
1 week ago
Fountain Hills, Arizona, United States Experis Full timeOur client, an industry leading Aerospace firm, is seeking a Procurement Coordinator to join their team.The ideal candidate who will be most successful in this role will have purchasing experience, strong analytical skills, and be detail oriented Job Title:Procurement Coordinator B Location: Mesa AZ Pay Range: $20/hour Whats Will You Do? Prepare customer...
-
Lead Data Engineer-AWS, Python
3 weeks ago
Fountain Hills, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Lead Data Engineer-AWS, PythonLocation: Scottsdale AZ (100% onsite)Duration:: FTE and CTHJob Description:Must have skill set: Spark, S3, Glue, AWS Redshift , python and stream set exp6-8 years of IT experience focusing on enterprise data architecture and management. Experience in Conceptual/Logical/Physical Data Modelling...
-
Lead AWS Data Engineer
2 months ago
Beverly Hills, United States GSPANN Technologies, Inc Full timeAbout GSPANNWe work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create...
-
Lead AWS Data Engineer
2 months ago
Beverly Hills, United States GSPANN Technologies, Inc Full timeAbout GSPANNWe work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create...
-
Lead AWS Data Engineer
4 weeks ago
Beverly Hills, United States GSPANN Technologies, Inc Full timeAbout GSPANNHeadquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high technology, and manufacturing, we help our clients transform and deliver business value by optimizing their IT capabilities, practices, and operations....
-
Lead AWS Data Engineer
4 weeks ago
Beverly Hills, United States GSPANN Technologies, Inc Full timeAbout GSPANNHeadquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high technology, and manufacturing, we help our clients transform and deliver business value by optimizing their IT capabilities, practices, and operations....
-
Data Engineer
3 weeks ago
Fountain Hills, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Data Engineer (Data Masking) Location: Scottsdale AZ (100% Onsite) Duration: 6+ Months Job Description: Must have : Python , Scala , Spark , SQL (Aerospike or Solr) Should be a having good hands-on working experience in Python and Scala - Should be having good hands-on working knowledge on spark framework, spark SQL,...
-
Senior AWS Cloud Engineer
4 weeks ago
Vernon Hills, Illinois, United States CDW Technologies LLC Full timeCDW Technologies LLC seeks Senior AWS Cloud Engineers to engage with clients and internal teams to provide automated, cloud native pattern solutions primarily to the public cloud service provider, Amazon Web Services (AWS); serve as billable consultant providing cloud native pattern engineering services to DV clients; provide automated, cloud-native pattern...
-
Senior AWS Cloud Engineer
2 months ago
Vernon Hills, Illinois, United States CDW Technologies LLC Full timeCDW Technologies LLC seeks Senior AWS Cloud Engineers to engage with clients and internal teams to provide automated, cloud native pattern solutions primarily to the public cloud service provider, Amazon Web Services (AWS); serve as billable consultant providing cloud native pattern engineering services to DV clients; provide automated, cloud-native pattern...
-
Lead Data Engineer
4 weeks ago
Arden Hills, Minnesota, United States LandOLakes Full timeLead Data EngineerJob Title: Lead Data EngineerDesign and build data-driven solutions and guide team of engineers to ensure consistent, reliable, and sustainable solutions are delivered. Use and manipulate ETL tools (including Informatica) for data reporting. Manage development and engineering resources. Coordinate full lifecycle, large complex reporting or...
-
Lead Data Engineer
1 month ago
Arden Hills, Minnesota, United States LandOLakes Full timeLead Data EngineerJob Title: Lead Data EngineerDesign and build data-driven solutions and guide team of engineers to ensure consistent, reliable, and sustainable solutions are delivered. Use and manipulate ETL tools (including Informatica) for data reporting. Manage development and engineering resources. Coordinate full lifecycle, large complex reporting or...
-
Data Engineer
3 weeks ago
Fountain Hills, United States Zortech Solutions Full timeJob DescriptionJob DescriptionRole: Data Engineer (Paze) Location: Scottsdale AZ (Day 1 onsite) Duration: FTE & C2C Job Description: Must have : Skillset: Java, Scala, S3, Glue, aws , Redshift. 6-8 years of IT experience focusing on enterprise data architecture and management. Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational...
-
Data Engineer
3 days ago
Woodland Hills, United States Motion Recruitment Full timeWe are a fast-moving Series D Gen AI SaaS start-up that is committed to making video animation accessible to music labels, artists, and creatives. Recently, we released our newest product version which can be accessed through their iOS app. On the app we feature several templates, artistic styles, and environments for you to transform to your liking by...
-
Data Engineer
6 days ago
Woodland Hills, United States Motion Recruitment Full timeWe are a fast-moving Series D Gen AI SaaS start-up that is committed to making video animation accessible to music labels, artists, and creatives. Recently, we released our newest product version which can be accessed through their iOS app. On the app we feature several templates, artistic styles, and environments for you to transform to your liking by...
-
Data Engineer
2 months ago
Bloomfield Hills, United States Unified Tech Group Inc Full timeJob DescriptionJob DescriptionSalary: Job Title: Data Engineer Job Duties: Perform full life cycle of data project architecture implementation. Design, code and debug database and business intelligence applications in various platforms including Oracle and MS SQL Server....
-
Data Engineer
4 weeks ago
Bloomfield Hills, United States Unified Tech Group Inc Full timeJob DescriptionJob DescriptionSalary: Job Title: Data Engineer Job Duties: Perform full life cycle of data project architecture implementation. Design, code and debug database and business intelligence applications in various platforms including Oracle and MS SQL Server....
-
Data Engineer
3 weeks ago
Auburn Hills, United States HRU Inc Technical Resources Full timeTitle: Data Engineer Product Support is the primary quality liaison group between the factories and Volkswagen of America. The primary role of the Data Engineer position is to design, construct, test and maintain data sources for deeper analysis. Additionally, the Data Engineer will be responsible for monitoring/improving work processes, and developing and...
-
Data Engineer
4 weeks ago
West Lake Hills, United States HCL Global Systems Full timeThe Expertise and Skills You Bring 10+ years in solutioning of Oracle development (PL/SQL) and/or Streams based development 3+ years of solutioning experience with one or more of the following: AWS Cloud environments (development, deployment, and support) Containerization and Orchestration technologies Application web server technology...
-
Principal DevOps Engineer
4 weeks ago
Vernon Hills, Illinois, United States CDW Technologies LLC Full timeCDW Government LLC seeks a Principal DevOps Engineer to take a lead role in the administration of infrastructure and applications in Amazon Web Services (AWS); be responsible for the applications architecture and support in AWS as well as developing and delivering customer-facing technical presentations on AWS solutions tailored for the customer's...
-
Principal DevOps Engineer
1 month ago
Vernon Hills, Illinois, United States CDW Technologies LLC Full timeCDW Government LLC seeks a Principal DevOps Engineer to take a lead role in the administration of infrastructure and applications in Amazon Web Services (AWS); be responsible for the applications architecture and support in AWS as well as developing and delivering customer-facing technical presentations on AWS solutions tailored for the customer's...
-
Principal Data Engineer
1 month ago
Parsippany-Troy Hills, United States US Tech Solutions Full timeResponsibilities: Work closely with cross-functional teams, including product managers, data scientists and engineers to understand project requirements and objectives ensuring alignment with overall business goals. Build data ingestion framework and data pipelines to ingest unstructured and structured data from various data sources such as SharePoint,...