Data Engineer
4 days ago
Data Engineer This is a remote position. We are looking for skilled Data Engineers to join our team. As a Data Engineer, you will be responsible for understanding business and technological challenges, develop data pipelines tackling those challenges, and ensuring their smooth deployment. You will also be responsible for the applications of standard industry and within-the-company good practices, and the application and evolution of our various patterns. Key Responsibilities Design, build, and maintain scalable batch pipelines in Databricks using PySpark. Develop and support real-time data streams. Implement robust data transformations following the Medallion Architecture (Bronze, Silver, Gold). Optimize and troubleshoot performance of large-scale data jobs. Platform & Infrastructure Manage and deploy infrastructure using Terraform and GitOps principles. Work within our Airflow orchestrator running on Azure Kubernetes Service (AKS). Apply best practices for CI/CD, monitoring, and error handling in production. Collaboration & Communication Work closely with Data Architects to understand and implement proposed architectures. Coordinate with Project Managers and stakeholders to align on requirements and milestones. Participate in code reviews and share knowledge across the engineering team. Testing & Documentation Define and perform tests to ensure data quality and pipeline reliability. Document technical specifications, workflows, and deployment processes. Requirements Proven experience with Databricks and PySpark. Strong understanding of batch and streaming data processing. Experience with Azure Data Lake Storage Gen2 (ADLS). Solid experience with Airflow, preferably deployed in Kubernetes (AKS). Understanding of Medallion Architecture. Familiarity with data privacy, governance, and security standards. Working knowledge of Terraform and infrastructure-as-code. If it sounds like you, share your CV with us and let's talk
-
Data Engineer
3 days ago
Hempstead, United States Axelon Full timeData Engineer Location: Remote (PST/MST) Pay Rate: $70-80/hr (Negotiable) Overview: We are seeking a skilled Data Engineer to design, build, and maintain scalable, auditable data pipelines and deliver reliable data products. The ideal candidate will have strong expertise in Databricks, Snowflake, SQL, and Tableau, with experience in data validation...
-
Data Engineer
1 day ago
Hempstead, United States Staffing the Universe Full timeAzure Data Engineer Azure data engineers help stakeholders understand the data through exploration, and they build and maintain secure and compliant data processing pipelines by using different tools and techniques. These professionals use various Azure data services and languages to store and produce cleansed and enhanced.
-
Principal Data Engineer
1 day ago
Hempstead, United States Worth AI Full timePrincipal Data Engineer Worth AI, a leader in the computer software industry, is looking for a talented and experienced Principal Data Engineer to join their innovative team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence while fostering an environment of collaboration, and adaptability, aiming to...
-
Principal Data Engineer
4 days ago
Hempstead, United States Worth AI Full timePrincipal Data Engineer Worth AI, a leader in the computer software industry, is looking for a talented and experienced Principal Data Engineer to join their innovative team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence while fostering an environment of collaboration, and adaptability, aiming to...
-
Principal Data Engineer
3 days ago
Hempstead, NY, United States Worth AI Full timePrincipal Data Engineer Worth AI, a leader in the computer software industry, is looking for a talented and experienced Principal Data Engineer to join their innovative team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence while fostering an environment of collaboration, and adaptability, aiming to...
-
AWS Cloud Data Engineer-Remote
4 days ago
Hempstead, United States Staffing the Universe Full timeAws Cloud Data Engineer Job title: AWS Cloud Data Engineer Location: Remote Job type: contract Description US Citizen/ GC /EAD (H4/L2/TN) preferred- No third parties resume accepted. Experience in data modelling, building Snowflake and/or Star schemas. Experience in ETL operations, experience with AWS Glue preferable. Experience with DWH operation...
-
AWS Cloud Data Engineer-Remote
3 days ago
Hempstead, NY, United States Staffing the Universe Full timeAws Cloud Data Engineer Job title: AWS Cloud Data Engineer Location: Remote Job type: contract Description US Citizen/ GC /EAD (H4/L2/TN) preferred- No third parties resume accepted. Experience in data modelling, building Snowflake and/or Star schemas. Experience in ETL operations, experience with AWS Glue preferable. Experience with DWH operation...
-
AWS Cloud Data Engineer-Remote
3 days ago
Hempstead, NY, United States Staffing the Universe Full timeAws Cloud Data Engineer Job title: AWS Cloud Data Engineer Location: Remote Job type: contract Description US Citizen/ GC /EAD (H4/L2/TN) preferred- No third parties resume accepted. Experience in data modelling, building Snowflake and/or Star schemas. Experience in ETL operations, experience with AWS Glue preferable. Experience with DWH operation...
-
AWS Cloud Data Engineer-Remote
3 days ago
Hempstead, NY, United States Staffing the Universe Full timeAws Cloud Data Engineer Job title: AWS Cloud Data Engineer Location: Remote Job type: contract Description US Citizen/ GC /EAD (H4/L2/TN) preferred- No third parties resume accepted. Experience in data modelling, building Snowflake and/or Star schemas. Experience in ETL operations, experience with AWS Glue preferable. Experience with DWH operation...
-
AWS Cloud Data Engineer-Remote
3 days ago
Hempstead, NY, United States Staffing the Universe Full timeAws Cloud Data Engineer Job title: AWS Cloud Data Engineer Location: Remote Job type: contract Description US Citizen/ GC /EAD (H4/L2/TN) preferred- No third parties resume accepted. Experience in data modelling, building Snowflake and/or Star schemas. Experience in ETL operations, experience with AWS Glue preferable. Experience with DWH operation...
