Sr. Data Engineer with Unity Catalog
2 days ago
Seattle Based client
Location - Seattle WA- 4 days office
Duration - 12 months
Core skills -
Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog
Need to coordinate with Offshore
10-12+ years of experience in data engineering or a related field
Expertise with programming languages such as Python/PySpark, SQL, or Scala
• Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
. Hands-on experience with Databricks Cloud Data Platforms Required.
-Should have experience migrating to Unity Catalog.
• Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines) Required
Responsibilities -
Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files.
• Develop and support data pipelines within a Cloud Data Platform, such as Databricks
Build data models that reflect domain expertise, meet current business needs, and will remain flexible as strategy evolves
• Monitor and optimize Databricks cluster performance, ensuring cost-effective scaling and resource utilization
• Demonstrates ability to communicate technical concepts to non-technical audiences both in written and verbal form.
Demonstrates strong understanding with coding and programming concepts to build data pipelines (e.g. data transformation, data quality, data integration, etc.). . Demonstrates strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
Implement and maintain Delta Lake for optimized data storage, ensuring data reliability, performance, and versioning
Automate CI/CD pipelines for data workflows using Azure DevOps
-
Sr. Data Engineer with Unity Catalog
1 week ago
Seattle, WA, United States r2 Technologies, Inc. Full timeSr. Data Engineer with Unity Catalog Sr. Data Engineer with Unity Catalog Location - Seattle WA- 4 days office Duration - 12 months Core skills - Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog Need to coordinate with Offshore 10-12+ years of experience in data engineering or a related field Expertise with...
-
Sr. Data Engineer with Unity Catalog
4 days ago
Seattle, WA, United States r2 Technologies, Inc. Full timeSr. Data Engineer with Unity Catalog Sr. Data Engineer with Unity Catalog Location - Seattle WA- 4 days office Duration - 12 months Core skills - Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog Need to coordinate with Offshore 10-12+ years of experience in data engineering or a related field Expertise with...
-
Sr. Data Engineer with Unity Catalog
4 days ago
Seattle, WA, United States r2 Technologies, Inc. Full timeSr. Data Engineer with Unity Catalog Sr. Data Engineer with Unity Catalog Location - Seattle WA- 4 days office Duration - 12 months Core skills - Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog Need to coordinate with Offshore 10-12+ years of experience in data engineering or a related field Expertise with...
-
Sr. Data Engineer with Unity Catalog
2 days ago
Seattle, WA, United States r2 Technologies, Inc. Full timeSr. Data Engineer with Unity Catalog Sr. Data Engineer with Unity Catalog Location - Seattle WA- 4 days office Duration - 12 months Core skills - Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog Need to coordinate with Offshore 10-12+ years of experience in data engineering or a related field Expertise with...
-
Seattle, WA, United States Equiliem Full timeML Engineer - Unity Catalog Need to have experience to feature store and operationalization of a feature store We are looking for an ML engineer with expertise in Unity Catalog and Feature Store in Databricks to help us build and maintain a solid foundation for our data and machine learning workflows. You will work on organizing data, managing access, and...
-
Seattle, WA, United States Equiliem Full timeML Engineer - Unity Catalog Need to have experience to feature store and operationalization of a feature store We are looking for an ML engineer with expertise in Unity Catalog and Feature Store in Databricks to help us build and maintain a solid foundation for our data and machine learning workflows. You will work on organizing data, managing access, and...
-
Data engineer
1 week ago
Seattle, WA, United States Georgia IT Inc Full timeData engineer who has experience with Databricks and Unity Catalog. Seattle WA 10 monthsCore Skills - Experience - 10+ years Azure Data bricks Azure data piplelines Azure data factory Azure data lakes Real time experience with migration to Unity Catalog- 1-2 years of hands on experience is good to have. Experience in implementing Unity catalog Design and...
-
Data engineer
1 week ago
Seattle, WA, United States Georgia IT Inc Full timeData engineer who has experience with Databricks and Unity Catalog. Seattle WA 10 monthsCore Skills - Experience - 10+ years Azure Data bricks Azure data piplelines Azure data factory Azure data lakes Real time experience with migration to Unity Catalog- 1-2 years of hands on experience is good to have. Experience in implementing Unity catalog Design and...
-
Data engineer
2 days ago
Seattle, WA, United States Georgia IT Inc Full timeData engineer who has experience with Databricks and Unity Catalog. Seattle WA 10 monthsCore Skills - Experience - 10+ years Azure Data bricks Azure data piplelines Azure data factory Azure data lakes Real time experience with migration to Unity Catalog- 1-2 years of hands on experience is good to have. Experience in implementing Unity catalog Design and...
-
Seattle, WA, United States Amazon Full timeThe future of ecommerce product data is being rewritten with Generative AI-and Amazon's Catalog Systems are at the center of it. Our team is re-envisioning how Amazon builds, enriches, and evaluates product data at scale. We're using foundation models, multimodal LLMs, and autonomous evaluation systems to transform the way customers discover, compare, and...
