Data Platform Engineer

1 month ago

Princeton, United States People Tech Group Inc Full time

Sr. Data Platform Engineer

Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm

Integrating technical functionality, ensuring data accessibility, accuracy, and security.

Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces.

Define and organize data assets (structured and unstructured) within the Unity Catalog.

Enable data analysts and etl engineers to discover and classify data, notebooks, dashboards, and files across clouds and platforms.

Implement a single permission model for data and AI assets.

Define access policies at a granular level (rows, columns, features) to ensure secure and consistent access management across workspaces and platforms.

Leverage Delta Sharing to enable easy data sharing across regions, and platforms.

Ensure that data and AI assets can be securely shared with minimal replication, maintaining a unified experience for users.

Monitoring and Observability: utilize AI to automate monitoring, diagnose errors, and maintain data and quality.

Set up alerts for personally identifiable information (PII) detection, and operational intelligence.

Work closely with data scientists, analysts, and engineers to promote adoption of the Unity Catalog.

Provide training and documentation to ensure effective usage and compliance with governance policies

Skills:

Designed data warehouse and data lake solutions along with data processing Pipeline using PySpark using Databricks

Performed Data Modelling on Databricks [Delta Table] for transactional and analytical need.

Designed and developed pipelines to load data to Data Lake

Databricks Platform Proficiency, including its components like Databricks SQL, Delta Live Tables, Databricks Repos, and Task Orchestration.

Deep understanding of data governance principles, especially related to data cataloging, access control, lineage, and metadata management.

Strong SQL skills for querying and managing data

Ability to design and optimize data models for structured and unstructured data.

Understand how to manage compute resources, including clusters and workspaces.

Ability to adapt to changes and emerging trends in data engineering and governance.

Involved in hands on development and configuration of Unity Catalog

  • Data Platform Engineer

    1 month ago

    Princeton, United States People Tech Group Inc Full time

    Sr. Data Platform EngineerDesign and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigmIntegrating technical functionality, ensuring data accessibility, accuracy, and security.Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks...

  • Data Platform Engineer

    2 weeks ago

    Princeton, United States Georgia IT Inc Full time

    Data Platform Engineer Location: Princeton NJ (prefer onsite) Duration: 6 months No third party C2C Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm Integrating technical functionality, ensuring data accessibility, accuracy, and security. Architect the Unity Catalog to provide centralized...

  • Principal Data Engineer

    2 days ago

    Princeton, United States Abbott Laboratories Full time

    Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries.Our medical...

  • senior Data Engineer

    3 weeks ago

    Princeton, United States Triunity Software Full time

    We're seeking a Senior Data Engineer to enhance our Data Science Team, focusing on implementing and managing data workflows that support machine learning models and large-scale analytics. This role involves designing ETL processes, ensuring data quality, and deploying ML models to production. The ideal candidate will have a strong computer science...

  • Senior Software Engineer

    3 weeks ago

    Princeton, United States Bloomberg Full time

    Senior Software Engineer - MySQL Data Infrastructure Princeton, NJ Posted Apr 25, 2024 - Requisition No. 124853 Bloomberg runs on data, it's our business and our product. The DataHub Engineering team provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse and real-time stream...

  • Cloud and Data Engineer

    1 month ago

    Princeton, New Jersey, United States Bristol Myers Squibb Full time

    Working with UsChallenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the...

  • Cloud and Data Engineer

    4 weeks ago

    Princeton, New Jersey, United States Bristol Myers Squibb Full time

    Working with UsChallenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the...

  • Data Scientist

    2 months ago

    Princeton, New Jersey, United States Kellton Technologies Full time

    Responsibilities Will work on customer-facing use cases such as anomaly detection social engineering fraud prevention Build comprehensive summary presentations to executive and technical teams Turn statistical information into meaningful actionable insights Proven ability to build a data science pipeline Leveraging advanced statistical techniques and...

  • GCP Data Architect

    4 weeks ago

    Princeton, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionGCP Data ArchitectFulltime/Permanent RolePrinceton, NJNote - No C2C and No Visa Sponsershp allowed.Job DescriptionOwn the end-to-end architecture of the modern Safety/Pharmacovigilance Data Platforms which ingests data from the several systems across clinical, non-clinical systems and transforms it into insights for internal and...

  • GCP Data Architect

    3 weeks ago

    Princeton, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionGCP Data ArchitectFulltime/Permanent RolePrinceton, NJNote - No C2C and No Visa Sponsershp allowed.Job DescriptionOwn the end-to-end architecture of the modern Safety/Pharmacovigilance Data Platforms which ingests data from the several systems across clinical, non-clinical systems and transforms it into insights for internal and...

  • Snowflake Data Engineer

    3 weeks ago

    Princeton, United States Triunity Software Full time

    Job DescriptionJob DescriptionJob descriptionA Data Engineer with experience using AWS and Snowflake typically has a strong background in working with large datasets and knowledge of database design and implementation. They are responsible for designing, building, and maintaining the data pipelines and architectures that support the organization's data...

  • senior Data Engineer

    2 months ago

    Princeton, United States Triunity Software Full time

    Job DescriptionJob DescriptionWere seeking a Senior Data Engineer to enhance our Data Science Team, focusing on implementing and managing data workflows that support machine learning models and large-scale analytics. This role involves designing ETL processes, ensuring data quality, and deploying ML models to production.The ideal candidate will have a strong...

  • senior Data Engineer

    3 weeks ago

    Princeton, United States Triunity Software Full time

    Job DescriptionJob DescriptionWere seeking a Senior Data Engineer to enhance our Data Science Team, focusing on implementing and managing data workflows that support machine learning models and large-scale analytics. This role involves designing ETL processes, ensuring data quality, and deploying ML models to production.The ideal candidate will have a strong...

  • General Manager Platform, K-16

    2 weeks ago

    Princeton, United States Educational Testing Service (ETS) Full time

    Job DescriptionJob DescriptionAbout ETS:For more than 75 years, we have amplified products and services based rigorous research and our belief in the power of learning. Driven by our mission to advance quality and equity in education, ETS provides learning solutions, pioneering research and trusted assessments that help guide learners around the world on...

  • Senior Software Engineer

    1 week ago

    Princeton, New Jersey, United States Bloomberg Full time

    Bloomberg runs on data, it's our business and our product. The DataHub Engineering team provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse and real-time stream processing capabilities. The platform provides a single place in the company to discover, access, publish and subscribe to data. The...

  • Data Scientist

    2 months ago

    Princeton NJ, United States Kellton Technologies Full time

    Responsibilities • Will work on customer-facing use cases such as anomaly detection social engineering fraud prevention • Build comprehensive summary presentations to executive and technical teams • Turn statistical information into meaningful actionable insights • Proven ability to build a data science pipeline • Leveraging advanced...

  • Adobe Experience Platform

    3 weeks ago

    Princeton, United States New Millenium Consulting Full time

    Job Title: Adobe Experience Platform (AEP) DeveloperJob location: Princeton, NJ (Hybrid-1 day onsite)Job Type: ContractMust have 3+ years hands-on experience with Adobe Experience Platform A global healthcare is seeking an Adobe Experience Platform (AEP) Developer to join their team in the New jersey office. The Adobe Experience Platform (AEP) Developer will...

  • Adobe Experience Platform

    2 weeks ago

    Princeton, United States New Millenium Consulting Full time

    Job Title: Adobe Experience Platform (AEP) DeveloperJob location: Princeton, NJ (Hybrid-1 day onsite)Job Type: ContractMust have 3+ years hands-on experience with Adobe Experience PlatformA global healthcare is seeking an Adobe Experience Platform (AEP) Developer to join their team in the New jersey office. The Adobe Experience Platform (AEP) Developer will...

  • Adobe Experience Platform

    1 month ago

    Princeton, United States New Millenium Consulting Full time

    Job Title: Adobe Experience Platform (AEP) DeveloperJob location: Princeton, NJ (Hybrid-1 day onsite)Job Type: ContractMust have 3+ years hands-on experience with Adobe Experience Platform A global healthcare is seeking an Adobe Experience Platform (AEP) Developer to join their team in the New jersey office. The Adobe Experience Platform (AEP) Developer will...

  • Power Platform Developer

    7 days ago

    Princeton, United States Randstad Digital Americas Full time

    ** No Corp to Corp **Hybrid - Princeton NJBuild workflow applications to support the Facultative and Corporate Business Unit utilizing the Power Automate Platform.The Application Developer will play a key role in the operation and support of the client's RI P&C applications. Will be a key technology support partner in developing Power Platform based...