Sr. Data Platform Engineer

2 months ago


Jersey City, United States Lorven Technologies Full time
Role: Sr. Data Platform Engineer

Location: Princeton, NJ- Onsite

Rate: $50/hr to $57/hr on W2 without benefits

Only W2 consultants

Duration: 6 months of project

Client - Sogeti - End customer : not disclosed

Skills:
  1. Designed data warehouse and data lake solutions along with data processing Pipeline using PySpark using Databricks
  2. Performed Data Modelling on Databricks [Delta Table] for transactional and analytical need.
  3. Designed and developed pipelines to load data to Data Lake
  4. Databricks Platform Proficiency, including its components like Databricks SQL, Delta Live Tables, Databricks Repos, and Task Orchestration.
  5. Deep understanding of data governance principles, especially related to data cataloging, access control, lineage, and metadata management.
  6. Strong SQL skills for querying and managing data
  7. Ability to design and optimize data models for structured and unstructured data.
  8. Understand how to manage compute resources, including clusters and workspaces.
  9. Ability to adapt to changes and emerging trends in data engineering and governance.
  10. Involved in hands on development and configuration of Unity Catalog
Job Description:

Sr. Data Platform Engineer
  1. Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm
  2. Integrating technical functionality, ensuring data accessibility, accuracy, and security.
  3. Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces.
  4. Define and organize data assets (structured and unstructured) within the Unity Catalog.
  5. Enable data analysts and etl engineers to discover and classify data, notebooks, dashboards, and files across clouds and platforms.
  6. Implement a single permission model for data and AI assets.
  7. Define access policies at a granular level (rows, columns, features) to ensure secure and consistent access management across workspaces and platforms.
  8. Leverage Delta Sharing to enable easy data sharing across regions, and platforms.
  9. Ensure that data and AI assets can be securely shared with minimal replication, maintaining a unified experience for users.
  10. Monitoring and Observability: utilize AI to automate monitoring, diagnose errors, and maintain data and quality.
  11. Set up alerts for personally identifiable information (PII) detection, and operational intelligence.
  12. Work closely with data scientists, analysts, and engineers to promote adoption of the Unity Catalog.
Provide training and documentation to ensure effective usage and compliance with governance policies
  • Sr. Network Engineer

    2 months ago


    Jersey City, United States Hudson Data Full time

    Job Title: Sr. Network Engineer IIILocation: Jersey City, NJ (Web Cam Interview) Duration: Long Term (W2) H1 Transfer/ GC/ CitizenJob Description: Business Overview: CIB IT Production is a transversal function which provides all core technologies to all businesses of the bank in the Americas. Responsibilities: The Network Engineer will have responsibility...


  • Jersey City, New Jersey, United States Zelis Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Zelis, a leading provider of healthcare financial solutions. This is an exciting opportunity to work on cloud data platforms, designing and implementing scalable data solutions that drive business growth.Key Responsibilities:Design and develop data pipelines using Snowflake Data...


  • Jersey City, New Jersey, United States Infojini Full time

    Company Overview:Welcome to Infojini, a leading technology firm that excels in data engineering and cloud computing. Our mission is to empower businesses with actionable insights through our cutting-edge data solutions.Job Summary:We are seeking an experienced Sr. Azure Data Engineer to join our team. The ideal candidate will have a strong background in data...

  • Sr .Net Engineer

    2 months ago


    Jersey City, United States Hudson Data Full time

    Job Title: Sr .Net Engineer (Banking Domain) Location: Jersey City, NJ (Web Cam Interview) Duration: Long Term (W2) H1 Transfer/ GC/ Citizen Job Description: Business Overview: Seeking talented senior.Net Framework/.NET Core C# Engineer and expert with strong system architecture background in Microsoft technologies for the Global Market Development...


  • Jersey City, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is a leading provider of innovative solutions for the telecommunications industry. We are seeking a talented Data Engineer with Palantir to join our team in Jersey City, New Jersey, US.In this role, you will be responsible for designing and developing a scalable cloud-based data platform using Palantir Foundry.The platform...


  • Jersey City, United States Futran Tech Solutions Pvt. Ltd. Full time

    Role Senior Data Engineer w/ Palantir Location Jersey City, New Jersey, US Project Description: Luxoft has contract with a major Telecommunications provider to engage to establish integrated cloud technology platforms to ingest information from various Network Engineering support applications in order to better optimize management and planning for the...

  • Data Engineer

    2 weeks ago


    Jersey City, United States Hexaware Technologies Full time

    Role: Sr. Data Engineer Location : Jersey City, NJType : Fulltime Job DescriptionExperienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systemsParticipate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development,...

  • Data Engineer

    2 weeks ago


    Jersey City, United States Hexaware Technologies Full time

    Role: Sr. Data Engineer Location : Jersey City, NJType : Fulltime Job DescriptionExperienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systemsParticipate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development,...

  • Sr Data Engineer

    4 weeks ago


    Salt Lake City, United States Wrench.AI Full time

    Company Description Wrench.AI focuses on making big data, deep learning, and machine learning accessible and valuable to all organizations, especially those without technical backgrounds. The company builds Big Data-based software and tools to empower leaders to make informed decisions and automate initiatives for optimal resource utilization. Wrench.AI aims...

  • Sr Data Engineer

    2 weeks ago


    Salt Lake City, United States Wrench.AI Full time

    Company Description Wrench.AI focuses on making big data, deep learning, and machine learning accessible and valuable to all organizations, especially those without technical backgrounds. The company builds Big Data-based software and tools to empower leaders to make informed decisions and automate initiatives for optimal resource utilization. Wrench.AI aims...

  • Data Engineering Lead

    4 weeks ago


    Jersey City, New Jersey, United States Compu-Vision Consulting Full time

    Job Description:Sr. Consultant profile with expertise in designing and developing scalable data architectures on Databricks Lakehouse platform.We are seeking a highly experienced professional with strong background in Property and Casualty (P&C) Industry to lead our data initiatives.Key Responsibilities:Design and implement data warehouses using Databricks...


  • Jersey City, United States h3 Technologies Full time

    Role: Sr. Power Platform developer Location: Richmond, VA (Hybrid) Contract: 12+ Months Job Description: Client is looking for an experienced hands-on Sr. Power Platform developer. The Senior Microsoft Power Platform Developer will be responsible for developing applications using Microsoft Power Platform components, like Power Apps including canvas apps,...


  • Jersey City, New Jersey, United States Infojini Full time

    Job Description:Data Engineers play a crucial role in building and maintaining large-scale data platforms. As a Sr. Azure Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines using Microsoft Azure services such as Azure Data Lake, Azure Data Factory, and Azure SQL Server.About the Project:The project involves...


  • Jersey City, New Jersey, United States Infojini Full time

    Job Requirements:We are looking for a highly skilled Sr. Azure Data Engineer who can design, implement, and optimize data pipelines using Microsoft Azure services. The ideal candidate will have a strong background in data engineering, Azure Cloud services, and Python/Pyspark programming.About the Role:This is a challenging and rewarding role that requires...


  • Jersey City, New Jersey, United States Arch Capital Group Ltd. Full time

    About the Role:Job Summary:We are seeking an experienced Manager of Data Engineering to lead the development of data platforms/systems/technologies at Arch Capital Group Ltd. The successful candidate will have a strong background in data engineering, excellent leadership skills, and the ability to collaborate effectively with cross-functional teams.Key...


  • Jersey City, United States Infojini Full time

    The project they will be working with is building a marketing data platform. Aside from what is in the JD, these are some additional points: Needs to be able to manipulate the data Needs experience with pulling data from multiple sources They will be working directly the client on requirements as well as an offshore team - great communication skills required...


  • Jersey City, New Jersey, United States Crossfire Consulting Full time

    OverviewCrossfire Consulting is a leading consulting firm specializing in data networking and telecommunications. We deliver innovative solutions to help our clients achieve their business objectives.About the RoleWe are seeking a highly experienced Data Networking Engineer to join our Core Network Engineering team. The successful candidate will be...

  • Sr Data Engineer

    6 months ago


    Texas City, United States Resource Informatics Group Full time

    Job Title: Sr Data Engineer Location: Houston, Texas Duration: 12+ months Needed in order of importance: • DBT • irbyte • irflow • Query optimization/SQL. • CI/CD pipelines, Azure deployment process Other: • 11+ years of experience as a Data Engineer designing and maintaining data pipeline architectures. • Experience in DBT, SQL, Airbyte,...


  • Kansas City, United States HART, INC. Full time

    Job DescriptionJob DescriptionDescription:At Hart, we are on a mission to revolutionize the healthcare information technology industry through data transformation and accessibility. As a rapidly growing start-up, we specialize in providing advanced solutions that empower health systems and channel partners to optimize their operations, improve patient...


  • Jersey City, New Jersey, United States Diverse Lynx Full time

    Job Title: Senior Data Platform Architect">Overview: Diverse Lynx LLC is seeking a highly experienced Senior Data Platform Architect to lead the design and implementation of our data platforms.">Responsibilities:">">Lead the design and implementation of scalable data platforms using Spark, Hadoop, and NoSQL databases.">Collaborate with cross-functional teams...