Data Catalog Engineer

3 weeks ago


New York, United States Tek Leaders Inc Full time

Hi

Please check the below requirement and get back to me asap.

Role: Data Catalog Engineer

Location: NYC NY (Remote)

Type of Hire Contract/ C2H C2C

Job Description:

Data Catalog Engineer

We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its metamodel to ensure seamless data discovery and governance.

Technical Skills Required:

Overall 10 Years of IT Experience with

Proficiency in AWS services including DataZone Glue Catalog Crawlers and Lake Formation.

Strong experience in metadata management and data classification techniques.

Responsibilities:

AWS DataZone Setup: Configure and optimize AWS DataZone for effective data cataloging.

Metadata Management: Harvest metadata from diverse sources like S3 Redshift and Aurora PostgreSQL ensuring comprehensive asset documentation.

Glue Catalog Management: Create and maintain the AWS Glue Data Catalog for accurate metadata representation.

Crawlers Configuration: Set up and manage AWS Glue Crawlers for automated data discovery and catalog updates.

Lake Formation Integration: Leverage Lake Formation for secure data lake setup and access management.

Data Classification: Implement data classification strategies using AWS Macie and Glue to enhance data governance.

Access Request Processes: Establish processes for requesting data access and managing identity and access permissions.

Data Inventory Maintenance: Maintain an uptodate inventory of data assets to facilitate data discovery for consumers.

User Interface Customization: Extend the DataZone UI to improve user experience and functionality.

Collaboration: Work with crossfunctional teams to ensure data assets meet organizational needs and compliance standards.

Skills

Years of Exp

AWS Data Zone

Postgres

Glue Catalog

S3 Redshift and Aurora PostgreSQL

AWS Data Zone,Postgres,Glue Catalog



  • New York, United States Tek Leaders Inc Full time

    Title: Data Catalog Engineer We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its metamodel to ensure seamless data discovery and governance. Technical Skills Required: Overall 10 Years of IT Experience with Proficiency in AWS services including...


  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...


  • New York, United States Material Bank Full time

    Job DescriptionJob DescriptionMaterial Bank is a fast-paced, high-growth technology company and created the world's largest material marketplace for the Architecture and Design industry, providing the fastest and most powerful way to start and manage a design project. Learn more about us at www.materialbank.com or see below.--Material Bank is seeking a...


  • New York, United States Bloomberg Full time

    Bloomberg's internal and enterprise compute and data analytic solutions are being established to support development efforts around data-driven compute, machine learning, and business analytics! As we center our data-analytical efforts around a dataset-first approach, we work to unify our ingestion and exploration solutions around the data we wish to manage....

  • Data Architect

    4 weeks ago


    New York, New York, United States Material Bank Full time

    Job DescriptionMaterial Bank is a leading technology company in the Architecture and Design industry, providing a comprehensive material marketplace for design professionals. We are seeking a highly skilled Principal Data Engineer/Architect to join our team and contribute to the development of our internal catalog systems.The ideal candidate will have deep...


  • New York, United States Mondo Full time

    Apply now: Associate Catalog Quality Manager Retail Operations-Marketing, this is a remote opportunity. The start date is ASAP for this long-term contract position Job Title: Associate Catalog Quality Manager Retail Operations-Marketing Location-Type: Remote Start Date Is: ASAP Duration: Long Term Contract Position Overview: As an Associate Catalog...

  • Data Steward

    4 weeks ago


    New York, United States Insight Global Full time

    Insight Global's Fortune 500 client is seeking a data steward who will join their stewardship community and support them in creating the future of their data landscape, collaborating with cross-functional teams and championing a data-driven culture. The data steward will be responsible for governing and managing our data assets using established tools and...


  • New York, United States Global Channel Management Full time

    About the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....


  • New York, United States Resource Logistics Full time

    Role Title: Service Catalog Engg /Cloud DevOps Engineer No. of Positions: 1 Hiring Mode: Contract (TP) Location: Remote (Preferably EST) Client: Will share once the profile gets shortlisted. Meanwhile, this company is a cloud service provider and is headquartered in New York City, New York, US. Skills Matrix Skill Last Used ...

  • Sr. Data Engineer

    3 weeks ago


    New York, United States Vimeo Full time

    Job DescriptionJob DescriptionVimeo is looking for an experienced Senior Data Engineer - Analytics to join our Data Architecture and Analytics Engineering team and work closely with Data Analysts and Data Scientists to create and maintain robust, scalable, and sustainable data models that provide decision-making insights for senior leadership including...

  • Data Scientist

    4 weeks ago


    New York, United States Diverse Lynx Full time

    Job Title: Data Scientist Location: New York, NY Duration: Long Term contract Job Description: 8 to 10 years of experience in Data Engineering space with AWS as primary cloud experience. Experience in conducting design reviews with Architects and Development Lead Experience in AWS technologies and services like : AWS Lake formation, AWS Glue Data Catalog,...


  • New York, United States Shulman Fleming & Partners Full time

    Senior Data ArchitectMUST be local to New York. Hybrid Schedule. At least 3 days onsite.Salary: up to $240k baseNo SponsorshipKey Responsibilities:Build and document reference architecture, including conceptual, logical, and physical models.Communicate and mentor teams on architectural standards and best practices.Support engineering teams in implementing...

  • Senior Data Architect

    2 weeks ago


    New York, United States Shulman Fleming & Partners Full time

    Senior Data Architect MUST be local to New York. Hybrid Schedule. At least 3 days onsite. Salary: up to $240k base No Sponsorship Key Responsibilities: Build and document reference architecture, including conceptual, logical, and physical models. Communicate and mentor teams on architectural standards and best practices. Support engineering teams in...

  • Senior Data Engineer

    3 weeks ago


    New York, United States Bloomberg Full time

    Bloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases....

  • Jr. Data Architect

    6 months ago


    New York, United States ShiftCode Analytics Full time

    Client: ConEd MOI- Video Location- New York, NY (Hybrid) A leading utility provider located in New York, NY is looking for a Jr. Data Architect for a 12+ month contract. This is a hybrid role- initially, one day per week on-site at the corporate headquarters, this may change to a maximum of 2 to 3 days per week on-site during the assignment period. ...


  • New York, United States Bloomberg Full time

    Bloomberg Enterprise Data provides financial institutions a platform to make millions of requests per day for a wide range of financial data. Whether it's ESG, Company, Pricing, Corporate Actions, Regulatory or Reference Data, the Data License department is the one-stop-shop for our clients' most demanding data and analytical needs. We offer thousands of...

  • Data Engineer

    3 months ago


    New England, United States MMG Insurance Full time

    MMG INSURANCE COMPANYJob DescriptionJob Title:Data Engineer Department:Data, Analytics, and Insights Reports To:Data, Analytics, and Insights Director FLSA Status:Exempt SUMMARY Facilitates the utilization of enterprise data for helping decision makers. Develops pipelines to transform raw data into reliable and usable information for analysis. Incorporates...

  • Data Engineer

    4 weeks ago


    New York, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    6 months ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...


  • New York, United States Mizuho Americas Full time

    Join the Mizuho team as a Senior Data Architect! Major Responsibilities: Collaborating to build reference architecture Documenting reference architecture: conceptual, logical and physical Communication and mentoring of architectural landscape in-team and cross-team Assisting engineering teams in all aspects with executing against...