Data Catalog Engineer
3 weeks ago
Hi
Please check the below requirement and get back to me asap.
Role: Data Catalog Engineer
Location: NYC NY (Remote)
Type of Hire Contract/ C2H C2C
Job Description:
Data Catalog Engineer
We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its metamodel to ensure seamless data discovery and governance.
Technical Skills Required:
Overall 10 Years of IT Experience with
Proficiency in AWS services including DataZone Glue Catalog Crawlers and Lake Formation.
Strong experience in metadata management and data classification techniques.
Responsibilities:
AWS DataZone Setup: Configure and optimize AWS DataZone for effective data cataloging.
Metadata Management: Harvest metadata from diverse sources like S3 Redshift and Aurora PostgreSQL ensuring comprehensive asset documentation.
Glue Catalog Management: Create and maintain the AWS Glue Data Catalog for accurate metadata representation.
Crawlers Configuration: Set up and manage AWS Glue Crawlers for automated data discovery and catalog updates.
Lake Formation Integration: Leverage Lake Formation for secure data lake setup and access management.
Data Classification: Implement data classification strategies using AWS Macie and Glue to enhance data governance.
Access Request Processes: Establish processes for requesting data access and managing identity and access permissions.
Data Inventory Maintenance: Maintain an uptodate inventory of data assets to facilitate data discovery for consumers.
User Interface Customization: Extend the DataZone UI to improve user experience and functionality.
Collaboration: Work with crossfunctional teams to ensure data assets meet organizational needs and compliance standards.
Skills
Years of Exp
AWS Data Zone
Postgres
Glue Catalog
S3 Redshift and Aurora PostgreSQL
AWS Data Zone,Postgres,Glue Catalog
-
New York, United States Tek Leaders Inc Full timeTitle: Data Catalog Engineer We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its metamodel to ensure seamless data discovery and governance. Technical Skills Required: Overall 10 Years of IT Experience with Proficiency in AWS services including...
-
Senior Systems Engineer
3 hours ago
New York, United States VAST Data Full timeVAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...
-
Principal Data Engineer
3 weeks ago
New York, United States Material Bank Full timeJob DescriptionJob DescriptionMaterial Bank is a fast-paced, high-growth technology company and created the world's largest material marketplace for the Architecture and Design industry, providing the fastest and most powerful way to start and manage a design project. Learn more about us at www.materialbank.com or see below.--Material Bank is seeking a...
-
New York, United States Bloomberg Full timeBloomberg's internal and enterprise compute and data analytic solutions are being established to support development efforts around data-driven compute, machine learning, and business analytics! As we center our data-analytical efforts around a dataset-first approach, we work to unify our ingestion and exploration solutions around the data we wish to manage....
-
Data Architect
4 weeks ago
New York, New York, United States Material Bank Full timeJob DescriptionMaterial Bank is a leading technology company in the Architecture and Design industry, providing a comprehensive material marketplace for design professionals. We are seeking a highly skilled Principal Data Engineer/Architect to join our team and contribute to the development of our internal catalog systems.The ideal candidate will have deep...
-
New York, United States Mondo Full timeApply now: Associate Catalog Quality Manager Retail Operations-Marketing, this is a remote opportunity. The start date is ASAP for this long-term contract position Job Title: Associate Catalog Quality Manager Retail Operations-Marketing Location-Type: Remote Start Date Is: ASAP Duration: Long Term Contract Position Overview: As an Associate Catalog...
-
Data Steward
4 weeks ago
New York, United States Insight Global Full timeInsight Global's Fortune 500 client is seeking a data steward who will join their stewardship community and support them in creating the future of their data landscape, collaborating with cross-functional teams and championing a data-driven culture. The data steward will be responsible for governing and managing our data assets using established tools and...
-
Cloud Data Platform Engineer
1 month ago
New York, United States Global Channel Management Full timeAbout the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....
-
Service Catalog Engg/Cloud DevOps Engineer
4 weeks ago
New York, United States Resource Logistics Full timeRole Title: Service Catalog Engg /Cloud DevOps Engineer No. of Positions: 1 Hiring Mode: Contract (TP) Location: Remote (Preferably EST) Client: Will share once the profile gets shortlisted. Meanwhile, this company is a cloud service provider and is headquartered in New York City, New York, US. Skills Matrix Skill Last Used ...
-
Sr. Data Engineer
3 weeks ago
New York, United States Vimeo Full timeJob DescriptionJob DescriptionVimeo is looking for an experienced Senior Data Engineer - Analytics to join our Data Architecture and Analytics Engineering team and work closely with Data Analysts and Data Scientists to create and maintain robust, scalable, and sustainable data models that provide decision-making insights for senior leadership including...
-
Data Scientist
4 weeks ago
New York, United States Diverse Lynx Full timeJob Title: Data Scientist Location: New York, NY Duration: Long Term contract Job Description: 8 to 10 years of experience in Data Engineering space with AWS as primary cloud experience. Experience in conducting design reviews with Architects and Development Lead Experience in AWS technologies and services like : AWS Lake formation, AWS Glue Data Catalog,...
-
Senior Data Architect
1 week ago
New York, United States Shulman Fleming & Partners Full timeSenior Data ArchitectMUST be local to New York. Hybrid Schedule. At least 3 days onsite.Salary: up to $240k baseNo SponsorshipKey Responsibilities:Build and document reference architecture, including conceptual, logical, and physical models.Communicate and mentor teams on architectural standards and best practices.Support engineering teams in implementing...
-
Senior Data Architect
2 weeks ago
New York, United States Shulman Fleming & Partners Full timeSenior Data Architect MUST be local to New York. Hybrid Schedule. At least 3 days onsite. Salary: up to $240k base No Sponsorship Key Responsibilities: Build and document reference architecture, including conceptual, logical, and physical models. Communicate and mentor teams on architectural standards and best practices. Support engineering teams in...
-
Senior Data Engineer
3 weeks ago
New York, United States Bloomberg Full timeBloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases....
-
Jr. Data Architect
6 months ago
New York, United States ShiftCode Analytics Full timeClient: ConEd MOI- Video Location- New York, NY (Hybrid) A leading utility provider located in New York, NY is looking for a Jr. Data Architect for a 12+ month contract. This is a hybrid role- initially, one day per week on-site at the corporate headquarters, this may change to a maximum of 2 to 3 days per week on-site during the assignment period. ...
-
Senior Software Engineer
2 weeks ago
New York, United States Bloomberg Full timeBloomberg Enterprise Data provides financial institutions a platform to make millions of requests per day for a wide range of financial data. Whether it's ESG, Company, Pricing, Corporate Actions, Regulatory or Reference Data, the Data License department is the one-stop-shop for our clients' most demanding data and analytical needs. We offer thousands of...
-
Data Engineer
3 months ago
New England, United States MMG Insurance Full timeMMG INSURANCE COMPANYJob DescriptionJob Title:Data Engineer Department:Data, Analytics, and Insights Reports To:Data, Analytics, and Insights Director FLSA Status:Exempt SUMMARY Facilitates the utilization of enterprise data for helping decision makers. Develops pipelines to transform raw data into reliable and usable information for analysis. Incorporates...
-
Data Engineer
4 weeks ago
New York, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
6 months ago
New York, United States Silver Search, Inc Full timeData Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...
-
IT Data Senior Architect
3 weeks ago
New York, United States Mizuho Americas Full timeJoin the Mizuho team as a Senior Data Architect! Major Responsibilities: Collaborating to build reference architecture Documenting reference architecture: conceptual, logical and physical Communication and mentoring of architectural landscape in-team and cross-team Assisting engineering teams in all aspects with executing against...