Data Catalog Engineer Data Quality Engineer Data Governance Engineer
1 month ago
Title: Data Catalog Engineer
We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its metamodel to ensure seamless data discovery and governance.
Technical Skills Required:
- Overall 10 Years of IT Experience with Proficiency in AWS services including DataZone Glue Catalog Crawlers and Lake Formation.
- Strong experience in metadata management and data classification techniques.
Responsibilities:
- AWS DataZone Setup: Configure and optimize AWS DataZone for effective data cataloging.
- Metadata Management: Harvest metadata from diverse sources like S3 Redshift and Aurora PostgreSQL ensuring comprehensive asset documentation.
- Glue Catalog Management: Create and maintain the AWS Glue Data Catalog for accurate metadata representation.
- Crawlers Configuration: Set up and manage AWS Glue Crawlers for automated data discovery and catalog updates.
- Lake Formation Integration: Leverage Lake Formation for secure data lake setup and access management.
- Data Classification: Implement data classification strategies using AWS Macie and Glue to enhance data governance.
- Access Request Processes: Establish processes for requesting data access and managing identity and access permissions.
- Data Inventory Maintenance: Maintain an uptodate inventory of data assets to facilitate data discovery for consumers.
- User Interface Customization: Extend the DataZone UI to improve user experience and functionality.
- Collaboration: Work with crossfunctional teams to ensure data assets meet organizational needs and compliance standards.
AWS Glue,Data Catalog,Glue,ETL
-
Data Catalog Engineer
3 weeks ago
New York, United States Tek Leaders Inc Full timeHi Please check the below requirement and get back to me asap. Role: Data Catalog Engineer Location: NYC NY (Remote) Type of Hire Contract/ C2H C2C Job Description: Data Catalog Engineer We are seeking a Data Catalog Engineer to lead the implementation and management of our data catalog solutions. You will set up AWS DataZone and enhance its...
-
Data Engineer
1 month ago
New York, New York, United States CCG Business Solutions, LLC Full timeJob DescriptionCCG Business Solutions, LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.The ideal candidate will have a strong background in data engineering, with experience in designing and implementing data...
-
Principal Data Engineer
2 weeks ago
New York, United States Material Bank Full timeJob DescriptionJob DescriptionMaterial Bank is a fast-paced, high-growth technology company and created the world's largest material marketplace for the Architecture and Design industry, providing the fastest and most powerful way to start and manage a design project. Learn more about us at www.materialbank.com or see below.--Material Bank is seeking a...
-
Data Engineer on W2
1 week ago
New York, United States Indsafri Full time****Please note that only GCs, GC-EADs and US citizens are eligible to apply****Position - Data Engineer Location - New York, NY (Locals), HybridDuration - 6 month contractJob Specification - We are seeking a highly skilled Data Engineer with previous hands-on experience in the Financial or Banking industry, capable of hitting the ground running and quickly...
-
Senior Security Systems Engineer
1 month ago
New York, New York, United States Acquired Data Solutions Full timeJob Title: Senior Security Systems EngineerWe are seeking a highly skilled Senior Security Systems Engineer to join our team at Acquired Data Solutions, Inc. in Egg Harbor, NJ.Job Summary:The successful candidate will be responsible for performing in-depth engineering analysis of security-related systems to determine their potential for further development,...
-
Data Engineer
1 week ago
New York, United States SimplifyVMS Full timeAs a Data Engineer, you will be responsible for building and optimizing data pipelines, architectures, and datasets for effective data analysis and machine learning applications. Responsibilities: Developing, constructing, testing, and maintaining architectures for data ingestion, processing, and extraction. Designing and implementing data pipelines to...
-
Cloud Data Engineer
2 weeks ago
New York, United States Atlas Search Full time3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...
-
Data Engineer
4 weeks ago
New York, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
2 weeks ago
New York, United States Wynd Labs Full timeJob DescriptionJob DescriptionData Engineer$100k - $140kWho We Are.Wynd Labs is an early-stage startup that is on a mission to make public web data accessible for AI through contributions to Grass.Grass is a network sharing application that allows users to share their unused bandwidth. Effectively, this is a residential proxy network that directly rewards...
-
Data Engineer
2 weeks ago
New York, United States Walsh Employment Full timeOur client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...
-
Data Engineer
6 months ago
New York, United States Silver Search, Inc Full timeData Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...
-
Senior Data Quality Assurance Engineer
3 weeks ago
New York, United States Tekvivid Inc Full timeRole: Senior Data Quality Assurance Engineer Location: New York NY ONLY LOCAL NOTE: ONLY W2 AND THE INTERVIEW WILL SINGLE ROUND ONLY & WE HAVE INTERVIEW SLOTS ON FRIDAY AND MONDAY (10 TO 1PM EST) Responsibilities The Senior Data Quality Assurance Engineer will be responsible for ensuring the accuracy integrity and consistency of data across our...
-
Sr. Data Engineer
2 weeks ago
New York, United States Vimeo Full timeJob DescriptionJob DescriptionVimeo is looking for an experienced Senior Data Engineer - Analytics to join our Data Architecture and Analytics Engineering team and work closely with Data Analysts and Data Scientists to create and maintain robust, scalable, and sustainable data models that provide decision-making insights for senior leadership including...
-
Cloud Data Engineer
2 weeks ago
new york city, United States Atlas Search Full time3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...
-
Cloud Data Engineer
2 weeks ago
new york city, United States Atlas Search Full time3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...
-
Data Engineer
4 weeks ago
new york city, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
4 weeks ago
new york city, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
2 weeks ago
new york city, United States Walsh Employment Full timeOur client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...
-
Data Engineer
2 weeks ago
new york city, United States Walsh Employment Full timeOur client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...
-
Data Solutions Engineer
2 months ago
New York, United States Preql Full timeWe’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...