AWS Data Lake Technical Lead
3 weeks ago
Job Title: AWS Data Lake Technical Lead
Job Location: REMOTE with Vocational Onsite Visits at Waterbury, VT (Travel Expenses will be reimbursed)
Duration: 3+ Years Contract
Job Description:
Background:
Client is seeking to improve statewide law enforcement data access. The purpose is to design and implement a state-controlled system to access de-identified, aggregated law enforcement and related data currently housed in a record management system.
Client in collaboration with the Agency of Digital (ADS) Services, is seeking to procure Amazon Web Service (AWS) professional services to work with the ADS Technical Lead to build out the Public Services Lakehouse environment.
Existing Technology Environment
Client currently uses a Computer Aided Dispatch Records Management System (CAD RMS) system that is currently running in a MySQL instance that will be used in the first phase of the Data Lake build. The supplemental data ranges from SQL server instances and flat file sources that are currently housed internally either in SharePoint or internal file stores.
Requirements:
Design and implement the Clients’ Data Lake in the AWS Environment
- Store Data in AWS CJIS compliant environment.
- Implement and design the lake house technologies with the IT Tech Lead
- assigned to the project.
- Design and implement using latest AWS Lake House standards.
- Data Security Layer
- Implement and design security Identity and Access Management roles and processes.
- Design and Create security IAM templates.
- Data Ingestion Layer
- Ingestion Design for variety of sources
- Operational Database Sources
- MySQL, SQL Server
- SaaS Applications
- File Shares (SharePoint and one drive)
- Stream Data Sources
- System Templates of ingestion processes
- Data Storage Layer
- AWS S3 CJIS compliant S3 buckets
- AWS Redshift Infrastructure
- Power BI Connector process
- Data Processing Layer
- Data Extract, Load and Transform (ELT) process for loading from source to S3 and Transforming data from S3 to Redshift for reporting and analytics.
- Templates for creating ELT processes for future processes.
- Data Catalog Layer
- Design and implement solution to solve data schema drift in AWS Glue for use with reporting and analytical needs.
- Design and build crawlers for schema and build catalog that stores schema information.
- Meta data store in catalog for consumption in data warehouse
- Create Catalog crawler templates for data sources.
- Create Templates for expansion of the data lake for future agencies.
- Base data warehouse implemented environment for reporting/dashboard use.
- Template designs for future data Lakehouse implementations.
- Lake House design needs to be able to be used by Power BI
- Design each layer for scaling based on usage.
Professional Service Requirements:
- AWS Lakehouse Certification
- AWS Design and Implementation Lake House Technologies
- AWS IAM
- AWS Lakehouse Technology
- AWS Glue Knowledge
- Data Catalog and Crawler
- AWS Redshift
- AWS Athena
- CJIS certified data storage
- AWS CJIS Data location
- CJIS Security Background Check (See Additional Attachments / Assurances)
-
Lead Data Engineer
2 days ago
Cleveland, United States Infinity Consulting Solutions Full timeWe have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...
-
Lead Data Engineer
9 hours ago
Cleveland, United States Infinity Consulting Solutions Full timeWe have partnered with our client in their search for a Lead Data Engineer for one of our clients in Cleveland OH The Lead DataEngineer designs, implements, and maintains data platforms and tools supported by the Digital Technology organization. The position is responsible for understanding the technical, functional, and security capabilities of managed...
-
Lake to Lake Peer Tutor
1 week ago
Cleveland, Ohio, United States Lakeshore Technical College Full timeLake to Lake Peer Tutor# of Weeks: School year Hours per week: See job description for more details Work Schedule Days: Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, Sunday Schedule: Flexible Reports To: Academic Support and Tutoring Coordinator Recruitment Group: Limited Term/Temp Help Multiple Locations - See job description for more...
-
Lake to Lake Peer Tutor
13 hours ago
Cleveland, Ohio, United States Lakeshore Technical College Full timeLake to Lake Peer Tutor# of Weeks: School year Hours per week: See job description for more details Work Schedule Days: Monday, Tuesday, Wednesday, Thursday, Friday, Saturday, Sunday Schedule: Flexible Reports To: Academic Support and Tutoring Coordinator Recruitment Group: Limited Term/Temp Help Multiple Locations - See job description for more...
-
Data Warehouse Mainframe Lead
1 week ago
Cleveland, United States Manpower Group Inc. Full timeData Warehouse Mainframe Lead (Multiple position) 100% Remote Role - TBD Highland Heights OH 44143 United States 12+ month contract with high potential for extension and can convert to permanent. Pay range: $60/hr to $65/hr Our Fortune 500 client (One of the world's largest Insurance companies) in Heights OH is looking for hardworking, motivated talent to...
-
Data Warehouse Mainframe Lead
1 week ago
Cleveland, United States Exodus Integrity Services Full timeExodus Integrity Services, Inc is a rapidly expanding technology company headquartered in Northeast Ohio. EIS provides quality services to our clients by instilling honesty, commitment, and hard work to find the most qualified candidates to fill each opportunity. Currently, we are seeking individuals for a Data Warehouse Mainframe Lead opportunity with our...
-
Data Warehouse Mainframe Lead
15 hours ago
Cleveland, United States Exodus Integrity Services Full timeExodus Integrity Services, Inc is a rapidly expanding technology company headquartered in Northeast Ohio. EIS provides quality services to our clients by instilling honesty, commitment, and hard work to find the most qualified candidates to fill each opportunity. Currently, we are seeking individuals for a Data Warehouse Mainframe Lead opportunity with our...
-
AWS Database Developer
7 days ago
Cleveland, United States Centric Consulting Full timeAWS Database Developer Job Location: Cleveland, OH, Remote Join our team Centric Consulting is an international management consulting firm with expertise in digital, business and technology. We are looking for a AWS Database Developer to join our growing team. While this position is remote, we do require candidates to attend an onsite interview as well as...
-
Data Solutions Architect
1 week ago
Cleveland, United States Forsyth Barnes Full timeWe are currently partnered with a global organization on their search for a Data Solutions Architect. The Solutions Architect will have a broad range of technical knowledge and will deliver solution architectures across multiple projects, as well as consultative technical leadership across the organization, from strategic decision making to project planning...
-
Data Solutions Architect
12 hours ago
Cleveland, United States Forsyth Barnes Full timeWe are currently partnered with a global organization on their search for a Data Solutions Architect. The Solutions Architect will have a broad range of technical knowledge and will deliver solution architectures across multiple projects, as well as consultative technical leadership across the organization, from strategic decision making to project planning...
-
Data Solutions Architect
1 week ago
Cleveland, United States Forsyth Barnes Full timePosition: Data Solutions ArchitectSalary: up to $150,000kIndustry: Retail/ManufacturingLocation: Cleveland, OH – HybridWe are currently partnered with a global organization on their search for a Data Solutions Architect. The Solutions Architect will have a broad range of technical knowledge and will deliver solution architectures across multiple projects,...
-
Data Solutions Architect
1 week ago
Cleveland, United States Forsyth Barnes Full timePosition: Data Solutions ArchitectSalary: up to $150,000kIndustry: Retail/ManufacturingLocation: Cleveland, OH – HybridWe are currently partnered with a global organization on their search for a Data Solutions Architect. The Solutions Architect will have a broad range of technical knowledge and will deliver solution architectures across multiple projects,...
-
BIOS Data Conversion Coordinator, Analyst
3 hours ago
Cleveland, United States The Sherwin-Williams Company Full timeThe BIOS Data Conversion Coordinator plays a key role in the Business Integrated Operating System (BIOS) program assisting in the seamless transformation of data. This role is responsible for coordinating data conversion plans, troubleshooting issues, and communicating with both technical and business stakeholders. This role requires understanding the...
-
Senior Technical Manager
2 weeks ago
Cleveland, United States PEAK Technical Full timeP-DPD-001 Position/Title: Technical Engineering Director Location: Cleveland, OH Additional Locations Considered: Toledo, OH Work Schedule: Standard Hours, Onsite, Full-Time Hybrid/Remote Options: Hybrid Relocation Assistance: Yes Citizenship Requirements: US Citizen, Green Card Holder, Permanent Resident Our client, awarded as one of the TOP...
-
Technical Lead
2 weeks ago
Cleveland, United States iSpace, Inc Full timeTechnical Team LeadFTE with client Cleveland, OH (4 days a week onsite)The position is considered more of a Technical Lead, as opposed to just Team Lead, meaning they need to have a high degree of knowledge within our tech stack. Experience leading/mentoring others. Applicants need to have experience with Azure and Microsoft technologies.Leads will oversee...
-
Technical Manager, Global Refinish Color Data
4 weeks ago
Cleveland, United States PPG Industries, Inc. Full timeLead the data management team, ensuring the integrity of refinish color data, optimizing workflow within USCA color labs, and providing exceptional customer service to Automotive Refinish clients. Manage and oversee customer service requests in the c Technical Manager, Manager, Technical, Global, Customer Service, Manufacturing, Technology
-
Technical Manager, Global Refinish Color Data
1 month ago
Cleveland, United States PPG Industries Full timeLead the data management team, ensuring the integrity of refinish color data, optimizing workflow within USCA color labs, and providing exceptional customer service to Automotive Refinish clients. Manage and oversee customer service requests in the c Technical Manager, Manager, Technical, Global, Customer Service, Manufacturing, Technology
-
Technical Lead
7 days ago
Cleveland, United States Tata Consultancy Services Full timeSkill: Tech Lead - Hadoop Candidate shell have 6+ years of experience. Full stack big data developer, python, hive, impala, hdfs, java, ranger, sqoop, linux, the whole 9 yards. Build, operate, monitor, and troubleshoot Hadoop infrastructure. Develop documentation and playbooks to operate Hadoop infrastructure. Write software to ingest data into Hadoop....
-
Sr. IT Data Analyst
1 week ago
Cleveland, Ohio, United States Randstad USA Full timejob summary: Core Responsibilities and Tasks Support the Enterprise Data Organization's business strategy as it relates to our platform and technologies to guide the business transformation program through the implementation of Oracle Cloud ERP and bolt-on systems. Coordinate with the Data Governance ERP Cloud Manager to ensure alignment throughout all EDO...
-
Sr. IT Data Analyst
7 hours ago
Cleveland, Ohio, United States Randstad USA Full timejob summary: Core Responsibilities and Tasks Support the Enterprise Data Organization's business strategy as it relates to our platform and technologies to guide the business transformation program through the implementation of Oracle Cloud ERP and bolt-on systems. Coordinate with the Data Governance ERP Cloud Manager to ensure alignment throughout all EDO...