Data Analyst/Cloud ETL Developer
4 months ago
Job Title :Data Analyst/Cloud ETL Developer Location: Richmond, VA, Hybrid
Rate : Best competitive rate
*Local Richmond, VA candidates ONLY required due to onsite requirement **This position requires onsite 3 days a week with 2 remote **Contractor will be responsible for purchasing parking through VDOT's Parking Management Office or procuring their own parking
Job Description: Data Analyst/SR ETL Developer
The Virginia Department of Transportation (VDOT)Information Technology Division (ITD) is seeking a Master Data Analyst with demonstrated experience in data analytics to work as a key member of Enterprise Data Asset team. This analyst will support teams working in Agile (Sprint) to analyze datasets to be made available in a cloud-based data management platform that will support the agency to produce master data with data governance. Responsibilities include analyzing source systems which contain a spatial component for candidate datasets; documenting business processes and data lifecycle; developing data requirements, user stories and acceptance criteria; and testing strategies. Develop ETL to extract business data and spatial data and load it into a data warehousing environment. Design and test the performance of the system. Consult with various teams to understand the company's data storage needs and develop data warehousing options. Deep knowledge of coding languages, such as python, Java, XML, and SQL. Well-versed in warehousing architecture techniques such as MOLAP, ROLAP, ODS, DM, and EDW.
VDOT is a fast-paced organization with very high standards for work quality and efficiency. This position is expected to handle multiple projects, and remain flexible and productive, despite changing priorities and processes. Ongoing improvement and efficiency are a part of our culture, and each team member is expected to proactively contribute to process improvements.
Responsibilities:
• Work with the Project team members and business stakeholders to understand business processes and pain points • Develop expertise in source system datasets and data lifecycle • Profile source data which may contain a spatial component; review source data and compare content and structure to dataset requirements; identify conflicts and determine recommendations for resolution • Conduct entity resolution to identify matching and merging and semantic conflicts • Elicit, record, and manage metadata • Diagram current processes and proposed modifications using process flows, context diagrams and data flow diagrams • Decompose requirements into Epics and Features and create clear and concise user stories that are easy to understand and implement by technical staff • Utilize progressive elaboration; map stories to data models and architectures to be used by internal staff to facilitate master data management • Identify and group related user stories into themes, document dependencies and associated business processes
Discover and document requirements and user stories with a focus on improving both business and technical processing • Assist Product Owner in maintaining the product backlog • Create conceptual prototypes and mock-ups • Collaborate with staff, vendors, consultants, and contractors as they are engaged on tasks to formulate, detail and test potential and implemented solutions • Perform Quality Analyst functions such as defining test objectives, test plans and test cases, and executing test cases • Coordinate and Facilitate User Acceptance Testing with Business and ensure Project Managers/Scrum Masters are informed of the progress
• Designs and develops systems for the maintenance of the Data Asset Program(Data Hub), ETL processes, ETL processes for spatial data, and business intelligence.
• Develop a new data engineering process that leverage a new cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed.
• Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of Data Marts.
• Work closely with data analysts, data scientists, and other data consumers within the business in an attempt together and populate data hub and data warehouse table structure, which is optimized for reporting.
• The Data developers partners with Data modeler and Data architect in an attempt to refine the business's data requirements, which must be met for building and maintaining Data Assets.
•Qualifications
Required: The candidate must have a minimum of 10 years of experience delivering business data analysis artifacts
5+ years of experience as an Agile Business Analyst; strong understanding of Scrum concepts and methodology
Experience organizing and maintaining Product and Sprint backlogs
Experience translating client and product strategy requirements into dataset requirements and user stories
Proficient with defining acceptance criteria and managing acceptance process
• Exceptional experience writing complex sql queries for Sql Server and Oracle
• Experience with Azure Databricks
• Experience with ESRI ArcGIS
Experience with enterprise data management
Expertise with Microsoft Office products (Word, Excel, Access, Outlook, Visio, PowerPoint, Project Server)
Experience with reporting systems - operational data stores, data warehouses, data lakes, data marts
• The candidate must have exceptional written and oral communications skills and have the proven ability to work well with a diverse set of peers and customers
Preferred Skills:
• Advanced understanding of data integrations.
• Strong knowledge of database architectures
• Strong analytical and problem solving skills
• Ability to build strong relationships both internally and externally
• Ability to negotiate and resolve conflicts
• Ability to effectively prioritize and handle multiple tasks and projects
• Strong written and verbal communication skills
• Desire to learn, innovate and evolve technology
Computer Skills/MS Office/Software:
• Excellent computer skills and be highly proficient in the use of MS Word, PowerPoint, MS Excel, MS Project, MS Visio, and MS Team Foundation Server, which will all be necessary in the creation of visually and verbally engaging ETL, data designs and tables as well as the communication of documentation and reporting.
• Deep passion for data analytics technologies as well as analytical and dimensional modeling. The candidate must be extensively familiar with ETL(Extraction, Transformation & Load), data warehousing, and business intelligence tools such as business objects, PowerBI and Tableau.
• The candidate must also have vast knowledge of database design and modeling in the context of data warehousing.
• Experience with key data warehousing architectures including Kimball and Inmon, and has a broad experience designing solutions using a broad set of data stores (e.g., HDFS, Azure Data Lake Store, Azure Blob Storage, Azure SQL Data Warehouse, Azure Cosmos DB
Technologies Required:
• Data Factory v2,Data Lake Store, Data Lake Analytics, Azure Analysis Services, AZURE Synapse
• IBM Datastage, Erwin, SQL Server (SSIS, SSRS, SSAS), ORACLE, T-SQL, Azure SQL Database, Azure SQL Datawarehouse.
• Operating System Environments (Windows, Unix, etc.).
• Scripting experience with Windows and/or Python, Linux Shell scripting
Skill
Required / Desired
Amount
of Experience
Designs and develops systems for the maintenance of the Data Asset Program, ETL processes, and business intelligence.Required10Years
Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of DataRequired10Years
Work closely with data analysts, data scientists, and other data consumers within the business in an attempt to gather and populate data hub and dataRequired10Years
Advanced understanding of data integrations.• Strong knowledge of database architectures, strong understanding of ingesting spatial dataRequired10Years
Ability to negotiate and resolve conflicts,• Ability to effectively prioritize and handle multiple tasks and projectsRequired10Years
Excellent computer skills and be highly proficient in the use of Ms Word, PowerPoint, Ms Excel, MS Project, MS Visio, and MS Team Foundation ServerRequired10Years
Experience with key data warehousing architectures including Kimball and Inmon, and has a broad experience designing solutions using a broad set of daRequired10Years
expertise in Data Factory v2,Data Lake Store, Data Lake Analytics, Azure Analysis Services, Azure SynapseRequired10Years
IBM Datastage, Erwin, SQL Server (SSIS, SSRS, SSAS), ORACLE, T-SQL, Azure SQL Database, Azure SQL Datawarehouse.Required10Years
Operating System Environments (Windows, Unix, etc.).• Scripting experience with Windows and/or Python, Linux Shell scriptingRequired10Years
Experience in AZURE Cloud engineeringRequired10Years
About Us:
InterSources Inc, a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services, etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a Google Cloud partner company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.
-
Data Analyst/Cloud ETL Developer
4 weeks ago
Richmond, Virginia, United States InterSources Full timeJob Title:Data Analyst/Cloud ETL DeveloperJob Description:Job Summary:We are seeking a highly skilled Data Analyst/Cloud ETL Developer to join our team at InterSources Inc. The ideal candidate will have a strong background in data analysis, cloud computing, and ETL development.Key Responsibilities:Design and develop ETL processes to extract, transform, and...
-
Data Analyst/Cloud ETL Developer
4 weeks ago
Richmond, Virginia, United States InterSources Full timeJob Title: Data Analyst/Cloud ETL DeveloperJob Description:The Virginia Department of Transportation (VDOT) Information Technology Division (ITD) is seeking a skilled Data Analyst/Cloud ETL Developer to join their Enterprise Data Asset team. As a key member of this team, you will be responsible for analyzing datasets to be made available in a cloud-based...
-
Data Analyst/Cloud ETL Developer
4 weeks ago
Richmond, California, United States Lorven Technologies Full timeJob Description: Lorven Technologies is seeking a highly skilled Data Analyst/Cloud ETL Developer to join our team. As a key member of our Enterprise Data Asset team, you will be responsible for analyzing datasets to be made available in a cloud-based data management platform. Your expertise will help us produce master data with data governance....
-
VDOT Data Analyst/Cloud ETL Developer
2 months ago
Richmond, United States Lorven Technologies Full timePosition: VDOT Data Analyst/Cloud ETL Developer (742720) Location: 6730 Public Safety Way Chesterfield, VA 23832 - Hybrid Contract Position Job Description: Data Analyst/SR ETL Developer The Virginia Department of Transportation (VDOT)Information Technology Division (ITD) is seeking a Master Data Analyst with demonstrated experience in data analytics to work...
-
Senior Azure ETL Developer
5 months ago
Richmond, United States Serigor Inc Full timeJob Title: Senior Azure ETL Developer (HYBRID) Location: Richmond, VA Duration: 12+ Months Job Description: The client is looking for a Senior Azure ETL developer to ingest/transform and load Data Assets and implementation of a cloud-based data management platform that will support the agency. This role is expected to take a Sr Developer role within the...
-
Senior Azure ETL Developer
4 weeks ago
Richmond, California, United States Lorven Technologies Full timeJob Title: Senior Azure ETL DeveloperJob Summary:At Lorven Technologies, we are seeking a highly skilled Senior Azure ETL Developer to join our team. The ideal candidate will have experience in designing, building, and deploying scalable Azure cloud-based data solutions. Key responsibilities include hands-on experience with Azure services such as Azure Data...
-
DataStage ETL Developer
3 months ago
Richmond, United States Syntricate Technologies Full timeTitle: Sr. DataStage ETL Developer Start Date: 09/09/2024 to 12 Months+ Position Type: contract Location: Richmond VA 23219 [Hybrid] Description: Short Description: Sr. DataStage ETL Developer. Complete Description: *Local Richmond candidates or candidates willing to relocate to Richmond due to onsite work requirement. *Web Cam and ONSITE interviews....
-
Senior DataStage ETL Developer
3 weeks ago
Richmond, California, United States Aloden, Inc. Full timeAbout the Role:At Aloden, Inc., we are seeking a highly skilled Sr. DataStage ETL Developer to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and maintaining ETL processes using IBM Infosphere DataStage.Key Responsibilities:Design and develop complex ETL processes using IBM Infosphere...
-
Sr. DataStage ETL Developer
2 months ago
Richmond, United States Aloden, Inc. Full timeSr. DataStage ETL Developer Location: Richmond, VA (Hybrid - 2-3 days onsite per week) Candidate Preference: Local to Richmond, VA, or willing to relocate. Work Authorization: W2 Candidates only Interview Type: Both Web Cam and In-Person Interview Must-Have Skills: IBM Infosphere DataStage: Advanced skills in IBM's Infosphere DataStage product...
-
Senior Data Engineer
2 months ago
Richmond, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior Data Engineer
2 months ago
richmond, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior Data Engineer
1 month ago
richmond, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior Data Engineer
2 months ago
Richmond, United States SingleStone Full timeAs a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data analytics, business intelligence, and machine learning initiatives. You will lead the development of systems that ingest, process, and transform large volumes of data while ensuring data quality, governance,...
-
Senior DataStage ETL Developer
4 weeks ago
Richmond, Virginia, United States InterSources Full timeJob Title : Sr. DataStage ETL DeveloperLocation: Richmond, VA, HybridRate : Best competitive rateLocal Richmond candidates or candidates willing to relocate to Richmond due to onsite work requirement. Web Cam and ONSITE interviews. Candidates must be willing and able to work onsite 2 days/week for the first couple of weeks, and 1-2 days/week...
-
Sr. DataStage ETL Developer
3 months ago
Richmond, United States InterSources Full timeJob Title : Sr. DataStage ETL Developer Location: Richmond, VA, Hybrid Rate : Best competitive rate Local Richmond candidates or candidates willing to relocate to Richmond due to onsite work requirement. *Web Cam and ONSITE interviews. Candidates must be willing and able to work onsite 2 days/week for the first couple of weeks, and 1-2 days/week...
-
Senior ETL Developer
1 week ago
Richmond, California, United States Saxon Global Full timeSenior ETL Developer We are seeking an experienced Senior ETL Developer to work with our team at Saxon Global. The ideal candidate should have a strong background in data transformation and be proficient in IBM DataStage.Key Responsibilities:Design and implement ETL processes to extract, transform, and load data into our data warehouse.Collaborate with...
-
Senior Data Analyst
4 weeks ago
Richmond, California, United States Commonwealth of Virginia Full timeJob SummaryWe are seeking a highly skilled Senior Data Analyst to join our Data Management Team (DMT) at the Virginia Department of Health (VDH). The successful candidate will provide development, system analysis, technical architecture support, and peer troubleshooting assistance in support of the VDH Strategic Plan.Key ResponsibilitiesImplement,...
-
Senior ETL Developer
3 weeks ago
Richmond, California, United States Saxon Global Full time**Job Summary**Saxon Global is seeking a highly skilled ETL developer to join our team in Richmond, VA. As a Senior ETL Developer, you will be responsible for designing, developing, and implementing efficient ETL solutions using IBM DataStage.**Key Responsibilities:**Develop and maintain ETL processes using IBM DataStage.Design and implement data models and...
-
richmond, United States DataStaff, Inc. Full timeDataStaff, Inc. is seeking a Programmer Analyst/Data Warehouse Technical Architect for a long-term contract opportunity with one of our direct clients in Richmond, VA*In office 1-2 days for first 3 months, then the resource should be in office every Wednesday.Job Description:Data architect to provide data intake, data governance, data transformation, data...
-
richmond, United States DataStaff, Inc. Full timeDataStaff, Inc. is seeking a Programmer Analyst/Data Warehouse Technical Architect for a long-term contract opportunity with one of our direct clients in Richmond, VA*In office 1-2 days for first 3 months, then the resource should be in office every Wednesday.Job Description:Data architect to provide data intake, data governance, data transformation, data...