Azure Data Engineer
4 weeks ago
Reports Directly To: CRISP Insights Project Manager
Location: Columbia, MD
Job Summary
The Data Engineer will be responsible for supporting HIT activities in the Baltimore/Washington region. The successful candidate will work to design, develop, and maintain a data analytics platform solution. CRISP is currently running an Azure Data Lake 2 / Azure Data Factory / Spark / Databricks infrastructure with approximately 300 production use cases that consolidate several streams of healthcare data. This role will primarily focus on the creation of new use cases through Databricks programming including communication, technical proficiency, collaboration, and willingness to learn new things. This role assists a senior data engineer to implement new ingestion pipelines and troubleshoot production issues.
This position will have a base salary.
This position requires the candidate to be in the Columbia office 1-2 days a week.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Include the following. Other duties may be assigned.
Create new business data sources from the available data in the data platform:
· Work with source system owners to understand integration needs
· Work with business users to understand reporting needs
· Implement Databricks and Azure Data Factory components to transform the data into business facing datasets
· Perform unit and integration testing of business facing datasets
· Document business use cases
· Monitor data pipeline job status and troubleshoot issues
· Work with source system owners and business owners to incorporate business changes into data pipeline (i.e., updating metadata file to add new object, update curated layer query, etc.)
· Perform automated data quality checks on data pipelines
Qualifications
To perform this job successfully, the incumbent must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Required Skills
· Experience in a production Data Lake or Data Warehouse environment
· Data Lake Design Patterns – Familiar
· Ability to develop programming components to build complex business use cases
· Ability to prioritize and manage multiple job duties, including personal time management and organization skills
· Ability to diagram and understand technical workflows
Preferred Skills
· Cloud Infrastructure (Azure) - Foundational
#J-18808-Ljbffr
-
Azure Cloud Engineer
3 weeks ago
West Columbia, United States York Solutions, LLC Full timeDescription Our direct end client is looking for a Azure cloud engineer for a 12+ month contract. This position can be remote. Logistics: Type: Contract, remote ok Location: Remote, if closer to Lacrosse a bonus $100-105 per hour **Azure Pipelines-Release and Deployments are actively being used. Not a central repository for code, some is in DevOps and some...
-
Senior Azure Cloud Engineer
4 weeks ago
Columbia, United States Ampcus Full timeMandatory Skills: • Bachelor's Degree Information Technology (or equivalent educational focus 10+ years) is required. • 5+ years of total IT experience • 2+ years of Cloud experience • Must have experience supporting Azure VM, Storage, Network, Backup, Database • Must have cross platform enterprise experience across IT (Server, Network, Storage,...
-
Senior Azure Cloud Engineer
1 week ago
Columbia, United States Ampcus Incorporated Full timeMandatory Skills: • Bachelor’s Degree Information Technology (or equivalent educational focus 10+ years) is required. • 5+ years of total IT experience • 2+ years of Cloud experience • Must have experience supporting Azure VM, Storage, Network, Backup, Database • Must have cross platform enterprise experience across IT (Server, Network,...
-
Data Protection Engineer
4 weeks ago
Columbia, United States Elevance Health Full timeData Protection Engineer Location: This position will work a hybrid model (remote & office). The ideal candidate will live within 50 miles of one of our Elevance Health PulsePoint office locations. The Data Protection Engineer supports the Data Protection and Monitoring Services (DPMS) team and has experience with various data structures, database...
-
Senior Software
2 months ago
Columbia, United States DataTribe Full timeJob DescriptionJob DescriptionDo you want to help build the next generation network security planning solution?Company Overview: Sixmap is working on leading edge network intrusion detection technology that enables enterprises and network operators to gain insights into their complete network attack surface and identify network vulnerabilities at unheard of...
-
Data Analyst
3 days ago
Columbia, United States Recruiting Solutions Full timeResponsibilities: Collaborate with cross-functional teams to assess existing on-premises server infrastructure and determine migration requirements Design, plan, and execute the migration of on-premises servers to Azure cloud, ensuring minimal downtime and data integrity Utilize advanced knowledge in SQL Server databases and SQL scripting to update...
-
Data Engineer
2 weeks ago
Columbia, United States ManTech International Corporation Full timeThe Data Engineer designs, implements, and maintains data infrastructure and systems. They collaborate with Data Scientists and Analysts to understand their data needs and create efficient solutions to extract, transform, load, link, and/or visualize Data Engineer, Engineer, Data Scientist, Technology
-
Software Engineer
1 month ago
Columbia, United States Insight Global Full timeQualifying Experience/Skillset: Skilled in programming languages such C#, Python, JavaScriptAzure Services - Azure OpenAI Services, Storage Accounts, Cognitive Search, App Insights, App Services, Key Vault etc.Azure DevOps and the workflows to build, test, package, release, and deploy to Azure services.Prompting techniques and customizations like...
-
Software Engineer
1 month ago
Columbia, United States Insight Global Full timeQualifying Experience/Skillset: Skilled in programming languages such C#, Python, JavaScriptAzure Services - Azure OpenAI Services, Storage Accounts, Cognitive Search, App Insights, App Services, Key Vault etc.Azure DevOps and the workflows to build, test, package, release, and deploy to Azure services.Prompting techniques and customizations like...
-
Data Engineer
1 week ago
Columbia, United States Merit 321 Full timePosition: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...
-
Data Engineer
3 weeks ago
Columbia, United States Merit 321 Full timePosition: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...
-
Data Engineer
3 days ago
Columbia, United States Merit 321 Full timePosition: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...
-
Data Analytics Analyst
2 days ago
Columbia, United States Southern Company Full timeNuclear Technology Solutions – Data Analytics Analyst JOB SUMMARY The Data Analytics Analyst provides application and programming support to the Nuclear Technology Solutions (NTS) Data Analytics team located in Birmingham, Alabama at the Energy Center. Their responsibilities include collaborating closely with Southern Nuclear Corporation (SNC) business...
-
Sr Systems Engineer
5 days ago
Columbia, United States TEKsystems Full timeTop Skills' Details 1.) Extensive experience designing and building out VMware environments 2.) Extensive experience working as a Systems Engineer designing and implementing data center and infrastructure technologies. • Server compute infrastructure (Cisco UCS) • Storage infrastructure (NetApp, Pure Storage) • Enterprise Backup and Disaster...
-
Azure Cloud Infrastructure Architect
3 weeks ago
Columbia, United States RICEFW Technologies Inc Full timeRemote is only 50% offsite - candidates must still report onsite during the week as well. SCOPE OF THE PROJECT: Serve as a technical thought leader and SME for our public cloud ecosystem across the State of South Carolina and will plan, analyze, design, test, and deploy enhancements to our Microsoft Azure and AWS cloud and PaaS solutions and provides...
-
Network Engineer
3 days ago
Columbia, United States Talent Software Services Full timeSCOPE OF THE PROJECT: THIS IS A BROAD POSITION THAT WILL WORK WITH ALL ASPECTS OF THE SYSTEMS AND NETWORK AREA. ROLE SUMMARY/ PURPOSE The candidate will be technically proficient in their area and will act as a point of reference for the team on technical issues, as well as be a leader who mentors other less experienced engineers. This project requires work...
-
Columbia, United States Data Direct Networks Full timeOverview: This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial...
-
Data Engineer
2 days ago
Columbia, United States Techizee Inc. Full timeJob Description Position Title: Data Engineer Key Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics. Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business requirements. ·...
-
Data Engineer
2 months ago
Columbia, United States Techizee Inc Full timeJob DescriptionJob DescriptionPosition Title: Data EngineerKey Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics.Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business...
-
Data Engineer
1 week ago
Columbia, United States Techizee Inc Full timeJob DescriptionJob DescriptionPosition Title: Data EngineerKey Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics.Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business...