Azure Data Engineer

4 weeks ago


Columbia, United States Lambentwit Technologies Inc Full time

Reports Directly To: CRISP Insights Project Manager Location: Columbia, MD Job Summary The Data Engineer will be responsible for supporting HIT activities in the Baltimore/Washington region. The successful candidate will work to design, develop, and maintain a data analytics platform solution. CRISP is currently running an Azure Data Lake 2 / Azure Data Factory / Spark / Databricks infrastructure with approximately 300 production use cases that consolidate several streams of healthcare data. This role will primarily focus on the creation of new use cases through Databricks programming including communication, technical proficiency, collaboration, and willingness to learn new things. This role assists a senior data engineer to implement new ingestion pipelines and troubleshoot production issues. This position will have a base salary. This position requires the candidate to be in the Columbia office 1-2 days a week. ESSENTIAL DUTIES AND RESPONSIBILITIES Include the following. Other duties may be assigned. Create new business data sources from the available data in the data platform: · Work with source system owners to understand integration needs · Work with business users to understand reporting needs · Implement Databricks and Azure Data Factory components to transform the data into business facing datasets · Perform unit and integration testing of business facing datasets · Document business use cases · Monitor data pipeline job status and troubleshoot issues · Work with source system owners and business owners to incorporate business changes into data pipeline (i.e., updating metadata file to add new object, update curated layer query, etc.) · Perform automated data quality checks on data pipelines Qualifications To perform this job successfully, the incumbent must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Required Skills · Experience in a production Data Lake or Data Warehouse environment · Data Lake Design Patterns – Familiar · Ability to develop programming components to build complex business use cases · Ability to prioritize and manage multiple job duties, including personal time management and organization skills · Ability to diagram and understand technical workflows Preferred Skills · Cloud Infrastructure (Azure) - Foundational

#J-18808-Ljbffr


  • Azure Cloud Engineer

    3 weeks ago


    West Columbia, United States York Solutions, LLC Full time

    Description Our direct end client is looking for a Azure cloud engineer for a 12+ month contract. This position can be remote. Logistics: Type: Contract, remote ok Location: Remote, if closer to Lacrosse a bonus $100-105 per hour **Azure Pipelines-Release and Deployments are actively being used. Not a central repository for code, some is in DevOps and some...


  • Columbia, United States Ampcus Full time

    Mandatory Skills: • Bachelor's Degree Information Technology (or equivalent educational focus 10+ years) is required. • 5+ years of total IT experience • 2+ years of Cloud experience • Must have experience supporting Azure VM, Storage, Network, Backup, Database • Must have cross platform enterprise experience across IT (Server, Network, Storage,...


  • Columbia, United States Ampcus Incorporated Full time

    Mandatory Skills: • Bachelor’s Degree Information Technology (or equivalent educational focus 10+ years) is required. • 5+ years of total IT experience • 2+ years of Cloud experience • Must have experience supporting Azure VM, Storage, Network, Backup, Database • Must have cross platform enterprise experience across IT (Server, Network,...


  • Columbia, United States Elevance Health Full time

    Data Protection Engineer Location: This position will work a hybrid model (remote & office). The ideal candidate will live within 50 miles of one of our Elevance Health PulsePoint office locations. The Data Protection Engineer supports the Data Protection and Monitoring Services (DPMS) team and has experience with various data structures, database...

  • Senior Software

    2 months ago


    Columbia, United States DataTribe Full time

    Job DescriptionJob DescriptionDo you want to help build the next generation network security planning solution?Company Overview: Sixmap is working on leading edge network intrusion detection technology that enables enterprises and network operators to gain insights into their complete network attack surface and identify network vulnerabilities at unheard of...

  • Data Analyst

    3 days ago


    Columbia, United States Recruiting Solutions Full time

    Responsibilities: Collaborate with cross-functional teams to assess existing on-premises server infrastructure and determine migration requirements Design, plan, and execute the migration of on-premises servers to Azure cloud, ensuring minimal downtime and data integrity Utilize advanced knowledge in SQL Server databases and SQL scripting to update...

  • Data Engineer

    2 weeks ago


    Columbia, United States ManTech International Corporation Full time

    The Data Engineer designs, implements, and maintains data infrastructure and systems. They collaborate with Data Scientists and Analysts to understand their data needs and create efficient solutions to extract, transform, load, link, and/or visualize Data Engineer, Engineer, Data Scientist, Technology

  • Software Engineer

    1 month ago


    Columbia, United States Insight Global Full time

    Qualifying Experience/Skillset: Skilled in programming languages such C#, Python, JavaScriptAzure Services - Azure OpenAI Services, Storage Accounts, Cognitive Search, App Insights, App Services, Key Vault etc.Azure DevOps and the workflows to build, test, package, release, and deploy to Azure services.Prompting techniques and customizations like...

  • Software Engineer

    1 month ago


    Columbia, United States Insight Global Full time

    Qualifying Experience/Skillset: Skilled in programming languages such C#, Python, JavaScriptAzure Services - Azure OpenAI Services, Storage Accounts, Cognitive Search, App Insights, App Services, Key Vault etc.Azure DevOps and the workflows to build, test, package, release, and deploy to Azure services.Prompting techniques and customizations like...

  • Data Engineer

    1 week ago


    Columbia, United States Merit 321 Full time

    Position: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...

  • Data Engineer

    3 weeks ago


    Columbia, United States Merit 321 Full time

    Position: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...

  • Data Engineer

    3 days ago


    Columbia, United States Merit 321 Full time

    Position: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...


  • Columbia, United States Southern Company Full time

    Nuclear Technology Solutions – Data Analytics Analyst JOB SUMMARY The Data Analytics Analyst provides application and programming support to the Nuclear Technology Solutions (NTS) Data Analytics team located in Birmingham, Alabama at the Energy Center. Their responsibilities include collaborating closely with Southern Nuclear Corporation (SNC) business...

  • Sr Systems Engineer

    5 days ago


    Columbia, United States TEKsystems Full time

    Top Skills' Details 1.) Extensive experience designing and building out VMware environments 2.) Extensive experience working as a Systems Engineer designing and implementing data center and infrastructure technologies. • Server compute infrastructure (Cisco UCS) • Storage infrastructure (NetApp, Pure Storage) • Enterprise Backup and Disaster...


  • Columbia, United States RICEFW Technologies Inc Full time

    Remote is only 50% offsite - candidates must still report onsite during the week as well. SCOPE OF THE PROJECT: Serve as a technical thought leader and SME for our public cloud ecosystem across the State of South Carolina and will plan, analyze, design, test, and deploy enhancements to our Microsoft Azure and AWS cloud and PaaS solutions and provides...

  • Network Engineer

    3 days ago


    Columbia, United States Talent Software Services Full time

    SCOPE OF THE PROJECT: THIS IS A BROAD POSITION THAT WILL WORK WITH ALL ASPECTS OF THE SYSTEMS AND NETWORK AREA. ROLE SUMMARY/ PURPOSE The candidate will be technically proficient in their area and will act as a point of reference for the team on technical issues, as well as be a leader who mentors other less experienced engineers. This project requires work...


  • Columbia, United States Data Direct Networks Full time

    Overview: This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial...

  • Data Engineer

    2 days ago


    Columbia, United States Techizee Inc. Full time

    Job Description Position Title: Data Engineer Key Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics. Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business requirements. ·...

  • Data Engineer

    2 months ago


    Columbia, United States Techizee Inc Full time

    Job DescriptionJob DescriptionPosition Title: Data EngineerKey Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics.Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business...

  • Data Engineer

    1 week ago


    Columbia, United States Techizee Inc Full time

    Job DescriptionJob DescriptionPosition Title: Data EngineerKey Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics.Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business...