Azure Data Engineer

3 weeks ago

Miami, United States e.biT Consulting Full time

SUMMARY DESCRIPTION:The Data Engineer will serve in a strategic role managing the infrastructure that supports data storage, transforming, processing, and retrieval enabling efficient data analysis and decision-making within the organization. This position is critical as part of the Database and Analytics team responsible for development and implementation of complex enterprise-level data integration and consumption solutions. It requires a highly technical, self-motivated senior developer who will work with analysts, architects, and systems engineers to develop and unit test solutions based on the functional and technical specifications to meet quality and performance requirements.


PRIMARY DUTIES AND RESPONSIBILITIES:

Design and optimize data models, warehouses, architectures, schemas, indexing, and partitioning strategies.

Collaborate with BI and data analysts to understand data requirements and optimize storage for analytical queries.

Modernize databases and data warehouses and prepare them for analysis, managing for optimal performance.

Design, build, manage, and optimize enterprise data pipelines ensuring efficient data flow, data integrity, and data quality throughout the process.

Automate efficient data acquisition, transformation, and integration from a variety of data sources including databases, APIs, message queues, data streams, etc.

Competently performs advanced data tasks with minimal supervision, including architecting advanced data solutions, leading and coaching others, and effectively partnering with stakeholders.

Interface with other technical and non-technical departments and outside vendors on assigned projects.

Under the direction of the IT Management, will establish standards, policies and procedures pertaining to data governance, database/data warehouse management, metadata management, security, optimization, and utilization.

Ensure data security and privacy by implementing access controls, encryption, and anonymization techniques as per data governance and compliance policies.

Provide training and consulting to other associates on database structure and standards.

Document data pipelines, processes, and architectural designs for future reference and knowledge sharing.

Stay informed of latest trends and technologies in the data engineering field, and evaluate and adopt new tools, frameworks, and platforms (like Microsoft Fabric) to enhance data processing and storage capabilities.

When necessary, implement and document schema modifications made to legacy production environment.

Perform any other function required by IT Management for the successful operation of all IT and data services provided to our clients.

Available nights and weekends as needed for system changes and rollouts.


EDUCATION AND EXPERIENCE REQUIREMENTS:

Bachelor’s or Master’s degree in computer science, information systems, applied mathematics, or closely related field.

Minimum of eight (8) years full time employment experience as a data engineer, data architect, or equivalent required.

Knowledge of Mortgage and/or Title Industry is helpful.




SKILLS:

Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures, and integrated datasets using traditional and modern data integration technologies (such as ETL, ELT, MPP, data replication, change data captures, message-oriented data movement, API design, stream data integration and data virtualization)

Experience working with cloud data engineering stacks (specifically Azure) and tools (Microsoft Fabric, Data Lake, Synapse, Azure Data Factory, Databricks, Informatica, etc.)

Strong, in-depth understanding of database architecture, storage, and administration utilizing Azure stack.

Deep understanding of Data architectural approaches, Data Engineering Solutions, Software Engineering principles and best practices.

Working knowledge and experience with modern BI and ETL tools (Power BI, Power Automate, ADF, SSIS, etc.)

Experience utilizing data storage solutions including Azure Blob storage, ADLS Gen 2.

Solid understanding of relational and dimensional database principles and best practices in a client/server, thin-client, and cloud computing environment.

Advanced working knowledge of TSQL and SQL Server, transactions, error handling, security and maintenance with experience writing complex stored procedures, views, and user-defined functions.

Experience with .net scripting and understanding of API integration in a service-oriented architecture.

Communicate effectively and professionally, in both oral and written communications, with all levels of associates.

Understanding of and experience with agile methodology.

Strong independent troubleshooting and problem-solving skills.

Organizational, time management, and motivational skills.

Must be able to perform in a fast paced and mission critical production environment.

Ability to analyze and troubleshoot problems, determine solutions, and produce the desired outcome.

Team Player with a strong work ethic.

PowerShell scripting experience desired.


Experience Waiver: Management reserves the right to amend, modify or waive any education, experience, or skill requirements for this position.


Equipment to be used:

Personal Computer / Printer

Any other equipment necessary to perform the normal functions of this job.


PHYSICAL REQUIREMENTS:

Typical Physical Demands:

Some travel may be required.

Must maintain a professional appearance.

Position requires long periods of work at a desk, utilizing a keyboard and monitor.


Working Conditions:

Available to work evenings and/or weekends (as required).

Workdays and hours are Monday thru Friday 8:30 am to 5:30 pm


ADDITIONAL REQUIREMENTS:

Ability to:

Establish and maintain effective working relationships with Business and IT associates.

Embrace and champion change as well as advocate for a data-driven culture.

Improve business productivity by proposing innovative and creative solutions.

Follow directions from management.

Understand and follow posted work rules and procedures.

Communicate in a positive manner to all associates and other business professionals.

Maintain a positive professional attitude.


This position outlines the basic tasks and requirements for the position noted. It is not a comprehensive listing of all job duties of the associate.

FLSA STATUS: Exempt

  • Data Engineer

    1 month ago

    Miami, United States GMSTEK Full time

    Job DescriptionJob DescriptionSalary: $90k - $120kThe JobWe are seeking a Data Engineer - Azure AI Solutions for GMSTEK, specializing in managing moderate volumes of data to enable real-time transactional data analytics. This role is pivotal in leveraging advanced Microsoft technologies such as Azure Synapse Analytics, Power BI, Dynamics 365, and Azure AI...

  • Azure Engineer

    1 month ago

    Miami, United States Banco de Crédito e Inversiones Full time

    ABOUT BCI Bci provides financial services to individuals and corporation. We focus on being a global leader in innovations and personalized client experience and, with more than 10,500 employees, Bci is recognized as one of the best companies in which to work and develop a career. It is the third largest privately owned bank in Chile and it has more than 300...

  • Azure Data Engineer

    3 weeks ago

    Miami, United States e.biT Consulting Full time

    SUMMARY DESCRIPTION:The Data Engineer will serve in a strategic role managing the infrastructure that supports data storage, transforming, processing, and retrieval enabling efficient data analysis and decision-making within the organization. This position is critical as part of the Database and Analytics team responsible for development and implementation...

  • Azure Engineer

    3 weeks ago

    Miami, United States Banco de Credito e Inversiones Full time

    Job DescriptionJob DescriptionABOUT BCIBci provides financial services to individuals and corporation. We focus on being a global leader in innovations and personalized client experience and, with more than 10,500 employees, Bci is recognized as one of the best companies in which to work and develop a career. It is the third largest privately owned bank in...

  • Azure Engineer

    2 weeks ago

    Miami, United States Banco de Credito e Inversiones Full time

    Job DescriptionJob DescriptionABOUT BCIBci provides financial services to individuals and corporation. We focus on being a global leader in innovations and personalized client experience and, with more than 10,500 employees, Bci is recognized as one of the best companies in which to work and develop a career. It is the third largest privately owned bank in...

  • Azure Engineer

    1 month ago

    Miami, United States Banco de Credito e Inversiones Full time

    Job DescriptionJob DescriptionABOUT BCIBci provides financial services to individuals and corporation. We focus on being a global leader in innovations and personalized client experience and, with more than 10,500 employees, Bci is recognized as one of the best companies in which to work and develop a career. It is the third largest privately owned bank in...

  • Azure Data Warehouse Architect

    4 weeks ago

    Miami, United States Resource Informatics Group Full time

    Role: Azure Data Warehouse Architect. Location: Miami, FL Duration: Long term (Hybrid) Rates: Open Synapse set up expertise. Azure cloud expertise, devops, etl expertise. Must have handled multiple data warehousing initiatives preferably from the scratch. Responsibilities Creating the future data architecture/platform and generating data management...

  • Azure/M365 Engineer

    5 days ago

    Miami, United States Apex Systems Full time

    Apex Systems is looking to hire an Azure / M365 Engineer with strong security experience. The hiring manager is looking for someone who has a strong background with supporting Azure and M365 applications and implement security recommendations/changes to the applications. If you're interested in the role, please apply directly to John Baer at...

  • Azure/M365 Engineer

    5 days ago

    Miami, United States Apex Systems Full time

    Apex Systems is looking to hire an Azure / M365 Engineer with strong security experience. The hiring manager is looking for someone who has a strong background with supporting Azure and M365 applications and implement security recommendations/changes to the applications. If you're interested in the role, please apply directly to John Baer at...

  • Azure DevOps

    1 month ago

    Miami, United States StaffChase Full time

    Job Title: Azure DevOps (ADO) Lead Support EngineerLocation: Miami, FLJob Type: Long term of contract (Could go to permanent)Position Status: RemoteMust haves:Lead Support Engineer with proven expertise in Azure DevOps ( ADO), Azure (Service bus, logic apps, functions, ADF), strong performance monitoring expertise, troubleshooting and and performance...

  • Azure DevOps

    1 month ago

    Miami, United States StaffChase Full time

    Job Title: Azure DevOps (ADO) Lead Support EngineerLocation: Miami, FLJob Type: Long term of contract (Could go to permanent)Position Status: RemoteMust haves:Lead Support Engineer with proven expertise in Azure DevOps ( ADO), Azure (Service bus, logic apps, functions, ADF), strong performance monitoring expertise, troubleshooting and and performance...

  • Data Engineer

    3 weeks ago

    Miami, United States Ledgent Technology Full time

    Location: RemoteType: Contract to possible hirePay: $50-$70/hour (depending on experience)The Data Engineering team within Data Services is responsible for creating and maintaining data pipelines, assembling complex datasets, and extracting, transforming, and loading data from a variety of data sources.Data Engineers work closely with Software Engineers,...

  • Systems Engineer/Cloud/Azure/AWS

    2 weeks ago

    Miami, United States Motion Recruitment Full time

    Systems Engineer An information services company in the Mortgage/Financial Industry is looking to hire a fulltime Systems Engineer to join their team! In this role you will be working heavily in their AWS and Azure environments - maintaining and creating new projects. You also will be working with the whole M365 suite, O365, Intune, Exchange, and...

  • Systems Engineer/Cloud/Azure/AWS

    1 month ago

    miami, United States Motion Recruitment Full time

    Systems Engineer  An information services company in the Mortgage/Financial Industry is looking to hire a fulltime Systems Engineer to join their team! In this role you will be working heavily in their AWS and Azure environments - maintaining and creating new projects. You also will be working with the whole M365 suite, O365, Intune, Exchange, and...

  • Data Engineer

    3 weeks ago

    Miami, United States Analytic Partners Full time

    Analytic Partners Recognized as a Leader by The Forrester Wave, Marketing Measurement & Optimization, Q3 2023 Report "Analytic Partners dominates with data-driven marketing insights." We are the Commercial Intelligence industry leader and the first to do it! We help brands use data to drive business growth, and we do this using a combination of technology...

  • Data Engineer

    6 hours ago

    Miami, United States Spot Pet Insurance Full time

    Spot Pet Insurance is the fastest growing pet insurance company in North America. Our commitment to an exceptional end-to-end customer experience and our data-driven approach have quickly established us as a leading pet insurance provider. We're dedicated to providing pet parents with peace of mind by offering accessible and comprehensive coverage so their...

  • Data Protection Engineer

    1 month ago

    Miami, United States Elevance Health Full time

    Data Protection Engineer Location: This position will work a hybrid model (remote & office). The ideal candidate will live within 50 miles of one of our Elevance Health PulsePoint office locations. The Data Protection Engineer supports the Data Protection and Monitoring Services (DPMS) team and has experience with various data structures, database...

  • Data Engineer

    1 month ago

    Miami Gardens, Florida, United States Florida Memorial University Full time

    Data EngineerJob Category: Information Management & TechnologyRequisition Number: DATAB001528Posting DetailsFull-TimeLocationsShowing 1 locationMiami Gardens, FL 33054, USAJob DetailsDescriptionThe Data Engineer will play a pivotal role in enhancing the data management and IT infrastructure at the university. The responsibilities of this position will...

  • Data Engineer

    1 month ago

    Miami Gardens, United States Florida Memorial University Full time

    Data EngineerJob Category: Information Management & TechnologyRequisition Number: DATAB001528 Posting DetailsFull-TimeLocationsShowing 1 locationMiami Gardens, FL 33054, USAJob DetailsDescriptionThe Data Engineer will play a pivotal role in enhancing the data management and IT infrastructure at the university. The responsibilities of this position will...

  • Data Analyst

    4 weeks ago

    Miami, United States Royal Caribbean Group Full time

    In this position, you will assist in the development, operation, and maintenance of computer systems and software applications, operating both in the cloud (primarily Azure platform) and on-premises for the data team product. They develop opportuniti Data Analyst, Analyst, Data Scientist, Cloud Engineer, Technology, Business