Azure Data Engineer

1 month ago

Ashburn, United States teamworkonline Full time
Job Title: Azure Data Engineer / Azure Cloud Data Engineer

Overview:   We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database administration, Azure services, and proficiency in C# programming for Azure Functions development.

Responsibilities:

Assessment and Planning:

·      Evaluate existing on-site SQL Server environment.·      Collaborate with stakeholders to gather requirements for Azure SQL migration.·      Develop a comprehensive migration plan, considering downtime, data transfer, and compatibility.

Database Migration:

·      Utilize Azure Database Migration Service (DMS) or relevant tools for seamless migration to Azure SQL.·      Ensure data integrity and consistency during the migration process.·      Minimize downtime and disruptions to ongoing operations.

Azure SQL Configuration:

·      Configure Azure SQL databases, servers, and related services based on requirements.·      Optimize Azure SQL performance and scalability.·      Implement security measures, including access controls and encryption.

Replication of Processes:

·      Replicate existing on-premises SQL Server processes and jobs in Azure SQL.·      Ensure scheduled tasks, backups, and maintenance plans are transferred and configured appropriately.

Data Ingestion from 3rd Party Vendors:·      Understand APIs provided by various 3rd party vendors.·      Design and implement robust data ingestion processes tailored to each vendor's API.·      Develop efficient workflows for the extraction, transformation, and loading (ETL) of external data into Azure SQL databases.·      Implement SQL replication when necessary for data synchronization.·      Ensure the security and integrity of ingested data from external sources.

Azure Services Integration:

·      Utilize Azure Data Factory, Logic Apps, or other relevant services to seamlessly integrate external data sources into the Azure SQL environment.·      Leverage Azure Data Bricks or similar tools for large-scale data processing and transformation.·      Design and implement Azure Functions for specific tasks or processes.·      Integrate Azure Functions into workflows for data processing and transformation.

Performance Monitoring and Optimization:·      Implement monitoring solutions for Azure SQL to track performance metrics and ensure the completion of data migration functions/jobs. Enable the ability to restart these functions/jobs in case of errors and configure SMS/Email notifications for severe issues.·      Identify and address performance bottlenecks; optimize queries for efficiency.

Troubleshooting and Support:

·      Provide support during and after migration to address any technical issues.·      Collaborate with Azure support services when needed.

Qualifications:

·      Bachelorâs degree in computer science, Information Technology, or a related field.·      3-4 years of experience as an Azure Data Engineer or in a similar role.·      Strong background in database administration, particularly with SQL Server and Azure SQL.·      Experience with Azure services, including Azure Functions and Azure Queues.·      Proficiency in C# programming language, with a focus on developing Azure Functions for specific tasks or processes.·      Proven expertise in data ingestion from 3rd party vendors using REST APIs and SQL replication.·      Knowledge of data engineering tools, ETL processes, and data warehousing.·      Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.·      Excellent communication and collaboration skills.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, age, disability, gender identity, marital or veteran status, or any other protected class.

  • Azure Data Engineer

    1 month ago

    Ashburn, Virginia, United States teamworkonline Full time

    Job Title: Azure Data Engineer / Azure Cloud Data EngineerOverview: We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database...

  • Azure Data Engineer

    4 weeks ago

    Ashburn, Virginia, United States teamworkonline Full time

    Job Title: Azure Data Engineer / Azure Cloud Data EngineerOverview: We are looking for a talented Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in the assessment, planning, and seamless migration of on-premises SQL Server environments to Azure SQL. This position requires expertise in database...

  • Football Solutions Data Engineer

    7 hours ago

    Ashburn, Virginia, United States teamworkonline Full time

    Job Title: Football Solutions Data EngineerLocation: Ashburn, VA Job Type: Full-Time Experience: Mid-Level (3-4 years) Reports to: Director of Football SolutionsJob Description:The Washington Commanders are seeking a skilled Football Solutions Data Engineer to manage the evolution of our data practices. This role is critical in ensuring the secure handling,...

  • Football Solutions Data Engineer

    2 weeks ago

    Ashburn, United States AEG Full time

    Job Title: Football Solutions Data Engineer Location: Ashburn, VA Job Type: Full-Time Experience: Mid-Level (3-4 years) Reports to: Director of Football Solutions Job Description: The Washington Commanders are seeking a skilled Football Solutions Data Engineer to manage the evolution of our data practices. This role is critical in ensuring the secure...

  • Football Solutions Data Engineer

    2 weeks ago

    Ashburn, United States AEG Full time

    Job Title: Football Solutions Data Engineer Location: Ashburn, VA Job Type: Full-Time Experience: Mid-Level (3-4 years) Reports to: Director of Football Solutions Job Description: The Washington Commanders are seeking a skilled Football Solutions Data Engineer to manage the evolution of our data practices. This role is critical in ensuring the secure...

  • Lead System Architect

    3 weeks ago

    Ashburn, United States Visa Full time

    **Company Description** Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...

  • Data Engineer

    2 months ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    2 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive: Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    3 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area. About Infinitive: Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our...

  • DevOps Engineer, Global

    4 weeks ago

    Ashburn, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • Data Engineer

    2 months ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    2 months ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people...

  • Data Engineer with Apache Flink

    1 week ago

    Ashburn, United States Infinite Computer Solutions Inc Full time

    Required Skills and Qualifications: Technical Skills: Proficiency in Apache Flink for real-time data processing. Strong programming skills in Java, Scala, or Python. Experience with distributed data processing frameworks such as Apache Kafka, Spark, or similar. Solid understanding of data modeling, ETL processes, and data warehousing concepts. Familiarity...

  • Data Engineer

    2 months ago

    Ashburn, United States Infinitive Inc Full time

    Job DescriptionJob Description*Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new...

  • Data Engineer

    1 week ago

    Ashburn, United States Infinitive Inc Full time

    Job DescriptionJob Description*Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new...

  • Data Engineer

    4 weeks ago

    Ashburn, United States Infinitive Inc Full time

    Job DescriptionJob Description*Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new...

  • Lead System Architect

    1 month ago

    Ashburn, United States Visa Full time

    Job DescriptionJob DescriptionCompany DescriptionVisa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative,...

  • Lead System Architect

    4 weeks ago

    Ashburn, United States Visa Full time

    Job DescriptionJob DescriptionCompany DescriptionVisa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative,...