Azure Data Engineer

7 days ago

Chicago, IL, United States RIT Solutions, Inc. Full time
Job Title - Azure Data Engineer
Location - Chicago, IL - Remote
Duration - 4+ months
Interview - Video

Job Description -

Responsibilities:
  • Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems
  • Collaborates with architects, data scientists, AI engineers, and analysts to manage data as an asset and optimize models and algorithms for data quality, security, and governance
  • Integrates data from different sources, including databases, data warehouses, APIs, and external systems
  • Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed
  • Transforms raw data into a usable format by applying data cleansing, aggregation, filtering, and enrichment techniques
  • Optimizes data pipelines and data processing workflows for performance, scalability, and efficiency
  • Monitors and tunes data systems, identifies and resolves performance bottlenecks, and implements caching and indexing strategies to enhance query performance
  • Implements data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data
  • Takes authority, responsibility, and accountability for exploiting the value of enterprise information assets and of the analytics used to render insights for decision making, automated decisions, and augmentation of human performance

Qualifications:
  • Bachelor's degree in computer science, data science, software engineering, information systems, or related quantitative field
  • 8+ years of overall experience in data engineering - primarily within data including experience with data modelling, ETL/ELT, data integration, master data management/entity management, data quality, data warehousing, analytics (prescriptive, predictive), business intelligence, data science, and governance.
  • Proficiency in programming languages such as C#, Python, SQL, and Java.
  • Experience with Microsoft technologies (SQL Server (IaaS, PaaS), Synapse, CosmosDB, HDInsight, Azure Data Factory, Azure Databricks, Power BI, Fabric), Informatica cloud technologies (CIH, DIH, CDGC, Master Data Management, Data Quality), Snowflake, and other relevant industry leaders.
  • Communicate clearly and concisely with others, including senior leadership, in and outside of the organization in a credible, engaging, and confident manner. Possess the ability to adapt communication style and method as necessary, using the most effective communication method for each situation.
  • Summarize and translate complex, technical information into straightforward language that is simple, memorable, and engaging for various technical and non-technical audiences, helping with interpretation based on anticipated use of the information.
  • bility to think critically and creatively. Demonstrate skill at using a variety of tools and processes to conduct research and analyses; Recognize trends in complex data and information; Use these insights to identify opportunities and make timely decisions, taking into consideration the short and long-term implications of decisions. Advise key decision makers and influence others using persuasion and negotiation tactics.
  • Take the initiative to make things happen. Proactively look for solutions and help others to think ahead. Accept and seek challenges, step outside of your comfort zone. Think and act strategically to drive the success of the business and enhance our client experience. Be innovative and share ideas for continuous improvement. Look for efficiencies in the way work is completed.
  • Be flexible and work effectively across various types of situations to achieve goals. Navigate through unexpected issues and be responsive to others' needs. Prioritize different work streams and balance short-term versus long-term objectives.
  • Value individual differences and treat everyone with respect and kindness. Be appreciative of others; Strive for humility. Respect diverse backgrounds and ways of thinking. Listen to understand and express genuine interest in other perspectives. Strive to understand and take ownership of how your emotions and actions impact others.
  • lign actions with words and approach work and interactions with others with a positive attitude and an optimistic outlook. Assume positive intent. Stay composed and resilient during challenging times. Respond productively to conflict and have difficult conversations when needed.
  • Distinguish yourself with stakeholders in and outside the firm by growing your personal brand. Look for ways to share knowledge, make an impact, and leverage talents.

Nice to Haves:
  • Certifications in relevant technologies listed above.
  • Previous experience in the professional services or accounting industry.
  • Previous client service or consultative experience.
  • Previous experience working in a managed services provider environment.

  • Azure Data Engineer

    2 weeks ago

    Chicago, IL, United States CData Software Full time

    As a Microsoft Azure Data Engineer, you will be responsible for designing, implementing, and managing data pipelines and architectures on the Azure Synapse platform. You will work with a variety of data sources and ensure data is processed and stored efficiently using the Medallion Architecture (Bronze, Silver, Gold layers). Your expertise in PySpark,...

  • Azure Data Engineer

    2 days ago

    Chicago, IL, United States CData Software Full time

    As a Microsoft Azure Data Engineer, you will be responsible for designing, implementing, and managing data pipelines and architectures on the Azure Synapse platform. You will work with a variety of data sources and ensure data is processed and stored efficiently using the Medallion Architecture (Bronze, Silver, Gold layers). Your expertise in PySpark,...

  • Azure Data Engineer

    5 days ago

    Chicago, IL, United States CData Software Full time

    As a Microsoft Azure Data Engineer, you will be responsible for designing, implementing, and managing data pipelines and architectures on the Azure Synapse platform. You will work with a variety of data sources and ensure data is processed and stored efficiently using the Medallion Architecture (Bronze, Silver, Gold layers). Your expertise in PySpark,...

  • Azure Data Engineer

    2 weeks ago

    Chicago, IL, United States 1872 Consulting Full time

    zure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance...

  • Azure Data Engineer

    1 week ago

    Chicago, IL, United States 1872 Consulting Full time

    zure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance...

  • Azure Data Engineer

    5 days ago

    Chicago, IL, United States 1872 Consulting Full time

    zure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance...

  • Azure Data Engineer- Snowflake

    5 days ago

    Chicago, IL, United States Spruce Infotech Full time

    Overview: Looking for an experienced Azure Data Engineer with strong Snowflake expertise to build and optimize enterprise data solutions for Northern Trust's financial services environment. Key Responsibilities: Design, develop, and maintain scalable Snowflake data warehouses and Azure-based data pipelines. Implement ETL/ELT processes using Azure Data...

  • Azure Data Engineer- Snowflake

    7 days ago

    Chicago, IL, United States Spruce Infotech Full time

    Overview: Looking for an experienced Azure Data Engineer with strong Snowflake expertise to build and optimize enterprise data solutions for Northern Trust's financial services environment. Key Responsibilities: Design, develop, and maintain scalable Snowflake data warehouses and Azure-based data pipelines. Implement ETL/ELT processes using Azure Data...

  • Azure Data Engineer

    1 week ago

    Chicago, IL, United States Capgemini Full time

    Azure Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations?unlock the value...

  • Azure Data Engineer

    2 weeks ago

    Chicago, IL, United States Capgemini Full time

    Azure Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations?unlock the value...