Azure Data engineer

3 weeks ago


Pittsburgh, United States Emonics LLC Full time

Job Title: Principal data engineer

Location: Pittsburg PA

Visa: USC/GC

About Tredence­:

Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. Headquartered in the San Francisco Bay Area, the company serves clients in the US, Canada, Europe, and SE Asia. Learn more at www.tredence.com

Required Skills/Qualifications:

  • 10-14 years of relevant experience
  • Bachelor's and/or master’s degree in computer science or equivalent experience.
  • Strong communication, analytical and problem-solving skills with a high attention to detail.


Desired Experience:

  • At least two years of experience building and leading highly complex, technical engineering teams.
  • Strong hands-on experience in Databricks
  • Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
  • Experience managing distributed teams preferred.
  • Comfortable working with ambiguity and multiple stakeholders.
  • Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
  • Expertise on Azure Cloud platform
  • Good SQL knowledge
  • Knowledge on orchestrating workloads on cloud
  • Ability to set and lead the technical vision while balancing business drivers
  • Strong experience with PySpark, Python programming
  • Proficiency with APIs, containerization and orchestration is a plus
  • Experience handling large and complex sets of data from various sources and databases
  • Solid grasp of database engineering and design principles.
  • Experience with Unity Catalog.
  • Familiarity with CI/CD methods desired
  • Good Exposure on Snowflake
  • Good to have Teradata Experience (not Mandatory)


Responsibilities:

  • Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
  • Follow the Agile development methodology; think strategically and execute methodically
  • Develop and manage capacity and growth projection forecasts of the environment within budgets
  • Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements
  • Drive optimization, testing and tooling to improve quality of solutions
  • Manage teams that build and operate high volume distributed systems in a SaaS environment
  • Great at devising efficient processes that increase velocity and quality
  • Train counterparts in the data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.
  • Accountable for operational effectiveness in performance, uptime, release management of the enterprise data platform.


  • Pittsburgh, Pennsylvania, United States Techstra Solutions Full time

    As an Azure Data Engineer at Techstra Solutions, you will play a pivotal role in designing, implementing, and managing data architecture on the Azure cloud platform. The ideal candidate will be proficient in leveraging Azure data services and tools to extract insights from large datasets, drive data-driven decision making, and contribute to the overall data...

  • Azure Data engineer

    2 weeks ago


    Pittsburgh, United States Emonics LLC Full time

    Job Title: Principal data engineer Location: Pittsburg PAVisa: USC/GC About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization...


  • Pittsburgh, Pennsylvania, United States Addison Group Full time

    About the RoleWe are seeking a highly skilled Cloud Engineer to join our team at Addison Group. As a Cloud Engineer, you will be responsible for designing, implementing, and managing cloud-based solutions for our clients.Key ResponsibilitiesCloud Architecture and Design: Design and implement cloud-based solutions that meet scalability, security, and...


  • Pittsburgh, Pennsylvania, United States IS3 Solutions Full time

    Join Our Team as a Cloud Operations EngineerIS3 Solutions is looking for a skilled Cloud Operations Engineer to enhance our team and assist in the optimization and management of our cloud infrastructure on the Microsoft Azure platform.Key Responsibilities:Provision, configure, and maintain Azure cloud resources, including virtual machines, databases, storage...


  • Pittsburgh, United States Duquesne Light Company Full time

    Duquesne Light Company, headquartered in downtown Pittsburgh, is a leader in providing electric energy and has been in the forefront of the electric energy market, with a history rooted in technological innovation and superior customer service. Today, the company continues its role as a leader in the transmission and distribution of electric energy,...


  • Pittsburgh, United States Duquesne Light Company Full time

    Duquesne Light Company, headquartered in downtown Pittsburgh, is a leader in providing electric energy and has been in the forefront of the electric energy market, with a history rooted in technological innovation and superior customer service. Today, the company continues its role as a leader in the transmission and distribution of electric energy,...

  • Senior Data Engineer

    3 weeks ago


    Pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Senior Data Engineer

    3 weeks ago


    Pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Data Analyst

    6 days ago


    Pittsburgh, United States eNGINE Full time

    eNGINE builds Technical Teams. We are a Solutions and Placement firm shaped by decades of interaction with Technical professionals. Our inspiration is continuous learning and engagement with the markets we serve, the talent we represent, and the teams we build. Our Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging...


  • Pittsburgh, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionPosition: Senior Data Center Network Engineer (with Cloud exp) Location: Hybrid- Multiple locations Pittsburgh, PA, Strongsville, OH, Birmingham, AL, Farmers Branch, TX, Cincinnati, OH, Miamisburg, OH, Downers Grove, IL, Overland Park, KS, Philadelphia, PA, Columbus, OH, Little Rock, AR, Jacksonville, FLDuration: 12+ MonthsJob...


  • Pittsburgh, Pennsylvania, United States Addison Group Full time

    About the RoleWe are seeking a highly skilled Cloud Engineer to join our team at Addison Group. As a Cloud Engineer, you will be responsible for designing, implementing, and managing cloud-based solutions for our clients.Key ResponsibilitiesCloud Infrastructure Management: Design and implement cloud infrastructure using Azure Resource Manager (ARM) templates...

  • Data Analyst

    1 month ago


    Pittsburgh, United States eNGINE Full time

    eNGINE builds Technical Teams. We are a Solutions and Placement firm shaped by decades of interaction with technical professionals. Our inspiration is continuous learning and engagement with the markets we serve, the talent we represent, and the teams we build. Our Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging...


  • Pittsburgh, Pennsylvania, United States eNGINE Full time

    eNGINE, a leading Solutions and Placement firm, is seeking a seasoned professional to lead our client's business intelligence efforts in the Specialty Pharmacy space. As a Manager of Analytics, you will be responsible for spearheading the development and maintenance of our business intelligence reporting environment.Key Responsibilities:Collaborate with...


  • Pittsburgh, United States Crossroads Full time

    Crossroads Treatment Centers is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Crossroads is a leading addiction treatment provider of outpatient medication-assisted treatment (MAT). We treat patients with opioid use disorder (OUD) using medications such as methadone...


  • Pittsburgh, Pennsylvania, United States Addison Group Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Addison Group. As a key member of our team, you will be responsible for designing and implementing cloud-based solutions that meet scalability, security, and performance requirements.Key ResponsibilitiesCloud Infrastructure Design and ImplementationDesign and...

  • SAP FICO Data Lead

    2 weeks ago


    Pittsburgh, United States NTT DATA Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a SAP FICO Data Lead to join our team in Pittsburgh, Pennsylvania (US-PA), United States (US).Job Description Function:Software...

  • SNOC Engineer

    3 weeks ago


    Pittsburgh, United States Addison Group Full time

    Top 3 Needs:Azure AdministrationLinux AdministrationNetworking & Security experience.ROLES & RESPONSIBILITIES· Design and implement Azure and/or other cloud-based solutions, ensuring they meet scalability, security, and performance requirements.· Collaborate with project managers, architects, and other stakeholders to gather and analyze business and...

  • SNOC Engineer

    3 weeks ago


    Pittsburgh, United States Addison Group Full time

    Top 3 Needs:Azure AdministrationLinux AdministrationNetworking & Security experience.ROLES & RESPONSIBILITIES· Design and implement Azure and/or other cloud-based solutions, ensuring they meet scalability, security, and performance requirements.· Collaborate with project managers, architects, and other stakeholders to gather and analyze business and...

  • Data Analyst

    4 days ago


    Pittsburgh, Pennsylvania, United States eNGINE Full time

    About eNGINEeNGINE is a leading solutions and placement firm that specializes in building technical teams. Our mission is to provide innovative solutions and expert talent to drive business growth and success.Job SummaryWe are seeking a highly skilled Data Reporting Analyst to join our team. As a Data Reporting Analyst, you will play a critical role in...

  • SAP FICO Data Lead

    2 weeks ago


    Pittsburgh, United States NTT DATA Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a SAP FICO Data Lead to join our team in Pittsburgh, Pennsylvania (US-PA), United States (US).Job Description Function:Software...