Smart IT Frame LLC | Data Engineer with Azure

3 weeks ago

pittsburgh, United States Smart IT Frame LLC Full time

Role: Data Engineer with Azure

Location: Pittsburgh, PA

Hire Mode: Fulltime

-Hybrid



Design, construct, and maintain scalable data management systems using Azure Data bricks, ensuring they meet end-user

expectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Create

data processing pipelines utilizing Data bricks Notebooks, Spark SQL, Python and other Data bricks tools. Oversee and lead the

module through planning, estimation, implementation, monitoring and tracking.



· Ability to work independently and multi-task effectively.

· Configure system settings and options and execute unit/integration testing.

· Develop end-user Release Notes, training materials and deliver training to a broad user base.

· Identify and communicate areas for improvement Demonstrate high attention to detail, should work in a dynamic

environment whilst maintaining high quality standards, a natural aptitude to develop good internal working

relationships and a flexible work ethic.

· Responsible for Quality Checks and adhering to the agreed Service Level Agreement (SLA) / Turn Around Time (TAT)


Over 8 + years of experience in data engineering, with expertise in Azure Databricks, MSSQL, Lake Flow, Python and

supporting Azure technology.

· Design, build, test, and maintain highly scalable data management systems using Azure Databricks.

· Create data processing pipelines utilizing Databricks Notebooks, Spark SQL.

· Integrate Azure Databricks with other Azure services like Azure Data Lake Storage, Azure SQL Data Warehouse.

· Design and implement robust ETL pipelines using Databricks, ensuring data quality and integrity.

· Design and implement effective data models, schemas and data governance using the Databricks environment.

· Develop and optimize PySpark/Python code for data processing tasks.

· Assist stakeholders with data-related technical issues and support their data infrastructure needs.

· Develop and maintain documentation for data pipeline architecture, development processes, and data governance.

· Data Warehousing: In-depth knowledge of data warehousing concepts, architecture, and implementation, including

experience with various data warehouse platforms.

· Data Quality – implement data quality rules using Databricks and external platforms like IDQ.

· Extremely strong organizational and analytical skills with strong attention to detail

· Strong track record of excellent results delivered to internal and external clients.

· Excellent problem-solving skills, with ability to work independently or as part of team.

· Strong communication and interpersonal skills, with ability to effectively engage with both technical and non-

technical stakeholders.

· Able to work independently without the needs for close supervision and collaboratively as part of cross-team

efforts.

  • Smart IT Frame LLC | Data Engineer with Azure

    4 weeks ago

    pittsburgh, United States Smart IT Frame LLC Full time

    Role: Data Engineer with AzureLocation: Pittsburgh, PAHire Mode: Fulltime-HybridDesign, construct, and maintain scalable data management systems using Azure Data bricks, ensuring they meet end-userexpectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Createdata processing pipelines utilizing Data...

  • Data Engineer with Azure

    3 weeks ago

    Pittsburgh, United States Smart IT Frame LLC Full time

    Role: Data Engineer with AzureLocation: Pittsburgh, PAHire Mode: Fulltime-HybridDesign, construct, and maintain scalable data management systems using Azure Data bricks, ensuring they meet end-userexpectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Createdata processing pipelines utilizing Data...

  • Smart IT Frame LLC | Fircosoft Developer | pittsburgh, pa

    4 weeks ago

    pittsburgh, United States Smart IT Frame LLC Full time

    Role: Fircosoft DeveloperLocation: Pittsburg, PA (Day 1 Onsite)Duration: Long Term Job Description:Must Haves:1. Firco Continuity V6 configuration, deployment & customization knowledge2. Understanding of integrations of Firco Continuity with Payment processors and third-party data providers and other interfaces3. Understanding of real-time payments & SEPA...

  • Smart IT Frame LLC | UI Developer

    4 weeks ago

    pittsburgh, United States Smart IT Frame LLC Full time

    Job Description:Working experience with complex Angular applications using TypescriptProficient in creating responsive layouts with CSS and HTMLExperience in Enterprise software developmentStrong understanding of server side CSS preprocessors like Stylus and LessFamiliarity with UX and design principlesExperience with databases such as MySQL Oracle...

  • Senior Cloud-Based Solution Architect

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Smart IT Frame LLC Full time

    About Smart IT Frame LLCWe are a forward-thinking technology firm based in the United States. Our company prides itself on innovative solutions and collaboration with clients.

  • Smart IT Frame LLC | Software Developer

    4 weeks ago

    pittsburgh, United States Smart IT Frame LLC Full time

    Experience Level: 9+ yearsNote: Only locals in PAMust Haves:1. Firco Continuity V6 configuration, deployment & customization knowledge2. Understanding of integrations of Firco Continuity with Payment processors and third-party data providers and other interfaces3. Understanding of real-time payments & SEPA payments Responsibilities:Firco Continuity V6...

  • Azure Data engineer

    3 weeks ago

    Pittsburgh, United States SysMind Tech Full time

    job description- Over 8 + years of experience in data engineering, with expertise in Azure Databricks, MSSQL, LakeFlow, Python and supporting Azure technology. Design, build, test, and maintain highly scalable data management systems using Azure Databricks. Create data processing pipelines utilizing Databricks Notebooks, Spark SQL. Integrate Azure...

  • Cloud Data Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Visvero, Inc. Full time

    Job Title: Cloud Data Engineer - Azure DatabricksAbout Visvero, Inc.Visvero, Inc. is a leading provider of data engineering solutions using Azure Databricks and Spark.Estimated Salary: $140,000 per yearAbout the RoleWe are seeking an experienced Cloud Data Engineer to join our team in designing, building, and maintaining large-scale data processing systems...

  • Senior Data Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States GTT, LLC Full time

    Job SummaryA talented SQL Engineer is sought to join our team in Pittsburgh, PA. This role involves designing and creating enterprise-level reports, dashboards, and business analysis solutions for large databases.About UsGTT, LLC is a leading healthcare technology company dedicated to improving patient lives through innovative medical devices and software...

  • Azure Solutions Engineer

    5 days ago

    Pittsburgh, Pennsylvania, United States Bright Vision Technologies Full time

    Bright Vision Technologies has an exciting opportunity for an Azure Solutions Engineer to join our team in Pittsburg, PA.The estimated annual salary for this position is $130,000 - $170,000, depending on experience.Job Description:We are seeking a talented engineer who can design and implement large-scale infrastructure solutions using Terraform, Azure...

  • Azure Architect

    3 months ago

    Pittsburgh, United States Saxon Global Full time

    This is a full timne role with PNC bank. 100% remote. USC/GC only. Salary min -130K - Max 150K. AI engineering 6 + Years Azure Cloud 6 + Years Azure Databricks (platform management and change management) 6 + Years DATA ANALYTICS 6 + Years Data engineering 6 + Years Lead experience 6 + Years Python 6 + Years Spar 6 + Years Cloudera/Big Data DataLake...

  • Data Engineer

    4 weeks ago

    Pittsburgh, United States RapidBrains Full time

    Job Post: Data EngineerExperience: 8 - 11 YearsLocation: PittsburghDuration : 12 MonthsNotice Period: 0 - 30 DaysJob PurposeDesign, construct, and maintain scalable data management systems using Azure Databricks, ensuring they meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows and create data processing pipelines...

  • Chief Data Architecture Specialist

    2 weeks ago

    Pittsburgh, Pennsylvania, United States Data Ideology Full time

    About the RoleWe are seeking a highly skilled Chief Data Architecture Specialist to join our team at Data Ideology. As a key member of our organization, you will play a crucial role in designing and implementing robust data models for our enterprise systems and external sources.Estimated Salary: $140,000 - $180,000 per year (based on national averages for...

  • UI Developer

    3 weeks ago

    Pittsburgh, United States Smart IT Frame LLC Full time

    Job Description:Working experience with complex Angular applications using TypescriptProficient in creating responsive layouts with CSS and HTMLExperience in Enterprise software developmentStrong understanding of server side CSS preprocessors like Stylus and LessFamiliarity with UX and design principlesExperience with databases such as MySQL Oracle...

  • Cloud Data Engineer

    3 weeks ago

    Pittsburgh, United States Prequel Solutions Remote Work Freelance Full time $50 - $80

    Cloud Data Engineer - 1-Year Contract OpportunityLocation: Pittsburgh, PA.Work Model: Hybrid (3 days onsite, 2 days remote).Prequel is seeking Pittsburgh-based Cloud Data Engineers for an exciting 1-year contract with a leading flagship financial services company. This role offers the chance to work on cutting-edge integration and development projects,...

  • Cloud Data Engineer

    3 weeks ago

    Pittsburgh, United States Prequel Solutions Full time

    Job Description:Cloud Data Engineer 1-Year Contract OpportunityLocation: Pittsburgh, PA Work Model: Hybrid (3 days onsite, 2 days remote) Prequel is seeking Pittsburgh-based Cloud Data Engineers for an exciting 1-year contract with a leading flagship financial services company. This role offers the chance to work on cutting-edge integration and development...

  • Software Developer

    3 weeks ago

    Pittsburgh, United States Smart IT Frame LLC Full time

    Experience Level: 9+ yearsNote: Only locals in PAMust Haves:1. Firco Continuity V6 configuration, deployment & customization knowledge2. Understanding of integrations of Firco Continuity with Payment processors and third-party data providers and other interfaces3. Understanding of real-time payments & SEPA payments Responsibilities:Firco Continuity V6...

  • Ruby on Rails Developer

    1 month ago

    Pittsburgh, United States Smart IT Frame LLC Full time

    Ruby Developer with working experience in Ruby/Jruby development– ruby 2.0+ or Jruby 9.2.6+ Deep expertise in object-oriented development, including design pattern knowledge backed by strong data structure fundamentals. Broad knowledge and experience in full lifecycle of Web Services/Application Development following agile methodology. Experience...

  • Fircosoft Developer

    4 weeks ago

    Pittsburgh, United States Smart IT Frame LLC Full time

    Role: Fircosoft DeveloperLocation: Pittsburg, PA (Day 1 Onsite)Duration: Long Term Job Description:Must Haves:1. Firco Continuity V6 configuration, deployment & customization knowledge2. Understanding of integrations of Firco Continuity with Payment processors and third-party data providers and other interfaces3. Understanding of real-time payments & SEPA...

  • Fircosoft Developer

    4 weeks ago

    Pittsburgh, United States Smart IT Frame LLC Full time

    Role: Fircosoft DeveloperLocation: Pittsburg, PA (Day 1 Onsite)Duration: Long Term Job Description:Must Haves:1. Firco Continuity V6 configuration, deployment & customization knowledge2. Understanding of integrations of Firco Continuity with Payment processors and third-party data providers and other interfaces3. Understanding of real-time payments & SEPA...