Current jobs related to Data Engineer - pittsburgh - RapidBrains

  • Data Engineer

    2 weeks ago

    Pittsburgh, United States Whitman Requardt and Associates Full time

    At Whitman, Requardt & Associates, LLP, we are "People Focused and Project Driven". We have been in business for more than 105 years and we are known for our quality work and quality employees. This is your chance to join our team - help us to design the infrastructure and buildings that improve the world! Do you love building the foundation for data-driven...

  • Data Engineering Manager

    4 days ago

    Pittsburgh, Pennsylvania, United States Govini Full time

    Company DescriptionGovini transforms Defense Acquisition from an outdated manual process to a software-driven strategic advantage for the United States. Our flagship product, Ark, supports Supply Chain, Science and Technology, Production, Sustainment, and Modernization teams with AI-enabled Applications and best-in-class data to more rapidly imagine,...

  • Data Engineering Director

    4 days ago

    Pittsburgh, Pennsylvania, United States Govini Full time

    Job DescriptionGovini is seeking a highly skilled and motivated Technical Lead - Data Engineering to join our dynamic team. As a Technical Lead, you will be responsible for leading a team of data engineers in data ingestion, transformation, and the creation of analytics solutions.Key Responsibilities:Lead and manage a team of data engineers, fostering a...

  • Data Engineer

    1 week ago

    Pittsburgh, United States Insight Global Full time

    Required Skills & Experience- College degree in data engineering/data science/AI/machine learning- High aptitude for problem solving- Knowledge/familiarity with the cloud- Knowledge/familiarity with AI/machine learningNice to Have Skills & Experience- Modelling experience- Snowflake experienceJob DescriptionInsight Global is seeking a fresh out of college or...

  • Data & Testing Engineer

    5 days ago

    Pittsburgh, Pennsylvania, United States Estat Actuation Full time

    Job Description Job Description About UsAt ESTAT Actuation, we're pioneering the future of motion with our cutting-edge electroadhesive clutches and brakes. Our tech is making robotics and automation lighter, more efficient, and more precise—and we need data-driven minds like yours to help us push the limits.We thrive on bold ideas, customer obsession, and...

  • Data Engineer Lead

    2 days ago

    Pittsburgh, Pennsylvania, United States Compunnel Full time

    Job Summary: We are seeking an experienced Data Engineering Lead with expertise in Snowflake, Python, PySpark, SQL, and Azure cloud-based data solutions. The ideal candidate is a self-motivated and independent problem-solver who thrives in dynamic environments and is eager to learn new technologies. This role will involve leading the design, development, and...

  • Data & Testing Engineer

    6 days ago

    Pittsburgh, United States Estat Actuation Full time

    Job DescriptionJob DescriptionAbout UsAt ESTAT Actuation, we’re pioneering the future of motion with our cutting-edge electroadhesive clutches and brakes. Our tech is making robotics and automation lighter, more efficient, and more precise—and we need data-driven minds like yours to help us push the limits.We thrive on bold ideas, customer obsession, and...

  • Technical Lead

    4 days ago

    Pittsburgh, Pennsylvania, United States Govini Full time

    ResponsibilitiesThe Technical Lead - Data Engineering will be responsible for:Leading a team of data engineers in data ingestion, transformation, and the creation of analytics solutionsProviding guidance, mentorship, and support to team membersCoordinating with cross-functional teams to align data engineering efforts with broader organizational goals and...

  • Data Engineer

    6 days ago

    Pittsburgh, PA, United States Raymond James Full time

    Job Description Summary of the Position: The Data Engineer role will support all data engineering and analysis activities related to TSC's enterprise data lake, commonly referred to as the Common Data Platform (CDP). The CDP leverages many Azure resources including Data Lake Gen 2 storage, Blob storage, Data Factory, Function Apps, and Logic Apps among...

  • Principle Data Engineer

    3 days ago

    Pittsburgh, United States E-Solutions Full time

    Role: Principal Data Engineer Location: Pittsburgh, PA (Remote) Hire Type: Full time Experience: 10 – 14 yrs. Required Skills/Qualifications: · 10-14 years of relevant experience · Bachelor's and/or master’s degree in computer science or equivalent experience. · Strong communication, analytical and problem-solving skills with...

  • Principle Data Engineer

    2 days ago

    Pittsburgh, Pennsylvania, United States E-Solutions Full time

    Role: Principal Data Engineer Location: Pittsburgh, PA (Remote) Hire Type: Full time Experience: 10 – 14 yrs. Required Skills/Qualifications: · 10-14 years of relevant experience · Bachelor's and/or master's degree in computer science or equivalent experience. · Strong communication, analytical and problem-solving skills with a...

  • Data Communications Engineer

    2 days ago

    Pittsburgh, Pennsylvania, United States Black Pearl Consult Full time

    About the Position:This Data Communications Engineer position requires a high level of technical expertise and experience in designing, implementing, and maintaining corporate data network and telecommunication systems.Key Responsibilities:Design, implement, and maintain complex data network and telecommunication systems, including routers, switches,...

  • Cloud Data Engineer Lead

    2 days ago

    Pittsburgh, Pennsylvania, United States AGM Tech Solutions Remote Work Freelance Full time

    AGM Tech Solutions is looking for an experienced Cloud Data Engineer Lead to lead our cloud data engineering efforts. This is a fantastic opportunity to drive innovation and growth in our cloud data platform.About the Role:The Cloud Data Engineer Lead will be responsible for developing and implementing data solutions for various cloud-based data platforms....

  • Data Engineering Lead

    3 days ago

    Pittsburgh, Pennsylvania, United States Virtusa Full time

    Job Details:Virtusa is hiring a talented Senior Data Engineer to drive our Data Fabric initiative. In this role, you will be responsible for designing, developing, and optimizing data pipelines to support our business needs.Key Responsibilities:Develop data pipelines using PySpark and Hadoop.Collaborate with data scientists and analysts to design scalable...

  • Product Manager

    2 weeks ago

    Pittsburgh, United States Candela Search Full time

    About the Company - Product Management at DICK’S Sporting Goods specializes in delivering retail excellence along every aspect of the customer journey. Its mission focuses on crafting intuitive, easy-to-use products that span across the business. About the Role -The Data Engineering Group Product Manager will define the strategic vision for Data within...

  • Data Systems Engineer

    5 days ago

    Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    Join us at Aurora Innovation, where we're committed to making transportation safer, more efficient, and accessible for all. As a Staff Software Engineer on our Data Platforms team, you'll have the opportunity to work on cutting-edge projects that shape the future of mobility.Key ResponsibilitiesDesign and develop large-scale data management systemsDrive...

  • Data Engineer

    5 days ago

    Pittsburgh, Pennsylvania, United States Innovation Works, Inc. Full time

    Job Description Job Description ABOUT IDELICIdelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each and every night. Our SaaS solutions are radically transforming the way in which the transportation industry manages safety through...

  • Data Engineer

    2 days ago

    Pittsburgh, Pennsylvania, United States OpenArc Full time

    OpenArc - Empowering Your Career. As a leading IT staffing firm, we are dedicated to connecting talented professionals with your ideal opportunities. We are currently seeking a qualified Data Engineer to join our client's organization and contribute to their ongoing success.  Job summaryPlans, designs, develops, and manages an organization's databases to...

  • SMART Manufacturing Data Engineer

    2 days ago

    Pittsburgh, Pennsylvania, United States VetJobs Full time

    Job Description On behalf of VetJobs/MilitarySpouseJobs, thank you for your interest. We are assisting our partnering company, listed below, with this position. It is open to Veterans, Transitioning Military, National Guard Members, Military Spouses, Wounded Warriors, and their Caregivers. If you have the required skill set, education requirements, and...

  • Big Data Solutions Engineer

    2 days ago

    Pittsburgh, Pennsylvania, United States Compunnel Full time

    Company Overview:Compunnel is a leading provider of digital transformation solutions, and we are seeking an experienced Big Data Solutions Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable, secure, and efficient data architecture and pipelines using Snowflake, Python,...

Data Engineer

1 month ago

pittsburgh, United States RapidBrains Full time

Job Post: Data Engineer

Experience: 8 - 11 Years

Location: Pittsburgh

Duration : 12 Months

Notice Period: 0 - 30 Days


Job Purpose

Design, construct, and maintain scalable data management systems using Azure Databricks, ensuring they meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows and create data processing pipelines utilizing Databricks Notebooks, Spark SQL, Python, and other tools.


Key Responsibilities

  • Interpret business requirements and collaborate with internal resources and application vendors.
  • Design, develop, and maintain Databricks solutions and data quality rules.
  • Troubleshoot and resolve data-related issues.
  • Configure and create data models and quality rules to meet customer needs.
  • Work with multiple database platforms, including MSSQL and Oracle.
  • Optimize PySpark/Python code and SQL queries to improve performance.
  • Design and implement ETL pipelines and effective data models.
  • Document data pipeline architecture and processes.
  • Communicate effectively with business and technology stakeholders.
  • Deliver results under tight deadlines while adhering to quality standards.


Key Competencies

  • Experience: 8+ years in data engineering with expertise in Azure Databricks, MSSQL, LakeFlow, and Python.
  • Proficient in creating and optimizing data pipelines using Databricks Notebooks, Spark SQL, and PySpark.
  • Knowledge of Azure services like Azure Data Lake Storage and Azure SQL Data Warehouse.
  • Expertise in data warehousing, ETL pipeline development, and data governance.
  • Hands-on experience with data quality rules using Databricks and platforms like IDQ.
  • Strong problem-solving, analytical, and organizational skills.
  • Ability to work independently and collaboratively in cross-functional teams.

Skills & Requirements

  • Technical Skills: Azure Databricks, PySpark, SQL (MSSQL, Spark SQL), Azure Data Lake Storage, ETL, Data Modeling and Governance, Data Warehousing, Python.
  • Soft Skills: Strong communication, problem-solving, and attention to detail.