Data Engineer

1 day ago


Pittsburgh, United States Whitman Requardt and Associates Full time

At Whitman, Requardt & Associates, LLP, we are "People Focused and Project Driven". We have been in business for more than 105 years and we are known for our quality work and quality employees. This is your chance to join our team - help us to design the infrastructure and buildings that improve the world Do you love building the foundation for data-driven decisions? Are you passionate about wrangling messy data and turning it into insights? If so, then we want to hear from you We are searching for a talented and experienced Data Engineer to join our growing team. In this role, you will play a critical part in designing, developing, and maintaining the data infrastructure that fuels our organization's analytics capabilities. Responsibilities: Design and implement scalable data pipelines for ingesting, transforming, and loading data from various sources (databases, APIs, etc.) Develop and maintain data models to optimize data storage, retrieval, and analysis. Ensure data quality and integrity through data cleansing, validation, and transformation techniques. Automate data processing workflows using scripting languages and orchestration tools (e.g., Python, R, etc.) Document and curate metadata and QA/QC results. Work closely with Data Scientists, and other stakeholders to understand data needs and translate them into technical solutions. Troubleshoot and resolve complex data issues to ensure smooth data flow. Stay up-to-date on the latest big data technologies and trends. Requirements: 4-9 years of progressive experience in data engineering or a related field. 4-9 years of experience with spatial data (eg. ESRI. PostGIS, GeoPandas). Strong proficiency in SQL and experience with relational databases (e.g.PostgreSQL). Excels across a range of data formats including JSON/GeoJSON, parquet and various unstructured formats. Experience setting up and using cloud-based data platforms (e.g., Azure with Snowflake or Databricks and Lakehouse, AWS Athena, Google BigQuery). Solid understanding of data warehousing concepts (ETL processes, data modeling). Experience with data ingestion tools and data workflow orchestration tools. Programming experience in Python and/or R. Experience with version control systems (e.g., Git). Ability to work collaboratively and communicate with a growing team. Preferred Qualifications: Experience with machine learning model deployment. Experience with feature engineering and monitoring. Experience in the Architecture & Engineering space -- transportation, asset management, transit, water resources etc. Experience implementing and standardizing data governance best practices. Benefits: WRA recognizes that employees play an important role in its success. Our commitment to full-time employees is reflected in the comprehensive benefits package we offer: Flexible work schedule options Competitive salary Leave accrual and paid holidays Healthcare benefits Group Life Insurance, as well as additional optional life Insurance, short and long term disability insurance Flexible spending accounts for medical and dependent care reimbursement 401(k) Retirement Plan Tuition Reimbursement Employee Assistance Program Parental and maternity leave benefits WRA is an equal opportunity/affirmative action employer and complies with all applicable anti-discrimination laws. Applicants must be currently authorized to work in the United States on a full-time basis without the need for employment-based visa sponsorship now or in the future. WRA will not sponsor applicants for U.S. work visa status for this opportunity. (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa) Position # 2314


  • Data Engineer

    1 month ago


    Pittsburgh, United States Synergy Staffing Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerLocation: Pittsburgh, PA(may have to come on-site a couple times a year)Job Type: Contract to HireJob Summary: As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and data models using Snowflake and Azure technologies. You will work closely with data...

  • Data Engineer

    6 days ago


    Pittsburgh, United States RapidBrains Full time

    Job Post: Data EngineerExperience: 8 - 11 YearsLocation: PittsburghDuration : 12 MonthsNotice Period: 0 - 30 DaysJob PurposeDesign, construct, and maintain scalable data management systems using Azure Databricks, ensuring they meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows and create data processing pipelines...

  • Senior Data Engineer

    4 months ago


    Pittsburgh, United States Indium Software Full time

    Job Description Title: Senior Data Engineer Education Qualification: Bachelor's degree in Computer Science, Information Technology, or a related field. Experience: 5-10 years Location: Pittsburgh Work Mode: Work from Office Required Skills: Snowflake engineers with strong SQL skills Snowflake Architecture and Design. SQL and Data Modeling. ETL and Data...

  • Data Engineer II

    1 week ago


    Pittsburgh, United States TeleTracking Technologies, Inc. Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer IIOrganizational RelationshipReports to: Manager, Software EngineeringDirect Reports: NoneInteracts with: Internal Business UnitsEducation Degree Discipline Required or Preferred: Bachelors Computer Science, Software Engineering, or related Required Masters Computer Science, Software Engineering, or...

  • Senior Data Engineer

    2 weeks ago


    Pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Senior Data Engineer

    2 weeks ago


    pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Senior Data Engineer

    2 weeks ago


    pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Product Manager

    1 week ago


    Pittsburgh, United States Candela Search Full time

    About the Company - Product Management at DICK’S Sporting Goods specializes in delivering retail excellence along every aspect of the customer journey. Its mission focuses on crafting intuitive, easy-to-use products that span across the business.About the Role -The Data Engineering Group Product Manager will define the strategic vision for Data within the...

  • Product Manager

    1 week ago


    Pittsburgh, United States Candela Search Full time

    About the Company - Product Management at DICK’S Sporting Goods specializes in delivering retail excellence along every aspect of the customer journey. Its mission focuses on crafting intuitive, easy-to-use products that span across the business.About the Role -The Data Engineering Group Product Manager will define the strategic vision for Data within the...

  • Data Engineer

    4 months ago


    Pittsburgh, United States TWO95 International Full time

    Title: Data Engineer Location: Pittsburgh, PA Type: 6 months (contract to hire) RATE : open Requirements 5+ years of developing software using object-oriented or functional language experience 5+ years of SQL 3+ years working with open source Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop/HDFS, Hive, Drill, Pig, etc.) or commercial...

  • Azure Data engineer

    23 hours ago


    Pittsburgh, United States SysMind Tech Full time

    job description- Over 8 + years of experience in data engineering, with expertise in Azure Databricks, MSSQL, LakeFlow, Python and supporting Azure technology. Design, build, test, and maintain highly scalable data management systems using Azure Databricks. Create data processing pipelines utilizing Databricks Notebooks, Spark SQL. Integrate Azure...

  • Data Engineer

    4 weeks ago


    Pittsburgh, Pennsylvania, United States Innovation Works, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Innovation Works, Inc. As a Data Engineer, you will play a critical role in deploying machine learning models in production, assisting data scientists and machine learning engineers with coding and devops tasks.Key Responsibilities:Design and implement microservices to run...


  • Pittsburgh, Pennsylvania, United States Tredence Inc. Full time

    About Tredence Inc.:Tredence focuses on delivering actionable insights to clients by combining its strengths in business analytics, data science, and software engineering. The company empowers end-users with predictive and optimization solutions that drive informed decision-making.Key Responsibilities:Investigate problem areas and collaborate with...


  • Pittsburgh, United States Duquesne Light Company Full time

    Duquesne Light Company, headquartered in downtown Pittsburgh, is a leader in providing electric energy and has been in the forefront of the electric energy market, with a history rooted in technological innovation and superior customer service. Today, the company continues its role as a leader in the transmission and distribution of electric energy,...


  • pittsburgh, United States RapidBrains Full time

    Job Post: Data EngineerExperience: 8 - 11 YearsLocation: PittsburghDuration : 12 MonthsNotice Period: 0 - 30 DaysJob PurposeDesign, construct, and maintain scalable data management systems using Azure Databricks, ensuring they meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows and create data processing pipelines...


  • pittsburgh, United States RapidBrains Full time

    Job Post: Data EngineerExperience: 8 - 11 YearsLocation: PittsburghDuration : 12 MonthsNotice Period: 0 - 30 DaysJob PurposeDesign, construct, and maintain scalable data management systems using Azure Databricks, ensuring they meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows and create data processing pipelines...


  • Pittsburgh, United States Comcast Corporation Full time

    Effectv helps businesses reach the right audience with the right message at the right time. We harness the scale and quality of Comcast data to target advertisers’ audiences across linear TV, streaming, and video on demand and enabling clients to evaluate performance. A division of Comcast, we have a presence in 60+ markets and an estimated reach of 96...


  • Pittsburgh, United States Smart IT Frame LLC Full time

    Role: Data Engineer with AzureLocation: Pittsburgh, PAHire Mode: Fulltime-HybridDesign, construct, and maintain scalable data management systems using Azure Data bricks, ensuring they meet end-userexpectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Createdata processing pipelines utilizing Data...


  • pittsburgh, United States Duquesne Light Company Full time

    Duquesne Light Company, headquartered in downtown Pittsburgh, is a leader in providing electric energy and has been in the forefront of the electric energy market, with a history rooted in technological innovation and superior customer service. Today, the company continues its role as a leader in the transmission and distribution of electric energy,...


  • pittsburgh, United States Duquesne Light Company Full time

    Duquesne Light Company, headquartered in downtown Pittsburgh, is a leader in providing electric energy and has been in the forefront of the electric energy market, with a history rooted in technological innovation and superior customer service. Today, the company continues its role as a leader in the transmission and distribution of electric energy,...