Data Engineer

3 weeks ago

Pittsburgh, United States Whitman Requardt and Associates Full time
At Whitman, Requardt & Associates, LLP, we are "People Focused and Project Driven". We have been in business for more than 105 years and we are known for our quality work and quality employees. This is your chance to join our team - help us to design the infrastructure and buildings that improve the world

Do you love building the foundation for data-driven decisions? Are you passionate about wrangling messy data and turning it into insights? If so, then we want to hear from you

We are searching for a talented and experienced Data Engineer to join our growing team. In this role, you will play a critical part in designing, developing, and maintaining the data infrastructure that fuels our organization's analytics capabilities. You will also be responsible for implementing on-prem and cloud-based solutions and standardizing data governance as we scale out the data practice.

This role will span across civil engineering practices and requires the ability to adapt solutions across multiple domains. Accordingly, you should be able formulate an MVP, empathize with the challenges and needs of clients and colleagues, and work collaboratively with subject matter experts.

Responsibilities:
  • Design and implement scalable data pipelines for ingesting, transforming, and loading data from various sources (databases, APIs, etc.)
  • Develop and maintain data models to optimize data storage, retrieval, and analysis.
  • Ensure data quality and integrity through data cleansing, validation, and transformation techniques.
  • Automate data processing workflows using scripting languages and orchestration tools (e.g., Python, R, etc.)
  • Document and curate metadata and QA/QC results.
  • Work closely with Data Scientists, and other stakeholders to understand data needs and translate them into technical solutions.
  • Troubleshoot and resolve complex data issues to ensure smooth data flow.
  • Stay up-to-date on the latest big data technologies and trends.
Requirements:
  • 5-10 years of progressive experience in data engineering or a related field.
  • 5-10 years of experience with spatial data (eg. ESRI. PostGIS, GeoPandas).
  • Strong proficiency in SQL and experience with relational databases (e.g.PostgreSQL).
  • Excels across a range of data formats including JSON/GeoJSON, parquet and various unstructured formats.
  • Experience setting up and using cloud-based data platforms (e.g., Azure with Snowflake or Databricks and Lakehouse, AWS Athena, Google BigQuery).
  • Solid understanding of data warehousing concepts (ETL processes, data modeling).
  • Experience with data ingestion tools and data workflow orchestration tools.
  • Programming experience in Python and/or R.
  • Experience with version control systems (e.g., Git).
  • Ability to work collaboratively and communicate with a growing team.
Preferred Qualifications:
  • Experience with machine learning model deployment.
  • Experience with feature engineering and monitoring.
  • Experience in the Architecture & Engineering space - transportation, asset management, transit, water resources etc.
  • Experience implementing and standardizing data governance best practices.
Benefits:

WRA recognizes that employees play an important role in its success. Our commitment to full-time employees is reflected in the comprehensive benefits package we offer:
  • Flexible work schedule options
  • Competitive salary
  • Leave accrual and paid holidays
  • Healthcare benefits
  • Group Life Insurance, as well as additional optional life Insurance, short and long term disability insurance
  • Flexible spending accounts for medical and dependent care reimbursement
  • 401(k) Retirement Plan
  • Tuition Reimbursement
  • Employee Assistance Program
  • Parental and maternity leave benefits

WRA is an equal opportunity/affirmative action employer and complies with all applicable anti-discrimination laws.

Applicants must be currently authorized to work in the United States on a full-time basis without the need for employment-based visa sponsorship now or in the future. WRA will not sponsor applicants for U.S. work visa status for this opportunity. (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)

Position # 2314

#LI - Onsite #LI - Mid Level

  • Data Engineering

    2 weeks ago

    Pittsburgh, United States ClifyX Full time

    Job Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh, PA (3 days onsite/week) Job Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design principles.Architecting scalable and...

  • Data Engineering

    2 weeks ago

    Pittsburgh, United States ClifyX Full time

    Job Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh, PA (3 days onsite/week) Job Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design principles.Architecting scalable and...

  • Data Engineer Leader

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Indium Software Full time

    About UsIndium Software is a leading technology company that specializes in providing innovative solutions to clients across the globe.Job SummaryWe are seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing data architectures, ensuring data quality, and developing...

  • Big Data Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States TWO95 International Full time

    Job Title: Big Data EngineerLocation: Pittsburgh, PAEstimated Salary: $120,000 - $150,000 per yearTWO95 International is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems that meet the needs of our...

  • Senior Data Engineer

    5 months ago

    Pittsburgh, United States Indium Software Full time

    Job Description Title: Senior Data Engineer Education Qualification: Bachelor's degree in Computer Science, Information Technology, or a related field. Experience: 5-10 years Location: Pittsburgh Work Mode: Work from Office Required Skills: Snowflake engineers with strong SQL skills Snowflake Architecture and Design. SQL and Data Modeling. ETL and Data...

  • Data Engineering Specialist

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Carnegie Mellon University Full time

    Data Engineering and Cybersecurity OpportunityWe are seeking a highly skilled Data Engineering Specialist to join our team at Carnegie Mellon University in Arlington, VA or Pittsburgh, PA. This is a full-time position with a salary of $120,000 - $180,000 per year.In this role, you will be responsible for designing and implementing effective data pipelines...

  • Snowflake Data Engineer

    3 days ago

    Pittsburgh, United States Compunnel Inc. Full time

    Job descriptionJob Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh - Pennsylvania (3 days onsite/week)Job Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design...

  • Snowflake Data Engineer

    2 days ago

    Pittsburgh, United States Compunnel Inc. Full time

    Job descriptionJob Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh - Pennsylvania (3 days onsite/week)Job Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design...

  • Snowflake Data Engineer

    1 day ago

    Pittsburgh, United States Compunnel Inc. Full time

    Job descriptionJob Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh - Pennsylvania (3 days onsite/week)Job Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design...

  • Pittsburgh Data Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States University of Pittsburgh Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer II to support data acquisition and maintenance at the University of Pittsburgh. This full-time regular position requires a Bachelor's degree in Life Science or a related field, along with 1 year of experience as a Data Engineer II or a related occupation.The successful candidate will be responsible...

  • Data Engineer Specialist

    3 weeks ago

    Pittsburgh, Pennsylvania, United States University of Pittsburgh Full time

    Job Title:Data Engineer IIAbout the Role:We are seeking a highly skilled Data Engineer II to support data acquisition and maintenance in our research team. The successful candidate will be responsible for locating datasets and software, communicating with researchers, and maintaining records in a database.Key Responsibilities:Locate and acquire datasets and...

  • Snowflake Data Engineer

    3 days ago

    Pittsburgh, United States ClifyX Full time

    Job Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh, PA (3 days onsite/week)Duration: Fulltime.Job descriptionJob Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design...

  • Snowflake Data Engineer

    2 days ago

    Pittsburgh, United States ClifyX Full time

    Job Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh, PA (3 days onsite/week)Duration: Fulltime.Job descriptionJob Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design...

  • Snowflake Data Engineer

    1 day ago

    Pittsburgh, United States ClifyX Full time

    Job Title: Specialist - Data Engineering (Snowflake Data Engineer)Location: Pittsburgh, PA (3 days onsite/week)Duration: Fulltime.Job descriptionJob Summary:Minimum of 10 years IT experience with 3+ in Snowflake.In depth technical knowledge of Snowflake architecture and operation.Strong experience in SQL/Unix/Python scripting and database design...

  • Cloud Data Engineer

    1 month ago

    Pittsburgh, United States Prequel Solutions Full time

    Job Description:Cloud Data Engineer 1-Year Contract OpportunityLocation: Pittsburgh, PA Work Model: Hybrid (3 days onsite, 2 days remote) Prequel is seeking Pittsburgh-based Cloud Data Engineers for an exciting 1-year contract with a leading flagship financial services company. This role offers the chance to work on cutting-edge integration and development...

  • Cloud Data Engineer

    1 week ago

    Pittsburgh, United States Prequel Solutions Full time

    Job DescriptionJob DescriptionCloud Data Engineer 1-Year Contract OpportunityLocation: Pittsburgh, PAWork Model: Hybrid (3 days onsite, 2 days remote)Prequel is seeking Pittsburgh-based Cloud Data Engineers for an exciting 1-year contract with a leading flagship financial services company. This role offers the chance to work on cutting-edge integration and...

  • ETL Data Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Resource Logistics Full time

    Job Description:Resource Logistics is seeking a highly skilled ETL Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data integration solutions using ETL tools. The ideal candidate will have 7-10 years of experience in ETL/Data centric Testing and be proficient in...

  • Data Infrastructure Engineer

    3 weeks ago

    Pittsburgh, Pennsylvania, United States Stack AV Full time

    About Stack AV:We are a pioneering company in the development of revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations.Our team is dedicated to creating innovative solutions that address the needs and challenges of the dynamic trucking transportation industry.We believe in empowering our...

  • Senior Data Science Engineer

    2 weeks ago

    Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    Become a Data Engineering Specialist at the Software Engineering Institute and contribute to the development of data architectures and analytics frameworks that support complex analysis and operational missions.As a key member of our ORE team, you will manage the data lifecycle from modeling to database architecture, ensuring integrity and accessibility of...

  • Senior Data Engineer

    1 month ago

    Pittsburgh, United States Carnegie Mellon University Full time

    What We Do The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense capabilities. Actively partnering with sponsors, CMR identifies and addresses...