Data Engineer

3 weeks ago

Butler, United States City of Philadelphia Full time

Job Description

Data Engineering at the City is a unique opportunity for meaningful, exciting work and professional development using state-of-the art technologies and software development best practices. This is a position on a diverse team of engineers, analysts, and GIS specialists, contributing to developing, maintaining, and optimizing our data pipelines and integration strategies, assisting departments and agencies in innovating, and enhancing the City’s service to its residents.

The data engineer/integration specialist will develop an intimate understanding of the City’s diverse data and contribute to improving the City’s data engineering infrastructure, pipelines, models, and integrations. The team uses a blend of open source, custom developed and off-the-shelf tools, including Python, Bash, SQL, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.

Some prominent services the team is responsible for include DataBridge, OIT’s enterprise data warehouse, AIS, the City’s custom address information systems which supports public address search and internal geocoding, and Databridge-Airflow, a custom workflow generator and orchestrator for departmental integrations ((url removed)) and open data publishing ((url removed)). Some examples of OIT’s commitment to serving the public through the effective and innovative integration of City open data include:

(url removed)

(url removed)

(url removed)

(url removed)

www.phila.gov/solarmap

www.phila.gov/stressmap

We are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work and data-driven decision-making, we encourage you to apply.

Essential Functions

Working with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements to optimize enterprise integrations and public data accessibility.

Design and develop new and expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments, improving data platform components, data governance, master data management, data standardization, enrichment and quality assurance.

Play a key role in enterprise integration and open data initiatives, developing and supporting critical systems like the City’s DataBridge, Databridge-Airflow and AIS.

Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.

Competencies, Knowledge, Skills and Abilities

Competencies:

Clear and concise writing and communication skills.

Creative problem-solving and critical thinking.

Ability to work with data from diverse domains.

Efficient time management and the ability to manage multiple workflows simultaneously.

Ability to seek innovative opportunities and continuous improvement.

Knowledge and Skills:

Proficient in Python

Strong SQL skills and experience with databases (Postgres preferred).

Familiarity with Docker, bash and minimal Linux server administration.

Experience with cloud services (AWS preferred).

Understanding of Git/GitHub for version control and CI/CD pipelines.

Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, Mulesoft.

Experience working with spatial datasets a plus.

Experience using command line interfaces.

Abilities:

To reason about, model and manipulate complex datasets.

To maintain clean and secure data environments.

To work effectively in a hybrid (on-premises and cloud) environment.

To communicate complex technical concepts in understandable terms. #J-18808-Ljbffr

  • Data Engineer

    3 weeks ago

    Butler, United States IntegriChain Full time

    Job Description Responsible for designing, developing, and optimizing data pipeline in AWS/Snowflake/Agile data engine environment to manage incremental data ingestion, data migration, data staging, loading, update, archive and restatement etc. Responsible for building data model and data catalog and maintaining data integrity across different...

  • Sr. Manager Software Engineering

    3 weeks ago

    Butler, United States Comcast Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Lead ML Engineer, Enterprise Data

    3 weeks ago

    Butler, United States Comcast Full time

    Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and...

  • Lead ML Engineer, Enterprise Data

    3 weeks ago

    Butler, United States Comcast Full time

    Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and...

  • Engineer 3, Engineering Operations

    3 weeks ago

    Butler, United States Comcast Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...

  • Software Engineer

    2 months ago

    Butler, United States iLocatum Full time

    Position Summary: Create and support new or existing Microsoft Windows based software and embedded microprocessor machine control/data acquisition systems. Collaborate with sales and marketing teams to generate new architecture, design, and development of software used in the control of machinery and data collection. Interface with electrical engineering and...

  • Paint Line Engineer

    3 days ago

    Butler, United States Hathaway Partners Full time

    Job DescriptionJob DescriptionResponsibilities•The Paint Manufacturing Engineer provides expert judgment to perform complex functions in the design, fabrication, modification and/or evaluation of manufacturing operations•Prepares complicated plans, conducts support studies, and provides analysis or tests in the development of manufacturing paint...

  • Metallurgical Service Engineer

    2 months ago

    Butler, United States Steel Dynamics Full time

    Overview: The Metallurgical Service Engineer is based in Butler, IN and is responsible for providing customer support and investigating defective or problematic material at customer facilities. This position works collaboratively with mill metallurgists, supervisors, and managers throughout the various mill departments to resolve customer issues, complete...

  • C++ Software Engineer

    3 weeks ago

    Butler, United States Comcast Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Outside Plant

    2 weeks ago

    Butler, United States Armstrong Group Full time

    Position Summary The Outside Plant (OSP) Engineer is responsible for supporting construction and field operations teams determining the best routes to service new and existing customers, maintaining the integrity of the network while working safely to develop a plan which can be executed timely and on budget. This position requires analysis of outside plant...

  • MarTech Engineer

    2 weeks ago

    Butler, United States Comcast Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...

  • MarTech Engineer

    3 weeks ago

    Butler, United States Comcast Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...

  • Cybersecurity Site Reliability Engineer 3

    3 weeks ago

    Butler, United States Comcast Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...

  • Principal Engineer

    3 weeks ago

    Butler, United States Comcast Full time

    Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and...

  • Summer 2024 Chemical Engineering Co-Op

    3 weeks ago

    Butler, United States Fortune Brands Innovations, Inc. Full time

    Therma-Tru in Butler, Indiana a global producer of entry door systems is seeking aChemical Engieering Co-op. As a Chemical Process Engineering Co-op, you will work with experts in chemical process engineering from raw material to finished product. The position will work with multiple departments and processes to drive continuous improvement. This is an...

  • Metallurgist

    1 month ago

    Butler, United States Steel Dynamics Full time

    Overview: The Metallurgist/Process Engineer is responsible for a wide variety of activities throughout the cold mill facility. This position is part of a team tasked with maintaining and improving safety, quality, and productivity at the Butler cold mill processes, including pickling, cold rolling, and/or galvanizing. Responsibilities: Promote and maintain...

  • Senior AWS DevOps

    3 weeks ago

    Butler, United States Comcast Full time

    Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and...

  • Quality Technician

    5 days ago

    Butler, United States Actalent Full time

    Description: Perform quality checks on medical grade plastics, rubbers, silicones, etc. Document all quality checks, quality data, product information, etc. Work with production personnel to ensure quality is met Ensure that clean rooms are maintained, sterile practices are adhered to, and products are made following FDA regulations Skills: quality...

  • ORMB (Oracle Revenue Management and Billing)

    3 weeks ago

    Butler, United States Chabez Tech Full time

    Job Description Job Title: ORMB (Oracle Revenue Management and Billing) Technical Lead Job Summary: We are seeking an experienced ORMB (Oracle Revenue Management and Billing) Technical Lead to join our team. The ideal candidate will have extensive knowledge and hands-on experience in ORMB modules such as Customer Setup, Billing, Pricing, Billing Payments...

  • ORMB (Oracle Revenue Management and Billing)

    2 weeks ago

    Butler, United States Chabez Tech Full time

    Job Description Job Title: ORMB (Oracle Revenue Management and Billing) Technical Lead Job Summary: We are seeking an experienced ORMB (Oracle Revenue Management and Billing) Technical Lead to join our team. The ideal candidate will have extensive knowledge and hands-on experience in ORMB modules such as Customer Setup, Billing, Pricing, Billing Payments...