Data Engineer

2 weeks ago


Pittsburgh, United States Accion Labs Full time

Those authorized to work in the United States without sponsorship are encouraged to apply.We are unable to sponsor visas for this position. No H1B's.



Our direct client is an American chain of convenience stores started interviewing Data Engineering Pittsburgh, PA (Hybrid – 2 day’s onsite) 6 month’s contract to hire…


Please note that all candidates submitted must be on your W2.


Title: Data Engineer

Location: Pittsburgh, PA (Hybrid – 2 days’ onsite a week & rest is remote) Day one onsite.

Duration: 6 Months contract to hire


Must have: Need to have strong understanding on Databricks on AWS - batch and real time loads. Data bricks knowledge on-delta table, delta live table, Unity Catalog, incremental loads, dependencies on multiple pipelines, Transit and transformation, managing data quality using Delta Live Tables and Expectations, validating the data. Need sound Spark SQL knowledge. Python knowledge has to be good * Databricks on Azure is not preferred. Data modelling knowledge is required, Schema, dimensional modelling. Airflow is good to have. Terraform is used for deploying the data pipeline. Teradata, data warehousing knowledge is good to have...


Responsibilities:

Co-lead in the selection and build of our data and analytic tools including Enterprise Data Warehouse, Data Lake, Analytics platform, and Data Catalogue.

Design, implement, and manage data architecture and data pipeline across multiple data sources.

Collaborate closely with Business and Technical Owners in identifying data sources and aggregating structured or unstructured data into dimensional data models able to be consumed by the business.

Identify potential process improvements and designs and implement automated solutions.

Manage the democratization of data knowledge across the organization through the communication and maintenance of master data, metadata, data management repositories, data models, and data standards

Establish standardization and educate data users on query best practices allowing for re-use and analytic efficiency.

Experience

End-to-end experience in the analytic lifecycle from structured/unstructured raw data, data wrangling, and creating data pipelines, to self-service dashboards leveraged by the business required

Advanced knowledge of SQL required

Minimum 5 years development experience in at least one object-oriented language (Python, Perl, Java, etc.) required

Proficiency in data visualization tool (Tableau) preferred

Strong understanding of cloud computing database technologies (Azure, AWS, GCP) required

Experience building and optimizing “Big Data” pipelines, architectures and data sets required

Experienced with data wrangling and preparation for use within data science, business intelligence or similar analytical functions required




Required: Bachelor's degree in Computer Science or a related field


This role is open to W2 or those seeking Corp-Corp employment. The salary range for this role is 110k-124k. For corp-Corp rates please contact the recruiter. In addition to other benefits, Accion Labs offers a comprehensive benefits package, with Accion covering 65% of the medical, dental, and Vision Premiums for employees, their spouses, and dependent children enrolling in the Accion-provided plans.


  • Data Engineer

    3 days ago


    Pittsburgh, United States Sheetz Full time

    OVERVIEW Responsible for developing complex, large scale data models and pipelines that organize and standardize the data to make it readily accessible and consumable by the business for reporting and data science needs. Collaborate with various areas of the Business in order to determine and source the appropriate data through internal and external means....

  • Data Engineer

    6 days ago


    Pittsburgh, Pennsylvania, United States Randstad USA Full time

    job summary: Seeking an exceptional and experienced data engineer who shares our passion and obsession with quality. You'll be a core member of our product and engineering team dedicated to helping our clients replace time-consuming, manual processes to reach informed real-time decisions about government markets, competitors, and agency relationships. We...

  • Data Engineer

    6 days ago


    Pittsburgh, Pennsylvania, United States Randstad USA Full time

    job summary: We are seeking an exceptional and experienced data engineer who shares our passion and obsession with quality. You'll be a core member of our product and engineering team dedicated to helping our clients replace time-consuming, manual processes to reach informed real-time decisions about government markets, competitors, and agency relationships....

  • Data Engineer

    1 day ago


    Pittsburgh, United States Govini Full time

    Company Description Govini builds software to accelerate the Defense Acquisition Process. Ark, Govini's flagship product, is a suite of AI-enabled applications, powered by integrated government and commercial data, to accelerate the entire spectrum of Defense Acquisition, including Supply Chain, Science & Technology, Production, Sustainment, and...


  • Pittsburgh, United States Saxon Global Full time

    Client: BNY Mellon Title: Senior Datawarehouse Developer Duration: 12 Month Contract to Hire "This position requires consultants to be able to convert to client's payroll without sponsorship. Client is unable to provide future sponsorship." Location: Pittsburgh, PA (Hybrid/On-Site) Interview Process: Apex Tech Screening then 2 step client interview....


  • Pittsburgh, United States Saxon Global Full time

    Client: BNY Mellon Title: Senior Datawarehouse Developer Duration: 12 Month Contract to Hire "This position requires consultants to be able to convert to client's payroll without sponsorship. Client is unable to provide future sponsorship." Location: Pittsburgh, PA (Hybrid/On-Site) Interview Process: Apex Tech Screening then 2 step client interview....

  • BIG Data Engineer

    3 weeks ago


    Pittsburgh, United States Saxon Global Full time

    Needs; SQL Database Modelling Stored Procedures Person has to work c2H Job Description: Enterprise Master Data Technology group is at the forefront of building BNYM Strategic Reference Data Platforms. We are looking for a motivated senior Data Engineer. S/he will be part of the team that builds, maintains, and promotes our Enterprise Master Data...

  • Lead Data Engineer

    9 hours ago


    Pittsburgh, United States Broadridge Full time

    Broadridge is hiring! The Distribution Data & Analytics team has an opening for a Lead Data Engineer based out of our Pittsburgh, PA location (hybrid remote work with hoteling space). We are looking for a proficient data engineer who is passionate about developing high quality software and data solutions. You will collaborate with other like-minded team...

  • Data Engineer

    7 days ago


    Pittsburgh, United States Montauk Energy Full time

    Job Title: Data Engineer Reports To: Director of IT Location: Pittsburgh, Pennsylvania Company Statement: Montauk Renewables, Inc. (NASDAQ: MNTK) is a renewable energy company specializing in the management, recovery, and conversion of biogas into RNG. The Company captures methane, preventing it from being released into the atmosphere, and converts it...


  • Pittsburgh, United States Data Science Automation Full time

    We are seeking proactive, highly-intelligent, passionate and personable technical professionals to serve our diverse and expanding customer base. You will work on challenging projects, often on the bleeding edge of what is technically possible --- we will bring out your very best, and help you make a big impact on this and future generations. At DSA you will...


  • Pittsburgh, United States HarbisonWalker International Full time

    Summary Senior Data Engineer Function: IT Experience: min. 10 years Job type : Permanent Division: IT Hierarchical attachment: Business Intelligence Manager Area: WW Country: US City: Pittsburgh Context Serving three core markets (Refractory solutions, Foundry & Metal flow), Calderys combine unique business expertise to provide customised and innovative...

  • Senior Data Engineer

    6 hours ago


    Pittsburgh, United States Carnegie Mellon University Full time

    What We Do The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense capabilities. Actively partnering with sponsors, CMR identifies and addresses...

  • Automation Engineer

    5 days ago


    Pittsburgh, United States Data Science Automation Full time

    We are seeking proactive, highly-intelligent, passionate and personable technical professionals to serve our diverse and expanding customer base. You will work on challenging projects, often on the bleeding edge of what is technically possible --- we will bring out your very best, and help you make a big impact on this and future generations. At DSA you will...


  • Pittsburgh, United States Form Energy, Inc. Full time

    Are you ready to build America’s clean energy future with the team that will deliver? Form Energy is an American energy technology and manufacturing company. We are pioneering a new class of iron-air batteries to enable our electric grid to run on renewable, reliable, and affordable energy, every day of the year. Form Energy has been recognized by TIME as...


  • Pittsburgh, United States Comcast Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Pittsburgh, United States Diverse Lynx Full time

    Hi , Below is the job description kindly look at it and let me know if you would be interested. Skill: Snowflake Data Engineer Pittsburgh, Pennsylvania Full time Experience in Snowflake data pipelines. Performance. Optimization. Snowflake development tasks. Authentication & Authorization. Good communication skills, work in a...


  • Pittsburgh, Pennsylvania, United States Govini Full time

    Company DescriptionGovini builds software that accelerates the Defense Acquisition Process. The Ark, Govini's flagship product, combines commercial data and artificial intelligence into applications that solve challenges across the entire spectrum of Defense Acquisition, including Supply Chain, Science and Technology, Production, Sustainment, and...

  • Data Engineer II

    4 days ago


    Pittsburgh, United States Net Health Full time

    About Net HealthBelong. Thrive. Make a Difference. Are you looking for a meaningful and satisfying career where you have endless opportunities to grow and be financially rewarded? Net Health may be the perfect place for you. A high-growth and profitable company, we help caregivers harness data for human health. We also honor and respect the needs of our Net...


  • Pittsburgh, United States Techstra Solutions Full time

    Job DescriptionJob DescriptionAs an Azure Data Engineer at Techstra Solutions, you will play a pivotal role in designing, implementing, and managing data architecture on the Azure cloud platform. The ideal candidate will be proficient in leveraging Azure data services and tools to extract insights from large datasets, drive data-driven decision making, and...


  • Pittsburgh, United States Insight Global Full time

    Position: Lead Data Engineer (Databricks/AWS)Duration: 6 Month Contract – w/extensions or conversionLocation: Remote ; East Coast!!!Must Haves:2-3 years exp. as a data engineer3 years of RECENT experience with Data Bricks Must be their most relevant experience!!Experience with Cloud ( Azure, GCP, or AWS)Experience with SQL – they will be writing...