Lead Data Engineer

4 weeks ago


Bethlehem, United States Smart IT Frame LLC Full time

Title: Lead Data Engineer

Location: Bethlehem, PA

Type: Contract


Role & Responsibilities:

Be accountable for the delivery of the project within the defined timelines with good quality.

Working with the clients and Offshore leads to understanding requirements, coming up with high-level designs, and completing development, and unit testing activities.

Keep all the stakeholders updated about the task status/risks/issues if there are any.

Keep all the stakeholders updated about the project status/risks/issues if there are any.

Work closely with the management wherever and whenever required, to ensure smooth

execution and delivery of the project.

Guide the team technically and give the team directions on how to plan, design, implement, and deliver the projects.


Key Skills:

  • 10+ years of relevant experience in Data Engineering and delivery.
  • 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
  • Strong experience with SQL, python, and Pyspark
  • Good understanding of Data ingestion and data processing frameworks
  • Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
  • Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
  • Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
  • Experience working in Agile Methodology
  • Ability to learn and help the team learn new technologies quickly.
  • Excellent communication and coordination skills
  • Knowledge of implementing ETL/ELT for data solutions end to end
  • ingest data from Rest APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift, Lakehouse
  • Understanding requirements, and data solutions (ingest, storage, integration, processing, access) on AWS
  • Knowledge of analyzing data using SQL Stored procedures
  • Build automated data pipelines to ingest data from relational database systems, file system
  • Conducting End to End verification and validation for the entire application
  • Using Git/bitbucket for efficient remote team working, storing framework, and developing test scripts.


Responsibilities:

  • Understand and translate business needs into data models supporting longterm solutions.
  • Work with the Application Development team to implement data strategies, build data flows and develop conceptual data models

Perform reverse engineering of physical data models from databases and SQL scripts.


  • Lead Data Engineer

    4 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Title: Lead Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities: Be accountable for the delivery of the project within the defined timelines with good quality. Working with the clients and Offshore leads to understanding requirements, coming up with high-level designs, and completing development, and unit testing activities. Keep all...

  • Data Engineer

    3 weeks ago


    Bethlehem, United States Lorven technologies Full time

    Job DescriptionJob DescriptionHi,Our client is looking Data Engineer for Contract project in Bethlehem, PA Opportunity below is the detailed requirements.Job Title : Data EngineerLocation : Bethlehem, PA Type : Contract Job description:Bachelor's degree in Computer science or equivalent, with minimum 9+ Years of relevant experience.5+ Years of experience...

  • Data Engineer

    3 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Title: Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities:10+ Years of experience as a Data EngineerStrong technical expertise in SQL is mustStrong knowledge of joins and common table expressions (CTEs)Strong experience with PythonStrong expertise in ETL process and with various data model conceptsKnowledge of star schema and a...

  • Data Engineer

    2 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Title: Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities:10+ Years of experience as a Data EngineerStrong technical expertise in SQL is mustStrong knowledge of joins and common table expressions (CTEs)Strong experience with PythonStrong expertise in ETL process and with various data model conceptsKnowledge of star schema and a...

  • Data Engineer

    4 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Experience: 10-12 yearsMust-Have: 10+ years of relevant experience in Data Engineering and delivery.10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.Strong experience with SQL, python, and PysparkGood understanding of Data ingestion and data processing frameworksGood experience in Snowflake, SQL, AWS (glue, EMR, S3,...

  • Data Engineer

    4 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Experience: 10-12 yearsMust-Have: 10+ years of relevant experience in Data Engineering and delivery.10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.Strong experience with SQL, python, and PysparkGood understanding of Data ingestion and data processing frameworksGood experience in Snowflake, SQL, AWS (glue, EMR, S3,...

  • Sr. AWS Data Engineer

    3 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Job Title: Sr. AWS Data Engineer Location: RemoteWork Type: Contract/ Full TimeJob Description:-We are expanding our Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a member...

  • Sr. AWS Data Engineer

    4 weeks ago


    Bethlehem, United States Smart IT Frame LLC Full time

    Job Title: Sr. AWS Data Engineer Location: RemoteWork Type: Contract/ Full TimeJob Description:-We are expanding our Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a member...


  • Bethlehem, United States PRI Technology Full time

    Job DescriptionJob DescriptionData Engineer Machine Learning My name is Bill Stevens and I have a new six month plus Data Engineer Machine Learning opportunity available for a major firm located in Bethlehem, Pennsylvania that could be of interest to you, please review my specification below. The work schedule will be a hybrid one, three days a week in the...


  • Bethlehem, United States PRI Technology Full time $90 - $100

    Job DescriptionJob DescriptionData Engineer Machine LearningMy name is Bill Stevens, and I have a new six month plus Data Engineer Machine Learning opportunity available for a major firm located in Bethlehem, Pennsylvania that could be of interest to you, please review my specification below. The work schedule will be a hybrid, two days a week in the firms...


  • Bethlehem, United States BerkOne Full time

    BerkOne's mission is to provide clients with customized and efficient back-office services enabling them to not only focus on their core competencies but reduce costs as well. The company helps organizations transform information-intensive business processes, reduce manual work and errors, minimize costs, and improve customer engagement. Whatever the client...


  • Bethlehem, United States BerkOne Full time

    BerkOne's mission is to provide clients with customized and efficient back-office services enabling them to not only focus on their core competencies but reduce costs as well. The company helps organizations transform information-intensive business processes, reduce manual work and errors, minimize costs, and improve customer engagement. Whatever the client...

  • Data Engineer

    3 weeks ago


    Bethlehem, United States Acunor Inc Full time

    Job DescriptionJob DescriptionTitle: AWS Data Engineer Location: Bethlehem, PAContracting opportunity.5+ Years of experience as a Data Engineer Strong technical expertise in SQL is must Strong knowledge of joins and common table expressions (CTEs) Strong experience with Python Strong expertise in ETL process and with various data model concepts Knowledge of...


  • Bethlehem, United States Guardian Life Insurance Company Full time

    Gain invaluable industry and organizational knowledge through daily business interactions and job assignments, in addition to engaging in projects that directly affect our business, interact with senior leaders in conversational settings, and network Data Engineer, Engineer, Summer, Intern, Data Scientist, Data Science, Technology, Insurance


  • Bethlehem, United States Orbweaver Full time

    Job DescriptionJob DescriptionOrbweaver is a fast-growing SaaS company specializing in supply chain integrations, efficiencies, and solutions for the electronic components industry. We develop large-scale B2B data integration solutions for customers and suppliers in electronics manufacturing and related sectors. We’re looking for an experienced Software...


  • Bethlehem, Pennsylvania, United States CHA Consulting, Inc. Full time

    WHY CHA?Discovering Innovative Solutions.At CHA, we are dedicated to the principles of clean water, sustainable energy, safe infrastructure, and designs that seamlessly integrate with their environment. Our mission is to create impactful solutions that benefit communities and enhance the quality of life. We pride ourselves on our commitment to diversity and...


  • Bethlehem, Pennsylvania, United States Messer Americas Full time

    Position Overview:Messer operates a comprehensive network of industrial gas facilities, including Air Separation Units (ASU), Carbon Dioxide (CO2), Hydrogen (H2), and Helium (He) plants, catering to a diverse array of sectors. The Gas Analysis framework is crucial for the effective functioning and quality assurance of these industrial gas operations and...


  • Bethlehem, Pennsylvania, United States Messer Americas Full time

    Position Overview: Messer operates a vast network of industrial gas facilities, including Air Separation Units (ASU), Carbon Dioxide (CO2), Hydrogen (H2), and Helium (He) plants, catering to a diverse array of sectors. The Gas Analysis framework is crucial for the effective functioning and quality assurance of these facilities and their products. This role...


  • Bethlehem, Pennsylvania, United States Guardian Life Insurance Full time

    Senior Collaboration Engineer - Microsoft 365Position OverviewAs a Senior Collaboration Engineer at Guardian Life Insurance, you will play a pivotal role in architecting, developing, testing, implementing, and maintaining Microsoft 365 collaboration functionalities.Key AttributesExceptional problem-solving abilitiesProficient project management skillsStrong...

  • Survey Crew Lead

    1 day ago


    Bethlehem, Pennsylvania, United States Liberty Personnel Services, Inc Full time

    Job SummaryWe are seeking a highly experienced Survey Crew Chief to join our team at Liberty Personnel Services, Inc. As a key member of our survey crew, you will be responsible for leading and managing the day-to-day operations of our surveying projects.Key ResponsibilitiesLead and manage a team of surveyors to ensure timely and accurate completion of...