Sr. AWS Data Engineer
4 weeks ago
Job Title: Sr. AWS Data Engineer
Location: Remote
Work Type: Contract/ Full Time
Job Description:-
We are expanding our Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a member of the Data Engineering team, you will report to the Manager of Data Engineering.
Primary Responsibilities:
- Implement and manage AWS tools and environment.
- Implement and manage Apache Kafka streams.
- Using Python, build and maintain multiple source data connections to API's, SQL databases, AWS S3, and other sources feeding into a Snowflake Clouds database system.
- Work with internal and external users and providers to build datasets that add value to the business and allow for informed business decisions.
- Ensure data consistency, accuracy and reliability as data and business requirements change.
Required Skills:
- 10+ years of AWS Console, S3, Lambda, Kinesis, Glue, and CloudWatch.
- 5+ years of Kafka streams experience.
- 5+ years of data engineering, data pipeline development, and ETL experience using Python, SQL, and Snowflake
- Experience requesting, transforming, and ingesting data from REST and SOAP APIs
- Proficiency in the Python scripting language, SQL, Cloud databases, and ETL development processes & tools
- Strong understanding of traditional relational databases, data and dimensional modeling principles, and data normalization techniques
- Ability to initiate, drive, and manage projects with competing priorities.
- Ability to communicate effectively with business leaders, IT leadership, and engineers.
- Must have a passion for data and helping the business turn data into information and action.
Bonus Skills:
- Experience with data streaming technologies like PySpark
- Experience with pipeline technologies like DBT, Apache Airflow or FiveTran
- Experience with MPP technologies and databases
- Experience with data visualization tools like Tableau or Sigma
- Experience with container orchestration tools like Docker or Kubernetes
- Experience with Azure data product offerings and platform
- Experience working with Salesforce and SAP data.
- Experience using Terraform or other infrastructure as code tools.
- Required Education/Experience:
- Bachelor's degree in information systems, computer science, or related technical field.
-
Sr. AWS Data Engineer
4 weeks ago
Bethlehem, United States Smart IT Frame LLC Full timeJob Title: Sr. AWS Data Engineer Location: RemoteWork Type: Contract/ Full TimeJob Description:-We are expanding our Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a member...
-
Lead Data Engineer
1 month ago
Bethlehem, United States Smart IT Frame LLC Full timeTitle: Lead Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities: Be accountable for the delivery of the project within the defined timelines with good quality. Working with the clients and Offshore leads to understanding requirements, coming up with high-level designs, and completing development, and unit testing activities. Keep all...
-
Lead Data Engineer
1 month ago
Bethlehem, United States Smart IT Frame LLC Full timeTitle: Lead Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities: Be accountable for the delivery of the project within the defined timelines with good quality. Working with the clients and Offshore leads to understanding requirements, coming up with high-level designs, and completing development, and unit testing activities. Keep all...
-
Data Engineer
4 weeks ago
Bethlehem, United States Smart IT Frame LLC Full timeExperience: 10-12 yearsMust-Have: 10+ years of relevant experience in Data Engineering and delivery.10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.Strong experience with SQL, python, and PysparkGood understanding of Data ingestion and data processing frameworksGood experience in Snowflake, SQL, AWS (glue, EMR, S3,...
-
Data Engineer
4 weeks ago
Bethlehem, United States Smart IT Frame LLC Full timeExperience: 10-12 yearsMust-Have: 10+ years of relevant experience in Data Engineering and delivery.10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.Strong experience with SQL, python, and PysparkGood understanding of Data ingestion and data processing frameworksGood experience in Snowflake, SQL, AWS (glue, EMR, S3,...
-
Data Engineer
2 weeks ago
Bethlehem, United States Smart IT Frame LLC Full timeTitle: Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities:10+ Years of experience as a Data EngineerStrong technical expertise in SQL is mustStrong knowledge of joins and common table expressions (CTEs)Strong experience with PythonStrong expertise in ETL process and with various data model conceptsKnowledge of star schema and a...
-
Data Engineer
3 weeks ago
Bethlehem, United States Smart IT Frame LLC Full timeTitle: Data EngineerLocation: Bethlehem, PAType: ContractRole & Responsibilities:10+ Years of experience as a Data EngineerStrong technical expertise in SQL is mustStrong knowledge of joins and common table expressions (CTEs)Strong experience with PythonStrong expertise in ETL process and with various data model conceptsKnowledge of star schema and a...
-
Data Engineer
3 weeks ago
Bethlehem, United States Lorven technologies Full timeJob DescriptionJob DescriptionHi,Our client is looking Data Engineer for Contract project in Bethlehem, PA Opportunity below is the detailed requirements.Job Title : Data EngineerLocation : Bethlehem, PA Type : Contract Job description:Bachelor's degree in Computer science or equivalent, with minimum 9+ Years of relevant experience.5+ Years of experience...
-
Data Engineer
3 weeks ago
Bethlehem, United States Acunor Inc Full timeJob DescriptionJob DescriptionTitle: AWS Data Engineer Location: Bethlehem, PAContracting opportunity.5+ Years of experience as a Data Engineer Strong technical expertise in SQL is must Strong knowledge of joins and common table expressions (CTEs) Strong experience with Python Strong expertise in ETL process and with various data model concepts Knowledge of...
-
Sr. Structural Engineer 3
3 months ago
Bethlehem, United States Cyfle Full timeAbout the job Sr. Structural Engineer 3 We have partnered with an engineering and construction company in the Bethlehem, PA area to provide them with a Senior Structural Engineer 3. Please review the below description and let us know if you are interested. Prioritized Must Have Skills for the Sr. Structural Engineer: #1. Professional Engineer and/or...
-
Data Engineer Machine Learning
3 months ago
Bethlehem, United States PRI Technology Full timeJob DescriptionJob DescriptionData Engineer Machine Learning My name is Bill Stevens and I have a new six month plus Data Engineer Machine Learning opportunity available for a major firm located in Bethlehem, Pennsylvania that could be of interest to you, please review my specification below. The work schedule will be a hybrid one, three days a week in the...
-
Data Engineer Machine Learning
2 weeks ago
Bethlehem, United States PRI Technology Full time $90 - $100Job DescriptionJob DescriptionData Engineer Machine LearningMy name is Bill Stevens, and I have a new six month plus Data Engineer Machine Learning opportunity available for a major firm located in Bethlehem, Pennsylvania that could be of interest to you, please review my specification below. The work schedule will be a hybrid, two days a week in the firms...
-
Data Management Specialist
2 days ago
Bethlehem, Pennsylvania, United States PRI Technology Full timeJob DescriptionJob SummaryPRI Technology is seeking an experienced PostgreSQL Database Administrator to join our team. As a key member of our database administration team, you will be responsible for designing, implementing, and maintaining our PostgreSQL database infrastructure.Key ResponsibilitiesDesign and implement PostgreSQL database solutions to meet...
-
Data Solutions Engineer
4 weeks ago
Bethlehem, United States BerkOne Full timeBerkOne's mission is to provide clients with customized and efficient back-office services enabling them to not only focus on their core competencies but reduce costs as well. The company helps organizations transform information-intensive business processes, reduce manual work and errors, minimize costs, and improve customer engagement. Whatever the client...
-
Data Solutions Engineer
4 weeks ago
Bethlehem, United States BerkOne Full timeBerkOne's mission is to provide clients with customized and efficient back-office services enabling them to not only focus on their core competencies but reduce costs as well. The company helps organizations transform information-intensive business processes, reduce manual work and errors, minimize costs, and improve customer engagement. Whatever the client...
-
Bethlehem, United States Guardian Life Insurance Company Full timeGain invaluable industry and organizational knowledge through daily business interactions and job assignments, in addition to engaging in projects that directly affect our business, interact with senior leaders in conversational settings, and network Data Engineer, Engineer, Summer, Intern, Data Scientist, Data Science, Technology, Insurance
-
Computational Fluid Dynamics Engineer
1 month ago
Bethlehem, United States TES Recruiting Solutions Full timeSr. Simulation Engineer – CFD and FEADirect hire role with excellent benefits and relocation assistance! Location: Bethlehem, PASummary:The Sr. Simulation Engineer will be responsible for developing, implementing, and maintaining analytic, modeling, and simulation support functions. The role involves supporting design teams to ensure the integrity of...
-
Computational Fluid Dynamics Engineer
2 months ago
Bethlehem, United States TES Recruiting Solutions Full timeSr. Simulation Engineer – CFD and FEADirect hire role with excellent benefits and relocation assistance! Location: Bethlehem, PASummary:The Sr. Simulation Engineer will be responsible for developing, implementing, and maintaining analytic, modeling, and simulation support functions. The role involves supporting design teams to ensure the integrity of...
-
Principal Platform Engineer Engineer KR1543
5 days ago
Bethlehem, United States Global InfoTek Inc Full timeJob DescriptionJob DescriptionClearance Level: SecretUS Citizenship: RequiredJob Classification: Full TimeLocation: Boston Metro AreaYears of Experience: 5-7 yearsEducation Level: Bachelor's Degree in Computer Science, Mathematics, or equivalent technical degree; or equivalent industry experience Position Description: The Platform Services Engineer...
-
Principal Platform Engineer Engineer KR1544
5 days ago
Bethlehem, United States Global InfoTek Inc Full timeJob DescriptionJob DescriptionClearance Level: SecretUS Citizenship: RequiredJob Classification: Full TimeLocation: Boston Metro AreaYears of Experience: 5-7 yearsEducation Level: Bachelor Degree in Computer Science, Mathematics, or equivalent technical degree; or equivalent industry experience Position Description: The Platform Services Engineer possesses...