AWS Data Engineer

1 day ago


Philadelphia, United States IVID TEK INC Remote Work Freelance Full time $55 - $60
Senior AWS Data EngineerContract (100% Remote)
Job Description:We are looking for AWS Big Data Platform Engineers who are passionate about resolving the challenges of building robust and scalable data systems aligned to enterprise data strategy.

As Senior Data Platform Engineer you will be part of a team that leads the design and implementation of data platform to support the strategic data needs & support enterprise reporting needs including datamarts, reporting and business intelligence. You will build data capabilities and support a wide range of data flows and use cases to advance the data-driven investment decisioning and deliver transformational programs.

 Required skills:
  • Experience with AWS Data & Analytics, Cloud data platforms, data warehouse, data lakes and analytics products
  • Experience with batch job scheduling, leveraging Apache Airflow, AWS EMR (Multi Tenant ), PySpark, YARN, EKS, S3, HDFS, AWS Athena, AWS Glue, Lakeformation, AWS Step Functions, DMS
  • Experience building data tools using spark , performance tuning , AQE, Spark Listener Events,
  • Experience in data architecture and familiarity with ETL tools, data warehousing & big data architecture.
  • Knowledge of cloud-native approaches to build fast, flexible, and cost-effective data applications on any data lake, open-source column oriented DBMS and/or big data OLAP engines for analytical processing (Apache Pinot, Apache Hudi, Iceberg etc.)

Good to Have:
  • Experience with DataOps and various continuous delivery practices to deploy, support and operate data pipelines ( terraform , terragrunt)
JD- Required skills – Cloud Devops, python, Big Data Admin exp on AWS , AWS lake formation ( lake house vs Data fabric ), Data Product concepts, spark jobs auditing, monitoring and Instrumentation, spark perf tuning,  exp in creating service and tools to manage multi tenant env, Tech stack ( Must )– terraform,  knowledge of spark internals ( spark 3+ features ) – architecture, events, system metrices , AQE, job level resource management, Hudi, Parquet , IAM, AWS Glue, HIVE

Good to have - Iceberg,  airflow, terragrunt, dynamo DB

  • Philadelphia, Pennsylvania, United States Atlantic Partners Corporation Full time

    We're searching for a seasoned Python AWS specialist to lead the development of our next-generation data analytics platform.The successful candidate will have extensive experience in designing and implementing data engineering solutions using Python and AWS, with a focus on scalability and performance.Experience with technologies such as Progress or...

  • Data Engineer

    2 days ago


    Philadelphia, United States Mondo Full time

    Job DescriptionJob DescriptionApply now: Data Engineer, this is a 100% remote opportunity. The start date is ASAP for this long-term contract position.Job Title: Data EngineerLocation-Type: 100% remoteStart Date Is: ASAPDuration: Long-term contractRate: $55-$63 Per Hour W2 The estimate above represents the candidate's typical compensation range at the...

  • AWS Engineer Lead

    13 hours ago


    Philadelphia, Pennsylvania, United States CrossTech Consulting Group, Inc. Full time

    Job Title: AWS Engineer LeadAbout the JobCrossTech Consulting Group, Inc. is seeking a highly skilled AWS Engineer Lead to lead our cloud engineering team in Philadelphia, PA.This full-time position requires 3 days onsite with 2 days working from home. The ideal candidate will have leadership experience in establishing standards, policies, strategy, and best...


  • Philadelphia, United States Generis Tek Inc Full time

    Please Contact : To discuss this amazing opportunity, reach out to our Talent Acquisition Specialist Chaitali Lad at email address chaitali.lad@generistek.com can be reached on # 630-576-1929. We have Contract for Data Analytics Engineer for our client Philadelphia, PA. Please let me know if you or any of your friends would be interested in this position....

  • Platform Engineer

    1 day ago


    Philadelphia, United States Diverse Lynx Full time

    Role:- Platform Engineer - Data Location- Philadelphia, PA/San Ramon, CA/San Francisco, CA - Onsite role/No remote Duration- Fulltime/Permanent Job Description Technical/Functional Skills Platform Engineer/Architecture for Data Platforms either Cloud-based or On-Prem (Databricks, Snowflake, Superset, etc.).Python or scripting language Experience...

  • Data Engineer II

    6 days ago


    Philadelphia, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering a contract for a Data Engineer II position. This role operates in the technology industry, focusing on the design, implementation, and analysis of technical products and systems. A key part of this role is to ensure the quality of products and procedures through continuous monitoring and...


  • Philadelphia, Pennsylvania, United States Mondo Full time

    Job OverviewMondo is a forward-thinking company seeking a skilled Data Engineer to join our experienced team. We are looking for someone who can contribute to the design and development of enterprise-level applications using Snowflake and AWS tools.


  • Philadelphia, United States Tata Consultancy Services Full time

    Job Title: AWS DevOps engineer in Philadelphia, PA/ West Chester/PATechnical/Functional Skills -MUST HAVE SKILLS Java, Springboot, Microservices, SQL, Oracle, and Cloud Technologies(AWS/PCF), Concourse, Ansible, CouchbaseRoles & Responsibilities • Must be a strong leader, an excellent communicator, and possess and display a positive attitude.• Must be...

  • AWS DevOps engineer

    6 days ago


    Philadelphia, United States Tata Consultancy Services Full time

    Job Title: AWS DevOps engineer in Philadelphia, PA/ West Chester/PATechnical/Functional Skills -MUST HAVE SKILLS Java, Springboot, Microservices, SQL, Oracle, and Cloud Technologies(AWS/PCF), Concourse, Ansible, CouchbaseRoles & Responsibilities • Must be a strong leader, an excellent communicator, and possess and display a positive attitude.• Must be...


  • Philadelphia, United States Tata Consultancy Services Full time

    Job Title: AWS DevOps engineer in Philadelphia, PA/ West Chester/PATechnical/Functional Skills -MUST HAVE SKILLS Java, Springboot, Microservices, SQL, Oracle, and Cloud Technologies(AWS/PCF), Concourse, Ansible, CouchbaseRoles & Responsibilities • Must be a strong leader, an excellent communicator, and possess and display a positive attitude.• Must be...

  • Sr. Systems Engineer

    9 hours ago


    Philadelphia, United States Resource Informatics Group Inc Full time

    Job DescriptionJob DescriptionPosition: Sr. Systems Engineer (with AWS experience)Duration: 1+ yearsLocation: Philadelphia, PA Position overview:Seeking a Sr. Systems Engineer that will be responsible for coordinating and performing migrations of applications to servers with upgraded operating systems. This role will also be responsible for administering...

  • Sr. Systems Engineer

    24 hours ago


    Philadelphia, United States ZipRecruiter Full time

    Job DescriptionJob Description Position: Sr. Systems Engineer (with AWS experience) Duration: 1+ years Location: Philadelphia, PA Position overview: Seeking a Sr. Systems Engineer that will be responsible for coordinating and performing migrations of applications to servers with upgraded operating systems. This role will also be responsible for...

  • Backend Data Engineer

    13 hours ago


    Philadelphia, Pennsylvania, United States Pyramid Consulting Full time

    As a Backend Data Engineer at Pyramid Consulting, you will play a crucial role in developing and implementing data verification and validation processes for backend data-oriented systems.Job Description:Develop and implement data validation and verification processes using industry-approved tools and frameworks.Design and implement automated testing...


  • Philadelphia, Pennsylvania, United States Perpay - Career's Page Full time

    Perpay - Career's Page is dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability.About the RoleWe are looking for a highly skilled Senior Data Engineer who will play a crucial role in designing and optimizing data pipelines and architectures that drive our data products and...

  • Data Engineering

    6 days ago


    Philadelphia, United States Sagax Team Full time

    Data Engineering & Integration ConsultantWe are currently seeking a Data Engineering & Integration Consultant for a client in the Philadelphia Area. Duration: 2-3 months initial termLocation: Hybrid (2 days in Philadelphia is a MUST). Long-distance expense reimbursement not offered. Start Date: ImmediatePossibility of extension based on project performance...


  • Philadelphia, Pennsylvania, United States Wipro Full time

    We are seeking an AWS Security Solutions Engineer to join our team at Wipro.About the RoleThis is an exciting opportunity to lead our DevOps efforts and drive security initiatives across multiple projects.Key Responsibilities:Lead daily Scrum meetings with your team to discuss past, current, and future priorities.Maintain overall project condition,...


  • Philadelphia, United States SysMind Tech Full time

    Salary: 120K Job Title: BigData and AWS Solution Architect Relevant Experience (in Yrs) 10+ Yrs Technical/Functional Skills • Strong networking experience on AWS with VPC, Subnets, ACLs, Routing tables and Security Groups and Architecture experience with Spark, AWS and Big Data. • Complete understanding of AWS security framework with IAM roles, groups,...

  • Data Engineer 3

    47 minutes ago


    Philadelphia, United States Comcast Corporation Full time

    FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can...


  • Philadelphia, Pennsylvania, United States eTeam Full time

    About the RoleeTeam is looking for an experienced AWS Cloud Engineer to help build and deploy highly scalable, reliable, and secure cloud environments for our customers. As a Senior AWS Cloud Engineer, you will be responsible for designing and implementing cloud architectures that meet the needs of our customers. Your role will involve working with our...


  • Philadelphia, Pennsylvania, United States Formotiv Full time

    Job Description:We are seeking a skilled Senior Data Backend Engineer to contribute to the development of our cutting-edge DBI platform.Your responsibilities will include working with our Platform Lead, Product Management, Data Science, MLOps, and TechOps teams to understand and refine service and data requirements.You will develop and implement feature and...