Data Engineering Lead-AWS Admin

3 weeks ago


Malvern, United States Tephra Full time
Description:

Technology exp required:

Relational database, SQL, transaction log, replication, applying deltas

Amazon Web Services (AWS) - load data into S3 (ssh, sftp, AWS CLI)

Deep expertise with Python scripting - preferably including Anaconda on AWS (processing CSV / pipe-delimited data files)

Experience in building reliable multi-step distributed data pipelines

Provide technical leadership for data engineering enabling us to advance architecture

The Architect would help guide the technical architecture for projects such as data replication from OnPrem to AWS, Data management, DBaaS, data modeling for the Data Lake on Cloud and data security.

Shaping an architecture to meet the needs of cloud data architecture to service identified use cases will be the primary technical objective of the role

Advanced knowledge of NoSQL and Graph databases, Hadoop, and ETL technologies will be needed to design overall data platform design

Experience designing systems to ingest, process, and get Big Data consumption ready for Data Science is required

Jupyter notebook on SageMaker for simple Python analytics

Duties and Responsibilities

1. Provides the architectural leadership in shaping strategic technology programs, which focus on both Business of IT (e.g., Unified Communication, SOI) and LOB-specific strategic technology programs.

2. Continuously pursues advanced level technical acumen:

• Attends conferences and engages in associated activities (e.g., conducting presentations, leading workshops, etc.).

• Consumes and contributes content from and to Open Source communities.

3. Provides architecture thought leadership and expertise including cost optimization

4. Defines reference and implementation architectures.

5. Produces technology roadmaps in support of IT's vision and strategy.

6. Develops proof-of-concept prototypes and initial implementation models.

7. Monitors implementation activity to ensure architecture and design principles are upheld.

8. Ensures implementation solutions support architecture objectives (availability, scalability, performance, security, etc.), as appropriate.

9. Rolls up sleeves and does deep dives on Financial Services data sets to understand intricacies and come up with optimal data models

10. Is adept with handling multiple data types from multiple data sources and strategize on the optimal way to analyze/store such data sets

Qualifications

• Minimum 10 years relevant work experience.

• Highly experienced with Big Data, Glue, EMR, and Data Quality tools/procedures for Cloud native data stores

• Strong database and cloud expertise, along with experience with data replication technology required

• Strong knowledge of micro-services and DDAAS required

• Expert level AWS and Cloud native data experience is required

• Minimum five years big data and advanced analytics experience required

- Minimum 2 years of cloud-native database design, migration, and implementation experience required

• Experience with Enterprise Information Management (EIM) is required

• Experience with CDC tools (Attunity preferred) to move data from OnPrem sources
  • AWS Developer

    6 days ago


    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionResponsibilitiesExperience working on a Cloud modernization project. Knowledge and experience of cloud batch concepts and technologies Proven experience using AWS services (Attunity, Kinesis, Glue, S3, SQS, SNS, Lambda, Aurora RDS, DynamoDB, Cloud Formation) . Have experience with software engineering fundamentals including...


  • Malvern, United States Motion Recruitment Partners, LLC Full time

    A PA based wealth management company is looking for an AWS cloud security engineer to join their team. This is a full time role operating on a hybrid model just on the outskirts of Wayne, PA. This position will be focused on the strategy and high level hands on technical alike The core migration to AWS has already taken place, but in efforts to strengthen...


  • Malvern, United States Motion Recruitment Full time

    A PA based wealth management company is looking for an AWS cloud security engineer to join their team. This is a full time role operating on a hybrid model just on the outskirts of Wayne, PA. This position will be focused on the strategy and high level hands on technical alike The core migration to AWS has already taken place, but in efforts to strengthen...

  • AWS Developer

    2 weeks ago


    Malvern, United States Vision It US Full time

    Job DescriptionJob DescriptionResponsibilities:This contractor will help build and manage the Data Discovery team products. As a Developer, they will be responsible for developing applications for user interaction. Responsible for implementing, testing, and deploying the applications. They will also need to analyze current state and collaborate on system...


  • Malvern, United States New York Technology Partners Full time

    In this role, you will:Provide technical expertise and completes complex development, design, implementation, architecture design specification, and maintenance activities.Ensure the viability of IT deliverables, recommending development options and approving the team's technical deliverables as well as conduct testing, including functionality, technical...


  • Malvern, United States CyberTec Full time

    Client: Vanguard Role: Sr. AWS Python Developer (8+ years of experience) Payrate: $59/hr on C2C - NO FLEX Duration: 6+ Months Location: Malvern, PA (hybrid- 3 days a week, onsite on day 1)Responsibilities: The ModelOps & Automated Controls team makes deploying machine learning models easy. With tools like Aws SageMaker, Lambda, Code Pipeline and many other...


  • Malvern, United States Diverse Lynx Full time

    Role: Unica Consultant with AWS Location: Malvern, PA Hire type: Contract /Full time Essential Skills: Technical knowledge at senior level needed: Unica Campaign, Interact support activities such as Migration to cloud and upgrades SQL/Oracle Unix Know-How AWS Knowledge is plus Role Description: Experience in Unica Migration from on-Prem to Cloud (AWS),...


  • Malvern, United States Kapital Data Corp Full time

    Note: 3 days onsite in Malvern, PA - a MUSTStart/On-boarding Process: Once offer is made, they will do a background check (they run) that includes:10 years backgroundDrug testFinger PrintingTimeline is 2 weeks from offer to start based on background processResponsibilities:To provide support to the following Oracle Cloud EPM modules as well as being a part...


  • Malvern, United States Diverse Lynx Full time

    Position - Tealeaf and Full Stack Developer with AWS Location - Malvern, PA Job Type - C2CJob ResponsibilitiesIn this role you will: Be a key technical contributor on this team. Good knowledge in AWS configurations. Partner with immediate team, architects, IT counterparts, leadership, and business partners Partner effectively with vendor in implementing...

  • AWS Consultant

    1 month ago


    Malvern, United States Unicorn Technologies, LLC Full time

    Job Title AWS ConsultantLocation Malvern PADuration 6+ Months AWS Analytic services; EMR. The candidate should also have the other AWS proficiencies like S3 etc Should be proficient in CI/CD – data pipelines with tools like Git Bitbucket Bamboo. Python and shell/bash scripting. JIRA

  • AWS Consultant

    1 month ago


    Malvern, Arkansas, United States Unicorn Technologies, LLC Full time

    Job Title AWS ConsultantLocation Malvern PADuration 6+ Months AWS Analytic services; EMR. The candidate should also have the other AWS proficiencies like S3 etc Should be proficient in CI/CD – data pipelines with tools like Git Bitbucket Bamboo. Python and shell/bash scripting. JIRA

  • Python Developer

    1 week ago


    Malvern, United States RIT Solutions, Inc. Full time

    Job Title - Python Developer - AWS Location - Malvern, PA - Hybrid Duration - 6+ Months Interview - VideoJob Description - Python Developer with devops exp. It would be Python development and AWS tools like Lambda, Secrets Manager, IAM Python Developer with strong AWS and testing experience. They should have sound AWS skills. Using Pythong to handle the...


  • Malvern, PA, United States (THE VANGUARD GROUP INC. MALVERN,PA) Full time

    Manage and optimize automation of key ETL (Extract / Transform / Load) and quality assurance processes for large volumes of data; consult with department or function heads on implementation, transition, and operating plans. Requires Master’s in Computer Science, Computer Engineering, Computer Science and Engineering, or closely related IT field and two...

  • AWS developer

    1 week ago


    Malvern, United States Skilzmatrix Full time

    Job DescriptionJob DescriptionResponsibilities:This contractor will help build and manage the Data Discovery team products.As a Developer, they will be responsible for developing applications for user interaction. Responsible for implementing, testing, and deploying the applications. They will also need to analyze current state and collaborate on system...


  • Malvern, United States Randstad Digital Full time

    Responsibilities Provide vulnerability management and secure configuration baseline management oversight and governance for Infosys VM/SCM programs. Adjudicate risk-acceptance ("exception") requests and false positive requests, review VM metrics, shape and govern based on trends being presented to us by Infosys Qualifications Looking for strong AWS...


  • Malvern, United States Georgia IT Inc Full time

    Job Title: Python/ AWS Developer Location: Malvern, PA Duration: Contract Rate: DOE (USC, GC, GCEAD and L2S are only preferred) Responsibilities The ModelOps & Automated Controls team makes deploying machine learning models easy. With tools like Aws SageMaker, Lambda, Code Pipeline and many other AWS services we serve our client by producing a...


  • Malvern, United States Motion Recruitment Partners, LLC Full time

    Job Description An international trading company is hiring a Senior Software Engineer for their team. This company has architected and developed multiple trading technologies for other firms. In total, they have access to over 70% of the U.S. options market volume. Within the position, you will get the chance to work on their exchange and surrounding...


  • Malvern, United States Randstad Digital Full time

    ResponsibilitiesProvide vulnerability management and secure configuration baseline management oversight and governance for Infosys VM/SCM programs. Adjudicate risk-acceptance ("exception") requests and false positive requests, review VM metrics, shape and govern based on trends being presented to us by InfosysQualificationsLooking for strong AWS experience...


  • Malvern, United States Vanguard Full time

    Vanguard Application Engineering Technical Lead Malvern , Pennsylvania Apply Now Personal Investor Technology Architecture is excited to share that we are looking for an Application Engineering Technical Lead to join our team! Looking for a motivated Technical Lead who will be responsible for multiple applications, most of which are being developed for the...


  • Malvern, United States Randstad Digital Full time

    Location: Malvern, PA / Plano, TX / Charlotte, NC / Scottsdale, AZAbout the Role: We are seeking a Senior Database Administrator with expertise in DB2 for Linux, Unix, and Windows (LUW) databases within an AWS environment. In this role, you will be responsible for the administration, optimization, and maintenance of our database infrastructure, leveraging...