Data engineer

1 week ago

Fremont, CA, United States Info Way Solutions Full time
Role: Data engineers (with strong Python and AWS experience)
Locations: DC/VA/Client(Onsite)

GC ,US CITIZEN & EAD Visa only

Need Strong Hands-on experience

Role Description:

Data Pipeline Development:
Design, implement, and manage robust data pipelines using Python, PySpark, SQL to efficiently extract, transform, and load data from diverse sources(Batch & Streaming)

AWS Expertise:
Demonstrate expertise in core AWS services such as AWS DMS, AWS Glue, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, Amazon EMR, AWS IAM, AWS LAMBDA etc., and apply them to build scalable and reliable data solutions.

Data Modeling:
Develop and maintain efficient data models to support the analytical and reporting needs.

Database Management:
Administer databases using AWS services like Amazon RDS or Amazon Redshift, focusing on schema design, performance optimization, and monitoring.

Data Warehousing:
Utilize Amazon Redshift or Amazon Snowflake to create high-performing analytical databases that empower data-driven decision-making.

ETL Best Practices:
Implement industry best practices for ETL processes, including data validation, error handling, and data quality checks.

Performance Optimization:
Optimize query performance through continuous tuning of databases and leveraging AWS's scalability capabilities.

Monitoring and Logging:
Establish robust monitoring and logging mechanisms using AWS CloudWatch, Amazon CloudTrail, or comparable tools to ensure pipeline reliability.

Security and Compliance:
Ensure adherence to security best practices and relevant compliance standards, tailoring solutions to meet GDPR, HIPAA, or other regulatory requirements.

Automation:
Drive automation of deployment and scaling of data pipelines using infrastructure as code (IaC) tools like AWS CloudFormation and Terraform.

Collaboration:
Collaborate closely with cross-functional teams, including data scientists, analysts, and other stakeholders, to understand their data needs and provide effective solutions.

Continuous Learning:
Stay updated on the latest developments in AWS services and data engineering methodologies, applying new insights to enhance our data infrastructure.

Soft Skills:
Exhibit strong communication skills to facilitate effective teamwork and interaction with diverse groups.

Thanks & Regards,

Saravanan.R |Infowaygroup.com|

Direct: (925)464-1116

Work: (925)-592-6160 Ext 111
Saravanan@infowaygroup.com
Info Way Solutions LLC, Fremont, CA

  • Lead Data Engineer

    1 week ago

    Fremont, CA, United States Inizio Partners Full time

    About the job Lead Data Engineer Role: Lead Data EngineerLocation: Fremont, CA(3 days onsite, 2 days work from home)Duration: Full TimeJob Description: Candidate should Provide technical expertise in needs identification, data modelling, data movement, translating business needs into technical solutions with adherence to established data guidelines and...

  • Data Engineer

    7 days ago

    Fremont, CA, United States SynergisticIT Full time

    Launch Your Data Career with Proof, Not Promises-At SynergisticIT If you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop guessing and start choosing results. At SynergisticIT, we don't just offer training-we offer outcomes. Our candidates have landed jobs at top tech firms like Google,...

  • Data Engineer

    2 weeks ago

    Fremont, CA, United States SynergisticIT Full time

    Launch Your Data Career with Proof, Not Promises-At SynergisticIT If you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop guessing and start choosing results. At SynergisticIT, we don't just offer training-we offer outcomes. Our candidates have landed jobs at top tech firms like Google,...

  • Lead Data Engineer

    1 week ago

    Fremont, CA, United States eTeam Full time

    Role: Lead Data Engineer Location: Fremont, CA (Hybrid 3 days a week from office) Duration: 12+ Months Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is required and preferred over other cloud platforms. 10 +...

  • Lead Data Engineer

    2 days ago

    Fremont, CA, United States eTeam Full time

    Role: Lead Data Engineer Location: Fremont, CA (Hybrid 3 days a week from office) Duration: 12+ Months Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is required and preferred over other cloud platforms. 10 +...

  • Data Engineer with QE experience

    1 week ago

    Fremont, CA, United States Info Way Solutions Full time

    Hi Professionals, Hope you are doing good This is Jayaraman from Info Way Solutions, LLC We have job opening for Data Engineer with QE experience and the detailed Job description is given below: Kindly check the JD and share your views Title: Data Engineer with QE experience Location: Austin or Remote Key skills required for the LPL Data Engineer with QE...

  • Software Engineer, Data and Evaluation

    2 weeks ago

    Fremont, CA, United States Pony.ai Full time

    3 weeks ago Be among the first 25 applicants This range is provided by Pony.ai. Your actual pay will be based on your skills and experience talk with your recruiter to learn more. Base pay range $120,000.00/yr - $180,000.00/yr Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending...

  • Role: Data Engineer

    6 days ago

    Fremont, CA, United States Info Way Solutions Full time

    Hi Professionals, Hope you are doing good This is Sangeetha from Info Way Solutions, LLC We have job opening for Data Scientist and the detailed Job description is given below: Kindly check the JD and share your view Role: Data Engineer Location: Montreal Canada ( Hybrid - 3days in a week) Responsibilities: • Defining and evaluating key metrics and...

  • Role: Data Engineer

    1 day ago

    Fremont, CA, United States Info Way Solutions Full time

    Hi Professionals, Hope you are doing good This is Sangeetha from Info Way Solutions, LLC We have job opening for Data Scientist and the detailed Job description is given below: Kindly check the JD and share your view Role: Data Engineer Location: Montreal Canada ( Hybrid - 3days in a week) Responsibilities: • Defining and evaluating key metrics and...

  • Sr. Azure Data Engineer

    2 weeks ago

    Fremont, CA, United States FIRST SOFTSOLUTIONS INC Full time

    We are actively hiring for Sr. Azure Data Engineer C2C Long term Looking for Senior candidates minimum 10+ years of experience. Must Have : Enterprise Data modeling / Design Azure SQL Data Warehouse (Synapse) Azure synapse serverless pool T-SQL ( Hands on experience , writing quires , building stored procs, performance optimization , etc..) ADF / Any...