Sr Data Engineer

3 weeks ago

San Francisco, United States Varite Full time
Pay rate range: $80-90/hr.

True Job Title-Senior Infrastructure Automation Engineer
Location-this is a hybrid position but we can consider remote candidates with exceptional technical expertise.

This role will be subject to level 2 screening.

In this role, you will get an opportunity to broadly apply your engineering skills across various technology solutions, as well as build your skills in other areas by being exposed to various aspects of product delivery from inception, through design, build, and deployment. You will be working multi-functionally with Product Managers, Architects, Engineers, and Customer teams in a rapidly evolving environment. You will be developing Infrastructure as Code to launch server instances, install and configure software, amongst other things. You will provide technical leadership in the planning, design, and implementation of cloud-based infrastructure systems with both traditional and non-traditional infrastructures.
• Demonstrated technical expertise across a variety of technology platforms and solutions
• Ability to work effectively independently or in a team environment
• Strong analytical, collaboration, leadership, critical thinking, multitasking, and time management skills
• Ability to influence successfully in a highly matrix or virtual organization
• Demonstrates independent thinking and decision-making abilities
• Ability to quickly receive and process information
• Proven ability to write clear and concise communications: technical documents, design documents, specifications
• 3 or more years of relevant technical experience, at senior level
• Bachelor's degree in Computer Science, Information Systems, or other related technical field or equivalent work
• Must be a US Citizen or a Green Card holder for over 3 years and with the intent to become a US Citizen

Required Skills:
• Experience in using Terraform to manage AWS Programmable Infrastructures
• Must have architected and implemented the Cloud Infrastructure Automation scripts to create and maintain various target environments like Dev, Stage, QA, Integration and Production in AWS environments
• The Infrastructure must include security roles and permissions, Cloud networking assets like VPC, Subnets, Routing Tables, Access Controls lists, storage assets like S3 buckets, creating lambda functions & layers, provisioning other AWS services like Redshift, DynamoDB etc.
• Experience with advanced features like S3 backends and State file locks in Terraform.
• Experienced in implementing Data and Advanced Analytics solutions, or related experience in the Cloud
• Experience in developing an end to end AWS native platform for building Data lakes ( S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool like Tableau run on an EC2 or AWS Quicksight, Athena
• Hands on programming skills in JAVA or Python or Scala or other scripting language.
• Working knowledge of Amazon Web Services
• Experience in Continuous Integration, Continuous Delivery, and Continuous Deployment software tools to support, enhance and grow our CI and CD capabilities
• Understanding of security design for enterprise software systems

Preferred Skills:
• Knowledge of high-availability, load-balancing and failover configurations across application, infrastructure, and platform
• Experience with and/or working knowledge the Financial Industry, Government Agencies, Client Bank Lines of Business (LoBs) Applications
• Working experience with Kubernetes, ConnectDirect, etc.
• Practical experience and knowledge of Service Oriented Architecture (SOA), Mircoservices and API Management
• Background in data security, governance and cybersecurity solutions.

  • Sr. Data Engineer

    1 month ago

    San Francisco, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance...

  • Sr. Data Engineer

    1 month ago

    San Francisco, California, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance tuning Strong...

  • Sr. Data Engineer

    4 days ago

    San Francisco, California, United States SS and C Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • Sr. Data Engineer

    4 days ago

    San Francisco, United States SS and C Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • Sr. Data Engineer

    3 weeks ago

    San Francisco, United States SS&C Technologies Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • Senior Data Engineer

    2 days ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Sr. Specialist, Data Engineering and Science

    2 days ago

    San Diego, United States Sony Electronics, Inc. Full time

    Sony Electronics Inc. is looking for the risk-takers, the collaborators, the inspired and the inspirational. We want the people who are brave enough to work at the cutting edge and create solutions that will enrich and improve the lives of people across the globe. In addition to competitive pay and benefits, we offer an environment and culture that promotes...

  • Sr Backend Engineer

    3 weeks ago

    San Francisco, United States TalentFish Full time

    Job Title: Sr Backend Engineer Primary Location: Remote Position Type: Direct Hire Overview TalentFish is casting a line for a Sr Backend Engineer. This is a remote direct hire role. This is a pivotal technical leadership role, crafting an immersive and user-friendly healthcare app using ReactJS, Firebase, and Node.js. What You Bring To The Role. Bachelor's...

  • Sr. Specialist, Data Engineering and Science

    2 days ago

    San Diego, United States Sony Corporation Full time

    Sony Electronics Inc. is looking for the risk-takers, the collaborators, the inspired and the inspirational. We want the people who are brave enough to work at the cutting edge and create solutions that will enrich and improve the lives of people across the globe. In addition to competitive pay and benefits, we offer an environment and culture that promotes...

  • Sr Renewables SCADA Controls Engineer

    18 hours ago

    San Francisco, United States ThinkBAC Consulting Full time

    Job DescriptionJob DescriptionThis is a remote position.Sr. Energy Storage SCADA Engineer - RenewablesLocation: FULL-TIME REMOTE (Anywhere in the USA)This is an opportunity to join an industry leading renewable energy venture with strong private equity backing that is focused on the development, execution, and operations of dynamic utility-scale energy...

  • Data Analyst

    20 hours ago

    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior Data Engineer

    2 days ago

    San Francisco, United States Tomo Credit Full time

    Job DescriptionJob DescriptionWho We AreAs seen on TechCrunch, Forbes, and Bloomberg, join one of fastest growing areas in FinTech by taking on the credit system. Work directly with one of Inc.’s top female founders and learn from some of the most talented people in the industry. Headquartered in San Francisco, Tomo’s mission is to replace the outdated...

  • AIML - Sr Engineering Program Manager, Data

    4 weeks ago

    San Francisco, California, United States Apple Full time

    SummaryImagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Do you love taking on challenges that create a positive impact? If so, then we want to speak with youAs a member of the AIML Data EPM group, you will be responsible for Apple's ability to use data to power...

  • Sr. Software Engineer

    1 week ago

    San Jose, United States Balbix, Inc. Full time

    ENGINEERING Balbix, Inc. in San Jose, CA seeks Sr. Software Engineer: Design technology architecture for data integrations & connectors. Implement & code for the designed architecture to handle data sources & integrations. Part-time telecommuting allowed. $184,662/yr. - $194,662/yr. Email res (

  • Sr. Software Engineer

    2 weeks ago

    San Jose, United States Balbix Full time

    ENGINEERING Balbix, Inc. in San Jose, CA seeks Sr. Software Engineer: Design technology architecture for data integrations & connectors. Implement & code for the designed architecture to handle data sources & integrations. Part-time telecommuting allowed. $184,662/yr. - $194,662/yr. Email res (...

  • Sr. Software Engineer

    2 weeks ago

    San Jose, United States Balbix, Inc. Full time

    ENGINEERING Balbix, Inc. in San Jose, CA seeks Sr. Software Engineer: Design technology architecture for data integrations & connectors. Implement & code for the designed architecture to handle data sources & integrations. Part-time telecommuting allowed. $184,662/yr. - $194,662/yr. Email res (must reference Job Code #41776) to HR@balbix.com.

  • Sr. Software Quality Engineer

    4 days ago

    San Francisco, United States CyberTec Full time

    Job Title : Sr. Software Quality Engineer - Medical Instruments ( Onsite )Location: San Jose, CA (On site)Job Type : 5 Day OnsiteDuration : 12 monthsOpening : 1 Opening ! MUST HAVES: Flow Cytometry/Medical Instrument testing, Robot, Python and 3 + years as Sr. Quality Engineer.Need to be a quick learner and to contribute and multitask. Must have strong...

  • Sr. Process Engineer

    4 days ago

    San Francisco, United States TRS Staffing Solutions Full time

    Sr. Process Engineer (Life Sciences) All potential candidates should read through the following details of this job with care before making an application. We currently seek a high caliber Sr. Process Engineer for a long-term basis within our clients' team of experienced EPC professionals. Based in South San Francisco, CA. Job Requirements The Sr. Process...

  • Data Engineer

    20 hours ago

    San Francisco, United States Plaid Full time

    We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with...