Sr. Data Reliability Engineer

1 week ago


San Antonio, United States Solugenix Full time

Sr. Data Reliability Engineer

San Antonio, TX or Irvine, CA (Hybrid - 3 days onsite)

Contract with potential to convert to FTE

Job ID 24-09149


Solugenix is assisting a client, a prestigious and large investment management company in their search for a Sr. Data Reliability Engineer.


We are currently seeking a highly skilled Data Reliability Engineer to join our team. This role requires a blend of expertise in data pipeline technologies and Site Reliability Engineering (SRE) principles to ensure the highest standards of data reliability and system performance.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.
  • Proven experience as a Data Engineer, Data Reliability Engineer, or in a similar role in an SRE environment.
  • Demonstrable experience with end-to-end monitoring of data pipelines and implementing reliability in data systems.

Responsibilities:

  • Design, build, and maintain the infrastructure and data pipelines to support data transformation, data structures, metadata, dependency, and workload management.
  • Develop and maintain scalable, reliable, and cost-effective data solutions using AWS technologies and big data tools like Databricks, Airflow, and Dremio.
  • Implement robust monitoring and alerting systems using tools such as Datadog to ensure proactive management of the production environments.
  • Work closely with data scientists and analytics teams to engineer and optimize data models using DBT (Data Build Tool) and ensure seamless data flow across all segments.
  • Enhance data validation and data quality metrics integration within data pipelines to ensure accuracy and reliability of data.
  • Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.
  • Handle the deployment of additional AWS services such as Lambda functions and manage data storage solutions.
  • Collaborate with IT and DevOps teams to enhance system performance and reliability through AWS solutions such as SNS, SQS, and Elastic Load Balancer.
  • Engage in continuous improvement efforts to enhance performance and provide increased functionality across data platforms.
  • Provide support and mentorship to offshore teams, ensuring best practices in coding, testing, and deployment are followed.
  • Troubleshoot complex issues across multiple databases and work with various stakeholders to ensure robust architecture and operational standards are maintained.

Mandatory Skills:

  • Strong proficiency in Apache Airflow, Python programming, and AWS cloud services.
  • Experience with real-time monitoring tools such as Datadog.
  • Expertise in data transformation tools like DBT and Dremio.
  • Strong experience with Databricks and AWS Lambda.
  • Excellent verbal and written communication skills, capable of working with cross-functional teams and managing relationships with business stakeholders.

Nice to Have Skills:

  • Familiarity with AWS services such as SNS, SQS, Elastic Load Balancer, CodeBuild, CodePipeline, ECR, and EKS.
  • Experience with both Linux and Windows operating systems.
  • Knowledge of Microsoft Azure Data Lake, Synapse, and additional Python scripting.


Pay Range for CA, CO, IL, NJ, NY, WA, and DC: $70/hour to $85/hour. Starting rate of pay offered may vary depending on factors including but not limited to, position offered, location, education, training, and/or experience.


Solugenix will consider qualified applicants with a criminal history pursuant to the California Fair Chance Act and Ordinance. Applicants do not need to disclose their criminal history or participate in a background check until a conditional job offer is made to you. After making a conditional offer and running a background check, if we are concerned about conviction that is directly related to the job, applicants will be given the chance to explain the circumstances surrounding the conviction, provide mitigating evidence, or challenge the accuracy of the background report.


About the Client

Our client is an American financial services company. It ranks among the world's oldest and largest investment management organizations. They have offices globally.


About Solugenix

Solugenix is an information technology services company known for its deep experience and knowledge in providing comprehensive technology services, solutions, and talent support for companies around the world. The company offers a variety of cutting edge and talent support solutions to promote growth and cutting-edge advancement to our esteemed clients and candidates. We provide these talent support solutions on a contract, contract-to-hire, and direct hire basis. We also have additional resources from our staffing partners to ensure the right match and expertise for the best result.

For over 50 years, global and local brands have trusted Solugenix as an added resource and partner in taking steps to ensure their immediate and future success. In addition to generating ground-breaking, industry-defining solutions, Solugenix has been delivering the talent and support needed to make it happen. We are dedicated to partnering with clients and candidates whose core values also foster a culture of professionalism, teamwork, and integrity.



  • San Antonio, United States Solugenix Corporation Full time

    Sr. Data Reliability Engineer San Antonio, TX or Irvine, CA (Hybrid - 3 days onsite) Contract with potential to convert to FTE Job ID Solugenix is assisting a client, a prestigious and large investment management....


  • San Antonio, United States Solugenix Full time

    Sr. Data Reliability Engineer San Antonio, TX or Irvine, CA (Hybrid - 3 days onsite) Contract with potential to convert to FTE Job ID 24-09149Solugenix is assisting a client, a prestigious and large investment management company in their search for a Sr. Data Reliability Engineer. We are currently seeking a highly skilled Data Reliability Engineer to join...


  • San Antonio, United States Sunoco LP Full time

    Sunoco LP is a leading energy infrastructure and fuel distribution master limited partnership operating across 47 U.S. states, Puerto Rico, Europe, and Mexico. The Partnership's midstream operations include an extensive network of approximately 9,500 miles of pipeline and over 100 terminals. This critical infrastructure complements the Partnership's fuel...

  • Sr. Data Engineer

    3 months ago


    San Francisco, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance...

  • Sr. Data Engineer

    3 months ago


    San Francisco, California, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance tuning Strong...


  • San Diego, United States Mentis Systems Full time

    Hi, We have an IMMEDIATE need for Sr. Systems / Reliability Engineer with Becton Dickinson, which suits your profile, Please ,can you go through the below project details and let me know a good time to talk ? Title: Sr. Systems / Reliability Engineer ID: CFNJP00049291 Duration: 12+ months Contract Location: Hybrid/San Diego CA Job Description Join a...


  • San Jose, United States Antora Energy Full time

    At Antora, we're on a mission to stop climate change. And we can't do that unless we tackle the 30% of global emissions that come from industry. Antora is unlocking zero-emissions industrial energy, cheaper than fossil fuels. Antora's thermal batteries store energy from renewables as heat for days on end, delivering that stored energy as heat and power at...


  • San Jose, United States Antora Energy Full time

    At Antora, we're on a mission to stop climate change. And we can't do that unless we tackle the 30% of global emissions that come from industry. Antora is unlocking zero-emissions industrial energy, cheaper than fossil fuels. Antora's thermal batteries store energy from renewables as heat for days on end, delivering that stored energy as heat and power at...


  • San Jose, United States Antora Energy Full time

    At Antora, we're on a mission to stop climate change. And we can't do that unless we tackle the 30% of global emissions that come from industry. Antora is unlocking zero-emissions industrial energy, cheaper than fossil fuels. Antora's thermal batteries store energy from renewables as heat for days on end, delivering that stored energy as heat and power at...


  • San Jose, United States Antora Energy Full time

    Job DescriptionJob DescriptionAt Antora, we're on a mission to stop climate change. And we can't do that unless we tackle the 30% of global emissions that come from industry.Antora is unlocking zero-emissions industrial energy, cheaper than fossil fuels. Antora's thermal batteries store energy from renewables as heat for days on end, delivering...


  • San Jose, United States Antora Energy Full time

    Job DescriptionJob DescriptionAt Antora, we're on a mission to stop climate change. And we can't do that unless we tackle the 30% of global emissions that come from industry.Antora is unlocking zero-emissions industrial energy, cheaper than fossil fuels. Antora's thermal batteries store energy from renewables as heat for days on end, delivering...


  • San Diego, United States Mentis Systems Full time

    Job DescriptionJob DescriptionHi,We have an IMMEDIATE need for Sr. Systems / Reliability Engineer with Becton Dickinson, which suits your profile, Please ,can you go through the below project details and let me know a good time to talk ?Title: Sr. Systems / Reliability EngineerID: CFNJP00049291 Duration: 12+ months Contract Location: Hybrid/San Diego CAJob...


  • San Leandro, California, United States NTT DATA Services Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Site Reliability Engineer (FTE / Hybrid) to join our team in San Leandro, California (US-CA), United States (US). Job Duties...


  • San Lorenzo, United States NTT DATA Full time

    Req ID: 294054 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Site Reliability Engineer (FTE / Hybrid) to join our team in San Leandro , California (US-CA) , United States (US) ....


  • San Jose, United States Rambus Full time

    Overview Rambus, a premier chip and silicon IP provider, is seeking to hire an exceptional Principal Reliability Engineer to join our Operations team in San Jose, CA. Candidates will be joining some of the brightest inventors and engineers in the world to develop products that make data faster and safer. As a Principal Reliability Engineer, the candidate...


  • San Leandro, United States NTT DATA Full time

    Req ID: 294054NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Site Reliability Engineer (FTE / Hybrid) to join our team in San Leandro, California (US-CA), United States (US).Job...


  • San Jose, United States Activate Global, Inc. Full time

    At Antora, we’re on a mission to stop climate change. And we can’t do that unless we tackle the 30% of global emissions that come from industry. Antora is unlocking zero-emissions industrial energy, cheaper than fossil fuels. Antora’s thermal batteries store energy from renewables as heat for days on end, delivering that stored energy as heat and power...


  • San Diego, United States Mentis Systems Full time

    Job DescriptionJob DescriptionTitle: Sr. Systems / Reliability EngineerDuration: 12+ months Contract Location: Hybrid/San Diego CAJob Description: Join a New Product Development project at BD! A Systems /Reliability Engineer in this role is responsible for using their broad technical expertise, leadership skills, and product development knowledge to provide...


  • San Jose, United States Rambus Full time

    Rambus, a premier chip and silicon IP provider, is seeking to hire an exceptional Principal Reliability Engineer to join our Operations team in San Jose, CA. Candidates will be joining some of the brightest inventors and engineers in the world to develop products that make data faster and safer. As a Principal Reliability Engineer, the candidate will be...


  • San Jose, United States Western Digital Full time

    Job DescriptionJob DescriptionCompany DescriptionWhether in your pocket, home, car, or the cloud, it’s likely that Western Digital is with you every step of the way. Advanced Reliability Engineering’s (ARE) mission is to develop and deploy reliability assurance methods that are industry-leading and cover the end-to-end product life cycle for Western...