Senior Data Engineer

2 weeks ago


Irvine, United States Authority Partners Full time

Authority Partners is seeking an experienced Data Engineer to join our team. You will design, expand, and optimize data pipelines and architectures to support cross-functional teams. The ideal candidate is skilled in building and enhancing data systems, supporting developers, analysts, and scientists, and ensuring seamless data delivery across projects.  Up for the challenge? Then read on and apply Responsibilities: Design, build, and maintain reliable and scalable data pipelines for ingesting, transforming, and delivering structured and unstructured data. Implement batch and streaming data workflows that support real-time and analytical use cases. Optimize data flows for performance, cost-efficiency, and maintainability. Develop and maintain data models that support business intelligence, analytics, and operational needs. Ensure effective partitioning, indexing, and data lifecycle management strategies. Collaborate with analysts and business stakeholders to understand data requirements and deliver high-quality datasets and data products. Implement data quality checks, monitoring, and validation processes to ensure data accuracy and integrity. Ensure compliance with relevant data governance, security, and privacy standards. Monitor and troubleshoot data pipelines and systems to ensure reliability and high availability. Design and develop interactive dashboards and reports that provide actionable insights to stakeholders, ensuring data is presented in a clear, intuitive, and visually compelling manner. What you have: Strong experience with Databricks for building scalable data pipelines and transformation workflows. Hands-on experience with PySpark for distributed data processing. Strong proficiency in SparkSQL for data transformation and analysis. Solid understanding of data pipelines and data modelling. You stand out if you have: Experience working with Azure cloud services. Working knowledge of Databricks Dashboards. Exposure to data visualization tools (Power BI, Tableau, Looker). Experience with CI/CD pipelines for data engineering workflows. Working knowledge of Microsoft Fabric and Dynamics 365 Finance and Operations. Education: Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field About Authority Partners: Authority Partners is a leading and global IT services company with over 25 years of experience, serving clients within the financial, healthcare, insurance, mortgage, and technology sectors among many others. We are committed to building relationships with IT professionals who possess integrity, dedication, teamwork, and the desire to learn and grow with us. We specialize in placement for long-term contracts and permanent opportunities and helping our consultants achieve their career success. AP Testimony: "I started out as an intern at Authority Partners during my last semester of college and immediately felt welcomed and accepted as a family member. Upon graduating, I found myself in my first full-time opportunity to work in a healthy environment with amazing people from whom I learn a lot. I am very grateful to be able to do something I enjoy while progressing professionally and personally." - Emina Hadzic, QA Engineer Authority Partners is an equal opportunity employer and is committed to providing a workplace that is free from all types of discrimination, as well as from abusive or offensive behavior and harassment.


  • Senior Data Engineer

    4 weeks ago


    Irvine, United States D.A. Davidson & Co. Full time

    1 week ago Be among the first 25 applicants D.A. Davidson Companies provided pay range This range is provided by D.A. Davidson Companies. Your actual pay will be based on your skills and experience talk with your recruiter to learn more. Base pay range $110,000.00/yr - $150,000.00/yr D.A. Davidson Companies is an independent, employee-owned company with a...


  • Irvine, United States Executive Placements, LLC. Full time

    1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Authority Partners is looking for a QA Engineer with strong data testing expertise to ensure the reliability, accuracy, and performance of our data pipelines, models, and dashboards. The ideal candidate will have experience testing ETL/ELT processes,...


  • Irvine, United States ExecutivePlacements.com Full time

    1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Authority Partners is looking for a QA Engineer with strong data testing expertise to ensure the reliability, accuracy, and performance of our data pipelines, models, and dashboards. The ideal candidate will have experience testing ETL/ELT processes,...


  • Irvine, United States Mantek Solutions, Inc. Full time

    Senior Data/AI Engineer Remote 6 months Contract to Hire Those authorized to work in the U.S. without sponsorship will be considered. We are not able to sponsor at this time. Our client does not offer H-1B sponsorship for this position. Education Bachelor's degree in computer science or a related field. Minimum Experience Minimum 5 years of experience in...

  • Data Engineer

    4 weeks ago


    Irvine, United States jobright.com Full time

    Join to apply for the Data Engineer role at Jobright.ai 2 days ago Be among the first 25 applicants Join to apply for the Data Engineer role at Jobright.ai Get AI-powered advice on this job and more exclusive features. Jobright is an AI-powered career platform that helps job seekers discover the top opportunities in the US. We are NOT a staffing agency....


  • Irvine, United States WeVision LLC Full time

    A consulting firm is seeking a Senior Software Engineer in California to contribute to the Ads Data organization. Responsibilities include designing and developing scalable data platforms, driving best practices in engineering, and collaborating with cross-functional teams. Candidates should have over 5 years of programming experience, a strong background in...

  • Data Engineer

    6 days ago


    Irvine, CA, United States Insight Global Full time

    An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and...

  • Data Engineer

    4 days ago


    Irvine, CA, United States Insight Global Full time

    An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and...

  • Data Engineer

    19 hours ago


    Irvine, CA, United States Insight Global Full time

    An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and...

  • Data Engineer

    14 hours ago


    Irvine, CA, United States Insight Global Full time

    An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and...