Senior Data Engineer

1 month ago

Irvine, United States CivicMinds, Inc Full time

Role Description:

Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases.

Role Responsibility:

• Translate functional specifications and change requests into technical specifications

• Translate business requirement document, functional specification, and technical specification to related coding

• Develop efficient code with unit testing and code documentation

• Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving

• Setting up the development environment and configuration of the development tools

• Communicate with all the project stakeholders on the project status

• Manage, monitor, and ensure the security and privacy of data to satisfy business needs

• Contribute to the automation of modules, wherever required

• To be proficient in written, verbal and presentation communication (English)

• Co-ordinating with the UAT team

Role Requirement:

• Proficient in basic and advanced DBT-SQL programming concepts (Procedures, Analytical functions etc.)

• Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)

• Knowledgeable in Shell / PowerShell scripting

• Knowledgeable in relational databases, nonrelational databases, data streams, and file stores

• Knowledgeable in performance tuning and optimization

• Experience in Data Profiling and Data validation

• Experience in requirements gathering and documentation processes and performing unit testing

• Understanding and Implementing QA and various testing process in the project

• Knowledge in any BI tools will be an added advantage

• Sound aptitude, outstanding logical reasoning, and analytical skills

• Willingness to learn and take initiatives

• Ability to adapt to fast-paced Agile environment

Additional Requirement:

• Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Snowflake, ensure the effective transformation and load data from diverse sources into data warehouse or data lake.

• Implement and manage data models in DBT, guarantee accurate data transformation and alignment with business needs.

• Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting.

• Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance.

• Establish best DBT processes to improve performance, scalability, and reliability.

• Expertise in SQL and a strong understanding of Data Warehouse concepts and Modern Data Architectures.

• Familiarity with cloud-based platforms (e.g., AWS, Azure, GCP).

• Migrate legacy transformation code into modular DBT data models.

  • Senior Data Engineer

    6 days ago

    Irvine, United States Convertible Full time

    Job DescriptionJob DescriptionAt Convertible, we leverage data to drive intelligent decision-making and optimize operations across various industries. Our Senior Data Engineers play a crucial role in designing and implementing robust data infrastructure that enables organizations to harness the full potential of their data assets.About the RoleWe are seeking...

  • Senior Data Engineer

    1 month ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Senior Data Engineer

    1 month ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • AWS Data Engineer

    7 hours ago

    Irvine, United States NextXap, Inc. Full time

    Role: AWS Data EngineerLocation: Irvine, CA (Onsite)Requirements:7+ years of experience as a Senior Data Engineer AWS, including designing and implementing complex Cloud applications5+ years of experience working with AWS - RDS, S3, Step Functions, Glue, Lambda, Athena, IAM, Codepipeline, Cloudformation, SNS, SQSShould be proficient in followingPostgreSql,...

  • Senior Mechanical Engineer

    7 days ago

    Irvine, United States Cluster Full time

    This company was founded to advance the technology necessary for humanity's future beyond Earth. They're developing low-earth-orbit spacecraft for space operations and data collection, emphasizing cost-effective high-performance space transport. Their upcoming mission in June 2024, marks significant steps toward this vision.They are looking for a Senior...

  • Senior Architect

    4 weeks ago

    Irvine, California, United States Publicis Sapient Full time

    Job Description Sr Manager, Data Engineering Publicis Sapient is looking for a Sr Manager of Data Engineering to lead top-notch technologists to enable real business outcomes for our enterprise clients. You will create impact for some of the world’s biggest brands, by translating their needs into transformative solutions that provide valuable insight....

  • Senior Mechanical Engineer

    4 weeks ago

    Irvine, United States Cluster Full time

    Job DescriptionJob DescriptionThis company was founded to advance the technology necessary for humanity's future beyond Earth. They're developing low-earth-orbit spacecraft for space operations and data collection, emphasizing cost-effective high-performance space transport. Their upcoming mission in June 2024, marks significant steps toward this...

  • Senior Software Engineer

    1 day ago

    Irvine, United States RXMG Full time

    RXMG is a California-based digital advertising company that employs our state-of-the-art analytical and consumer intelligence platform to match people with the products they need to enrich their financial well-being. RXMG delivers campaign optimization and data monetization through multiple channels and proprietary websites, primarily in the finance...

  • Senior Engineer

    1 day ago

    Irvine, United States RPMGlobal Full time

    Transforming the Future with Convergence of Simulation and Data Senior Engineer (Chassis) Job Summary: Our client in Irvine, CA is looking for a Senior Engineer (Chassis). This is a contract position. What You Will Do: This position will support concept design, design maturation, packaging, analysis and validation activity for spare wheels, spare tires,...

  • Senior Cloud Engineer

    5 days ago

    Irvine, United States Solugenix Full time

    Job DescriptionJob DescriptionSenior Cloud EngineerIrvine, CA or San Antonio, TX (Hybrid)Long Term ContractJob ID 2024-9848Solugenix is assisting a client, a prestigious and large investment management company in their search for a Senior Cloud Engineer. This is a long-term contract opportunity based out of Irvine, CA/San Antonio, TX (Hybrid).We are seeking...

  • Senior Engineer

    6 days ago

    Irvine, United States Premier Staffing Solution Full time

    Senior Engineer (Chassis) Location: Irvine, CA Job Category: Engineering Position Type: Contractor (W-2) Job Description Position Purpose This position will support concept design, design maturation, packaging, analysis and validation activity for spare wheels, spare tires, jacks, service kits, temporary mobility kits (compressors and sealants) and other...

  • Senior Data Insights Analyst

    1 week ago

    Irvine, California, United States Endpoint Full time

    Endpoint is looking for an ambitious Senior Data Insights Analyst to join our Insights & Analytics team. As a key member of the team, you will collaborate with Product, Operations, Revenue, and Business Development teams to draw insights from our data and provide business recommendations. Along with demonstrating technical and analytical skills, you will...

  • Senior Cloud Engineer

    3 days ago

    Irvine, United States Solugenix Full time

    Senior Cloud Engineer Irvine, CA or San Antonio, TX (Hybrid) Long Term Contract Job ID 2024-9848Solugenix is assisting a client, a prestigious and large investment management company in their search for a Senior Cloud Engineer. This is a long-term contract opportunity based out of Irvine, CA/San Antonio, TX (Hybrid).We are seeking two highly skilled Senior...

  • Senior Cloud Engineer

    3 days ago

    Irvine, United States Solugenix Full time

    Senior Cloud Engineer Irvine, CA or San Antonio, TX (Hybrid) Long Term Contract Job ID 2024-9848Solugenix is assisting a client, a prestigious and large investment management company in their search for a Senior Cloud Engineer. This is a long-term contract opportunity based out of Irvine, CA/San Antonio, TX (Hybrid).We are seeking two highly skilled Senior...

  • Senior Cloud Engineer

    3 days ago

    Irvine, United States Solugenix Full time

    Senior Cloud Engineer Irvine, CA or San Antonio, TX (Hybrid) Long Term Contract Job ID 2024-9848Solugenix is assisting a client, a prestigious and large investment management company in their search for a Senior Cloud Engineer. This is a long-term contract opportunity based out of Irvine, CA/San Antonio, TX (Hybrid).We are seeking two highly skilled Senior...

  • Senior Cloud Engineer

    9 hours ago

    Irvine, United States Solugenix Corporation Full time

    Overview: Senior Cloud Engineer Irvine, CA or San Antonio, TX (Hybrid) Long Term Contract Job ID 2024-9848 Solugenix is assisting a client, a prestigious and large investment management company in their search for a Senior Cloud Engineer. This is a long-term contract opportunity based out of Irvine, CA/San Antonio, TX (Hybrid). We are seeking two highly...

  • Senior Site Reliability Engineer

    1 day ago

    Irvine, United States Rx Marketing Group Full time

    RXMG, a California-based digital advertising company, utilizes state-of-the-art analytical and consumer intelligence platforms to enhance individuals' financial well-being. Specializing in campaign optimization and data monetization within the finance vertical, RXMG is expanding its team with talented, passionate, and visionary individuals. Competitive...

  • Senior Electrical Engineer

    4 weeks ago

    Irvine, United States ContractTECH Inc Full time

    Healthcare - Irvine or Long Beach Senior Level Mechanical Engineer at our office in Irvine, CA, or Long Beach office - you could be a perfect fit. If you meet the qualifications below. Level: Senior General Responsibilities As a competent registered professional engineer, the candidate performs work involving the application of all conventional aspects of...

  • Senior Firmware Engineer

    4 days ago

    Irvine, United States Cryoport Systems Inc Full time

    POSITION SUMMARY The Senior Firmware Engineer possesses a full range of responsibilities to evolve and support Cryoport’s next generation of asset tracking/medical devices through a strong understanding of algorithm, data structure. From incorporating cutting edge technologies to designing robust customer centric solutions that scale, the Senior Firmware...

  • Senior Cloud Engineers

    6 days ago

    Irvine, United States IT MINDS L.L.C. Full time

    Job DescriptionJob DescriptionJob Title: Senior Cloud Engineer (SRE)Location: Irvine, CA preferred. But we can also consider San Antonio, TX for one of them.Onsite: Hybrid (at least 3 days a week)Job Overview:We are seeking two highly skilled Senior Cloud Engineers (SRE) to join our dynamic cloud operations team. The ideal candidates will possess in-depth...