Data Engineer

2 weeks ago


San Diego, United States ASCENDING LLC Full time

Description:

Top 3 Required Skills:
• Hands-on experience creating automated data pipelines using Pega DataFlow and other modern technology stacks for batch ETL or API
• Hands-on experience with Pega 8.X, Postgres and Cassandra
• Knowledge and experience with configuration, load-balancing, auto-scaling, monitoring, networking, and problem-solving in a cloud environment

Top 3 Desired Skills:
• Load Customer Data into Pega CDH on Pega Cloud, monitor data quality and implement related controls
• Migrate existing ETL for the Pega marketing PaaS solution to a Pega managed service in the cloud, SaaS solution
• Implement integration plans and interface with testing teams to incorporate plans into the integration testing process

Basic Purpose:
Develop technical solutions for importing and ingesting Customer Data into Pega CDH on Pega Cloud. The Data Engineer will be responsible for guiding the design, development, of Navy Federal's Data with a specific focus on Pega DataFlow, and ETL pipelines to support Pega Marketing systems capabilities. Solves highly complex problems; takes a broad perspective to identify solutions. Interacts with other functional teams or projects. Works independently.
 

Responsibilities:
• Load Customer Data into Pega CDH on Pega Cloud, monitor data quality and implement related controls
• Migrate existing ETL for the Pega marketing PaaS solution to a Pega managed service in the cloud, SaaS solution
• Evaluate possible designs, improve methods, and implement optimizations
• Document best practices for data models, data loads, query performance and enforce with other team members
• Implement integration plans and interface with testing teams to incorporate plans into the integration testing process
• Perform data archival
• Create reports to provide insight into ETL execution statistics and status
• Ensure the security and integrity of solutions including compliance with Navy Federal, industry engineering and Information Security principles and practices
• Analyze and validate data sharing requirements within and outside data partners
• Work directly with business leadership to understand data requirements; propose and develop solutions that enable effective decision-making and drives business objectives
Qualifications and Education Requirements:

• Bachelor’s degree in Information Systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training, and experience
• Hands-on experience creating automated data pipelines using Pega DataFlow and other modern technology stacks for batch ETL or API
• Hands-on experience with Pega 8.x, Postgres and Cassandra
• Knowledge and experience with configuration, load-balancing, auto-scaling, monitoring, networking, and problem-solving in a cloud environment
• Experience with processing various file types
• Experienced in the use of ETL tools and techniques and have knowledge of CI/CD
• Very good understanding of SQL (Advanced level)
• Demonstrates change management and/or excellent communication skills
• Pega Cloud experience is desired, but not required


  • Data Engineer

    2 weeks ago


    San Diego, United States Diverse Lynx Full time

    Role: Senior Data Engineer with Snowflake/Informatica IICS or Azure ADF Location: Fontana, CA (Hybrid model / 2-3 days onsite) Duration: 12+ Months Qualifications: 6+ years of professional experience in data & analytics technologies/solutions as data engineer or related roles Proficient level data engineering skills using Cloud Data Platforms -...

  • Data Engineer

    4 weeks ago


    San Diego, United States ASCENDING Full time

    Job DescriptionJob DescriptionDescription:Top 3 Required Skills:• Hands-on experience creating automated data pipelines using Pega DataFlow and other modern technology stacks for batch ETL or API• Hands-on experience with Pega 8.X, Postgres and Cassandra• Knowledge and experience with configuration, load-balancing, auto-scaling, monitoring, networking,...


  • San Diego, California, United States MetroSys Full time

    Responsibilities:Collaborate with stakeholders to understand data migration requirements, including scope, timelines, and specific data sets.Design and develop a comprehensive data migration plan, considering factors such as data volume, complexity, and business continuity.Utilize Komprise data management software to perform assessments, identify target...

  • Data Engineer

    2 weeks ago


    San Diego, United States Spectraforce Technologies Full time

    Position: Data EngineerLocation: Onsite (San Diego, CA)Duration: 12 MonthsJob description: Analyzes complex business problems to be solved with automated systems. Provides technical expertise in identifying, evaluating and developing systems and procedures that are cost effective and meet user requirements. Configures system settings and options; plans and...

  • Data Engineer

    3 weeks ago


    San Diego, California, United States MSIT Full time

    Responsibilities Develop and operate data management tools monitoring data flows data quality data cleansing and data processing. Create and document logical data integration strategies for data flows between disparate systems and the enterprise data warehouse/data lakes. Collaborate with different stakeholders to collect required data from internal and...


  • San Diego, California, United States ServiceNow Full time

    Job Description Team: We are seeking a Manager, Software Engineering to grow and lead our Data Streaming team for in-office flex in our San Diego office.   The Data Streaming group has teams that provide streaming API for higher-layer applications and/or work to scale our application platforms. Depending on the nature of the data, the storage systems...

  • Cloud Data Engineer

    2 weeks ago


    San Diego, United States Sayva Solutions Full time

    About the Opportunity: Our client is seeking an Cloud Data Engineer (Azure) who will work collaboratively with the data team responsible for supporting, modernizing and transforming their data and reporting capabilities across the company`s products by implementing a new modernized data architecture. Salary: $130-150k base salary Responsibilities: •...


  • San Diego, United States ActioNet Full time

    Description ActioNet has an immediate opportunity for a Telecommunications Engineer - Voice, Video, Data requiring a Secret clearance located in San Diego, CA. ActioNet is an IT service provider and solutions integrator headquartered in Vienna, VA that works with the Federal Government and Department of Defense. The Voice, Video, Data Telecommunications...


  • San Diego, United States ActioNet Full time

    Description ActioNet has an immediate opportunity for a Telecommunications Engineer - Voice, Video, Data requiring a Secret clearance located in San Diego, CA. ActioNet is an IT service provider and solutions integrator headquartered in Vienna, VA that works with the Federal Government and Department of Defense. The Voice, Video, Data Telecommunications...


  • San Diego, United States ActioNet Full time

    Description ActioNet has an immediate opportunity for a Telecommunications Engineer - Voice, Video, Data requiring a Secret clearance located in San Diego, CA. ActioNet is an IT service provider and solutions integrator headquartered in Vienna, VA that works with the Federal Government and Department of Defense. The Voice, Video, Data Telecommunications...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...


  • San Diego, California, United States ServiceNow Full time

    Job Description You will be part of the ServiceNow Cloud Services Big Data Team.  The Big Data team is building the next-generation platform that collects, stores and provides real-time access to large amounts of data. You will also build real-time analytic tools and reporting capabilities for various purposes including: Monitoring, alerting and...

  • Data Architect

    5 days ago


    San Diego, United States Insight Global Full time

    An employer in Mexico is looking for a Senior Data Architect. This person will be joining the Enterprise Data Architecture and Platform vertical and will be part of a team that is essential in defining and delivering the Data and Analytics based insights that can be leveraged by business teams throughout the retail organization. This person will be...

  • Data Engineer

    2 weeks ago


    San Francisco, United States Triune Infomatics Inc Full time

    Role: Data Engineer Location: Hybrid in Pleasanton, CA Duration: 6 months Areas of Responsibility Include: • Build test and implement Data Engineering - ETL, Data Integrations, Data Governance, Data Quality. • Build reusable Data Engineering assets and frameworks. • Identify opportunities to use existing data from multiple sources to inform data...

  • Test Engineer

    2 weeks ago


    San Jose, United States Data Electronic Devices Full time

    Job DescriptionJob DescriptionBestronics (an Emerald Technologies company) has an exciting opportunity for a Test Engineer to join our team! This exciting opportunity involves analyzing and identifying customer test requirements, as well as establishing test plans, routes, and times for initial and production builds.At Emerald Technologies each employee has...

  • Data Analyst

    2 weeks ago


    San Diego, United States Diverse Lynx Full time

    Role: Data Analyst Contract Locations: San Diego, CADescription: Role name: Senior Engineer Role Description: Data Analyst Strong SQL, statistics and Python knowledge - Experience analyzing large datasets - Experience with statistical decision making systems a big plus Competencies: Informatica Powercentre, Digital : Python Web Frameworks, Digital : Python...

  • Data Engineer

    4 weeks ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    2 weeks ago


    San Jose, United States RIT Solutions, Inc. Full time

    Job Description: Responsibilities: - Architect, develop, and maintain scalable data pipelines and ETL processes, facilitating the seamless flow of data across our ecosystem. - Collaborate closely with cross-functional teams to gather requirements, identify data sources, and deliver solutions aligned with business objectives. - Harness the power of SQL...


  • San Diego, CA, United States ActioNet Full time

    DescriptionActioNet has an immediate opportunity for a Telecommunications Engineer - Voice, Video, Data requiring a Secret clearance located in San Diego, CA. ActioNet is an IT service provider and solutions integrator headquartered in Vienna, VA that works with the Federal Government and Department of Defense. The Voice, Video, Data Telecommunications...

  • Systems Engineer

    5 days ago


    San Diego, United States TUG Full time

    Job DescriptionJob DescriptionTechnology Unlimited Group (TUG) seeks a highly motivated System Engineer who will be responsible for the creation of network interoperability concepts and prototypes for networks formed from multiple mobile platforms using RF links. The Systems Engineer will be part of a team of system/software engineering professionals...