Sr Data Engineer

3 weeks ago

Philadelphia, United States HealthVerity Full time

Position: Data Engineer Reporting to: Director, Data Engineering Location: Philadelphia, PA How you will help As a data engineer on the data platform team, you will be supporting and enhancing the platform that supports HealthVerity's Petabyte-scale core data asset. You will work closely with other engineers, data scientists, and business leaders to ensure that our data platform is available, secure, and reliable. You will use your strong engineering and product mindset to understand business needs and develop scalable engineering solutions that support HealthVerity's product roadmap and vision while continuously looking for opportunities to simplify, automate tasks, and build reusable components. * What you will do * Engineer efficient, adaptable and scalable data pipelines to process structured and unstructured data Develop and maintain data pipelines to efficiently process and analyze large amounts of streaming data Collaborate with other data engineers to maintain a cohesive and standardized data infrastructure Work closely with the software engineering team to integrate data pipelines into the overall platform architecture Collaborate with cross-functional teams including software engineers, data scientists, product managers, and analysts to understand data needs and deliver valuable platform enhancements that support the overall HealthVerity vision and roadmap. Identify and implement solutions to optimize data storage, retrieval, and processing Continuously evaluate and improve data engineering processes and systems to increase efficiency and scalability Stay up-to-date with emerging technologies and industry trends in data engineering Ensure data security and compliance with privacy regulations Troubleshoot and resolve data-related issues in a timely manner Leverage large-scale distributed computing and serverless architecture including Spark, AWS Lambda, etc. to develop pipelines for transforming data Partner with the product teams to understand product goals and provide data that enables us to respond to customer and regulatory data requests Monitor data quality and proactively identify and resolve data issues Required skills and experience You are proficient in at least one primary language (e.g., Java, Scala, Python) and Advanced SQL (any variant) ```{=html} ``` - *You have a product mindset to understand business needs and develop scalable engineering solutions. * *You are always looking for opportunities to simplify, automate tasks, and build reusable components across multiple use cases and teams. * *You have strong communication skills to collaborate with cross-functional partners and drive projects. You are curious and eager to work across a variety of engineering specialties (i.e., Data Science, Data Engineering, and Machine Learning to name a few). * You have an eye for detail and like to spark joy amongst your partners with well-documented high-quality data products that are modeled and easy to understand. You are able to successfully lead large, complex systems design and implementation challenges independently You have a strong knowledge of Databricks features and functionalities, such as Unity Catalog, Audit Logs, Databricks SQL and Delta Live Tables *Experience with CI/CD pipelines and DataOps * Experience using Infrastructure as Code (IaC) tools, such as Terraform, YAML, and Helm Charts *You have 8+ years of industry experience and proficiency in building distributed data pipelines for both batch and real-time (experience with Databricks, Spark, Hive, Iceberg, Kafka, Snowflake is helpful, but not strictly required). * You have experience with Databricks pipeline automation, AWS EMR, AWS S3 service AWS Services Snowflake, Spark, Docker.

  • Sr Data Scientist

    6 days ago

    Philadelphia, United States Motion Recruitment Full time

    A large truck rental agency is looking for a contract Sr Data Scientist to join their team through the end of the year with possibility of extension or conversion. This company offers state-of-the-art transportation and distribution solutions to help customers stay on track and avoid supply chain disruptions. Their data science teams work across various...

  • Sr Data Scientist

    1 week ago

    Philadelphia, Pennsylvania, United States Motion Recruitment Full time

    A large truck rental agency is looking for a contract Sr Data Scientist to join their team through the end of the year with possibility of extension or conversion. This company offers state-of-the-art transportation and distribution solutions to help customers stay on track and avoid supply chain disruptions.Their data science teams work across various...

  • Sr Data Engineer

    2 weeks ago

    Philadelphia, United States codesbright Full time

    Responsibilities Develop and maintain database architectures data schemas and data integration processes. Conduct performance tuning troubleshooting and data quality checks to guarantee the accuracy reliability and availability of data. Collaborate with software engineers to integrate data-driven capabilities into applications. Stay up-to-date with...

  • Sr Data Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States codesbright Full time

    Responsibilities Develop and maintain database architectures data schemas and data integration processes. Conduct performance tuning troubleshooting and data quality checks to guarantee the accuracy reliability and availability of data. Collaborate with software engineers to integrate data-driven capabilities into applications. Stay up-to-date with emerging...

  • Sr. Network Engineer

    3 weeks ago

    Philadelphia, Pennsylvania, United States Okaya Power Group Full time

    Hello,Position: Sr. Network EngineerDuration: 12+ Months (eligible to convert full time after 90 days)Location: Philadelphia, PA(3 Days onsite required)Interview: Phone & VideoQualifications:• BS in Electrical Engineering, Computer Science/Engineering, or equivalent.• 7+ years of Data Network experience preferred• In-depth knowledge of Cisco Switching...

  • Sr Network Engineer

    1 week ago

    Philadelphia, United States Motion Recruitment Full time

    An incident response company is looking to add a Sr Network Engineer to their team. This is a remote role with occasional client travel needed. As the Sr Network engineer you will be using your expertise in routing and switching setups, as well as network design, Cisco, Juniper, and Aruba technologies. Your proficiency with Palo Alto, Fortinet, and Cisco...

  • Sr Network Engineer

    1 week ago

    Philadelphia, United States Motion Recruitment Partners, LLC Full time

    An incident response company is looking to add a Sr Network Engineer to their team. This is a remote role with occasional client travel needed. As the Sr Network engineer you will be using your expertise in routing and switching setups, as well as network design, Cisco, Juniper, and Aruba technologies. Your proficiency with Palo Alto, Fortinet, and Cisco...

  • Sr NLP Engineer

    2 days ago

    Philadelphia, Pennsylvania, United States Motion Recruitment Full time

    A leading Data & Analytics company is looking for a contract Sr NLP Engineer to join their team. As a provider of legal, government, business and high-tech information source, this company combines information, analytics, and technology to promote a more just world.In this role, you will lead the design, development, and implementation of NLP algorithms and...

  • Sr NLP Engineer

    7 days ago

    Philadelphia, United States Motion Recruitment Full time

    A leading Data & Analytics company is looking for a contract Sr NLP Engineer to join their team. As a provider of legal, government, business and high-tech information source, this company combines information, analytics, and technology to promote a more just world.In this role, you will lead the design, development, and implementation of NLP algorithms and...

  • Sr NLP Engineer

    6 hours ago

    Philadelphia, United States Motion Recruitment Full time

    A leading Data & Analytics company is looking for a contract Sr NLP Engineer to join their team. As a provider of legal, government, business and high-tech information source, this company combines information, analytics, and technology to promote a more just world. In this role, you will lead the design, development, and implementation of NLP algorithms...

  • Sr. Network Engineer

    15 hours ago

    Philadelphia, United States InSource, Inc Full time

    Sr. Network Engineer Philadelphia, PA 19103Hybrid role (onsite every Tuesday-Wednesday-Thursday), local candidates onlyContract-to-HirePay range: $70/hour - $73/hour on W2NO C2C/NO 3rd party/NO Visa candidatesSend resume to: asim.ghosh@insourcenow.comJob SummaryThe Senior Network Engineer role is to ensure the stability and integrity of the organization’s...

  • Sr/Engineer - Design Review

    1 week ago

    Philadelphia, Pennsylvania, United States Amtrak Full time

    SUMMARY OF DUTIES:The Design Review Engineer is responsible for managing the design review process for major capital in-house projects, as well as external third-party projects, to ensure that the project design documents are in compliance with all Amtrak Corporate and Engineering Department standards, policies, and procedures. The Design Review Engineer is...

  • Sr. Systems Engineer

    4 weeks ago

    Philadelphia, United States Resource Informatics Group Inc Full time

    Job DescriptionJob DescriptionPosition: Sr. Systems Engineer (with AWS experience)Duration: 1+ yearsLocation: Philadelphia, PA Position overview:Seeking a Sr. Systems Engineer that will be responsible for coordinating and performing migrations of applications to servers with upgraded operating systems. This role will also be responsible for administering...

  • Sr. Mechanical

    10 hours ago

    Philadelphia, United States Penn Technical Staffing Full time

    A well-respected national MEP engineering firm is seeking a Sr. Mechanical Engineer to work in their Life Sciences group located in Philadelphia, PA. Hybrid schedule - 3 days in the office, 2 works remote. This person will be responsible designing a variety of HVAC systems as well as developing mechanical and plumbing drawings and specifications to meet the...

  • Sr. Azure Cloud Engineer

    5 days ago

    Philadelphia, United States Partner's Consulting Inc Full time

    Title: Sr. Azure Cloud Engineer Location: Philadelphia, PA Type: Contract to Hire Our client is seeking a Sr. Azure Cloud Engineer who will play a key role in migrating and transforming legacy solutions to the cloud. Description Looking for dynamic individuals who love to learn, thrive on innovation, and are open to exploring new ways to achieve our...

  • Data Engineer

    1 week ago

    Philadelphia, United States Mondo Full time

    Job DescriptionJob DescriptionApply now: Data Engineer, this is a 100% remote opportunity. The start date is ASAP for this long-term contract position.Job Title: Data EngineerLocation-Type: 100% remoteStart Date Is: ASAPDuration: Long-term contractRate: $55-$63 Per Hour W2 The estimate above represents the candidate's typical compensation range at the...

  • Sr Information Systems Security Engineer

    2 days ago

    Philadelphia, United States Alutiiq Full time

    Taxable Entity ALUTIIQ INFORMATION MANAGEMENT LLC Job Title Sr Information Systems Security Engineer Location PA Philadelphia NSWC - Philadelphia, PA 19112 US (Primary) Category IT and Computer Related Job Type Full-time Typical Pay/Range $110,000 to $130,000 yearly Education Bachelor's Degree Travel Up to 25% Security Clearance Required Secret POSITION...

  • Machine Learning Engineer

    1 month ago

    Philadelphia, United States Data-Core Systems, Inc. Full time

    As a Machine Learning Engineer you will take a lead role in executing deep learning (CNN LSTM) clustering and classification algorithm fractal and spectral data analysis feature engineering and synthetic data generation.Duties and Responsibilities Execute deep learning (CNN LSTM) Clustering and classification algorithm Fractal and spectral data...

  • Machine Learning Engineer

    1 month ago

    Philadelphia, Pennsylvania, United States Data-Core Systems, Inc. Full time

    As a Machine Learning Engineer you will take a lead role in executing deep learning (CNN LSTM) clustering and classification algorithm fractal and spectral data analysis feature engineering and synthetic data generation.Duties and Responsibilities Execute deep learning (CNN LSTM) Clustering and classification algorithm Fractal and spectral data analysis...

  • Sr Quality Engineer

    6 days ago

    Philadelphia, United States Planet Pharma Full time

    Sr Quality Engineer Find out exactly what skills, experience, and qualifications you will need to succeed in this role before applying below. Needs to be a strong QA Engineer who has experience with Quality Assurance related computer system implementation - needs to have worked in a cGMP/GMP/GxP environment. Fully onsite in PA location Need to be...