Senior Data Engineer

1 week ago

Lebanon, New Hampshire, United States StepStone Group Full time
Company Description

Appcast is the global leader in programmatic recruitment advertising technology and recruitment marketing services. With advanced technology, unmatched market data and a team of the industry's best recruitment marketers, Appcast's technology and services manage job advertising annually for enterprise clients across multiple industries and geographies. Headquartered in Lebanon, N.H. with offices in the U.S., Canada and Europe. Appcast is part of the Stepstone group, a leading digital recruitment platform that connects companies with the right talent and helps people find the right job.

Job Description

The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract data from disparate sources; efficiently build and manage transformations into a cloud data warehouse; and build pipelines that load data into tools used by economists, data scientist, data analysts, and many other stakeholders. SQL and Python/R skills are a must. As is extensive experience managing data warehouses and ELT/ETL processes in an OLAP database.

Job Responsibilities

Move data between systems:
  • Extraction - Appcast has several disparate internal proprietary, external proprietary and external public sources that all serve our customers in several ways. A senior data engineer's primary job is to build automated processes that extract data from these disparate sources for downstream use by data analysts.
  • Transform - The senior data engineer will transform data from disparate sources into distinct tables using a relational data model, so that analysts can pull them together in one unified workflow.
  • Load - The senior data engineer will need to load the new tables into a cloud data warehouse using efficient, low-latency methods.
Manage cloud data warehouse:
  • Monitor performance - As data needs grow, the senior data engineer will need to monitor essential performance queries used by downstream analysts to ensure data is being delivered in a timely manner that does not cause slowdowns.
  • Data quality - Ensuring both internal and external data sources are accurate and up to date to provide the best quality for our clients and media partners.
Serve data to downstream users ("democratize data"):
  • Liaison with the Appcast core software development team on data extraction from its proprietary database.
  • Data visualization/dashboards - Partner with data analysts to ensure BI tools (e.g., Tableau) are accurate and up to date.
  • Data permissions/access - Manage the onboarding and offboarding of data permissions, who is given access to the cloud data warehouse and ensuring proper security protocols are being followed.
Set data strategy for company:
  • Control cost - Work with procurement specialists to keep negotiated contracts controlled with external data vendors; research/keep up to date with new data vendors that can provide Appcast with a competitive advantage in our competitive market
  • Data awareness/education - Educate analysts on basic data "hygiene" on how to manage and clean data, and where to access data sources
  • Data security and governance - Develop a deep understanding of Appcast data, work with internal stakeholders to decide on what data is proper to share with clients/media due to sample size and quality
  • Pioneer the adoption of sophisticated ETL/ELT frameworks and platforms such as Apache Airflow and DBT to enhance data workflow automation.
  • Serve as the primary senior data engineering expert, advising senior management and other internal stakeholders on technological advancements and strategic investments in data infrastructure.
Qualifications
  • Expert proficiency in writing SQL queries
  • Expert proficiency in a data engineering programming language (e.g. Python, R, Scala)
  • Expert proficiency at managing data warehouses and ETL/ELT/OLAP processes
  • Background in data modeling and distributed data systems
  • Strong problem-solving skills and attention to detail
  • Excellent communication and collaboration skills
  • Experience with streaming data platforms like Amazon Kinesis or Apache Kafka
  • Implement and manage complex data systems like Apache Spark for efficient data storage and computation.
  • Familiarity with BI tools like Tableau, Shiny or PowerBI is a plus
Education and Experience
  • Bachelor's degree (or higher) in Computer Science, Information Technology, or a related field
  • And, 8+ years of experience in data engineering
  • Expert experience in writing SQL queries
  • Strong experience in writing Python, R, and/or Scala code
  • Strong experience in managing data warehouses and ETL/ELT/OLAP processes
  • Experience with PostgreSQL, Tableau, or AWS tools is a plus
  • Experience with big data technologies like Apache Spark is a plus
Travel Requirements
  • Regular travel is not necessary for this position.
Additional Information

Appcast recognized as one of Inc Magazine's "Best Workplaces" for 2021 & 2022
  • We're the best at what we do. We're the global leader in programmatic recruitment advertising. With advanced technology, unmatched market data and a team of the industry's best recruitment marketers.
  • We have an amazing culture driven by great people. Headquartered in Lebanon, N.H. with offices in the U.S., Canada and Europe, Appcast is part of the Stepstone group. To better understand our company culture, read Our Story and check out Working at Appcast on our website.
  • We take care of our employees. We're dedicated to creating an inviting environment where individuals from diverse backgrounds can thrive and develop. We believe in providing competitive compensation and comprehensive benefits, ensuring our team can support their loved ones and one another. We enjoy fostering a sense of community through dedicated employee networks, fun gatherings, delicious food, and even welcoming furry friends into our workspace. We live our values each day including volunteering and giving back to our communities.
All your information will be kept confidential according to EEO guidelines.

Appcast is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Videos To Watch

  • Senior Healthcare Data Analyst Quality Analytics

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth Health Full time

    Overview Works with technical and non-technical customers to translate business needs into functional specifications using advanced understanding of clinical workflows, healthcare terminology, revenue management data and processes. Mentors and coaches colleagues and partners. Responsibilities Supports the goals of the organization through reporting,...

  • Senior Implementation Analyst

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth Health Full time

    Dartmouth Health Senior Implementation Analyst (hybrid) Lebanon , New Hampshire Apply Now Function as a senior member of the RMD leadership team, using knowledge of operations healthcare business systems, as well as requirements for compliant billing practices.ResponsibilitiesSupports the Epic (eD-H) implementation project and business systems...

  • Senior Accountant

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth-Hitchcock Concord Full time

    Overview Assists in the completion of the monthly and annual close; prepares and reviews journal entries prepared by accounting staff. Prepares and reviews monthly account analyses and reconciliations of assigned balance sheet accounts; prepares and reviews interim and year end audit work papers. Responsibilities Compiles and analyzes financial and...

  • Preclinical Research Technician Analyst

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth Health Full time

    Overview We are seeking a talented and motivated individual with a Bachelor's degree in Physics, Engineering, Biophysics, or equivalent, to join our research team. As a Technician/Analyst, you will play a crucial role in advancing our understanding of bacterial biofilms using cutting-edge optical techniques and statistical analysis of the...

  • Sr Applications Systems Programmer Analyst IS ERP

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth-Hitchcock Health Full time

    Overview Performs programming and analysis functions in the development and implementation of new systems, the revision of existing systems, and to support special projects.The ideal candidate has senior level PeopleSoft Developer skills. Responsibilities Develops technology programs of moderate complexity and scope from abstract requirements.Develops...

  • Vice President, Advancement Administration

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth Health Full time

    Overview Vice President, Advancement Administration Dartmouth Health Dartmouth Health and Geisel School of Medicine at Dartmouth College are pleased to announce a national Vice President of Advancement Administration search. The Vice President of Advancement Administration at Dartmouth Health is responsible for leading a best-in-class, comprehensive...

  • Sr Applications Systems Programmer Analyst IS ERP

    1 week ago

    Lebanon, New Hampshire, United States Dartmouth-Hitchcock Health Full time

    Overview Performs programming and analysis functions in the development and implementation of new systems, the revision of existing systems, and to support special projects. The ideal candidate has senior level PeopleSoft Human Capital Management (HCM) Developer skills. ResponsibilitiesDevelops technology programs of moderate complexity and scope from...

  • Senior Associate

    1 week ago

    Lebanon, New Jersey, United States New York Life Insurance Company Full time

    Location Designation: Hybrid - 3 days per month When you join New York Life, youre joining a company that values career development, collaboration, innovation, and inclusiveness. We want employees to feel proud about being part of a company that is Reliability Engineer, Liability, Associate, Engineer, Reliability, Reliability, Technology, Insurance

  • Purchasing Specialist

    1 week ago

    Lebanon, New Hampshire, United States Frank Mayer and Associates Inc Full time

    Overview:We are seeking a detail-oriented and experienced Purchasing Specialist to join our team. As a Purchasing Specialist, you will play a crucial role in managing our procurement process, ensuring the timely and cost-effective acquisition of goods and services.Responsibilities: Generate and manage purchase orders, BOMs and project schedules. Evaluate...

  • Senior Data Engineer

    4 weeks ago

    Lebanon, United States AppCast Full time

    Job Description The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract data...

  • Senior Data Engineer

    3 weeks ago

    Lebanon, United States Appcast Full time

    Job DescriptionJob DescriptionCompany DescriptionAppcast is the global leader in programmatic recruitment advertising technology and recruitment marketing services. With advanced technology, unmatched market data and a team of the industry’s best recruitment marketers, Appcast’s technology and services manage job advertising annually for enterprise...

  • Jet Engine Data Engineer

    2 weeks ago

    Lebanon, United States Insight Global Full time

    Salary: 100-130KLocation: Lebanon, IN or remoteWork authorization: must be able to work on W2 without sponsorshipPLEASE READ CLEARLY AND ONLY APPLY IF YOU HAVE THE BELOW QUALIFICATIONS -Candidate needs to have a deep understanding of engine performance data. Jet engines collect data - that data can be used to determine the "health" of an engine. That data...

  • Jet Engine Data Engineer

    2 weeks ago

    Lebanon, United States Insight Global Full time

    Salary: 100-130K Location: Lebanon, IN or remote Work authorization: must be able to work on W2 without sponsorship PLEASE READ CLEARLY AND ONLY APPLY IF YOU HAVE THE BELOW QUALIFICATIONS - Candidate needs to have a deep understanding of engine performance data. Jet engines collect data - that data can be used to determine the "health" of an engine. That...

  • Aviation Data Engineer

    2 months ago

    Lebanon, United States AeroCore Technologies Full time

    AeroCore Technologies, LLC is seeking a skilled and experienced Engine & Powerplant Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining our performance data infrastructure. You will work closely with our engineering team to develop computational modeling to evaluate and optimize jet engine...

  • Aviation Data Engineer

    3 weeks ago

    Lebanon, United States AeroCore Technologies Full time

    AeroCore Technologies, LLC is seeking a skilled and experienced Engine & Powerplant Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining our performance data infrastructure. You will work closely with our engineering team to develop computational modeling to evaluate and optimize jet engine...

  • SENIOR ASSOCIATE, Data Analyst

    1 week ago

    Lebanon, Pennsylvania, United States New York Life Insurance Co Full time

    Job Requisition ID: 90322Location Designation: Hybrid - 3 days per week Location: Lebanon, New Jersey Offered Wage: $148,000.06/yearDuties: Defines authoritative sources and systems of record and anomaly discovery. Performs root cause and gap analysis. Engages with Application and Testing teams across the organization to understand data requirements, flows,...

  • SENIOR ASSOCIATE, Data Analyst

    4 weeks ago

    Lebanon, United States New York Life Insurance Co Full time

    Job Requisition ID: 90322Location Designation: Hybrid - 3 days per week   Location: Lebanon, New Jersey  Offered Wage: $148,000.06/yearDuties: Defines authoritative sources and systems of record and anomaly discovery. Performs root cause and gap analysis. Engages with Application and Testing teams across the organization to understand data...

  • SENIOR ASSOCIATE, Data Analyst

    2 weeks ago

    Lebanon, United States New York Life Insurance Co Full time

    Job Requisition ID: 90322Location Designation: Hybrid - 3 days per week   Location: Lebanon, New Jersey  Offered Wage: $148,000.06/yearDuties: Defines authoritative sources and systems of record and anomaly discovery. Performs root cause and gap analysis. Engages with Application and Testing teams across the organization to understand data...

  • Senior Engineer

    3 days ago

    Lebanon, Pennsylvania, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Senior Director- Engineering

    2 weeks ago

    Lebanon, United States Eli Lilly Full time

    For this role include:Pre-Startup and Startup Phase:Be a collaborative, inclusive, energetic leader and support the broader lead team to:Build the organization with the necessary capability, capacity and culture to operate this facility to the highes Director, Engineer, Leadership, Senior, Operations, Project Management, Technology

  • Senior Director- Engineering

    1 week ago

    Lebanon, Indiana, United States Eli Lilly Full time

    For this role include:Pre-Startup and Startup Phase:Be a collaborative, inclusive, energetic leader and support the broader lead team to:Build the organization with the necessary capability, capacity and culture to operate this facility to the highes Director, Engineer, Leadership, Senior, Operations, Project Management, Technology

  • Senior Director- Engineering

    1 day ago

    Lebanon, United States BioSpace, Inc. Full time

    Job Details At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our...

  • Senior Director- Engineering

    7 days ago

    Lebanon, United States Eli Lilly and Company Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Senior Director- Engineering

    2 weeks ago

    Lebanon, United States Eli Lilly Full time

    At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities...

  • Senior Automation Controls Engineer

    3 days ago

    Lebanon, United States Kadant Black Clawson LLC Full time

    Overview: KADANT BLACK CLAWSON LLC is an established leader in equipment and systems for the international pulp and paper process industries. For 150 years, weve helped our customers reduce their input costs and improve efficiency through innovative products and technologies. Our sustainability efforts have been nationally recognized, and Kadant is also...

  • Senior Project Engineer-Systems

    6 days ago

    Lebanon, United States A. O. Smith Full time

    Company / Location Information Why A. O. Smith? Water technology is one of the fastest-growing industries in the world, and, as a leading global water technology company, A. O. Smith Corporation is at the center of the trend. Founded in 1874, we are a $3.5 billion company that employs more than 12,000 men and women. With manufacturing operations in the...

  • Senior Quality Engineer

    2 days ago

    Lebanon, United States Advics Manufacturing Ohio Full time

    The Company: ADVICS Manufacturing Ohio Inc. is a leading manufacturer of automotive braking systems. We are dedicated to producing the highest quality, most competitive brakes in the world. ADVICS manufactures caliper disc brakes, Electronic Stability Control units and Electronic Parking Brakes for most of the worlds major auto makers. We have been located...

  • Senior Quality Engineer

    2 weeks ago

    Lebanon, United States ADVICS Manufacturing Ohio, Inc. Full time

    The Company:ADVICS Manufacturing Ohio Inc. is a leading manufacturer of automotive braking systems. We are dedicated to producing the highest quality, most competitive brakes in the world. ADVICS manufactures caliper disc brakes, Electronic Stability Control units and Electronic Parking Brakes for most of the world’s major auto makers. We have been located...

  • Senior Quality Engineer

    2 weeks ago

    Lebanon, United States ADVICS Manufacturing Ohio, Inc. Full time

    The Company:ADVICS Manufacturing Ohio Inc. is a leading manufacturer of automotive braking systems. We are dedicated to producing the highest quality, most competitive brakes in the world. ADVICS manufactures caliper disc brakes, Electronic Stability Control units and Electronic Parking Brakes for most of the world’s major auto makers. We have been located...