Senior Big Data Developer

4 weeks ago

New York, New York, United States Conde Nast Full time

We are seeking an experienced Data Engineer to join our Data Solutions Engineering team at Conde Nast. As a key member of this team, you will play a critical role in shaping how we enable our business using data. Your responsibilities will include building and maintaining data pipelines, collaborating with data scientists, and contributing to the development of shared data engineering tooling and standards.

About the Company

Conde Nast is a global media company with a rich history of producing high-quality content for over 1 billion consumers across 32 territories. Our portfolio includes some of the world's most respected and influential media properties, such as Vogue, Vanity Fair, Glamour, and The New Yorker.

**Our Mission:**

We are committed to publishing the best consumer, trade, and lifestyle content that informs readers and ignites their passions. We believe in the importance of working closely with our cross-functional teams to deliver innovative solutions that meet the needs of our customers.

**About the Role:**

This is an exciting opportunity for a skilled Data Engineer to join our team and contribute to the development of our data engineering capabilities. You will have the opportunity to work on a wide range of projects, from building data pipelines to collaborating with data scientists on machine learning models.

**Responsibilities:**

  • Design, build, and test batch and streaming data pipelines
  • Work with data scientists to deploy machine learning model outputs into CEPs for recommendations and personalizations
  • Collaborate with other data engineers, data scientists, and product managers to implement a shared technical vision
  • Participate in the entire software development lifecycle, from concept to release
  • Contribute to shared data engineering tooling & standards to improve productivity
  • Support, monitor, and optimize current and future data infrastructure and platform
  • Provide technical guidance and mentorship to junior engineers
  • Evaluate technologies and conduct proof-of-concepts

**Requirements:**

  • B.S. or higher degree in Computer Science or related field or relevant professional experience
  • 3+ years of software development experience designing scalable & automated software systems
  • Experience in processing structured and unstructured data into a form suitable for analysis and reporting
  • Experience with data modelling, batch data pipeline design, and implementation
  • Experience building batch or real-time data pipelines
  • Strong software development skills with high proficiency in Python/PySpark or Scala
  • High Proficiency in SQL
  • Experience with data processing frameworks such as Apache Spark (we use Databricks)
  • Experience with data transformation tools such as dbt Cloud
  • Experience in cloud-based infrastructures such as AWS or GCP
  • Exposure to orchestration platforms such as Airflow (we use Astronomer)
  • Proven attention to detail, critical thinking, and ability to work independently within a cross-functional team
  • Comfortable with CI/CD (we use GitHub Actions) Pipelines
  • Experience with Git version control and other software adjacent tools

The estimated salary range for this position is $140,000-$155,000 per year, depending on experience.

  • Senior Big Data Developer

    3 weeks ago

    New York, New York, United States TechnoGen Full time

    Job OverviewWe are seeking a Senior Big Data Developer to join our team at TechnoGen in Brooklyn, NY. This is a 9-month full-time contractor position with a competitive salary of $200,000 per year.The ideal candidate will have experience building applications and managing infrastructure using major cloud providers. A strong understanding of distributed...

  • Senior Big Data Specialist

    6 days ago

    New York, New York, United States Synechron Full time

    **Company Overview:** Synechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions.**Job Summary:** We are seeking an experienced Senior Big Data Specialist to lead our big data initiatives. The ideal candidate will have a strong background in big data engineering, architecture, and...

  • Senior Big Data Specialist

    4 days ago

    New York, New York, United States Capital One Full time

    Job ResponsibilitiesAs a Senior Data Engineer, your primary responsibilities will include:Designing and Developing Data Solutions: Collaborate with cross-functional teams to design, develop, and implement data solutions that meet business requirements.Big Data Technologies: Utilize programming languages like Java, Scala, Python, and work with big data...

  • Big Data Developer

    4 weeks ago

    New York, New York, United States Infojini Full time

    **Job Description:**We're seeking a talented Big Data Developer to join our team at Infojini. As a Big Data Developer, you'll be responsible for designing, developing, and implementing large-scale big data solutions using Hadoop, Spark, and other relevant technologies.About the Role:Design, develop, and implement large-scale big data solutionsCollaborate...

  • Senior Snowflake Developer

    4 weeks ago

    New York, New York, United States ApTask Full time

    We are seeking an experienced Senior Snowflake Developer to join our team at ApTask. As a key member of our organization, you will be responsible for developing and optimizing complex data storage architectures using Snowflake.The ideal candidate will have at least 12 years of experience in data warehousing and big data processing. Your expertise in Snowpark...

  • Senior Big Data Solutions Architect

    22 hours ago

    New York, New York, United States Resource Informatics Group Inc Full time

    Company OverviewResource Informatics Group Inc is a leading provider of big data solutions, empowering businesses to unlock the full potential of their data.Job DescriptionWe are seeking an experienced Senior Big Data Solutions Architect to join our team. The ideal candidate will have a strong background in designing and implementing scalable big data...

  • Senior Big Data Solutions Architect

    4 weeks ago

    New York, New York, United States Nexxen Full time

    As a Senior Big Data Developer, you will be part of our Data Management platform, responsible for processing, storing, and serving data for all our core systems. With a focus on high-scale big-data solutions, you will contribute to our platform infrastructure and architecture. We encourage you to take a proactive & autonomous approach in research &...

  • Senior Big Data Engineer with Kubernetes Expertise

    4 days ago

    New York, New York, United States Pinnacle living Full time

    Pinnacle living is seeking a seasoned Senior Big Data Engineer with expertise in Kubernetes to spearhead our big data initiatives.About the RoleAs a key member of our team, you will be responsible for designing, developing, and maintaining scalable big data solutions using Apache Spark (PySpark), deploying containerized applications on Kubernetes, and...

  • Senior Big Data Engineer

    3 weeks ago

    New York, New York, United States Glow Networks Full time

    Glow Networks seeks a highly skilled Senior Big Data Engineer to join our team. The estimated salary for this role is $145,000 - $170,000 per annum, based on the location in New York City, NY.Job DescriptionWe are looking for a talented engineer with hands-on experience in big data engineering in a cloud environment. Key responsibilities include designing...

  • Senior Data Architect

    4 days ago

    New York, New York, United States Community Blood Center Full time

    Job DescriptionWe are seeking a Senior Data Architect with expertise in cloud and Big Data technologies to join our team at Community Blood Center. As a Senior Data Architect, you will lead the design and implementation of our data infrastructure, ensuring it is scalable, secure, and aligned with our business objectives.Your responsibilities will include...

  • Big Data Analytics Developer

    3 weeks ago

    New York, New York, United States Diverse Lynx Full time

    Job Title: Big Data Analytics DeveloperAbout the Role:This role involves working on big data analytics tasks using strong coding skills in Python, Java or Scala. Proficiency in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols is required.A solid understanding of relational and NoSQL database such...

  • Senior Big Data Engineer

    4 days ago

    New York, New York, United States DoubleVerify Full time

    Company OverviewDoubleVerify, a leading technology company in the advertising industry, is seeking a highly skilled Data Engineer, Social Integrations to join its team. The successful candidate will be responsible for designing and implementing complex streaming and batch systems that process billions of records daily.Key ResponsibilitiesDevelop ETL...

  • Cloud Architect for Big Data

    3 weeks ago

    New York, New York, United States Capital One Services, LLC Full time

    Join Our TeamWe are a fast-paced and dynamic team of engineers and technologists who are passionate about delivering innovative solutions to our customers. If you are looking for a challenging and rewarding role that allows you to grow your skills and expertise, then we want to hear from you!About the PositionWe are seeking a skilled Senior Data Engineer to...

  • Big Data Solutions Engineer

    4 weeks ago

    New York, New York, United States Blood Bank of Delmarva Full time

    Job DescriptionNew York Blood Center Enterprises (NYBCe) is a leading blood bank that provides blood products and services to hospitals and healthcare organizations. We are seeking a skilled Data Engineering Lead to join our team.The successful candidate will lead the architectural design and optimization of robust, scalable data pipelines using SQL, Python,...

  • Big Data Solutions Developer

    4 weeks ago

    New York, New York, United States POINT72, L.P. Full time

    About UsPOINT72, L.P. is a global investment manager dedicated to delivering exceptional returns to our clients.We are committed to fostering a culture of innovation, collaboration, and excellence, and we seek like-minded individuals to join our team.Job SummaryWe are seeking an experienced Data Engineer II to lead the development of big data solutions,...

  • Big Data Architect

    4 days ago

    New York, New York, United States Capital One Full time

    At Capital One, we are looking for a Senior Data Engineer to join our team of innovators who are passionate about marrying data with emerging technologies. As a Senior Data Engineer, you will have the opportunity to be on the forefront of driving a major transformation within Capital One.We are seeking an experienced professional who is well-versed in big...

  • Senior Software Engineer, Big Data and Ad Tech

    4 weeks ago

    New York, New York, United States Amazon Full time

    As a Senior Software Engineer, Big Data and Ad Tech, you'll join our team of innovators who are transforming the advertising landscape with advanced technologies and data science. At Amazon, we're pushing the boundaries of what's possible with big data and machine learning.Our ideal candidate has a strong background in software engineering and a passion for...

  • Big Data Solutions Lead

    4 weeks ago

    New York, New York, United States Capital One Services, LLC Full time

    About Capital One Services, LLCAt Capital One Services, LLC, we believe that data is the key to driving business success. As a Senior Data Engineer, you will be responsible for designing, developing, and deploying data solutions that transform the way we operate and interact with customers.Job SummaryThis is an exciting opportunity for a highly motivated...

  • Senior Big Data Professional

    3 days ago

    New York, New York, United States Capital One Full time

    About Capital One">We are a leading financial institution dedicated to helping our customers achieve financial empowerment. Our team of experts works together to deliver innovative solutions that meet the evolving needs of our customers.">Job Description">This role requires a skilled Data Engineer to collaborate with cross-functional teams and design,...

  • Big Data Solutions Manager

    4 weeks ago

    New York, New York, United States MasterCard Full time

    Tech Lead for Cloud Data SolutionsWe are looking for a highly skilled Tech Lead for Cloud Data Solutions to join our Data Platforms and Engineering Services team. As a Senior Principal Big Data Engineer, you will be responsible for leading the technology architecture, design, implementation, operation, and support of the data technology and platforms needed...