Senior Software Development Engineer, Big Data

2 months ago


Loma de Santa Bárbara El Organal, United States Zillow Full time
About the teamAt Zillow Group, data is one of our most valuable assets to understand and support our customers to unlock life's next chapter. The Data Platform organization enables teams across Zillow Group to unlock potential behind that data efficiently and securely.

The Data Lifecycle Management Team provides guardrails for security, privacy, and data quality ensuring that the data infrastructure and processes adhere to industry standards and best practices. In addition to the Data Platform Governance team, the senior software development engineers collaborate closely with two other development teams within the Data Platform organization:

Learn more about what we are doing at / zillow. com/engineering and / zillow. com/ai

Acerca del equipo

En Zillow Group, los datos son uno de nuestros activos más valiosos para comprender y ayudar a nuestros clientes a desbloquear el siguiente capítulo de la vida. La organización de la Plataforma de Datos permite a los equipos de todo el Grupo Zillow desbloquear el potencial detrás de esos datos de forma eficiente y segura.

El equipo de gestión del ciclo de vida de los datos se encarga de la seguridad, la privacidad y la calidad de los datos, garantizando que la infraestructura y los procesos de datos se adhieran a las normas y mejores prácticas del sector. Además del equipo de Gobernanza de la Plataforma de Datos, los ingenieros superiores de desarrollo de software colaboran estrechamente con otros dos equipos de desarrollo dentro de la organización de la Plataforma de Datos:

Más información sobre lo que hacemos en / zillow. com/engineering y / zillow. com/aiAbout the role

This role will be responsible for developing and supporting data platform infrastructure. They utilize data technologies such as Spark, Hive, Airflow, Databricks, Kafka, Flink, and other industry and internal tools.

Will collaborate to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions that create trust and delight our customers.

Acerca del puesto
Este rol será responsable de desarrollar y dar soporte a la infraestructura de la plataforma de datos. Utilizará tecnologías de datos como Spark, Hive, Airflow, Databricks, Kafka, Flink y otras herramientas internas y del sector.

Colaborarán para proporcionar entornos de plataforma de datos que permitan a los clientes internos del Grupo Zillow ofrecer soluciones de datos de alta calidad que generen confianza y deleiten a nuestros clientes.

This role has been categorized as a teleworker position. Teleworkers do not have a permanent corporate office workplace and, instead, work from a physical location of their choice which must be identified to the Company. Employees may live in any part of Mexico, but preferably in Mexico City, as we would encourage attendance for occasional in-office events.

In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location.

Who you are

Collaboration and Leadership:

Collaborate with cross-functional team members and data scientists to understand their requirements and provide solutions. Passion and experience mentoring junior data engineers. Continuous Learning: Enthusiasm for continuous learning and staying updated with the latest trends and technologies in the data engineering field. Proactive in exploring new tools and techniques to enhance data platform systems capabilities. General Requirements: Experience in software development with one or more programming languages such as Python, Java, C++, etc. Proficiency in developing and supporting services with cloud infrastructure such as AWS. Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes. Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink. Experience in setting up and optimizing data pipelinesExperience in developing scalable processes for supporting multiple user groups and teams. Familiarity and Experience with running on-call operational responsibilities for data platform systemsDatabricks experience is a plus. Experience with Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) is a plus Transferable Skills: Here at Zillow - we value the experience and perspective of candidates with non-traditional backgrounds. We encourage you to apply if you have transferable skills or related experiences. Quiénes somos Colaboración y liderazgo: Colaborar con los miembros del equipo multifuncional y los científicos de datos para comprender sus requisitos y proporcionar soluciones. Pasión y experiencia como mentor de ingenieros de datos junior. Aprendizaje continuo: Entusiasmo por el aprendizaje continuo y por mantenerse actualizado con las últimas tendencias y tecnologías en el campo de la ingeniería de datos. Proactivo en la exploración de nuevas herramientas y técnicas para mejorar las capacidades de los sistemas de plataformas de datos. Requisitos generales: Experiencia en desarrollo de software con uno o más lenguajes de programación como Python, Java, C++, etc. Competencia en el desarrollo y soporte de servicios con infraestructura en la nube como AWS. Experiencia y capacidad para depurar/resolver problemas de plataformas de orquestación de contenedores como Kubernetes. Experiencia con sistemas de infraestructura de datos como Databricks, Spark, Hive, Airflow, Trino, Kafka y Flink. Experiencia en la configuración y optimización de pipelines de datos. Experiencia en el desarrollo de procesos escalables para dar soporte a múltiples grupos de usuarios y equipos. Familiaridad y experiencia en la ejecución de responsabilidades operativas de guardia para sistemas de plataformas de datosExperiencia en Databricks es un plus. Experiencia con Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) es un plus Habilidades transferibles: Aquí en Zillow - valoramos la experiencia y la perspectiva de los candidatos con antecedentes no tradicionales. Te animamos a presentar tu candidatura si tienes habilidades transferibles o experiencias relacionadas. Get to know us Zillow is reimagining real estate to make it easier to unlock life's next chapter.

  • Santa Clara, United States Rootshell Enterprise Technologies Inc. Full time

    Job DescriptionJob DescriptionHello All,Greetings from Rootshell Inc.Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Principal Big Data Engineer for one of our client, Please share your resume with current location & full contact infoRole:Principal Big Data...


  • Santa Clara, United States Right Skale Inc Full time

    Job DescriptionJob DescriptionPrincipal Big Data Engineer Extendible Contract Onsite (Santa Clara, CA)This role will be available in Santa Clara, CA, and local candidates are strongly preferred.About you:As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design,...


  • Santa Clara, United States Palo Alto Networks Full time

    PALO ALTO NETWORKS® is the fastest-growing security company in history.  We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you! We are ushering in the future of security innovation and reinventing...


  • Santa Clara, United States Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for...


  • Santa Clara, United States Palo Alto Networks Full time

    Job DescriptionJob DescriptionCompany DescriptionOur MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting...


  • Santa Clara, United States Rootshell Inc Full time

    Hello All,Greetings from Rootshell Inc.Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Principal Big Data Engineer for one of our client, Please share your resume with current location & full contact infoRole:Principal Big Data EngineerLocation: Santa Clara, CA (Onsite...


  • Santa Clara, United States Rootshell Inc Full time

    Hello All,Greetings from Rootshell Inc.Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Principal Big Data Engineer for one of our client, Please share your resume with current location & full contact infoRole:Principal Big Data EngineerLocation: Santa Clara, CA (Onsite...


  • Santa Clara, California, United States Plus Full time

    Plus is a global provider of highly automated driving and fully autonomous driving solutions with headquarters in Silicon Valley, California. Named by Forbes as one of America's Best Startup Employers and Fast Company as one of the World's Most Innovative Companies, Plus's open autonomy technology platform is already powering vehicles in commercial use...


  • Santa Clara, California, United States Sira Consulting Full time

    About Sira ConsultingJob Title: Senior AWS Data EngineerJob SummarySira Consulting is seeking a highly skilled Senior AWS Data Engineer to join our team. As a Senior AWS Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesDesign and Implement Data Processing...


  • Santa Clara, United States Softcrylic Full time

    Who We Are For more than 20 years, we have been working with organizations large and small to help solve business challenges through technology. We bring a unique combination of engineering and strategy to Make Data Work for organizations. Our clients range from the travel and leisure industry to publishing, retail and banking. The common thread between our...


  • El Segundo, California, United States Bayforce Full time

    Job Title: Senior Software Engineer - Java DeveloperAbout the Role:We are seeking a highly skilled Senior Software Engineer to join our team at Bayforce. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining large-scale software applications using Java.Key Responsibilities:Design and develop clean, modular, and...


  • Santa Clara, United States Palo Alto Networks Full time

    Job DescriptionJob DescriptionCompany DescriptionOur MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting...


  • Santa Clara, United States AIxMed, Inc. Full time

    Job Title: Senior Software Engineers – AI/Computer Vision: Computational CytopathologySummary:Embark on a journey at the cutting edge of digital cytopathology with AIxMed, a pioneering startup leveraging AI and computer vision to transform digital cytology. In the role of Senior Software Engineer, you will be instrumental in crafting innovative software...


  • Santa Clara, United States AIxMed, Inc. Full time

    Job Title: Senior Software Engineers – AI/Computer Vision: Computational CytopathologySummary:Embark on a journey at the cutting edge of digital cytopathology with AIxMed, a pioneering startup leveraging AI and computer vision to transform digital cytology. In the role of Senior Software Engineer, you will be instrumental in crafting innovative software...


  • El Dorado, Arkansas, United States Murphy USA Full time

    About the RoleMurphy USA is seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our cloud-based data lake. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining data-driven systems solutions that support our business initiatives.Key...


  • Santa Clara, California, United States Nvidia Corporation Full time

    The Automotive Vehicles team is searching for a creative and experienced Software Engineer to help us bring NVIDIA's autonomous vehicle solution out to the world. You will participate in a focused effort to develop and productize ground-breaking solutions that will redefine the world of transportation and the growing field of self-driving cars. You will work...

  • Senior Data Engineer

    21 hours ago


    El Dorado, Arkansas, United States Murphy USA Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Murphy USA. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our modern cloud-based data lake.Key ResponsibilitiesDevelop and support data products on our cloud-based data lake, leveraging expertise in...


  • el segundo, United States Bayforce Full time

    Role Title: Senior Software Engineer - JavaClient: Global ticketing technology company Location: El Segundo, CA 3x/week onsiteFull TimeRole Description: As a Senior Software Engineer, your primary responsibilities will be to write clean, concise, modular code in an agile environment, mentor developers and provide code reviews.Lead and take ownership of...


  • El Segundo, United States Bayforce Full time

    Role Title: Senior Software Engineer - JavaClient: Global ticketing technology company Location: El Segundo, CA 3x/week onsiteFull TimeRole Description: As a Senior Software Engineer, your primary responsibilities will be to write clean, concise, modular code in an agile environment, mentor developers and provide code reviews.Lead and take ownership of...


  • Santa Clara, California, United States Oracle Full time

    About the RoleWe are seeking a highly skilled Principal Software Engineer to join our Observability and Data team at Oracle Cloud Infrastructure. As a key member of our team, you will be responsible for designing and developing innovative solutions for our cloud-based observability platform.Key ResponsibilitiesDesign and develop scalable and highly available...