Python Developer

1 day ago

Sunnyvale, California, United States One moment, please Full-time

Job Summary

We are seeking a highly skilled Python Developer with strong experience in Google Cloud Platform (GCP), PySpark, and Apache Airflow to join a fast-paced data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and cloud-based data solutions that support business-critical analytics and reporting.

This role requires hands-on experience with large-scale data processing, workflow orchestration, cloud-native services, and modern software development best practices.

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using Python and PySpark.
  • Build and maintain ETL/ELT workflows using Apache Airflow.
  • Develop cloud-native data solutions leveraging Google Cloud Platform (GCP) services.
  • Process and transform large datasets for analytics and reporting.
  • Optimize data processing jobs for performance, scalability, and reliability.
  • Collaborate with Data Engineers, Data Scientists, Product Managers, and Business stakeholders to understand data requirements.
  • Implement monitoring, logging, error handling, and automated recovery mechanisms for data pipelines.
  • Write clean, maintainable, and well-documented code following software engineering best practices.
  • Participate in code reviews, testing, deployment, and production support.
  • Troubleshoot production issues and continuously improve pipeline performance.

Required Qualifications

  • 5+ years of experience in Python development.
  • Strong hands-on experience with Python, PySpark, and Apache Airflow.
  • Experience working with Google Cloud Platform (GCP) services such as:
    • BigQuery
    • Cloud Storage (GCS)
    • Cloud Composer
    • Cloud Functions
    • Dataflow (preferred)
    • Pub/Sub (preferred)
  • Strong SQL skills and experience working with relational and distributed databases.
  • Experience building scalable ETL/ELT pipelines.
  • Knowledge of distributed data processing frameworks.
  • Experience with Git and CI/CD pipelines.
  • Strong debugging, analytical, and problem-solving skills.
  • Excellent communication and collaboration skills.