Big Data Engineer/PySpark Developer

2 weeks ago


Owings Mills, MD, United States Diverse Lynx Full time
Role name: Lead Role Description: • Lead the design, development, and deployment of PySpark-based big data solutions.• Architect and optimize ETL pipelines for structured and unstructured data.• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.• Optimize Spark performance through partitioning, caching, and tuning.• Implement best practices in data engineering (CI/CD, version control, unit testing).• Work with cloud platforms like AWS • Ensure data security, governance, and compliance.• Mentor junior developers and review code for best practices and efficiency. Competencies: Digital : Amazon Web Service(AWS) Cloud Computing, Digital : PySpark Experience (Years): 8-10

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Owings Mills, MD, United States Diverse Lynx Full time

    Lead PySpark developer Owings Mills, MD Contract Role Description: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions....


  • Owings Mills, MD, United States Diverse Lynx Full time

    Role Description: • Lead the design, development, and deployment of PySpark-based big data solutions.• Architect and optimize ETL pipelines for structured and unstructured data.• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.• Optimize Spark performance through...

  • Lead PySpark Developer

    21 hours ago


    Owings Mills, MD, United States Diverse Lynx Full time

    Role Description: • Lead the design, development, and deployment of PySpark-based big data solutions.• Architect and optimize ETL pipelines for structured and unstructured data.• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.• Optimize Spark performance through...


  • Owings Mills, MD, United States ESR Healthcare Full time

    About the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...


  • Owings Mills, MD, United States ESR Healthcare Full time

    About the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...


  • Owings Mills, MD, United States ESR Healthcare Full time

    About the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...


  • Owings Mills, MD, United States ESR Healthcare Full time

    About the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...

  • AWS Data Engineer

    4 days ago


    Owings Mills, MD, United States Purple Drive Full time

    Job Title: Senior Data Engineer - Python, PySpark, Apache Airflow & AWS Role Overview We are seeking a highly skilled Senior Data Engineer with extensive hands-on experience in Python, PySpark, Apache Airflow, and AWS services to design, build, and manage scalable data pipelines and architectures. The ideal candidate will have deep expertise in data...

  • AWS Data Engineer

    2 weeks ago


    Owings Mills, MD, United States Purple Drive Full time

    Job Title: Senior Data Engineer - Python, PySpark, Apache Airflow & AWS Role Overview We are seeking a highly skilled Senior Data Engineer with extensive hands-on experience in Python, PySpark, Apache Airflow, and AWS services to design, build, and manage scalable data pipelines and architectures. The ideal candidate will have deep expertise in data...

  • AWS Data Engineer

    7 hours ago


    Owings Mills, MD, United States Purple Drive Full time

    Job Title: Senior Data Engineer - Python, PySpark, Apache Airflow & AWS Role Overview We are seeking a highly skilled Senior Data Engineer with extensive hands-on experience in Python, PySpark, Apache Airflow, and AWS services to design, build, and manage scalable data pipelines and architectures. The ideal candidate will have deep expertise in data...