Lead PySpark developer
2 weeks ago
Owings Mills, MD
Contract
Role Description:
- Lead the design, development, and deployment of PySpark-based big data solutions.
- Architect and optimize ETL pipelines for structured and unstructured data.
- Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.
- Optimize Spark performance through partitioning, caching, and tuning.
- Implement best practices in data engineering (CI/CD, version control, unit testing).
- Work with cloud platforms like AWS
- Ensure data security, governance, and compliance.
- Mentor junior developers and review code for best practices and efficiency.
- 10+ years of experience in big data and distributed computing.
- Very Strong hands-on experience with PySpark, Apache Spark, and Python.
- Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
- Proficiency in data modeling and ETL workflows.
- Proficiency with workflow schedulers like Airflow
- Hands on experience with AWS cloud-based data platforms
- Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
- Strong problem-solving skills and ability to lead a team
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
-
Lead PySpark Developer
18 hours ago
Owings Mills, MD, United States Diverse Lynx Full timeRole Description: • Lead the design, development, and deployment of PySpark-based big data solutions.• Architect and optimize ETL pipelines for structured and unstructured data.• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.• Optimize Spark performance through...
-
Lead PySpark Developer
2 weeks ago
Owings Mills, MD, United States Diverse Lynx Full timeRole Description: • Lead the design, development, and deployment of PySpark-based big data solutions.• Architect and optimize ETL pipelines for structured and unstructured data.• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.• Optimize Spark performance through...
-
Lead PySpark Developer Owings Mills, MD $$$ bonus
13 hours ago
Owings Mills, MD, United States ESR Healthcare Full timeAbout the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...
-
Owings Mills, MD, United States ESR Healthcare Full timeAbout the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...
-
Owings Mills, MD, United States ESR Healthcare Full timeAbout the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...
-
Owings Mills, MD, United States ESR Healthcare Full timeAbout the job Lead PySpark Developer (7234-1) Owings Mills, MD $$$ bonus If you post this job on a job board, please do not use company name or salary. Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : $68 per hour Total...
-
Big Data Engineer/PySpark Developer
2 weeks ago
Owings Mills, MD, United States Diverse Lynx Full timeRole name: Lead Role Description: • Lead the design, development, and deployment of PySpark-based big data solutions.• Architect and optimize ETL pipelines for structured and unstructured data.• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.• Optimize Spark...
-
Informatica Developer
14 hours ago
Owings Mills, MD, United States CData Software Full timeRequirement ID: 10061434 Posted On: May-14-2025 Role name: Developer Role Description: • Design, develop, modify, configure & debug Informatica workflows using Informatica PowerCenter and Power Exchange CDC tools• leads the design, development, and maintenance of data integration solutions using Informatica, ensuring data quality • Troubleshoot and...
-
Informatica Developer
2 weeks ago
Owings Mills, MD, United States CData Software Full timeRequirement ID: 10061434 Posted On: May-14-2025 Role name: Developer Role Description: • Design, develop, modify, configure & debug Informatica workflows using Informatica PowerCenter and Power Exchange CDC tools• leads the design, development, and maintenance of data integration solutions using Informatica, ensuring data quality • Troubleshoot and...
-
Lead AI Data Engineer
1 week ago
Owings Mills, MD, United States Artech Full timeJob Title: Lead AI Data Engineer Location: Owings Mills, MD - onsite Introduction Join our dynamic team as a Lead AI Data Engineer, where you will play a pivotal role in designing and developing cutting-edge AI solutions. We are seeking a passionate individual who thrives in a collaborative environment and is eager to contribute to innovative projects....
