Senior Python Data Processing Developer

3 days ago

Suitland, Maryland, United States Reveal Global Consulting Full-time
We are seeking an experienced Senior Python Data Processing Developer to design and develop scalable data-processing solutions, implement complex business rules, and support cloud-based data workflows.

Key Responsibilities
• Develop and maintain Python-based data-processing and transformation workflows.
• Translate business rules and technical requirements into tested, production-ready code.
• Implement data validation, edit checks, aggregations, calculations, and transformation logic.
• Develop and maintain cloud-based processing jobs using AWS services.
• Build and optimize complex SQL queries and PostgreSQL-based data operations.
• Work with large structured and semi-structured datasets using Spark, PySpark, Polars, or similar technologies.
• Implement data-quality checks and validate processing outputs for accuracy and completeness.
• Troubleshoot production data issues and optimize processing performance.
• Collaborate with business, data, and engineering teams to support ongoing enhancements and releases.
• Participate in code reviews, testing, documentation, and Agile development activities. Required Skills
• 6+ years of hands-on Python development experience, with a strong focus on data processing and business-logic implementation.
• Strong SQL and PostgreSQL experience.
• Experience developing complex SQL using CTEs, joins, aggregations, update/merge operations, and data transformations.
• Hands-on experience with AWS services such as:
• AWS Glue
• AWS Lambda
• AWS Step Functions
• Amazon S3
• Strong experience with Spark, PySpark, Polars, or similar large-scale data-processing frameworks.
• Experience designing and maintaining ETL/data-processing pipelines.
• Strong experience with data validation, reconciliation, and data-quality checks.
• Ability to work with large datasets and optimize data-processing performance.
• Strong debugging and problem-solving skills. Preferred Skills
• Experience working with statistical, survey, financial, or other complex business-rule-driven datasets.
• Experience with Pandas or other Python data-processing libraries.
• Experience with cloud-native and serverless application development.
• Familiarity with CI/CD pipelines, Git, automated testing, and Agile development practices.
• Experience supporting production data-processing systems. U.
S. Citizens and Green Card holders are preferred due to the nature of the federal engagement and background investigation requirements.