BigData with Python+Pyspark

Title: BigData with Python+Pyspark
Location: Phoenix, Arizona
Job Type: Contract

Job description:
Technical/Functional Skills
Big Data
Python
Pyspark
Hive;
Familiar with Agile or other rapid application development methods
Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent.
Hands-on experience with programming using Python
Expert on Hadoop and Spark Architecture and its working principle
Hands-on experience on writing and understanding sophisticated SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data
Hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
Proven Datawarehousing concepts
Knowledge of Financial reporting ecosystem is a plus
Proven experience within Data Engineering/ Data Warehousing using Big Data technologies will be ddon
Expert on Distributed ecosystem
bility to design and develop optimized Data pipelines for batch and real time data processing
Should have experience in analysis, design, development, testing, and implementation of system applications
Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
Experience with design and coding across one or more platforms and languages as appropriate
Experience in analytical languages (Python or the equivalent) and knowledge about machine learning techniques.
Extensive experiencing in application, integration, system, and regression testing, including demonstration of automation and other CI/CD efforts.
Experience with version control software like git and CI/CD testing/automation experience.
Strong analytical ability
Excellent communication skills
Roles & Responsibilities
Perform hands-on architecture, design, development, and testing.
Drive user story analysis and elaboration, design and develop web applications, test and build automation tools
Bring a culture of innovation, ideas, and continuous improvement.
Work closely with product managers, back-end and other front-end engineers to implement web applications
Optimize components for maximum performance across devices and browsers
Drive automation and ensure automated test scripts are built.
Willingness to adopt new technologies and passion for learning
Utilize best-of-breed technologies to build a layered, component-based architecture over existing Client technologies
Be highly motivated and maintain a positive, can-do attitude in a fast moving environment
Foster the spirit of collaboration across multiple internal teams

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

---