Principal Data Solutions Architect

Salary$132,000-$226,000 / year Principal Data Solutions Architect​
Full time Position
Oakland, CA

This position is hybrid, working from your remote office and your assigned work location based on business need

Bay Area Minimum: $132,000
Bay Area Maximum: $226,000
-Or-
California Minimum: $125,000
California Maximum: $215,000 * Looking for some with strong architecture for service-oriented Spark based systems and Kafka. * Must have Palantir Foundry - If you couldn't find candidates with Palantir Foundry you can submit the candidates with Kafka, Spark. * Keep up-to-date with the Flink and Kafka capabilities of Palantir Foundry releases, features and best practices and recommend changes to improve efficiency, performance and scalability. * Kafka, Flink, Apache is desired. * Look for Data Engineer. * Must have spark, Hadoop. * Big plus to have Java. * Nice to have Python. * Lead technical design and implementation of Flink and Kafka event driven use cases. * No JAVA coding test but will ask few questions on Java. * 2 rounds of Interview. * Min 5 years of exp. Position Summary:

We are looking for an Expert Technical Lead to be a part of our exciting and growing team. Your primary focus will be to provide technical leadership and mentorship across our Flink and Kafka real-time data platform and product engineering teams. You will lead technical design and implementation of real-time event driven use cases and drive technical feasibility discussions for our products as you collaborate with other technical leaders, product owners and development leads. You will be required to Client the boundaries of our platforms, provide solutions for technical problems and drive discussions within IT and Lines of Business. As a productive member of a motivated group of engineers, product teams, and technical analysts, you will be producing ground-breaking, forward thinking, and revolutionary projects that will modernize critical infrastructure. Job Responsibilities: * Lead technical design and implementation of Flink and Kafka event driven use cases. * Ensure best practices are followed for performance tuning, security, and data governance. * Build awesome big data products within a fun team where culture is the foundation for success. * Lead and mentor the development team in a hands-on way. * Provide technical feasibility assessment while collaborating with Product Owner and Design team to guide features and provide technical know-how. * Define and address application non-functional requirements, and manage technical debt Debug and optimize complex applications. * Effectively communicate the vision and architecture to team members Maintain a productive working environment for development teams Be a strong advocate for a culture of quality across the team. * Collaborate with external teams, especially security, to design, implement and support solutions that are scalable and efficient. * Build best-in-class real time analytics products with Flink and Kafka. * Effectively communicate the solution to non-technical stakeholders Follow an agile development methodology. * Keep up-to-date with the Flink and Kafka capabilities of Palantir Foundry releases, features and best practices and recommend changes to improve efficiency, performance and scalability. * Advocate for appropriate data modelling techniques to enable agile development and the business use cases, specifically in the integration of event-driven with batch data processing. Qualifications: Minimum: • High School or GED-General Educational Development-GED Diploma • 5 years' relevant work experience to include experience as a Technical Lead and intermediate to expert level development in Python and Java. Desired: • BA/BS degree in Computer Science, Engineering, Business or related field or equivalent experience • 10 years of experience in IT working in application development and architecture, with 7 years project implementation experience and hands-on experience developing data products • Expert in the solution architecture discipline, processes, concepts, and best practices • Firsthand experience building solutions in Flink and/or Kafka including development of Java and/or Python Flink UDFs. • Exposure to a process improvement discipline (e.g., Six Sigma) used within a technology supported business process implementation • Process design, information modeling and / or system solution architecture development with project or portfolio focus in at least one of the following: Cloud Architecture, Data Management, Security, Microservices, or Infrastructure technologies • Operational support for applications, systems, or infrastructure • Experience providing direction to design and engineering staff • Experience providing direction to one or more architects and technical leads • 5 years of experience developing solution architectures for complex data platforms and products • 5 years of hands on experience working with multiple technologies and platforms such as integrations with ERP systems (e.g. SAP), Cloud technologies (e.g. AWS) etc. • Demonstrated solid understanding of architecture best practices and enterprise-scale solution development • Possess diversified technical background with Enterprise System Solution mindset • Able to provide individual or project oversight on rapid prototyping/POC efforts and large-scale enterprise wide roll out planning • Experience working with technology and business partners to develop secure and scalable solutions • Experience working as an Agile/Technical Lead in an Agile environment • Experience with developing solutions for data-driven applications • Experience with GIS is a plus • Knowledge of SAP and/or ESRI a plus • Knowledge of Data Vault 2.0 modeling techniques a plus • Excellent communication and collaboration skills and a strong work ethic • Very strong analytical and problem-solving skills • Able to build strong relationships with and influence at the Director level of leadership • Able to build a sense of trust and rapport that creates a comfortable & effective workplace • Able to further community & elevate team performance • Brings a high-energy and passionate outlook to the role and has strong sense of ownership Department Overview:

Client Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality technology solutions.

This position is hybrid, working from your remote office and your assigned work location based on business need. The assigned work location will be within the Client's Service Territory.
The Data, Analytics & Insights Team within IT is responsible for working collaboratively with the lines of business (e.g., Electric Operations, Gas Operations, etc.) to implement consumer-grade data platforms and products across various user groups (e.g., asset strategists, inspectors, emergency operations, etc.).

This includes, but is not limited to:

• Deploying best-in-class / rapid delivery capabilities for data solutions and self-service enablement for highly skilled analysts and data scientists
• Simplifying, improving, and standardizing processes to promote data-driven decisions and drive the digital transformation of the utility.
• Rapid delivery of back-end solutions for a multitude of applications