Data Streaming Technical Lead

2 weeks ago


Oakland, United States AllSTEM Connections Full time

Data Streaming Tech Lead. Direct Hire. Salary Range: 195-225K.

Hybrid (One day per month onsite in local office).

Relocation Assistance Provided.


Applicants must be legally authorized to work in the U.S. without sponsorship. The Company is unable to sponsor or take over sponsorship of an employment visa.


Our client is seeking a Data Streaming Technical Lead whose primary focus will be to provide technical leadership and mentorship across a Flink and Kafka real-time data platform and product engineering teams. You will lead technical design and implementation of real-time event driven use cases and drive technical feasibility discussions products as you collaborate with other technical leaders, product owners and development leads. You will be required to discover the boundaries of these platforms, provide solutions for technical problems and drive discussions within IT and Lines of Business. As a productive member of a motivated group of engineers, product teams, and technical analysts, you will be producing ground-breaking, forward thinking, and revolutionary projects that will modernize critical infrastructure.


Responsibilities

• Lead technical design and implementation of Flink and Kafka event driven use cases

• Ensure best practices are followed for performance tuning, security, and data governance

• Build awesome big data products within a fun team where culture is the foundation for success

• Lead and mentor the development team in a hands-on way

• Provide technical feasibility assessment while collaborating with Product Owner and Design team to guide features and provide technical know-how

• Define and address application non-functional requirements, and manage technical debt

• Debug and optimize complex applications

• Effectively communicate the vision and architecture to team members

• Maintain a productive working environment for development teams

• Be a strong advocate for a culture of quality across the team

• Collaborate with external teams, especially security, to design, implement and support solutions that are scalable and efficient

Build best-in-class real time analytics products with Flink and Kafka (PySpark)

• Effectively communicate the solution to non-technical stakeholders

• Follow an agile development methodology

Keep up-to-date with the Flink and Kafka capabilities of Palantir Foundry releases, features and best practices and recommend changes to improve efficiency, performance and scalability

• Advocate for appropriate data modeling techniques to enable agile development and the business use cases, specifically in the integration of event-driven with batch data processing


Qualifications

• BA/BS degree in Computer Science, Engineering, Business or related field or equivalent experience

• 10 years of experience in IT working in application development and architecture, with 7 years project implementation experience and hands-on experience developing data products

• Expert in the solution architecture discipline, processes, concepts, and best practices

Firsthand experience building solutions in Flink and/or Kafka (PySpark) including development of Java and/or Python Flink UDFs.

• Exposure to a process improvement discipline (e.g., Six Sigma) used within a technology supported business process implementation

• Process design, information modeling and/ or system solution architecture development with project or portfolio focus in at least one of the following: Cloud Architecture, Data Management, Security, Microservices, or Infrastructure technologies

• Operational support for applications, systems, or infrastructure

• Experience providing direction to design and engineering staff

• Experience providing direction to one or more architects and technical leads

• 5 years of experience developing solution architectures for complex data platforms and products

• 5 years of hands on experience working with multiple technologies and platforms such as integrations with ERP systems (e.g. SAP), Cloud technologies (e.g. AWS) etc.

• Demonstrated solid understanding of architecture best practices and enterprise-scale solution development

• Possess diversified technical background with Enterprise System Solution mindset

• Able to provide individual or project oversight on rapid prototyping/POC efforts and large-scale enterprise wide roll out planning

• Experience working with technology and business partners to develop secure and scalable solutions

• Experience working as an Agile/Technical Lead in an Agile environment

• Experience with developing solutions for data-driven applications

• Experience with GIS is a plus

• Knowledge of SAP and/or ESRI a plus

• Knowledge of Data Vault 2.0 modeling techniques a plus

• Excellent communication and collaboration skills and a strong work ethic

• Very strong analytical and problem-solving skills

• Able to build strong relationships with and influence at the Director level of leadership

• Able to build a sense of trust and rapport that creates a comfortable & effective workplace

• Able to further community & elevate team performance

• Brings a high-energy and passionate outlook to the role and has strong sense of ownership



  • Oakland, United States GTT, LLC Full time

    Java Streaming Technical LeadDirect HireSalary $132k - $226k / YearDepartment OverviewOur client's Information Technology (IT) organization is comprised of various unified departments that collaborate effectively in order to deliver high-quality technology solutions.The Data, Analytics & Insights Team within IT is responsible for working collaboratively with...


  • Oakland, United States GTT, LLC Full time

    Java Streaming Technical LeadDirect HireSalary $132k - $226k / YearDepartment OverviewOur client's Information Technology (IT) organization is comprised of various unified departments that collaborate effectively in order to deliver high-quality technology solutions.The Data, Analytics & Insights Team within IT is responsible for working collaboratively with...


  • Oakland, CA, United States GTT, LLC Full time

    Java Streaming Technical Lead Our client's Information Technology (IT) organization is comprised of various unified departments that collaborate effectively in order to deliver high-quality technology solutions. The Data, Analytics & Insights Team within IT is responsible for working collaboratively with the lines of business (e.g., Electric Operations,...


  • Oakland, United States Tekwissen Full time

    Overview: Tekwissen Group is a workforce management provider throughout the USA and many other countries in the world. This Client is a holding company that primarily operates through Gas and Electric Company subsidiary. The subsidiary provides natural gas and electric service to residential and business clients. It also offers building and construction...


  • Oakland, CA, United States GTT, LLC Full time

    Java Streaming Technical Lead Direct Hire Salary $132k - $226k / Year Department Overview Our client's Information Technology (IT) organization is comprised of various unified departments that collaborate effectively in order to deliver high-quality technology solutions. The Data, Analytics & Insights Team within IT is responsible for working...


  • Oakland, United States PG&E Corporation Full time

    Requisition ID # 153132 Job Category: Information Technology Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland Department Overview PG&Es Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality technology...


  • Oakland, United States PG&E Full time

    Requisition ID# 153132 Job Category: Information Technology Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland Department Overview PG&E's Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality technology...


  • OAKLAND, United States PG&E Corporation Full time

    Requisition ID # 153132 Job Category: Information Technology Job Level: Individual ContributorBusiness Unit: Information TechnologyWork Type: HybridJob Location: Oakland  Department Overview PG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality...


  • OAKLAND, United States PG&E Corporation Full time

    Requisition ID # 153132 Job Category: Information Technology Job Level: Individual ContributorBusiness Unit: Information TechnologyWork Type: HybridJob Location: Oakland  Department Overview PG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality...


  • Oakland, United States Global Technical Talent Full time

    Expert Technical Lead Direct Hire Department Overview: Our client's Information Technology (IT) organization is comprised of various unified departments that collaborate effectively in order to deliver high-quality technology solutions. The Data & Analytics Team within IT is responsible for working collaboratively with the lines of business (e.g., Electric...


  • Oakland, CA, United States PG&E Corporation Full time

    Requisition ID # 153132  Job Category: Information Technology  Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland    Department Overview   PG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver...


  • Oakland, CA, United States PG&E Corporation Full time

    Requisition ID # 153132  Job Category: Information Technology  Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland    Department Overview   PG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver...


  • Oakland, CA, United States PG&E Corporation Full time

    Requisition ID # 153132  Job Category: Information Technology  Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland    Department Overview   PG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high...


  • Oakland, CA, United States PG&E Corporation Full time

    Requisition ID # 153132  Job Category: Information Technology  Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland    Department Overview   PG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high...


  • Oakland, United States Sunrise System Inc Full time

    Job Title: Expert Technical Lead Job ID: 24-01859 Location: Oakland, CA (This position is hybrid, working from your remote office and your assigned location based on business need.) Duration: STRAIGHT FTE/ Client's DIRECT HIRE Department Overview CLIENT's Information Technology (IT) organization is comprised of various unified departments which...

  • Technical Lead

    7 days ago


    Oakland, United States Tata Consultancy Services Full time

    Job Title DERMS Support Tech Lead Relevant Experience (inYrs) 8 years + Must Have Technical/Functional Skills•Provide primary technology support for the DERMSplatform.•Lead a team of resources in supporting theapplication and platform in DERMS•Manage and deploy vendor application updates(patches, hotfixes) along with system level upgrades•Manage and...


  • Oakland, United States PG&E Corporation Full time

    Requisition ID # 153133 Job Category: Information Technology Job Level: Individual ContributorBusiness Unit: Information TechnologyWork Type: HybridJob Location: Oakland  Department OverviewPG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality...


  • Oakland, United States PG&E Full time

    Requisition ID# 153133 Job Category: Information Technology Job Level: Individual Contributor Business Unit: Information Technology Work Type: Hybrid Job Location: Oakland Department Overview PG&E's Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality technology...

  • Expert Technical Lead

    2 weeks ago


    OAKLAND, United States PG&E Corporation Full time

    Requisition ID # 153133 Job Category: Information Technology Job Level: Individual ContributorBusiness Unit: Information TechnologyWork Type: HybridJob Location: Oakland  Department OverviewPG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality...

  • Expert Technical Lead

    2 weeks ago


    OAKLAND, United States PG&E Corporation Full time

    Requisition ID # 153133 Job Category: Information Technology Job Level: Individual ContributorBusiness Unit: Information TechnologyWork Type: HybridJob Location: Oakland  Department OverviewPG&E’s Information Technology (IT) organization is comprised of various unified departments which collaborate effectively in order to deliver high quality...