Big Data Platform Lead

3 weeks ago


Toronto, United States Talent Hires Full time
Hiring on Big Data Platform Lead - Full Time Toronto, Canada (Hybrid role - 2days onsite) Required:
  • 10+ years of relevant experience in a related field of job function.
  • Experience with: Java, Spring,
  • Experience with big data tools: Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.
  • Experience with relational SQL and NoSQL databases, including Cassandra.
  • Experience designing production grade, scalable applications and microservices.
  • 5+ years of Capital Markets experience.
  • Experience working on Agile Teams
Responsibilities:
  • Create and maintain optimal data pipeline architecture
  • Implement data products curated by our Chief Data Office, as well as custom data models for fit for use.
  • Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.
  • Optimize data pipelines for performance and scalability.
  • Provide technical support to promptly resolve escalated incidents/outages.
  • Develop and document a detailed solution design, impart your subject matter expertise throughout life cycle.
  • Take business, Enterprise Architecture, system performance and development standards requirements, then develop functional, technical and user interface designs for an application and/or system.
  • Find ways to keep costs low, help come up with strategic solutions to support cost effectiveness and enhance stakeholder experience.
  • Conduct code reviews to address quality, standards compliance, reusability and ease of maintenance, Operational Readiness Reviews, and support gating and review signoffs for solution design.
  • Ensure design leverages existing reusable components, traces back to business requirements, and that new modules are designed with reusability in mind.
  • Keep up to date with the latest industry trends and technologies related to data engineering.

  • Sr Platform Lead

    3 weeks ago


    Toronto, United States Brains Technology Solution Full time

    Role : Sr Platform Lead - Full Stack - canada ( Java & Big Data ) Location : Toronto, ON (Hybrid - 2 days/week onsite)Required:10+ years of relevant experience in a related field of job function.Experience with: Java, Spring,Experience with big data tools: Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.Experience with relational SQL and NoSQL...


  • Toronto, United States Activesoft, Inc. Full time

    Job Title: Sr Platform Lead - Full StackLocation: Toronto, ON (Hybrid - 2 days/week onsite)Employment Type: Full Time Experience: 10+Duration: Long Term Key Technology: Java, Big Data Skills and Experience Required:10+ years of relevant experience in a related field of job function.Experience with: Java, Spring,Experience with big data tools: Hadoop, HDFS,...

  • Data Engineer Lead

    2 weeks ago


    Toronto, Ohio, United States John Hancock Full time

    Job Title: Data Engineer LeadWe are seeking a highly skilled Data Engineer Lead to join our team at John Hancock. As a key member of our data engineering team, you will be responsible for designing and delivering data pipelines, data warehouses, and big data solutions that drive business insights and decision-making.Key Responsibilities:Design and build...

  • Big Data Developer

    4 weeks ago


    Toronto, United States Cynet Systems Full time

    We are looking for Big Data Developer for our client in Toronto, ON Job Title: Big Data Developer Job Location: Toronto, ON Job Type: Contract Job Description:6-8 years of experience.Experience in Programming languages (Java, Scala, SQL, Unix scripting), frameworks (Spring boot, Open Shift containers), DevOps (Jenkins, UCD etc.) and Cloud (Azure, AWS...


  • Toronto, Ohio, United States Mastech Digital Full time

    Job Title: Azure Synapse Data EngineerJob Summary:Mastech Digital is seeking an experienced Azure Synapse Data Engineer to join our team. As a key member of our consulting domain, you will be responsible for designing, implementing, and maintaining large-scale data warehouses and big data ecosystems on the Microsoft Azure platform.Key Responsibilities:-...


  • Toronto, United States Canadian Tire Corporation Full time

    What you'll do: Canadian Tire is seeking a highly skilled and experienced Manager, Automotive Data Infrastructure to join our dynamic team. The successful candidate will be responsible for managing and optimizing our automotive aftermarket parts fitment catalogue, ensuring data accuracy, and enhancing our stores and customers experiences. This role demands...


  • Toronto, United States Canadian Tire Corporation Full time

    Job DescriptionWhat you'll do:Canadian Tire is seeking a highly skilled and experienced Manager, Automotive Data Infrastructure to join our dynamic team. The successful candidate will be responsible for managing and optimizing our automotive aftermarket parts fitment catalogue, ensuring data accuracy, and enhancing our stores and customers experiences....


  • Toronto, United States Canadian Tire Corporation Full time

    What you'll do:Canadian Tire is seeking a highly skilled and experienced Manager, Automotive Data Infrastructure to join our dynamic team. The successful candidate will be responsible for managing and optimizing our automotive aftermarket parts fitment catalogue, ensuring data accuracy, and enhancing our stores and customers experiences. This role demands a...


  • Toronto, United States Canadian Tire Corporation Full time

    What you'll do:Canadian Tire is seeking a highly skilled and experienced Manager, Automotive Data Infrastructure to join our dynamic team. The successful candidate will be responsible for managing and optimizing our automotive aftermarket parts fitment catalogue, ensuring data accuracy, and enhancing our stores and customers experiences. This role demands a...


  • Toronto, United States NTT DATA Americas, Inc Full time

    NTT DATA currently hiring onsite in Toronto ,OntarioContract 100% onsite Must have experience migrating VMware to OpenShift VirtualizationAn infrastructure architect for VMware and OpenShift may have responsibilities that include: Assessing needs: Evaluating an organization's computer systems and identifying potential issues Designing and building: Creating...


  • Toronto, United States Cynet Systems Full time

    We are looking for Business Analyst AML Financial Crime for our client in Toronto, ON Job Title: Business Analyst AML Financial Crime Job Location: Toronto, ON Job Type: Contract Job Description:5+ years of experience with business systems analysis and software development.Expertise in data mapping and creating data mapping specifications.Familiarity with...


  • Toronto, United States Lorven Technologies, Inc. Full time

    Responsibilities: Know pandas and Python ( Important & Mandatory) Must have Experience working on projects (Agile methodologies) related to pricing/risk and Market and Credit/Counterparty data for Risk engines Relevant Risk experience: Modeling of different product types including Bonds, Equity, FX etc. for Market and Counterparty Credit Risk exposures...

  • Lead Python Developer

    3 weeks ago


    Toronto, United States Collabera LLC Full time

    Must Haves: 8+yrs of Python Development Hands on coding QuartzNew features, maintenance, enhancements, bug fixesMarket Risk/ Margin/ Regulatory experience Enterprise banking clients SQL Distributed environment - Large scale application development- delivering concurrencyDatabase such as Oracle, Hadoop, CassandraObject Database (i.e. Cassandra)Prior big 5...

  • Azure Data Engineer

    3 days ago


    Toronto, United States Experis Full time

    Azure Data Engineer Start ASAP End Date: Oct-6-2025, renewable Work Location: Saint Laurent, QC. Hybrid, 2 days per week onsite, the other days remote Our client, a global leading consulting firm, is looking for a Data Engineer. Responsibilities: Leverage your understanding of complex data analysis and modeling to ensure project teams and clients can...

  • Data Center

    4 weeks ago


    Toronto, United States Net2Source Inc. Full time

    Job Title: Data Center TechnicianLocation: Toronto, ON (Onsite)Requirements Exceptional server hardware knowledge with deep understanding of all component & system type failures Ability to assist in conducting failure analysis on field issues. Proven history in RCA and/or Failure analysis Solid experience with IPMI utilization in diagnostics Administer...


  • Toronto, OH, United States Canadian Tire Corporation Full time

    What you'll do:Canadian Tire is seeking a highly skilled and experienced Manager, Automotive Data Infrastructure to join our dynamic team. The successful candidate will be responsible for managing and optimizing our automotive aftermarket parts fitment catalogue, ensuring data accuracy, and enhancing our stores and customers experiences. This role demands a...

  • Data Engineer

    3 weeks ago


    Toronto, United States Virtusa Corporation Full time

    CORE Expectation: AWS, Glue, SQL, Redshift, Lambda Data Engineer (Multiple roles - Mid to Lead designation) Hybrid Onsite from Toronto ON Canada Job Description :Minimum 6-12+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Devops, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the...


  • Toronto, United States Arthur Lawrence Full time

    Arthur Lawrence is seeking an experienced Business Systems Analyst (BSA) with a strong background in banking and Microsoft cloud technologies. The ideal candidate will have hands-on expertise in data profiling, data mapping, and classification, and experience working with Straight Through Transaction Management (STTM), SQL, and Oracle databases. This role...


  • Toronto, Ohio, United States MaintainX Full time

    About the RoleMaintainX is a leading mobile-first workflow management platform for industrial and frontline workers. As a Revenue Operations Analyst, you will support stakeholders across multiple cross-functional teams, driving strategic growth and providing analytical support to optimize operational processes and contribute to strategic planning efforts.Key...


  • Toronto, United States Excellerent Technology Solutions Full time

    JAVA Developer /Production Support Profile (Contract to Hire) 10+ years of overall IT experience5+ years of 24/7 production support experienceVery strong knowledge of both incident and problem management processShould have experience in handling production support for Tier 1 or Tier 1 Critical application. Preferable in banking domain applicationsVery...