Senior Data Engineer

1 week ago

pittsburgh, United States Tredence Inc. Full time

About Tredence­:

Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. Headquartered in the San Francisco Bay Area, the company serves clients in the US, Canada, Europe, and SE Asia. Learn more at www.tredence.com

Required Skills/Qualifications:

  • 10-14 years of relevant experience
  • Bachelor's and/or master’s degree in computer science or equivalent experience.
  • Strong communication, analytical and problem-solving skills with a high attention to detail.


Desired Experience:

  • At least two years of experience building and leading highly complex, technical engineering teams.
  • Strong hands-on experience in Databricks
  • Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
  • Experience managing distributed teams preferred.
  • Comfortable working with ambiguity and multiple stakeholders.
  • Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
  • Expertise on Azure Cloud platform
  • Good SQL knowledge
  • Knowledge on orchestrating workloads on cloud
  • Ability to set and lead the technical vision while balancing business drivers
  • Strong experience with PySpark, Python programming
  • Proficiency with APIs, containerization and orchestration is a plus
  • Experience handling large and complex sets of data from various sources and databases
  • Solid grasp of database engineering and design principles.
  • Experience with Unity Catalog.
  • Familiarity with CI/CD methods desired
  • Good Exposure on Snowflake
  • Good to have Teradata Experience (not Mandatory)


Responsibilities:

  • Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
  • Follow the Agile development methodology; think strategically and execute methodically
  • Develop and manage capacity and growth projection forecasts of the environment within budgets
  • Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements
  • Drive optimization, testing and tooling to improve quality of solutions
  • Manage teams that build and operate high volume distributed systems in a SaaS environment
  • Great at devising efficient processes that increase velocity and quality
  • Train counterparts in the data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.
  • Accountable for operational effectiveness in performance, uptime, release management of the enterprise data platform


About you:

You are self-motivated, collaborative, eager to learn, and hands on

You love trying out new apps, and find yourself coming up with ideas to improve them

You stay ahead with all the latest trends and technologies

You are particular about following industry best practices and have high standards regarding quality


Why join Tredence?

There is a reason we are one of the fastest growing private companies in the country You will have the opportunity to work with some of the smartest, friendliest, hardest working people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our clients, some of the largest and most innovative businesses in the world. We offer a 401k match; full medical, dental and vision benefits, a fun team atmosphere and a work life balance. Our people are our greatest asset and we value every one of them. Come see why we’re so successful in one of the most competitive and fastest growing industries in the world

  • Senior Data Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Highmark Health Full time

    Job Title: Senior Data EngineerJob Summary:Highmark Health is seeking a Senior Data Engineer to lead our data engineering team in delivering high-performance data solutions. As a key member of our team, you will design, build, and maintain well-engineered data solutions in various environments, including traditional data warehouses, Big Data solutions, and...

  • Senior Data Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States YinzCam, Inc. Full time

    About YinzCam, Inc.We are a leading provider of digital products for professional sports teams and leagues worldwide.The RoleAs a Senior Data Engineer, you will be responsible for collecting, organizing, and analyzing large datasets to provide actionable insights for our clients.Key ResponsibilitiesDesign and implement new ETL workflows using Python to...

  • Senior Mechanical Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Jacobs Full time

    At Jacobs, we're pushing the boundaries of what's possible in data center infrastructure design. We're seeking a Senior Mechanical Engineer to join our team of innovative engineers who are shaping the future of mission-critical facilities.As a Senior Mechanical Engineer, you'll be responsible for designing and delivering high-performance mechanical systems...

  • Senior Data Engineer

    2 weeks ago

    Pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Senior Data Engineer

    1 week ago

    pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....

  • Senior Data Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States YinzCam Full time

    About YinzCamYinzCam is a leading provider of digital products for professional sports teams and leagues worldwide. Our innovative solutions are used by over 200 teams, including clubs in the NFL, NBA, MLS, NHL, LigaMX, AFL, and more.The RoleWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will...

  • Senior Mechanical Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Jacobs Full time

    At Jacobs, we're shaping the future of infrastructure design. As a Senior Mechanical Engineer, you'll play a key role in delivering innovative solutions for our clients' most complex projects.Data Center Infrastructure DesignYou'll be responsible for designing and developing data center infrastructure, working closely with our team of experts to deliver...

  • Senior ETL Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Smart IT Frame LLC Full time

    Job Title: Senior ETL EngineerJob Summary:We are seeking a highly skilled Senior ETL Engineer to join our team at Smart IT Frame LLC. The ideal candidate will have 8 to 10 years of experience in designing, developing, and optimizing ETL processes, with strong expertise in Hadoop, PySpark, Spark, and Dask.Key Responsibilities: Design, develop, and optimize...

  • Senior Data Governance Lead

    1 month ago

    Pittsburgh, Pennsylvania, United States Techstra Solutions Full time

    Job Title: Senior Data Governance LeadWe are seeking an experienced Senior Data Governance Lead to join our team at Techstra Solutions. As a key member of our organization, you will be responsible for driving and building out valuable business use cases, supporting and elevating Data Lineage strategy, and leveraging data models to visualize data...

  • Data Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Synergy Staffing Full time

    Job Title: Data EngineerJob Summary: We are seeking a skilled Data Engineer to design, build, and maintain data pipelines and data models using Snowflake and Azure technologies. The ideal candidate will work closely with data analysts, data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis.Key...

  • Senior Data Integration Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Diverse Lynx Full time

    Data Integration ExpertiseWe are seeking a highly skilled Data Integration Expert to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, testing, deploying, maintaining, and improving data integration pipelines.Key Responsibilities:Design and develop data integration pipelines...

  • Data Engineer

    4 weeks ago

    Pittsburgh, United States Synergy Staffing Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerLocation: Pittsburgh, PA(may have to come on-site a couple times a year)Job Type: Contract to HireJob Summary: As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and data models using Snowflake and Azure technologies. You will work closely with data...

  • Data Engineer

    4 weeks ago

    Pittsburgh, United States Synergy Staffing Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerLocation: Pittsburgh, PA(may have to come on-site a couple times a year)Job Type: Contract to Hire Job Summary: As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and data models using Snowflake and Azure technologies. You will work closely with data...

  • Data Engineer for Advanced Health Experiences

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Highmark Full time

    We are on a mission to deliver remarkable health experiences, freeing people to be their best.Our approach requires a 360-degree perspective to deliver the right message, guidance, care, outcome, and experiences at the right time.As a Senior Data Engineer, you will play a key role in developing advanced data solutions that support our mission.Key...

  • Senior Data Engineer

    1 month ago

    pittsburgh, United States YinzCam, Inc. Full time

    NOTE: This in an in-office role in Pittsburgh, PA, USA. ABOUT YINZCAM Our digital products are used by 200+ professional sports teams and leagues around the world, including clubs in the NFL, NBA, MLS, NHL, LigaMX, AFL (Australia), and more.THE ROLEAs a Senior Data Engineer, you will be responsible for collecting, organizing and analyzing terabytes of...

  • Senior Data Engineer

    5 months ago

    Pittsburgh, United States YinzCam, Inc. Full time

    NOTE: This in an in-office role in Pittsburgh, PA, USA. ABOUT YINZCAM Our digital products are used by 200+ professional sports teams and leagues around the world, including clubs in the NFL, NBA, MLS, NHL, LigaMX, AFL (Australia), and more.THE ROLEAs a Senior Data Engineer, you will be responsible for collecting, organizing and analyzing terabytes of...

  • Data Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States PNC Full time

    Job SummaryPNC is seeking a highly skilled Data Engineer to join our Enterprise Fraud Organization. As a key member of our team, you will be responsible for designing, building, and maintaining data services to support our business objectives. Key Responsibilities- Design and develop data services to meet business requirements- Collaborate with...

  • Senior Data Scientist

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Gilbane Building Company Full time

    About the RoleGilbane Building Company is seeking a highly skilled Senior Data Scientist to join our Information Technology Team. As a Top-10 ENR Contractor, we are a family-owned business with 45 offices that has been shaping communities since 1870.We are committed to delivering projects safely and on-time, and we are looking for a coach/leader who leads...

  • Senior Software Engineer

    4 weeks ago

    Pittsburgh, Pennsylvania, United States TTI of USA, Inc. Full time

    Job Description:At TTI of USA, Inc., we are seeking a highly skilled Senior Software Engineer to lead our application software development efforts. This role involves providing technical support in situations of moderate complexity, as well as being responsible for requirements gathering and BRD/SRD preparation.The ideal candidate will have a thorough...

  • Senior Data Architect

    4 weeks ago

    Pittsburgh, Pennsylvania, United States Saxon Global Full time

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team at Saxon Global. As a Senior Data Architect, you will be responsible for designing and implementing data models, architectures, and ETL processes to support analytics and reporting needs.### Responsibilities* Collaborate with business users, SMEs, and peer...