Senior Data Engineer

1 month ago


pittsburgh, United States Tredence Inc. Full time

About Tredence­:

Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. Headquartered in the San Francisco Bay Area, the company serves clients in the US, Canada, Europe, and SE Asia. Learn more at www.tredence.com

Required Skills/Qualifications:

  • 10-14 years of relevant experience
  • Bachelor's and/or master’s degree in computer science or equivalent experience.
  • Strong communication, analytical and problem-solving skills with a high attention to detail.


Desired Experience:

  • At least two years of experience building and leading highly complex, technical engineering teams.
  • Strong hands-on experience in Databricks
  • Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
  • Experience managing distributed teams preferred.
  • Comfortable working with ambiguity and multiple stakeholders.
  • Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
  • Expertise on Azure Cloud platform
  • Good SQL knowledge
  • Knowledge on orchestrating workloads on cloud
  • Ability to set and lead the technical vision while balancing business drivers
  • Strong experience with PySpark, Python programming
  • Proficiency with APIs, containerization and orchestration is a plus
  • Experience handling large and complex sets of data from various sources and databases
  • Solid grasp of database engineering and design principles.
  • Experience with Unity Catalog.
  • Familiarity with CI/CD methods desired
  • Good Exposure on Snowflake
  • Good to have Teradata Experience (not Mandatory)


Responsibilities:

  • Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
  • Follow the Agile development methodology; think strategically and execute methodically
  • Develop and manage capacity and growth projection forecasts of the environment within budgets
  • Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements
  • Drive optimization, testing and tooling to improve quality of solutions
  • Manage teams that build and operate high volume distributed systems in a SaaS environment
  • Great at devising efficient processes that increase velocity and quality
  • Train counterparts in the data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.
  • Accountable for operational effectiveness in performance, uptime, release management of the enterprise data platform


About you:

You are self-motivated, collaborative, eager to learn, and hands on

You love trying out new apps, and find yourself coming up with ideas to improve them

You stay ahead with all the latest trends and technologies

You are particular about following industry best practices and have high standards regarding quality


Why join Tredence?

There is a reason we are one of the fastest growing private companies in the country You will have the opportunity to work with some of the smartest, friendliest, hardest working people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our clients, some of the largest and most innovative businesses in the world. We offer a 401k match; full medical, dental and vision benefits, a fun team atmosphere and a work life balance. Our people are our greatest asset and we value every one of them. Come see why we’re so successful in one of the most competitive and fastest growing industries in the world


  • Senior Data Engineer

    5 months ago


    Pittsburgh, United States Indium Software Full time

    Job Description Title: Senior Data Engineer Education Qualification: Bachelor's degree in Computer Science, Information Technology, or a related field. Experience: 5-10 years Location: Pittsburgh Work Mode: Work from Office Required Skills: Snowflake engineers with strong SQL skills Snowflake Architecture and Design. SQL and Data Modeling. ETL and Data...


  • Pittsburgh, Pennsylvania, United States Data Ideology Full time

    About the RoleWe are seeking a highly skilled Chief Data Architecture Specialist to join our team at Data Ideology. As a key member of our organization, you will play a crucial role in designing and implementing robust data models for our enterprise systems and external sources.Estimated Salary: $140,000 - $180,000 per year (based on national averages for...


  • Pittsburgh, Pennsylvania, United States Data Ideology, LLC Full time

    Data Ideology - Senior Data Insights SpecialistWe are seeking a Senior Data Insights Specialist to join our team at Data Ideology, LLC. This role will involve leveraging business and technical knowledge to organize and manage deliverables in a data warehouse consolidation and business intelligence implementation project.Responsibilities:Data Analysis and...


  • Pittsburgh, Pennsylvania, United States Data Ideology Full time

    Senior Data Insights Professional sought by Data Ideology to lead our data analytics efforts. As a key member of our team, you will be responsible for driving data-driven decision making through the analysis and interpretation of complex data sets.Key Responsibilities:Data Analysis and Interpretation:Analyze data warehouse to identify trends, patterns, and...


  • Pittsburgh, Pennsylvania, United States Data Ideology, LLC Full time

    About the RoleWe are seeking an experienced Senior Data Governance Consultant to lead our clients' data governance initiatives and develop effective data governance strategies.Responsibilities:Leverage your expertise in data governance to design and implement data governance frameworks, policies, and best practices.Collaborate with clients to establish data...

  • Senior Data Engineer

    3 weeks ago


    Pittsburgh, United States Carnegie Mellon University Full time

    What We Do The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense capabilities. Actively partnering with sponsors, CMR identifies and addresses...


  • Pittsburgh, Pennsylvania, United States ConsultUSA Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Pipeline Engineer to join our team at ConsultUSA. In this role, you will be responsible for designing and implementing efficient data pipelines that meet the needs of our clients.About UsConsultUSA is a leading provider of IT consulting services, with a focus on delivering high-quality solutions that...

  • Data Engineer Leader

    2 weeks ago


    Pittsburgh, Pennsylvania, United States Indium Software Full time

    About UsIndium Software is a leading technology company that specializes in providing innovative solutions to clients across the globe.Job SummaryWe are seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing data architectures, ensuring data quality, and developing...

  • Senior Data Engineer

    4 weeks ago


    Pittsburgh, Pennsylvania, United States Indium Software Full time

    Job Title: Senior Data EngineerJob Summary:Data Engineers at Indium Software design, build, and maintain large-scale data systems. This role focuses on cloud computing, Snowflake architecture, and data warehousing concepts.Responsibilities:• Design and develop data pipelines using Snowflake and cloud computing platforms.• Implement data modeling,...


  • Pittsburgh, Pennsylvania, United States Data Ideology Full time

    About the RoleThe Senior Data Governance Consultant will lead consulting engagements, working with clients to design and implement comprehensive data governance strategies.This role involves deep expertise in data governance, lifecycle management, data security, risk management, and cybersecurity, with the ability to navigate complex environments and provide...


  • Pittsburgh, Pennsylvania, United States Carnegie Mellon University Full time

    Cybersecurity and Data Analysis OpportunityAt Carnegie Mellon University, we are seeking a skilled Senior Data Architect to join our team in Arlington, VA or Pittsburgh, PA. This is a full-time position with a salary of $120,000 - $180,000 per year.This role involves developing data architectures and analytics frameworks that support complex analysis and...

  • Senior Data Engineer

    1 month ago


    pittsburgh, United States Tredence Inc. Full time

    About Tredence­:Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making....


  • Pittsburgh, Pennsylvania, United States NTT DATA Group Corporation Full time

    Unlock Business Insights with Power BINTT DATA is seeking a highly skilled Sr Power BI Developer to join their team in the United States. This remote role offers a competitive salary range of $45 to $58 per hour, depending on location and qualifications.About the Role:We are looking for an experienced Power BI developer to design and develop reports and...


  • Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    Become a Data Engineering Specialist at the Software Engineering Institute and contribute to the development of data architectures and analytics frameworks that support complex analysis and operational missions.As a key member of our ORE team, you will manage the data lifecycle from modeling to database architecture, ensuring integrity and accessibility of...

  • Data Engineer

    2 weeks ago


    Pittsburgh, United States Duquesne Light Company Full time

    Duquesne Light Company, headquartered in downtown Pittsburgh, is a leader in providing electric energy and has been in the forefront of the electric energy market, with a history rooted in technological innovation and superior customer service. Today, the company continues its role as a leader in the transmission and distribution of...


  • Pittsburgh, Pennsylvania, United States TeleTracking Technologies, Inc. Full time

    We are seeking a highly skilled Data Solutions Engineer to join our team at TeleTracking Technologies, Inc. As a key member of our data engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth and improvement.About the Role:This is a challenging and rewarding role that requires strong...


  • Pittsburgh, Pennsylvania, United States Indium Software Full time

    Pittsburgh LocationThis Senior Data Engineer role is based in Pittsburgh, where you will have the opportunity to collaborate with our talented team and contribute to the development of innovative solutions.Work EnvironmentAs a Senior Data Engineer at Indium Software, you will work in a dynamic and collaborative environment that encourages creativity,...


  • Pittsburgh, Pennsylvania, United States Data Ideology, LLC Full time

    About the OpportunityData Ideology, LLC is seeking a seasoned Sr. Data Insights Specialist to drive business outcomes through data-driven decision making. This full-time role offers a salary of $125,000 per year.Job DescriptionThe ideal candidate will leverage their technical expertise to organize and manage deliverables in a data warehouse consolidation...


  • Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    About the RoleIn this position, you will be responsible for designing and implementing effective data pipelines and architectures, managing the data lifecycle, and ensuring data integrity and accessibility. You will also work collaboratively with mission partners to evaluate and improve their data engineering and analysis programs.


  • Pittsburgh, Pennsylvania, United States Indium Software Full time

    Company OverviewIndium Software is a cutting-edge technology company that pushes the boundaries of innovation. Our team is passionate about delivering exceptional results and making a meaningful impact on the world.Job DescriptionThis Senior Data Engineer position offers an exciting opportunity to work with our talented team and contribute to the development...