Current jobs related to Databricks Engineer - Portland - Genpact

  • Databricks Engineer

    4 weeks ago

    Portland, United States Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Databricks Engineer

    2 months ago

    Portland, United States Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • IS Data Engineer

    4 weeks ago

    Portland, United States CareOregon Full time

    The IS Data Engineer ensures compliance with data governance and data security requirements while enabling faster data access, integrated data reuse and acceleration of time-to-solution for CareOregon’s data and analytics initiatives.In depth knowledge of commonly used cloud-based data warehouse platforms (e.g. Snowflake, Redshift, etc.)Ability to develop...

  • Azure Data Engineer

    4 weeks ago

    Portland, United States Tredence Inc. Full time

    Required Skills/Qualifications:• 9-14 years of relevant experience• Bachelor's and/or master’s degree in computer science or equivalent experience.• Strong communication, analytical and problem-solving skills with a high attention to detail.Desired Experience:• At least two years of experience building and leading highly complex, technical...

  • IS Data Engineer

    2 months ago

    Portland, Oregon, United States CareOregon Full time

    The IS Data Engineer ensures compliance with data governance and data security requirements while enabling faster data access, integrated data reuse and acceleration of time-to-solution for CareOregon's data and analytics initiatives.In depth knowledge of commonly used cloud-based data warehouse platforms (e.g. Snowflake, Redshift, etc.)Ability to develop...

  • IS Data Engineer

    3 weeks ago

    Portland, Oregon, United States CareOregon Full time

    The IS Data Engineer ensures compliance with data governance and data security requirements while enabling faster data access, integrated data reuse and acceleration of time-to-solution for CareOregon's data and analytics initiatives.In depth knowledge of commonly used cloud-based data warehouse platforms (e.g. Snowflake, Redshift, etc.)Ability to develop...

  • Senior Data Engineer

    3 weeks ago

    Portland, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: Senior Data EngineerLocation: Portland, OR- OnsiteDuration:12+ months Term: Full TimeRequired Skills/Qualifications:10-15 years of relevant experienceBachelor's and/or master's degree in computer science or equivalent experience.Strong communication, analytical and problem-solving skills with a high attention...

  • Forward Deployed Artificial intelligence

    4 weeks ago

    Portland, Oregon, United States SkyPoint Cloud Full time

    About Skypoint:The Skypoint AI platform (AIP) is tailored for regulated sectors, allowing users in healthcare, financial services, and the public sector to securely utilize precise AI. Equipped with generative AI Copilots and AI Agents, the platform facilitates question answering, analytics, and task automation, thereby boosting productivity and efficiency...

  • Data Engineer

    2 months ago

    Portland, United States RxAnte Inc Full time

    Job DescriptionJob DescriptionDescription:Data Engineer, Data ServicesCompany OverviewOver the next ten years, there will be at least 4.6 million hospitalizations from the misuse of prescription drugs in people 65 or older, resulting in $528 billion in annual avoidable costs. RxAnte is on a mission to improve people’s health by helping them get more from...

  • Sr. Data Engineer

    1 month ago

    Portland, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionKey Responsibilities:Collect, organize, and analyse large sets of data from various sources.Develop and implement data analyses, data collection systems, and other strategies that optimize statistical efficiency and quality.Interpret data, analyse results using statistical techniques, and provide ongoing reports.Identify,...

  • Senior Software Engineer

    1 week ago

    Portland, Oregon, United States Gilder Search Group Full time

    Join Our Innovative TeamWe are seeking a talented Senior Software Engineer to be part of a premier group of software developers dedicated to designing, implementing, and launching a consumer-oriented product that leverages AI technology to provide reliable information, empowering users to make informed decisions.This is a full-time, fully remote position,...

  • Senior AI/ML Software Engineer with DevOps Exp

    1 month ago

    Portland, United States smart folks inc Full time

    Job DescriptionJob DescriptionRole : AI/ML Software Engineer with DevOps ExpLocation: Portland, OR (Day 1 Onsite) Contract Positions . No of opening 2 Total EXP : 10+ Years Job Description:Required skills: Python, AWS, API services, SQL Databases, KubernetesNice-to-have skills: AWS Sagemaker, Mathematical Optimization, TerraformProven ability to write...

  • Marketing Analytics Lead

    7 days ago

    Portland, Oregon, United States Providence Full time

    **Key Responsibilities:**The Marketing Analytics Lead will work closely with our regional marketing team, marketing engineering/architecture, and executives to provide thought leadership on measuring the effectiveness and financial outcomes of all marketing activities and the consumer journey.As a member of the Marketing Analytics Team, the Marketing...

  • Principal Marketing Analytics DIG

    3 months ago

    Portland, United States Providence Full time

    The Principal Marketing Analytics DIG works alongside our reginal marketing team, marketing engineering/architecture, and executives in providing deep thought leadership around measuring the effectiveness and financial outcome all marketing activity and the consumer journey. Working as a part of the Marketing Analytics Team, the Principal must have a broad...

  • Senior Data Scientist

    3 weeks ago

    Portland, Oregon, United States Providence Health & Services Full time

    Job DescriptionThe Senior Data Scientist is a subject matter expert who leverages data science and knowledge of health care data to develop data-driven solutions focused on research. The Senior Data Scientist builds predictive models, experimental designs and web analytics, machine learning algorithm using advance technologies to support research...

Databricks Engineer

2 months ago

Portland, United States Genpact Full time

Inviting applications for the role of Senior Principal Consultant- Databricks Engineer

We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data warehousing, and big data technologies. They will work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.


Responsibilities

  • Architect and design solutions to meet functional and non-functional requirements.
  • Lead the design, implementation, and optimization of our Databricks platform.
  • Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
  • Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
  • Collaborate with other teams to ensure that our Databricks platform is integrated with our other systems and technologies.
  • Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
  • Provide guidance and support to our data engineering team on Databricks-related issues.
  • Create and review architecture and solution design artifacts.
  • Evangelize re-use through the implementation of shared assets.
  • Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
  • Proactively guide engineering methodologies, standards, and leading practices.
  • Guidance of engineering staff and reviews of as-built configurations during the construction phase.
  • Provide insight and direction on roles and responsibilities required for solution operations.
  • Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
  • Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Ability to analyze and operate at various levels of abstraction.
  • Ability to balance what is strategically right with what is practically realistic.
  • Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
  • Supporting and developing our people, including learning & development, certification & career development plans
  • Providing technical governance and oversight for platform design and implementation
  • Should have technical foresight to understand new technology and advancement.
  • Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance
  • Should have Technical Experience in AWS Cloud Data Engineering services and solutions.
  • Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives
  • Evangelizing the Data Engineering service offerings to both internal and external stakeholders
  • Development of Whitepapers, blogs, webinars and other though leadership material
  • Development of Go-to-Market and Service Offering definitions for Data Engineering
  • Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.
  • Expand the business within existing accounts and help clients, by building and sustaining strategic executive relationships, doubling up as their trusted business technology advisor.
  • Position differentiated and custom solutions to clients, based on the market trends, specific needs of the clients and the supporting business cases.
  • Build new Data capabilities, solutions, assets, accelerators, and team competencies.
  • Manage multiple opportunities through the entire business cycle simultaneously, working with cross-functional teams as necessary.


Qualifications we seek in you

Minimum qualifications

  • Excellent technical architecture skills, enabling the creation of future-proof, complex global Platform solutions on Databricks.
  • Excellent interpersonal communication and organizational skills are required to operate as a leading member of global, distributed teams that deliver quality services and solutions.
  • Ability to rapidly gain knowledge of the organizational structure of the firm to facilitate work with groups outside of the immediate technical team.
  • Knowledge and experience in IT methodologies and life cycles that will be used.
  • Familiar with solution implementation/management, service/operations management, etc.
  • Leadership skills can inspire others and persuade.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Experience in a Platform architecture role using service and hosting solutions such as private/public cloud IaaS, PaaS, and SaaS platforms.
  • Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
  • Must have strong hands-on experience on various cloud services like Lambda, S3, Security, Monitoring, Governance & Compliance.
  • Hands-on Experience to design and build Databricks based solution on AWS.
  • Hands-on experience to design and build solution powered by DBT models and integrate with Databricks.
  • Must have good knowledge of Data Engineering concept and related services of cloud.
  • Must have good experience in Python and Spark.
  • Must have good experience in setting up development best practices.
  • Strong knowledge of docker and Kubernetes.
  • Experience with claims-based authentication (SAML/OAuth/OIDC), MFA, RBAC, SSO etc.
  • Knowledge of cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.
  • Experience building and supporting mission-critical technology components with DR capabilities.
  • Experience with multi-tier system and service design and development for large enterprises
  • Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.
  • Exposure to infrastructure and application security technologies and approaches
  • Familiarity with requirements gathering techniques.


Preferred qualifications

  • Must have designed E2E Platform architecture on Databricks covering all the aspect of data lifecycle starting from Data Ingestion, Transformation, Serve and consumption.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in DevSecOps working closely on Data Engineering based project
  • Must have designed and implemented at least 2-3 project end-to-end in Databricks.
  • Strong expertise in Databricks component
  • Delta lake
  • db API 2.0
  • SQL Endpoint – Photon engine
  • Delta Sharing
  • Unity Catalog
  • Security management
  • Platform governance, Auditing & Compliance
  • Data Security
  • Proficiency in AWS services including but not limited to S3, EC2, IAM, VPC, EKS, Lambda, Glue, Private Link, KMS, CloudWatch, EMR etc.
  • Must have knowledge of new features available in Databricks and its implications along with various possible use-case.
  • Strong expertise in designing SOX & GDPR compliant platform architecture.
  • Must know how to manage various Databricks account & workspace and its integration with other applications.
  • Must know how to enable geo redundancy and DR capabilities on databricks.
  • Proficient in designing and implementing Everything as a code
  • Infrastructure as a code
  • Configuration as a code
  • Configuration as a code
  • Security configuration as a code
  • Must have strong expertise in designing platform with strong observability and Monitoring standards.
  • Proficient in developing and setting best practices of various DevSecOps activities including CI/CD.
  • Must have knowledge of Databricks cluster optimization and its integration with various cloud services.
  • Must have strong performance optimization skills to improve efficiency and reduce cost.
  • Must have strong communication skills and have worked with cross platform team.
  • Must have great attitude towards learning new skills and upskilling the existing skills.
  • Responsible to set best practices around Databricks CI/CD.
  • Must understand composable architecture to take fullest advantage of Databricks capabilities.
  • Good to have Rest API knowledge.
  • Good to have understanding around cost distribution.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Software development full lifecycle methodologies, patterns, frameworks, libraries, and tools
  • Knowledge of programming and scripting languages such as JavaScript, Bash, SQL, Python, etc.
  • Experience in distilling complex technical challenges to actionable decisions for stakeholders and guiding project teams by building consensus and mediating compromises when necessary.
  • Experience coordinating the intersection of complex system dependencies and interactions
  • Experience in solution delivery using common methodologies especially SAFe Agile but also Waterfall, Iterative, etc.

Demonstrated knowledge of relevant industry trends and standards