Senior DATA ENGINEER

1 month ago

Plano, United States ConnectedX, Inc. Full time

What we are looking for

Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem. Success in designing and implementing scalable cloud solutions, data pipelines, optimizing data architectures, and delivering high-quality analytics solutions. Proficient at collaborating with cross-functional teams to drive business insights and data-driven decision-making. Skilled in automating processes and ensuring high availability and security in cloud environments.

  • Implemented scalable cloud architectures for enterprise applications using AWS services for Data platforms
  • Develops and maintains CI/CD pipelines to automate deployment processes and ensure continuous integration.
  • Leads teams in designing and developing centralized data warehouses and data lakes. Preferably using redshift
  • Creates and optimizes ETL processes to ingest and transform large datasets for analytical purposes.
  • Utilizes Apache Airflow for scheduling and monitoring data workflows to ensure timely data delivery.
  • Implements data partitioning, compression strategies, and query optimization techniques.
  • Develops serverless applications using AWS Lambda and API Gateway to reduce operational costs.
  • Automates configuration management using tools like Ansible and Terraform.
  • Conducts security assessments and implemented IAM and VPC best practices to secure cloud environments.
  • Integrated monitoring and logging solutions using CloudWatch, Prometheus, and ELK Stack for performance and security monitoring.
  • Created automated reporting solutions and interactive dashboards using Tableau, Looker, and Power BI.
  • Conducts data quality checks and ensured data integrity across multiple data pipelines.
  • Ability to securely ingest data from public and other Toyota sources to better insights

Technical Skills:

Cloud Platforms: AWS (EC2, S3, RDS, Lambda, CloudFormation, VPC, IAM, Redshift)

Data Engineering: ETL, Data Warehousing, Data Modeling, SQL, NoSQL

Big Data Technologies: Hadoop, Spark, Athena, materialized views

DevOps Tools: Docker, Kubernetes, Jenkins, Terraform, Git, Big query, Firebase

Workflow Orchestration: Apache Airflow

Programming Languages: Python, SQL, Java, Go, Bash

Data Visualization: Tableau, Looker, Power BI, Quicksight

Monitoring & Logging: CloudWatch, Prometheus, Grafana, ELK Stack

Other Tools: GitLab CI/CD

Security: ForgeRock, Keycloak, SSO solutions for data platforms

Senior DATA ENGINEER

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Syntricate Technologies Full time

    Job Title: Senior Big Data/Data EngineerAt Syntricate Technologies, we are seeking a highly skilled Senior Big Data/Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using cutting-edge technologies.Key Responsibilities:Design and...

  • Senior Data Engineer

    2 weeks ago

    Plano, Texas, United States One Park Financial Full time

    Senior Data EngineerAt One Park Financial, we're seeking a highly skilled Senior Data Engineer to lead the transformation of our technology data lake and analytics platform within the AWS ecosystem. As a key member of our team, you'll be responsible for designing and building the necessary infrastructure to support advanced data and AI capabilities.Key...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Capital One Full time

    Job Title: Senior Data EngineerAbout the Role:Capital One is seeking a Senior Data Engineer to join our product data team. As a Senior Data Engineer, you will be responsible for building and maintaining sophisticated data pipelines that ingest data from major auto customers, utilizing advanced AWS services including EMR, S3, and EC2. Your work will directly...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Syntricate Technologies Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have a strong background in Java and experience working with large data sets, ETL, and high-volume data collection. Additionally, they should have expertise in Spark, AWS, and RDBMS. A strong understanding of software...

  • Senior Azure Data Engineer

    3 weeks ago

    Plano, Texas, United States Motion Recruitment Full time

    Senior Azure Data EngineerWe are seeking a highly skilled Senior Azure Data Engineer to join our team at Motion Recruitment. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Senior Data Engineer

    2 weeks ago

    Plano, Texas, United States Capital One Full time

    Job DescriptionCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights.Key Responsibilities:Design and build Enterprise Level scalable, low-latency,...

  • Senior Software Engineer

    3 weeks ago

    Plano, Texas, United States Smart Data Solutions Full time

    As a technology leader in healthcare process automation and interoperability, Smart Data Solutions (SDS) is a strategic partner that utilizes data and intelligent automation to digitally transform operations and deliver outcomes for clients, reducing costs, streamlining workflows, and improving overall customer experience.SDS is seeking a skilled Senior...

  • Senior Big Data/Data Engineer

    3 days ago

    Plano, United States Syntricate Technologies Full time

    J OB Description: Senior Big Data/Data Engineer - 9 roles left Plano, TX (1 offer resume attached) Sample Resume attached (Skills: Java/Python, AWS (EMR/Glue), Spark/Snowflake) (can submit non local) (EAD GC,USC, GC) Pay rate- $80-85 Sample resume attached Big data engineer with AWS experience / Java Python - combination of both ,More emphasis on Java...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States One Park Financial Full time

    Job OverviewOne Park Financial is seeking a highly skilled Senior Data Engineer to lead the transformation of our technology data lake and analytics platform within the AWS ecosystem.This role is pivotal in enabling Data Science and Advanced Analytics by designing and building the necessary infrastructure to support these advanced capabilities.Define and...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Public Storage Full time

    Job SummaryWe are seeking a highly skilled Data Engineer II to join our team and play a key role in advancing our cutting-edge data infrastructure. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable data systems to support advanced analytical capabilities and meet evolving business needs.Key...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Zenith Services Inc. Full time

    About the RoleZenith Services Inc. is seeking a highly skilled Senior Software Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures on AWS.Key ResponsibilitiesCollaborate with cross-functional teams to design and implement data...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Trident Consulting Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with 9 to 12 years of experience to join our dynamic team.The ideal candidate will have extensive experience in Unix, Python, and AWS, with a strong background in project management and leadership.This hybrid role requires excellent communication and interpersonal skills,...

  • Senior Azure Data Engineer

    2 weeks ago

    Plano, Texas, United States Motion Recruitment Full time

    Are you an experienced Azure Data Engineer looking for a challenging role in cloud data solutions? Motion Recruitment is seeking a Senior Azure Data Engineer to join their team and contribute to the development of cloud-based ETL data processes.This is a senior-level opportunity that requires a minimum of 6 years of experience in Azure PaaS/SaaS solutions,...

  • Data Engineer

    3 weeks ago

    Plano, Texas, United States Zenith services Full time

    Senior Data EngineerZenith Services is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data pipelines and architectures.Key Responsibilities:Design and develop scalable data pipelines using Informatica Cloud (IICS) and...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States Capital One Full time

    About the Role:Capital One is seeking a Senior Data Engineer to join our Sales Data Team, dedicated to innovating and optimizing our data pipeline architecture.As a key member of our team, you will be responsible for building and maintaining sophisticated data pipelines that ingest data from major auto customers, utilizing advanced AWS services including...

  • Senior Data Engineer

    3 weeks ago

    Plano, Texas, United States UnitedHealth Group Full time

    Job SummaryAs a Senior Data Engineer at UnitedHealth Group, you will be responsible for designing and implementing data storage and retrieval systems that meet the needs of our business. This includes analyzing current business practices and identifying future opportunities for leveraging data storage and retrieval system capabilities.Key Responsibilities-...

  • Senior Data Engineer

    1 month ago

    Plano, United States Capital One Full time

    Plano 7 (31067), United States of America, Plano, TexasSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems...

  • Senior Snowflake Data Engineer

    3 weeks ago

    Plano, Texas, United States Visionary Innovative Technology Solutions LLC Full time

    We are seeking a highly skilled Senior Data Engineer with extensive experience in Snowflake, data warehousing, ETL, and BI projects.The ideal candidate will have expertise in Snowflake Database and query optimization, as well as data modeling.Additionally, experience in implementing complex stored procedures, standard DWH and ETL concepts, and basic...

  • Senior Data Engineer

    3 weeks ago

    Plano, United States Capital One Full time

    Plano 7 (31067), United States of America, Plano, TexasSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems...

  • Senior Data Analytics Engineer

    4 weeks ago

    Plano, Texas, United States Talent Groups Full time

    Job Title: Senior Data Analytics EngineerJob Type: Direct HireLocation: Onsite in Plano, TXSalary Range: $105,000-120,000Our client is only able to work with W2 candidates at this time (US Citizen or Green Card Perm Residents)We are seeking a highly skilled Senior Data Analytics Engineer to join our team. As a key member of our data analytics team, you will...