Lead AWS Data engineer

1 month ago

Dallas, United States InfoVision Inc. Full time

Senior AWS Data Engineer

Dallas, TX (Onsite)

Longterm


Job Description


Looking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be responsible for not only understanding data pipelines but, event streaming applications, and how to build systems that handle massive amounts of data while making it consumable by other application teams, users and data scientists.


You will also be assisting in the design and architecture of highly scalable, fault tolerant infrastructure capable of processing millions of operations per minute coming from millions of TVs, efficiently store petabytes of data and provide fast insights from the data. You will also be working with teams across the client enterprise to bring their data into our Big Data ecosystem, monitor data quality for cleanliness and fix discrepancies. Ensure data accuracy through validation tasks, perform root cause analysis and implement solutions for data prep and cleanliness, review data at all granular/aggregate levels, and versioning.


About You

  • You have a BS or MS in Computer Science or similar relevant field
  • You work well in a collaborative, team-based environment
  • You are an experienced engineering with 5+ years of experience
  • You have a passion for big data structures
  • You possess strong organizational and analytical skills related to working with structured and unstructured data operations
  • You have experience implementing and maintaining high performance / high availability data structures
  • You are most comfortable operating within cloud based eco systems
  • You enjoy leading projects and mentoring other team members

Specific Skills

  • Experience or knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
  • Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
  • Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
  • Experience or knowledge of object-oriented/object function scripting languages: i.e., Python, Java, Scala, R, SQL.
  • Experience or knowledge of data pipeline and workflow management tools: i.e., AWS Data Pipeline, Apache Airflow, Argo.
  • Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
  • Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
  • Hands-on experience in designing and maintaining data schema life-cycles.

  • Data Engineer

    4 weeks ago

    Dallas, Texas, United States Inizio Partners Full time

    About the JobWe are expanding our Data Engineering capabilities and seeking an experienced AWS, Python, and SQL Data Engineer to join our team. This role will involve designing and implementing new data pipelines using AWS, as well as training other team members. As a Data Engineer on our Data Engineering team, you will design, write, scale, and maintain...

  • Data Engineer

    1 month ago

    Dallas, Texas, United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...

  • Python AWS Data engineer

    3 weeks ago

    Dallas, United States Infovision Full time

    Senior AWS Data Engineer Dallas, TX (Onsite)LongtermJob DescriptionLooking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be...

  • Python AWS Data engineer

    3 weeks ago

    dallas, United States InfoVision Inc. Full time

    Senior AWS Data Engineer Dallas, TX (Onsite)LongtermJob DescriptionLooking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be...

  • Python AWS Data engineer

    2 weeks ago

    dallas, United States InfoVision Inc. Full time

    Senior AWS Data Engineer Dallas, TX (Onsite)LongtermJob DescriptionLooking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be...

  • Lead Data Engineer

    3 weeks ago

    Dallas, United States Photon Full time

    We are currently seeking an experienced Lead Data Engineer with over 9 years of experience in data engineering to join our team, and I wanted to reach out to see if you might be interested. Your expertise in Hadoop, Python, Kafka, Snap Logic, Snowflake, and AWS Cloud makes you a strong fit for this role.In this position, you would lead the development of...

  • Lead Data Engineer

    1 month ago

    Dallas, Texas, United States Alcority Full time

    Job Title: Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms.This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable...

  • Data Engineer

    5 months ago

    Dallas, United States NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Onsite) to join our team in Dallas, Texas (US-TX), United States (US).Job Responsibilities...

  • Data Engineer

    4 weeks ago

    Dallas, Texas, United States Diverse Lynx Full time

    Job Title: Data Engineer - AWS Cloud ExpertJob Summary: We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines that ensure seamless integration between on-premises and cloud-based environments.Key Responsibilities:* Design...

  • Lead Data Engineer

    2 weeks ago

    Dallas, United States INSPYR Solutions Full time

    Title: Lead Data Engineer Location: Irving, TX 75039 (Hybrid) Duration: Direct Hire Compensation: $175K - $200K Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Skillset / Experience: We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in...

  • Lead AWS Cloud Modernization Engineer

    3 weeks ago

    Dallas, United States First Tek Full time

    Must Have Requirements: • AWS - 5+ years solutioning and deploying applications in AWS • Lead Experience - 3+ years in a role demonstrating ability to own and drive deliverables with minimal technical guidance • AWS Lambda / Step Functions (serverless architectures) • AWS ECS / Fargate (proficiency with containerized deployments, e.g. Docker)...

  • AWS Cloud Engineer

    3 weeks ago

    Dallas, United States Caliber Sourcing Full time

    Job Description Location: Dallas, TX (In Office Position Only - Must be in Dallas Area, No relocation available) DLRdmv delivers innovative Title & Registration technology and Governmental Compliance solutions to the Automotive Industry. DLRdmv offers an exciting, entrepreneurial work environment for individuals interested in being part of a growing company...

  • Data Engineer II

    4 weeks ago

    Dallas, Texas, United States University of Texas at Dallas Full time

    Job SummaryAs a key member of the University of Texas at Dallas team, the Systems Engineer II will be responsible for designing, developing, and maintaining the data infrastructure required for accurate extraction, transformation, and loading (ETL) of data from various sources. This role demands a forward-thinking approach to building data infrastructures...

  • Data Engineer

    1 week ago

    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    2 weeks ago

    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    1 week ago

    Dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months + Hybrid - 3 Days on Site Interview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce). Job Description: Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience...

  • AWS Data Architect

    3 weeks ago

    Dallas, United States TechnoGen Full time

    Job Title : AWS Data Architect Job Type : Contract Location : Dallas, TX-Onsite Job Description: 15+ years of experience with Data and Analytics. Proficient with AWS Data Analytics Platform solutions architecture.

  • Data Engineer

    1 month ago

    Dallas, Texas, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Transportation Finance team at Amazon. As a Data Engineer, you will design, implement, and support scalable data infrastructure solutions to integrate with multi-heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting,...

  • IOT Data Solutions Engineer

    4 weeks ago

    Dallas, Texas, United States Diamondpick Full time

    Data Engineering Role at DiamondpickAt Diamondpick, we're seeking a skilled Data Engineer to join our team and contribute to the development of our IOT data solutions. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining complex data pipelines that integrate with time-series databases, PostgreSQL, and...

  • AWS Cloud Engineer

    3 weeks ago

    dallas, United States Tietoevry Full time

    Position – AWS Cloud EngineerLocation – Dallas, TXDuration – 6 months Rate - CompetitiveVisa Preference - USC, GC, H4 EAD, L2 EADJob Responsibilities:Disaster Recovery and High Availability skills with AWS neededKnowledge and experience with deploying and managing cloud solutions in AWS.Proficient in designing and supporting cloud environments,...