Python AWS Data engineer

2 weeks ago

dallas, United States InfoVision Inc. Full time

Senior AWS Data Engineer

Dallas, TX (Onsite)

Longterm


Job Description


Looking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be responsible for not only understanding data pipelines but, event streaming applications, and how to build systems that handle massive amounts of data while making it consumable by other application teams, users and data scientists.


You will also be assisting in the design and architecture of highly scalable, fault tolerant infrastructure capable of processing millions of operations per minute coming from millions of TVs, efficiently store petabytes of data and provide fast insights from the data. You will also be working with teams across the client enterprise to bring their data into our Big Data ecosystem, monitor data quality for cleanliness and fix discrepancies. Ensure data accuracy through validation tasks, perform root cause analysis and implement solutions for data prep and cleanliness, review data at all granular/aggregate levels, and versioning.


About You

  • You have a BS or MS in Computer Science or similar relevant field
  • You work well in a collaborative, team-based environment
  • You are an experienced engineering with 5+ years of experience
  • You have a passion for big data structures
  • You possess strong organizational and analytical skills related to working with structured and unstructured data operations
  • You have experience implementing and maintaining high performance / high availability data structures
  • You are most comfortable operating within cloud based eco systems
  • You enjoy leading projects and mentoring other team members

Specific Skills

  • Experience or knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
  • Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
  • Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
  • Experience or knowledge of object-oriented/object function scripting languages: i.e., Python, Java, Scala, R, SQL.
  • Experience or knowledge of data pipeline and workflow management tools: i.e., AWS Data Pipeline, Apache Airflow, Argo.
  • Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
  • Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
  • Hands-on experience in designing and maintaining data schema life-cycles.

  • Python AWS Data engineer

    3 weeks ago

    Dallas, United States Infovision Full time

    Senior AWS Data Engineer Dallas, TX (Onsite)LongtermJob DescriptionLooking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be...

  • Python AWS Data engineer

    3 weeks ago

    dallas, United States InfoVision Inc. Full time

    Senior AWS Data Engineer Dallas, TX (Onsite)LongtermJob DescriptionLooking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be...

  • Data Engineer

    4 weeks ago

    Dallas, Texas, United States Inizio Partners Full time

    About the JobWe are expanding our Data Engineering capabilities and seeking an experienced AWS, Python, and SQL Data Engineer to join our team. This role will involve designing and implementing new data pipelines using AWS, as well as training other team members. As a Data Engineer on our Data Engineering team, you will design, write, scale, and maintain...

  • Sr Python Data Engineer

    3 weeks ago

    Dallas, United States Tekvivid Inc Full time

    Hello Hope you are doing well. This is Mike from Tekvivid and I have a new job opening for you. Please have a look at the below job description if interested please share your updated resume or feel free to contact me /129/ Role: Sr. Python Data Engineer Location: Remote ONLY W2 AND ONLY CITIZEN GC Must have: 10yrs of Data Engineering 5yrs...

  • AWS Python Developer

    4 months ago

    Dallas, United States Saxon Global Full time

    Client: Southwest Airlines Position: Junior/Mid Python Developer Openings: 2 Location: Dallas TX (starting with candidates who are local, will let you know if we can open it up more) Duration: Open ended contract, potential to convert to full time Subvend: Yes Requirements: Junior or Mid level Python Developer 1+ years of experience AWS Nice to have: ...

  • Data Engineer

    4 weeks ago

    Dallas, Texas, United States Diverse Lynx Full time

    Job Title: Data Engineer - AWS Cloud ExpertJob Summary: We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines that ensure seamless integration between on-premises and cloud-based environments.Key Responsibilities:* Design...

  • Lead AWS Data engineer

    1 month ago

    Dallas, United States InfoVision Inc. Full time

    Senior AWS Data Engineer Dallas, TX (Onsite)LongtermJob DescriptionLooking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be...

  • Data Engineer

    5 months ago

    Dallas, United States NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Onsite) to join our team in Dallas, Texas (US-TX), United States (US).Job Responsibilities...

  • Senior Python Developer with Expertise in AWS

    4 weeks ago

    Dallas, Texas, United States Maintec Technologies Full time

    Job Title: Senior Python Developer with Expertise in AWSJob Summary: We are seeking a dedicated and experienced Software Developer to work with our team at Maintec Technologies.Key Responsibilities:* Develop, maintain, and improve our Python applications, focusing on efficiency, reliability, and performance.* Work extensively with AWS services such as EC2,...

  • Data Engineer

    1 week ago

    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    2 weeks ago

    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    1 week ago

    Dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months + Hybrid - 3 Days on Site Interview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce). Job Description: Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience...

  • SR Python AWS Developer

    6 months ago

    Dallas, United States Saxon Global Full time

    Client: Southwest Airlines Role: Sr. Python/AWS Developer Location: Remote/Dallas, TX Duration: 1 year open-ended Contract (no contract maximum) Apex Notes: They are looking for developers with hands on AWS Serverless development using: Python, Lambda, Kinesis Streams, SQS, DynamoDB , Microservices, Domain Driven Design, Enterprise Integration in the...

  • Data Engineer

    1 month ago

    Dallas, Texas, United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...

  • Lead Data Engineer

    3 weeks ago

    Dallas, United States Photon Full time

    We are currently seeking an experienced Lead Data Engineer with over 9 years of experience in data engineering to join our team, and I wanted to reach out to see if you might be interested. Your expertise in Hadoop, Python, Kafka, Snap Logic, Snowflake, and AWS Cloud makes you a strong fit for this role.In this position, you would lead the development of...

  • Data Engineer

    1 month ago

    dallas, United States V-Soft Consulting Group, Inc. Full time

    Title: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...

  • Data Engineer

    1 month ago

    dallas, United States V-Soft Consulting Group, Inc. Full time

    Title: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...

  • Data Engineer

    1 month ago

    Dallas, United States V-Soft Consulting Group, Inc. Full time

    Title: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...

  • Senior Data Systems Engineer

    1 month ago

    Dallas, Texas, United States Shtudy Full time

    Job Title: Senior Data Systems EngineerWe are seeking a highly skilled Senior Data Systems Engineer to join our dynamic team at Shtudy. This role requires a strong background in data engineering, cloud technologies, and quality assurance.Key Responsibilities:Automate ETL pipelines using Python to streamline data integration, transformation, and migration...

  • AWS Cloud Engineer

    3 weeks ago

    Dallas, United States Caliber Sourcing Full time

    Job Description Location: Dallas, TX (In Office Position Only - Must be in Dallas Area, No relocation available) DLRdmv delivers innovative Title & Registration technology and Governmental Compliance solutions to the Automotive Industry. DLRdmv offers an exciting, entrepreneurial work environment for individuals interested in being part of a growing company...