Data Engineer

2 weeks ago


Dallas, United States TechnoGen Full time
Data Engineer

Job Description

Data Pipeline Development:

Design, implement, and manage robust data pipelines using Python, PySpark, SQL to efficiently extract, transform, and load data from diverse sources(Batch & Streaming)

AWS Expertise

Demonstrate expertise in core AWS services such as AWS DMS, AWS Glue, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, Amazon EMR, AWS IAM, AWS LAMBDA etc., and apply them to build scalable and reliable data solutions.

Data Modeling

Develop and maintain efficient data models to support the analytical and reporting needs.

Database Management

Administer databases using AWS services like Amazon RDS or Amazon Redshift, focusing on schema design, performance optimization, and monitoring.

Data Warehousing

Utilize Amazon Redshift or Amazon Snowflake to create high-performing analytical databases that empower data-driven decision-making.

ETL Best Practices

Implement industry best practices for ETL processes, including data validation, error handling, and data quality checks.

Performance Optimization

Optimize query performance through continuous tuning of databases and leveraging AWS's scalability capabilities.

Monitoring And Logging

Establish robust monitoring and logging mechanisms using AWS CloudWatch, Amazon CloudTrail, or comparable tools to ensure pipeline reliability.

Security And Compliance

Ensure adherence to security best practices and relevant compliance standards, tailoring solutions to meet GDPR, HIPAA, or other regulatory requirements.

Automation

Drive automation of deployment and scaling of data pipelines using infrastructure as code (IaC) tools like AWS CloudFormation and Terraform.

Collaboration

Collaborate closely with cross-functional teams, including data scientists, analysts, and other stakeholders, to understand their data needs and provide effective solutions.

Continuous Learning

Stay updated on the latest developments in AWS services and data engineering methodologies, applying new insights to enhance our data infrastructure.

Soft Skills

Exhibit strong communication skills to facilitate effective teamwork and interaction with diverse groups.

  • Dallas, Texas, United States MDS (Micro-Data Systems) Full time

    Data Center Networking ExpertiseMDS (Micro-Data Systems) requires a skilled Data Center Infrastructure Engineer to join our team. As a key contributor, you will be responsible for designing, implementing, and optimizing our data center network infrastructure. Your expertise in Cisco networking data center equipment, network monitoring, and troubleshooting...

  • IT - Data Engineer

    2 weeks ago


    Dallas, United States ADEX Full time

    Job Title: Data Engineer Job Description: Client is looking for a Data Engineer to join their Advanced Analytics team under the Wholesale organization. This engineer will design and deliver data solutions for the analytics and data science teams in the consumer organization. The engineer will be able to work with all types of interesting data: fiber network...

  • Data Engineer

    2 weeks ago


    Dallas, United States Omni Inclusive Full time

    We are seeking a talented Data Engineer with 7+ years of experience to join our team in the telecom industry. The ideal candidate will have a strong background in data engineering, with specific experience in telecom data processing, ETL development, and data pipeline optimization. You will work closely with our data scientists and business analysts to help...

  • Data Engineer

    6 months ago


    Dallas, United States Diverse Lynx Full time

    Skill: Data Engineer Must have Python, AWS skills. As a Lead Software Engineer specializing in modern data engineering, you will play a crucial role in our data ecosystem, leveraging your expertise in AWS tools, scripting, data analytics, and software development. Collaborating with cross-functional teams, you will be responsible for designing,...

  • Data Engineer

    6 months ago


    Dallas, United States Capgemini Full time

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore®. Sogeti brings...

  • "Data Engineer"

    2 weeks ago


    Dallas, United States TechnoGen Full time

    Job Title: Data Engineer Job Location: Remote Mandatory Skills: • Strong hands-on Experience with GCP • Strong Experience with Python Developemnt • Experience with GCP, SQL, Pyspark, Python, Airflow Job Description: We are seeking a talented Data Engineer with a strong hands-on experience with Snowflake, expertise in Python development, and...

  • Senior Linux Engineer

    4 weeks ago


    Dallas, United States NTT DATA Full time

    Req ID: 299982 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Linux Engineer - Irving, Texas to join our team in Irving, Texas (US-TX), United States (US).NTT Data Americas is...

  • Data Engineer

    7 days ago


    Dallas, United States Premier Group Recruitment Full time

    Data Engineer 6-month contract – No C2C for this hire. $55 - $65 per hour Dallas, TX – Hybrid 3x days per weekPremier Group has engaged with a 75-employee organization who are seeking an experienced Data Engineer to join their team, working in a hybrid fashion out of their Dallas HQ. You will be the first Data Engineer within their Dallas HQ, working...

  • Data Engineer

    2 weeks ago


    Dallas, United States United Software Group Full time

    Data Engineer 12 Months Work location : Dallas, TX (Temporary remote. But need to onsite later) Job Summary We are looking for an experienced and talented technical individual to join our team as Cloud DevOps Engineer to support our Cloud Data Management and Advanced Analytics platforms. In this role, a person will work with data services, data analysts...

  • Data Engineer

    4 months ago


    Dallas, United States Resource Informatics Group Full time

    Role: Data Engineer Job Location: Hybrid(Candidate must be local to Dallas, TX, St. Louis, MO, Charlotte, NC or Denver, CO) Duration: 12+ Months Interview: Telephonic/Skype Prefer USC/GC (Unfortunately client is not sponsering for this position) Job Description:Data Engineer who has solid experience in DevOps and CI/CD automation • Experience building,...

  • Data Engineer

    3 weeks ago


    Dallas, United States PDS Tech Commercial Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer - Advanced Analytics Team (Wholesale Organization)PDS Tech Commercial, Inc. is seeking an experienced Data Engineer to join our Advanced Analytics team under the Wholesale organization. This role will focus on designing and building ETL pipelines to migrate data from SQL Server to Databricks, optimizing...

  • Data Engineer

    2 months ago


    dallas, United States V-Soft Consulting Group, Inc. Full time

    Title: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...

  • Data Engineer

    2 months ago


    dallas, United States V-Soft Consulting Group, Inc. Full time

    Title: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...

  • Data Engineer

    2 months ago


    Dallas, United States V-Soft Consulting Group, Inc. Full time

    Title: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...

  • Data Engineer

    3 weeks ago


    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    4 weeks ago


    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    3 weeks ago


    Dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months + Hybrid - 3 Days on Site Interview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce). Job Description: Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience...

  • Data Engineer

    4 months ago


    Dallas, United States Inizio Partners Full time

    About the job Data Engineer - AWS Summary: We are expanding our Data Engineering toolset and need an experienced AWS, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS, and train other team members. As a Data Engineer on our Data Engineering team, you will also design, write, scale, and...


  • Dallas, United States Pan Asia Resources Full time

    Job Title: Data Engineer Architect (PySpark) Location: Dallas, TX Job Type: Full-Time Department: Data Engineering We are seeking a talented Data Engineer Architect with expertise in PySpark. Job Summary: As a Data Engineer Architect, you will play a pivotal role in designing and implementing scalable data pipelines and architecture that facilitate data...

  • Lead Data Engineer

    2 weeks ago


    Dallas, United States CV Library Full time

    Job Title: Lead Data EngineerDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data...