Data Engineer
2 weeks ago
Job Description
Data Pipeline Development:
Design, implement, and manage robust data pipelines using Python, PySpark, SQL to efficiently extract, transform, and load data from diverse sources(Batch & Streaming)
AWS Expertise
Demonstrate expertise in core AWS services such as AWS DMS, AWS Glue, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, Amazon EMR, AWS IAM, AWS LAMBDA etc., and apply them to build scalable and reliable data solutions.
Data Modeling
Develop and maintain efficient data models to support the analytical and reporting needs.
Database Management
Administer databases using AWS services like Amazon RDS or Amazon Redshift, focusing on schema design, performance optimization, and monitoring.
Data Warehousing
Utilize Amazon Redshift or Amazon Snowflake to create high-performing analytical databases that empower data-driven decision-making.
ETL Best Practices
Implement industry best practices for ETL processes, including data validation, error handling, and data quality checks.
Performance Optimization
Optimize query performance through continuous tuning of databases and leveraging AWS's scalability capabilities.
Monitoring And Logging
Establish robust monitoring and logging mechanisms using AWS CloudWatch, Amazon CloudTrail, or comparable tools to ensure pipeline reliability.
Security And Compliance
Ensure adherence to security best practices and relevant compliance standards, tailoring solutions to meet GDPR, HIPAA, or other regulatory requirements.
Automation
Drive automation of deployment and scaling of data pipelines using infrastructure as code (IaC) tools like AWS CloudFormation and Terraform.
Collaboration
Collaborate closely with cross-functional teams, including data scientists, analysts, and other stakeholders, to understand their data needs and provide effective solutions.
Continuous Learning
Stay updated on the latest developments in AWS services and data engineering methodologies, applying new insights to enhance our data infrastructure.
Soft Skills
Exhibit strong communication skills to facilitate effective teamwork and interaction with diverse groups.
-
Data Center Infrastructure Engineer
7 days ago
Dallas, Texas, United States MDS (Micro-Data Systems) Full timeData Center Networking ExpertiseMDS (Micro-Data Systems) requires a skilled Data Center Infrastructure Engineer to join our team. As a key contributor, you will be responsible for designing, implementing, and optimizing our data center network infrastructure. Your expertise in Cisco networking data center equipment, network monitoring, and troubleshooting...
-
IT - Data Engineer
2 weeks ago
Dallas, United States ADEX Full timeJob Title: Data Engineer Job Description: Client is looking for a Data Engineer to join their Advanced Analytics team under the Wholesale organization. This engineer will design and deliver data solutions for the analytics and data science teams in the consumer organization. The engineer will be able to work with all types of interesting data: fiber network...
-
Data Engineer
2 weeks ago
Dallas, United States Omni Inclusive Full timeWe are seeking a talented Data Engineer with 7+ years of experience to join our team in the telecom industry. The ideal candidate will have a strong background in data engineering, with specific experience in telecom data processing, ETL development, and data pipeline optimization. You will work closely with our data scientists and business analysts to help...
-
Data Engineer
6 months ago
Dallas, United States Diverse Lynx Full timeSkill: Data Engineer Must have Python, AWS skills. As a Lead Software Engineer specializing in modern data engineering, you will play a crucial role in our data ecosystem, leveraging your expertise in AWS tools, scripting, data analytics, and software development. Collaborating with cross-functional teams, you will be responsible for designing,...
-
Data Engineer
6 months ago
Dallas, United States Capgemini Full timeSogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore®. Sogeti brings...
-
"Data Engineer"
2 weeks ago
Dallas, United States TechnoGen Full timeJob Title: Data Engineer Job Location: Remote Mandatory Skills: • Strong hands-on Experience with GCP • Strong Experience with Python Developemnt • Experience with GCP, SQL, Pyspark, Python, Airflow Job Description: We are seeking a talented Data Engineer with a strong hands-on experience with Snowflake, expertise in Python development, and...
-
Senior Linux Engineer
4 weeks ago
Dallas, United States NTT DATA Full timeReq ID: 299982 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Linux Engineer - Irving, Texas to join our team in Irving, Texas (US-TX), United States (US).NTT Data Americas is...
-
Data Engineer
7 days ago
Dallas, United States Premier Group Recruitment Full timeData Engineer 6-month contract – No C2C for this hire. $55 - $65 per hour Dallas, TX – Hybrid 3x days per weekPremier Group has engaged with a 75-employee organization who are seeking an experienced Data Engineer to join their team, working in a hybrid fashion out of their Dallas HQ. You will be the first Data Engineer within their Dallas HQ, working...
-
Data Engineer
2 weeks ago
Dallas, United States United Software Group Full timeData Engineer 12 Months Work location : Dallas, TX (Temporary remote. But need to onsite later) Job Summary We are looking for an experienced and talented technical individual to join our team as Cloud DevOps Engineer to support our Cloud Data Management and Advanced Analytics platforms. In this role, a person will work with data services, data analysts...
-
Data Engineer
4 months ago
Dallas, United States Resource Informatics Group Full timeRole: Data Engineer Job Location: Hybrid(Candidate must be local to Dallas, TX, St. Louis, MO, Charlotte, NC or Denver, CO) Duration: 12+ Months Interview: Telephonic/Skype Prefer USC/GC (Unfortunately client is not sponsering for this position) Job Description:Data Engineer who has solid experience in DevOps and CI/CD automation • Experience building,...
-
Data Engineer
3 weeks ago
Dallas, United States PDS Tech Commercial Full timeJob DescriptionJob DescriptionJob Title: Data Engineer - Advanced Analytics Team (Wholesale Organization)PDS Tech Commercial, Inc. is seeking an experienced Data Engineer to join our Advanced Analytics team under the Wholesale organization. This role will focus on designing and building ETL pipelines to migrate data from SQL Server to Databricks, optimizing...
-
Data Engineer
2 months ago
dallas, United States V-Soft Consulting Group, Inc. Full timeTitle: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...
-
Data Engineer
2 months ago
dallas, United States V-Soft Consulting Group, Inc. Full timeTitle: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...
-
Data Engineer
2 months ago
Dallas, United States V-Soft Consulting Group, Inc. Full timeTitle: Data EngineerRequired Location: Dallas, TX (and in-office 5 days a week. Candidates must be local and available to interview in-person. TOP SKILLS:Although this role will be sitting on-site, they must also be able to use a personal workstation, or options are available for rent. They are a Microsoft shop.5-8+ years of experience in data engineering or...
-
Data Engineer
3 weeks ago
dallas, United States Intracruit Solutions Full timeTitle: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...
-
Data Engineer
4 weeks ago
dallas, United States Intracruit Solutions Full timeTitle: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...
-
Data Engineer
3 weeks ago
Dallas, United States Intracruit Solutions Full timeTitle: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months + Hybrid - 3 Days on Site Interview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce). Job Description: Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience...
-
Data Engineer
4 months ago
Dallas, United States Inizio Partners Full timeAbout the job Data Engineer - AWS Summary: We are expanding our Data Engineering toolset and need an experienced AWS, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS, and train other team members. As a Data Engineer on our Data Engineering team, you will also design, write, scale, and...
-
Data Engineer Architect
2 weeks ago
Dallas, United States Pan Asia Resources Full timeJob Title: Data Engineer Architect (PySpark) Location: Dallas, TX Job Type: Full-Time Department: Data Engineering We are seeking a talented Data Engineer Architect with expertise in PySpark. Job Summary: As a Data Engineer Architect, you will play a pivotal role in designing and implementing scalable data pipelines and architecture that facilitate data...
-
Lead Data Engineer
2 weeks ago
Dallas, United States CV Library Full timeJob Title: Lead Data EngineerDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data...