Data Engineer
3 days ago
Job Title: Data Engineer
Location: Charlotte, NC ** On-Site
Duration: 12 Mon ths (Possible Extension)
Role Type: W2 Contract Engagement
Job Summary:
We are seeking a Data Engineer with strong experience in Python, PySpark, and Airflow, and hands-on knowledge of Cloudera Hadoop environments. You'll be responsible for building and maintaining scalable data pipelines, enabling high-quality data flow and transformation across the organization. Infosec experience and Google Cloud Platform (GCP) familiarity are strong pluses.
Key Responsibilities:
- Design, build, and maintain robust, scalable, and efficient data pipelines using PySpark and Airflow.
- Manage and optimize large-scale data workflows on Cloudera Hadoop
- Develop reusable code in Python for data ingestion, transformation, and delivery.
- Ensure data quality, integrity, security, and performance across all pipelines.
- Work cross-functionally with data analysts, data scientists, InfoSec, and DevOps teams.
- Support data integration projects involving on-premise and cloud systems, particularly GCP.
- Participate in incident resolution, root cause analysis, and implement process improvements.
- Implement best practices for data security, governance, and access control, especially in regulated environments.
- 3-6 years of professional experience in data engineering or related fields.
- Strong coding skills in Python and experience using PySpark for big data processing.
- Hands-on experience with Apache Airflow for orchestrating ETL workflows.
- Deep understanding of Cloudera Hadoop (HDFS, Hive, Impala, etc.).
- Solid understanding of data pipeline design, performance optimization, and data lake/data warehouse concepts.
- Google Cloud Platform (GCP) experience, particularly with BigQuery, Dataflow, or Cloud Storage.
- Exposure to data security practices, InfoSec principles, or experience working in a regulated data environment.
- Familiarity with version control systems (e.g., Git) and CI/CD pipelines.
- Experience working in agile environments and using Jira/Confluence.
- Strong problem-solving and analytical thinking skills.
- Excellent communication skills-able to collaborate with technical and non-technical stakeholders.
- Detail-oriented, with a focus on performance, reliability, and maintainability.
- Set the bar high for what a company should do
- Create jobs
- Offer people an opportunity to succeed and change their station in life
- Improve the communities where we live and work through volunteering and charitable giving
-
Data Engineer
5 days ago
Charlotte, NC, United States My3Tech Inc Full timePosition: Data Engineer Location: Charlotte, NC or Denver, CO 4x/week onsite Contract Length: 12+ months Top Requirements: Python Prefect AWS Athena Terraform JavaScript Plusses FinOps background Redshift, S3, and Lambda Day to Day Responsibilities/project specifics: This resource will initially help automate projects and complete hands on code work...
-
Data Engineer
1 day ago
Charlotte, NC, United States My3Tech Inc Full timePosition: Data Engineer Location: Charlotte, NC or Denver, CO 4x/week onsite Contract Length: 12+ months Top Requirements: Python Prefect AWS Athena Terraform JavaScript Plusses FinOps background Redshift, S3, and Lambda Day to Day Responsibilities/project specifics: This resource will initially help automate projects and complete hands on code work...
-
Data Engineer
13 hours ago
Charlotte, NC, United States My3Tech Inc Full timePosition: Data Engineer Location: Charlotte, NC or Denver, CO 4x/week onsite Contract Length: 12+ months Top Requirements: Python Prefect AWS Athena Terraform JavaScript Plusses FinOps background Redshift, S3, and Lambda Day to Day Responsibilities/project specifics: This resource will initially help automate projects and complete hands on code work...
-
Data Engineer
13 hours ago
Charlotte, NC, United States Veracity Full timeData Engineer Duration: 12 Months (Contract) Locations: Charlotte, NC / Phoenix, AZ / Minneapolis, MN We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale data processing,...
-
Data Engineer
5 days ago
Charlotte, NC, United States Diverse Lynx Full timeData Engineer The Opportunity If you are passionate about data, cloud engineering, architecture, software development, and analytics with first-hand experience with cloud data warehousing, data integration, API development, and analytics using modern methods, collaboration, and creativity we are interested in talking to you! Data Engineer to join our agile...
-
Data Engineer
3 days ago
Charlotte, NC, United States Diverse Lynx Full timeData Engineer The Opportunity If you are passionate about data, cloud engineering, architecture, software development, and analytics with first-hand experience with cloud data warehousing, data integration, API development, and analytics using modern methods, collaboration, and creativity we are interested in talking to you! Data Engineer to join our agile...
-
Data Engineer
1 day ago
Charlotte, NC, United States Euclid Innovations Full timeRole: Cloud Data Engineer Location: Charlotte, NC Duration: 12+ MonthsJob Description: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major...
-
Data Engineer
1 day ago
Charlotte, NC, United States Apex Informatics Full timeJob Title: Data Engineer Contract: Ongoing contract (up to 24 months) Location: Charlotte NC Onsite / Hybrid / Remote: Hybrid- 3 days onsite Interview Process: 2 rounds (virtual)- 1st is 30 minute technical with his lead, 2nd is cultural with HM. Mission: To join the Information Security organization and be responsible for data ingestion, transformation,...
-
Data Engineer
5 days ago
Charlotte, NC, United States Purple Drive Full timeJob Description: Data EngineerResponsibilities Data Pipelines: Design, build, and maintain scalable pipelines using Databricks and Spark for ETL (extraction, transformation, loading). Data Modeling: Develop and optimize databases and large-scale processing systems with robust data modeling. Version Control: Use GitHub for collaboration and codebase...
-
Data Engineer
1 day ago
Charlotte, NC, United States Purple Drive Full timeJob Description: Data EngineerResponsibilities Data Pipelines: Design, build, and maintain scalable pipelines using Databricks and Spark for ETL (extraction, transformation, loading). Data Modeling: Develop and optimize databases and large-scale processing systems with robust data modeling. Version Control: Use GitHub for collaboration and codebase...