Data Engineer
1 day ago
- Typically requires 10-plus years of applicable experience.
- Ability to develop, modify, and adopt tools and processes to support self-service data pipeline management.
- Drive adoption of data tools to modernize existing ETL frameworks/processes and implement with a strategic mindset and typically have in-depth knowledge of development tools, and languages.
- Collaborate with business and technology partners across the organization to assess data needs and prioritize adoption.
- Identify additional strategic opportunities to evolve the data engineering practice.
- 10+ years of experience in data engineering or business intelligence.
- Good Understanding of Spark/PySpark framework.
- 3+ years experience with Python (e.g. Pandas, Data Frames) and use in data processing solutions.
- Minimum 3 to 5 Years practical working experience with relational databases, preferably Oracle Exadata.
- Familiarity with Data Warehouse / Data Mart / Business Intelligence concepts.
- Hands-on experience with schema design and data modeling.
- Strong practical working experience with Unix scripting in at least one of Python, Perl, and Shell (either bash or zsh).
- Experience with performance-tuning data transformations across large data sets.
- Experience with CI/CD processes and tools (e.g. Ansible, Jenkins).
- Design and development experience in modern technologies such as API management, REST/API integration, Containers, Microservices.
- Banking / Capital Markets / Accounting domain knowledge.
- Implementing ETL with PySpark.
- Practical working experience using ETL tools, preferably Informatica.
- Experience or familiarity with orchestration tools, such as Airflow.
- Experience designing and building data warehouses and knowledge of the data flows involved.
- Software development in an Agile environment.
- Working experience with Git, Jira, and Confluence.
- Excellent written and oral communication skills.
- Willingness to take on problems outside of current skillset and experience.
-
Data Engineer
2 weeks ago
Charlotte, NC, United States Purple Drive Full timeJob Description: Data EngineerResponsibilities Data Pipelines: Design, build, and maintain scalable pipelines using Databricks and Spark for ETL (extraction, transformation, loading). Data Modeling: Develop and optimize databases and large-scale processing systems with robust data modeling. Version Control: Use GitHub for collaboration and codebase...
-
Data Engineer
2 weeks ago
Charlotte, NC, United States Purple Drive Full timeJob Description: Data EngineerResponsibilities Data Pipelines: Design, build, and maintain scalable pipelines using Databricks and Spark for ETL (extraction, transformation, loading). Data Modeling: Develop and optimize databases and large-scale processing systems with robust data modeling. Version Control: Use GitHub for collaboration and codebase...
-
Data Engineer
5 days ago
Charlotte, NC, United States Veracity Full timeJob Title: Data Engineer Duration: 12 Months (Contract) Locations: Charlotte, NC / Phoenix, AZ / Minneapolis, MN Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale...
-
Data Engineer
3 days ago
Charlotte, NC, United States Veracity Full timeJob Title: Data Engineer Duration: 12 Months (Contract) Locations: Charlotte, NC / Phoenix, AZ / Minneapolis, MN Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale...
-
Data Engineer
1 week ago
Charlotte, NC, United States Veracity Full timeJob Title: Data Engineer Duration: 12 Months (Contract) Locations: Charlotte, NC / Phoenix, AZ / Minneapolis, MN Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale...
-
Data Engineer
7 days ago
Charlotte, NC, United States Veracity Full timeJob Title: Data Engineer Duration: 12 Months (Contract) Locations: Charlotte, NC / Phoenix, AZ / Minneapolis, MN Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and optimization of data solutions supporting enterprise-level initiatives. The successful candidate will work on large-scale...
-
Data Quality engineer
3 days ago
Charlotte, NC, United States RIT Solutions, Inc. Full timeTitle: Data Quality engineer - Data & Automation Location: Charlotte, NC | Dallas, TX | Chandler, AZ (Hybrid 3 days onsite /2 days remote) This technical role is focused on ensuring the integrity and accuracy of data across visualization dashboards, ETL processes, and automation solutions. As a Data Quality engineer - Data & Automation , you will - ...
-
Sr. Data Engineer
2 weeks ago
Charlotte, NC, United States Veracity Full timeJob Title: Sr. Data Engineer Duration: 12+ Months Location: Charlotte, NC - Hybrid Role (3 days onsite in a week) Manager Notes: • Team Duties and business impact: The Risk Data Services is a horizontal function within Risk Technology organization and is responsible for delivering data consistently across Risk. The Risk Data Services team is seeking a Lead...
-
Data Platforms Engineer
2 weeks ago
Charlotte, NC, United States Resideo Full timeJob Description ADI is seeking a passionate Data Platforms Engineer to design, develop, and maintain our enterprise data platforms. As the Engineer of Data Platforms, you will be part of a talented engineering and operations team focused on building and supporting secure, performant, and scalable next gen data platforms that include Snowflake, Databricks, MS...
-
Lead Data Engineer
2 weeks ago
Charlotte, NC, United States Diverse Lynx Full timeJob Description Role: Lead Data Engineer Location: Onsite/Charlotte, NC(4 days onsite) Who are we looking for? We're seeking an experienced data engineer to analyze large volume of different data set, identify the data gaps and address the same. Build automated future ready data reconciliation process in-place. Technical Skills: Lead the Analysis of...