Data Engineer
1 week ago
Hartford, CT or Charlotte, NC
Possible contract to hire
- Mix of lead and developer role - Kanban teams, scrum teams this candidate is expected to go into scrum teams and guide teams on delivery as primary objective. Also expecting to do hands on coding 50% of the time
- 5-8 years of lead experience
- This person makes sure delivery goes as smoothly as possible
- DevOps knowledge
- Maintenance team- Business Insurance
- Senior Data Engineer working with Data Engineer, QAs
- New products, maintenance on existing
- Moved from talend to IDMC
- Industry experience is nice to have (insurance)
- Informatica
- Right now it is legacy tech stack but they are building datahub on the cloud and hope to migrate to cloud fully in the future
ata environment and improving speed of delivery; provide technical leadership, mentoring, and coaching to technical team; implement design patterns across the portfolio delivery teams; deliver high quality work of high technical complexity; research and evaluate alternative solutions and recommend the most efficient and cost-effective solution for the systems design.
Role Expectations:
• Design and develop high quality, scalable software modules for next generation analytics solution suite
• Prototype high impact innovations, catering to changing business needs, by learning and leveraging new technologies (AWS Cloud, Big Data, Snowflake, Informatica Cloud).
• Integrate with Data Quality Services to ensure Quality data is Published to consumers.
• Possesses functional knowledge and skills reflective of a competent practitioner with the ability to deliver on work of varying technical complexity
• Consults with functional management in the analysis of short and long-range business requirements and recommends innovations which anticipate the future impact of changing business needs
• Works closely with client management to identify and specify the complex business requirements and processes for diverse development platforms, computing environments (e.g., Cloud, host based, distributed systems, client server), software, hardware, technologies and tools
• Exposure to CI/CD processes and experience working with GIT, Jenkins, Urban Code Deploy, Nexus repositories
• Coordinate activities with cross-functional IT unit stakeholders (e.g., database, operations, telecommunications, technical support, etc.)
• Researches and evaluates alternative solutions and recommends the most efficient and cost-effective solution for the systems design
• Work within a self-organized scrum development team regarding all design and implementation
Qualifications:
• Bachelor's degree with at least 5 or more years of applicable work experience with respect to Data Analysis, manipulation, and technical development
• Desired educational experience includes, but are not limited to: Computer Science, Engineering, IT, Management Information Systems, Data Analytics, Applied Mathematics, and Business.
• Desire candidates with prior Data Engineer/ETL competencies and prior experience with successful enablement of Data Delivery initiatives.
• Knowledge of ETL tools like Informatica & Talend; relational databases like Oracle & Snowflake; Oracle PL/SQL etc.
• Understanding of current and emerging IT products, services, processes and methodologies.
• Analytical approach with a strong ability to uncover and resolve problems by delivering innovative approaches and solutions.
• Technical leadership with respect to design, implementation and overseeing complex technical processes
• Strong ability to estimate project tasks and to deliver upon committed dates. Ability to develop and maintain systems according to a defined set of standards.
• Experience with AWS Services (i.e. S3, EMR, etc) a plus
• Experience with Cloud data warehouses, automation, and data pipelines (i.e. Snowflake, Redshift) a plus
• Experience using Gen AI solutions to automate data engineering pipelines preferred.
• Ability to work as part of and with high performing teams.
Dress Codes:
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...
-
Databricks Data Engineer | Real-Time ETL
2 weeks ago
Hartford, CT, United States Data Based Development Systems Full timeA data integration and development firm seeks a Software Engineer/Developer in Farmington, Connecticut. The role requires expertise in data processing, with responsibilities including data ingestion, transformation, and ETL process development. Candidates should have experience with Python, SQL, and cloud technologies like AWS and Azure. This contract...