Senior Cloud Data Engineer
1 week ago
Job description
The Sr. Cloud Data Engineer is a hands-on role responsible for performance, availability and scalability of the public cloud environment. You will collaborate with other Architects and Engineers to enable enterprise applications to meet the organizations business goals.
Role and Responsibilities:
- Work closely with application development and data engineers on day-to-day tasks.
- Participate in project planning and implementation.
- Coordinate with Data Scientists, Product Managers and business leaders to understand data needs and deliver on those needs.
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and other data sources.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Improve, optimize and identify opportunities for efficient software development processes.
- Help achieve milestones as per sprint plan and prioritize to manage ad-hoc requests in parallel with ongoing sprints.
Required Qualifications:
- 10+ years of hands-on experience in building Data pipeline (ETL/ELT) in a cloud platform
- GCP knowledge strongly preferred - other cloud experience such as AWS. AZURE is good to have
- 10+ years of hands-on experience of building and operationalizing data processing systems
- Strong Python scripting experience is very important requirement.
- 4+ years' experience in NoSQL databases and close familiarity with technologies/languages such as Python/R, Scala, Java, Hive, Spark, Kafka
- 5+ years' experience working with data platforms (Data warehouse, Data Lake, ODS)
- 5+ years' experience working with tools to automate CI/CD pipelines (e.g., Jenkins, GIT, Control-M)
- Must have working experience with the clinical data
Preferred Qualifications:
- GCP (google cloud platform) experience.
- 5+ years of experience working on healthcare / clinical data.
- Data analysis / Data mapping skills
- Python
- Cloud Data flow/Data proc/Function.
- Whistle map SDK.
- Google Health care API/ FHIR store
-
Data Engineer
7 days ago
Hartford, Connecticut, United States Amicis Global Technologies Full time $80,000 - $120,000 per yearTitle: Data EngineerLocation: Hartford Insurance Group, CT, 06155Duration: 6+ MonthsPay: $70-$80/hr on W2Job Description: Key ResponsibilitiesServe as subject matter expert and/or technical lead for large-scale data products.Drive end-to-end solution delivery across multiple platforms and technologies, leveraging ELT solutions to acquire, integrate, and...
-
Senior Staff AI Data Engineer
1 week ago
Hartford, Connecticut, United States The Hartford Full time $135,040 - $202,560 per yearSr Staff Data Engineer - GE07DEWe're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals – and to help others accomplish theirs, too. Join our team as we help shape the future.Join our team as a Senior Staff AI Data Engineer...
-
Snowflake Data Engineer
1 week ago
Hartford, Connecticut, United States Robotics Technologies Full time $140,000 - $220,000 per yearJob ID:J50030- Job Title:Snowflake Data Engineer- Location:Hartford,, CT- Duration:12 Months + Extension- Hourly Rate:Depending on Experience (DOE)- Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD- Client:To Be Discussed Later- Employment Type:W-2, 1099, C2CJob DescriptionWe are seeking a highly skilled Snowflake Data...
-
Senior Cloud Solution Architect
3 days ago
Hartford, Connecticut, United States Oracle Full timeDescriptionDo you have passion for technology, the curiosity and willingness to learn new skills, work with new tools and discover new and innovative approaches to solving complex technical challenges in an increasing cloud-based world?Due to rapid growth, Oracle GDI – Government, Defense & Intelligence, is hiring Senior Cloud Solution Architect to be the...
-
Senior Data Engineer
5 days ago
Hartford, Connecticut, United States Voya Financial Full time $120,000 - $150,000 per yearTogether we fight for everyone's opportunity for a better financial future.We will do this together — with customers, partners and colleagues. We will fight for others, not against: We will stand up for and champion everyone's access to opportunities. The status quo is not good enough … we believe every individual and every community deserves access to...
-
Senior System Engineer
1 day ago
Hartford, Connecticut, United States Conning Full timeConning is a leading global investment management firm with a long history of serving the insurance industry.We develop customized investment strategies that address our clients' unique objectives, requirements and tolerance for risk. We develop solutions by leveraging Conning's risk management tools and utilizing a highly disciplined investment process that...
-
Senior Data Scientist
7 days ago
Hartford, Connecticut, United States The Hartford Full time $110,720 - $166,080 per yearSr Data Scientist - GD07AEWe're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals – and to help others accomplish theirs, too. Join our team as we help shape the future.The Hartford seeks a Senior Data Scientist Employee...
-
Senior Systems Engineer
1 week ago
Hartford, Connecticut, United States American Eagle Financial Credit Union Full time $120,000 - $180,000 per yearThe OpportunityAs a Senior Systems Engineer, you'll have the opportunity to shape and support the core IT infrastructure that powers our business. In this role, you'll apply your expertise in Microsoft technologies, virtualization, and networking to ensure our systems are secure, reliable, and ready to scale. From designing solutions to tackling complex...
-
Sr Staff AI Data Engineer
1 day ago
Hartford, Connecticut, United States The Hartford Full timeSr Staff Data Engineer - GE07DEWe're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals – and to help others accomplish theirs, too. Join our team as we help shape the future.Sr Staff AI Data Engineer is responsible for...
-
Lead Data Engineer, Advanced Analytics/AI
20 hours ago
Hartford, Connecticut, United States Travelers Full timeWho Are We?Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 170 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you...