Senior Cloud Data Platform Engineer
3 days ago
About the job Senior Cloud Data Platform Engineer
Senior Cloud Data Platform Engineer needs 5+ years of implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
Senior Cloud Data Platform Engineer requires:
- Locations: Charlotte, NC; Iselin, NJ; NY, NY
- Hybrid role must be in office 2 days a wee
- Ability to type a minimum of 50 wpm accurately.
- Masters or Bachelor's degree in computer science or related discipline
- Manage and ensure delivery of project tasks as required
- Excellent documentation skills to create and manage design, implementation and automation related documentation
- Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.
- Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.
- Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.
- Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.
- Must be ability to multi-task and prioritize tasks for self
- Must experience working in agile environment with multiple priorities
- 5+ years of implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
- 5+ year support experience of Big Data technologies in Hadoop ecosystem Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.
- 5+ year experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.
- 5+ year experience with Orchestration tools such as Airflow, Autosys etc.
- Experience with Jira and Agile methodology is a plus;
- Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities
- Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems
- Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.
- Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.
- Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
- Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
-
Cloud Data Platform Engineer
3 days ago
New York, NY, United States Global Channel Management Full timeAbout the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....
-
Cloud Data Platform Engineer
19 hours ago
New York, NY, United States Global Channel Management Full timeAbout the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
Senior Data Platform Engineer
2 weeks ago
New York, NY, United States Dataiku Full timeDataiku is The Universal AI Platform™, giving organizations control over their AI talent, processes, and technologies to unleash the creation of analytics, models, and agents. Providing no-, low-, and full-code capabilities, Dataiku meets teams where they are today, allowing them to begin building with AI using their existing skills and knowledge. Context:...
-
Senior Data Platform Engineer
2 weeks ago
New York, NY, United States The Hartford Full timeSr Cloud Engineer - IE07NE We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as we help shape the future. The Hartford is seeking a seasoned Senior Data...
-
Senior Data Platform Engineer
2 weeks ago
New York, NY, United States ORBIS Full timeSenior Data Platform Engineer - Fintech scale-upNew York City - Hybrid (2x days per week in office)Up to ~$230,000 base + equity A fast-growing fintech is rebuilding its core data foundation and hiring a Senior Data Platform Engineer to help design and build the next-generation platform that powers identity, risk, and compliance decisions across financial...
-
Senior Data Platform Engineer
8 hours ago
New York, NY, United States ORBIS Full timeSenior Data Platform Engineer - Fintech scale-upNew York City - Hybrid (2x days per week in office)Up to ~$230,000 base + equity A fast-growing fintech is rebuilding its core data foundation and hiring a Senior Data Platform Engineer to help design and build the next-generation platform that powers identity, risk, and compliance decisions across financial...
