Cloud Data Platform Engineer
2 weeks ago
Cloud Data Platform Engineer needs 5+ years' implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.5+ year support experience of Big Cloud Data Platform Engineer requires:3 days a week, hybridLocations: Iselin, NJ, Charlotte, NC, NY, NYData Engineering 60-70 %.Infrastructure 30-40%. (Moving Data in & Out of cloud)Snowflake exp is preferredMaster's or Bachelor's degree in computer science or related disciplineManage and ensure delivery of project tasks as requiredExcellent documentation skills to create and manage design, implementation and automation related documentationImplementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.Must be ability to multi-task and prioritize tasks for selfMust experience working in agile environment with multiple prioritiesPreferred Skills:-5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.-5+ year support experience of Big Data technologies in Hadoop ecosystem - Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.-5+ years' experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.-5+ years' experience with Orchestration tools such as Airflow, Autosys etc.-Experience with Jira and Agile methodology is a plus;-Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activitiesCloud Data Platform Engineer duties:-Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems-Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.-Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.-Identifies and documents all system constraints, implications, and consequences of various proposed system changes.-Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.-Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.Employment Type: Full-TimeSalary: $ 88.00 Per Hour
-
Cloud Data Platform Engineer
4 days ago
New York, NY, United States Global Channel Management Full timeAbout the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....
-
Data Engineer BI Developer Cloud Data Platform
2 weeks ago
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
Data Engineer BI Developer Cloud Data Platform
9 hours ago
New York, NY, United States DS Technologies Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
Sr. Cloud Data Platform Engineer W2
2 days ago
New York, New York, United States Intellyk Inc. Full time $180,000 - $250,000 per yearJob Description:Skills:Cloud Technologies: Proficiency in cloud platforms like Azure, AWS, or Google Cloud.Data Engineering: Strong understanding of data warehousing, data lakes, and ETL processes.Programming: Experience with programming languages like Python, Java, or Scala.Cloud Data Platform: Strong experience with Cloud Data Platform like Databricks...
-
Cloud Data Engineer
5 days ago
New York, United States Gotham Technology Group Full timeTitle: Enterprise Data Management – Data Cloud, Senior Developer ILocation: Hybrid, 2 days onsite in NYCDuration: FTE/PermanentSalary: 130-165kThe Data Engineering team oversees the organization's central data infrastructure, which powers enterprise-wide data products and advanced analytics capabilities in the investment management sector. We are seeking a...
-
Cloud Data Engineer
5 days ago
New York, United States Gotham Technology Group Full timeTitle: Enterprise Data Management – Data Cloud, Senior Developer ILocation: Hybrid, 2 days onsite in NYCDuration: FTE/PermanentSalary: 130-165kThe Data Engineering team oversees the organization's central data infrastructure, which powers enterprise-wide data products and advanced analytics capabilities in the investment management sector. We are seeking a...
-
Cloud Data Architect
4 weeks ago
New York, United States AI Technologies LLC Full timeLocation: New York, NY Duration: 12Months+ Extension Hourly Rate: Depending on Experience (DOE) Work Authorization: Job Title: Cloud Data Architect (AWS/Azure/Google Cloud Platform) Location: Onsite/Hybrid USA EST Coast Duration: Long Term Contract Primary Skills: cloud platforms (AWS, Azure, and Google Cloud Platform) Job Summary We are seeking an...
-
Cloud Data Engineer
5 days ago
New York, New York, United States Gotham Technology Group Full time $120,000 - $240,000 per yearTitle: Enterprise Data Management – Data Cloud, Senior Developer ILocation: Hybrid, 2 days onsite in NYCDuration: FTE/PermanentSalary: kThe Data Engineering team oversees the organization's central data infrastructure, which powers enterprise-wide data products and advanced analytics capabilities in the investment management sector. We are seeking a senior...
-
Data Engineer
4 weeks ago
New York, United States Eucloid Data Solutions Full timeOverview We are seeking a talented and driven Data Engineer to join our team. The ideal candidate is passionate about working with data, designing efficient solutions, and contributing to the development of scalable data platforms. As a Data Engineer at Eucloid, you will play a pivotal role in building and optimizing data pipelines and architectures to drive...
