Cloud Data engineer

15 hours ago

New York, United States Damco Solutions Full time
Role: Cloud Data engineer
Location: NYC NY (Onsite)(Hybrid)

Job Description :
This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
Major Responsibilities:
  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
  • 5+ years Python coding experience.
  • 5+ years - SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.
We can offer you:
  • highly competitive compensation and benefits package
  • multinational organization with 55 offices in 20 countries and the possibility to work abroad
  • Laptop and a mobile phone
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & Paternity leave plans
  • comprehensive insurance plan including: medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region)
  • Retirement savings plans
  • higher education certification policy
  • Commuter benefits (varies by region)
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
  • Cutting edge projects at the world's leading tier-one banks, financial institutions and insurance firms
  • flat and approachable organization
  • truly diverse, fun-loving and global work culture

  • Cloud Data Engineer

    6 days ago

    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...

  • Cloud Data Engineer

    2 weeks ago

    New York, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Cloud Data Engineer

    2 weeks ago

    New York, United States People Placers Staffing Full time

    Title : Data/Cloud Engineer Location : New York, NY Salary/Pay Rate: $175,000 - $275,000 per year + Bonus Schedule: Full-Time, Partially Remote About the Client: People Placers Staffing is partnering with a $10 billion AUM hedge fund committed to developing state-of-the-art models and technology. They are building a cutting-edge, cloud-based data and...

  • Cloud Data Engineer

    2 weeks ago

    new york city, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Cloud Data Engineer

    2 weeks ago

    new york city, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Sr. Azure Data Engineer

    4 months ago

    New York, United States Hudson Data Full time

    Job Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...

  • Cloud Data Engineer

    1 month ago

    New York, United States Inizio Partners Full time

    About the job Cloud Data Engineer - GCP Cloud Data Engineer-GCP- 4 positions Location- Remote Salary- $125k base 130k base + (15% to 18%) Performance Bonus + Benefits 7-10 years of total IT experience & 2+ years of experience in GCP Hands-on experience in design, and development of enterprise data processing applications (ETL/ELT). Hands-on and robust...

  • Cloud Data Platform Engineer

    1 month ago

    New York, United States Global Channel Management Full time

    About the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: 3 days a week, hybrid Locations: Iselin, NJ, Charlotte, NC, N Y, NY Data Engineering 60-70 %....

  • Senior Data

    1 month ago

    New York, United States iSphere Full time

    iSphere.net, a leading IT consulting company, is seeking a Data Engineer for a direct hire, full-time opportunity to join our client's growing team in NYC. You will work on designing, developing and optimizing the data infrastructure and pipelines that power our client's business analytics and operations. Responsibilities: - Design, implement and optimize...

  • Data Engineer

    1 month ago

    New York, New York, United States Glow Networks Full time

    Job DescriptionAt Glow Networks, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems in a cloud environment.Key Responsibilities:Design and implement big data architectures using cloud-based technologies such as AWS, Spark, and...

  • Data Scientist and Cloud Engineer

    4 weeks ago

    New York, New York, United States Maania Consultancy Services Full time

    Job DescriptionMaania Consultancy Services is seeking a highly skilled Data Scientist and Cloud Engineer to join our team. The ideal candidate will have a strong background in machine learning and data engineering, with experience in designing and implementing scalable cloud-based solutions.Key Responsibilities:Design and develop cloud-based machine learning...

  • Senior Data and Cloud Engineer

    19 hours ago

    New York, United States Perennial Resources International Full time

    Lead Data Engineer Full-time/Permanent Onsite - NYCResponsibilities: Take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring Manage and work with the firm's database managed service provider (MSP) to manage and monitor the firm's evolving database requirements Design, develop, and maintain...

  • Cloud Data Platform Engineer

    1 month ago

    New York, New York, United States Global Channel Management Full time

    About the JobGlobal Channel Management is seeking a highly skilled Cloud Data Platform Engineer to join our team. As a Cloud Data Platform Engineer, you will be responsible for designing, developing, and delivering cloud datastore solutions and automation pipelines to migrate data sets from on-prem to cloud platforms.Key Responsibilities:Design and develop...

  • Cloud Data Engineer

    2 weeks ago

    New Brighton, United States All Volusia and Flagler Heating and Air Full time

    Bell Lumber and Pole Company requires a Cloud Data Engineer to enhance business processes and deliver data solutions by leveraging cloud data services. The role involves analyzing data workflows, identifying improvement areas, and leading advanced data solution implementations. The engineer will also develop custom business applications integrating with ERP...

  • Cloud Data Engineer

    15 hours ago

    New York, New York, United States Mondelēz International Full time

    About This RoleWe are seeking an experienced Cloud Data Engineer to join our team at Mondelēz International. As a key member of our data and analytics team, you will be responsible for designing, developing, and deploying cloud-based data solutions using Google Cloud Platform (GCP).

  • AWS Cloud Architect and Data Engineer

    4 weeks ago

    New York, New York, United States Capgemini Full time

    Unlock the Power of AWSCapgemini is a global leader in digital transformation, helping organizations accelerate their journey to a digital and sustainable world. As an AWS Cloud Architect and Data Engineer, you will play a key role in shaping the future of data management and analytics for our clients.Job SummaryWe are seeking an experienced AWS Cloud...

  • Cloud Engineer

    2 months ago

    New York, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Cloud Data Architect

    2 days ago

    New York, New York, United States HR Recruiting Services Full time

    Job DescriptionWe are seeking a skilled Data-Cloud Engineer to join our team at HR Recruiting Services.About the RoleThe successful candidate will take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring.They will manage and work with our database managed service provider (MSP) to manage...

  • Cloud Data Architect

    3 weeks ago

    New York, New York, United States Unreal Gigs Full time

    At Unreal Gigs, we're seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer at Unreal Gigs, you'll play a vital role in designing, developing, and managing cloud-based data infrastructures that support analytical and operational needs across the organization. You'll collaborate with data scientists, analysts, and software...

  • Cloud Engineer

    1 month ago

    new york city, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...