Senior Data and Cloud Engineer

1 day ago

New York, United States Perennial Resources International Full time
Lead Data Engineer
Full-time/Permanent
Onsite - NYC

Responsibilities:
  • Take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring
  • Manage and work with the firm's database managed service provider (MSP) to manage and monitor the firm's evolving database requirements
  • Design, develop, and maintain scalable data pipelines and ETL processes critical to support business operations and analytics. (Python / SQL)
  • Optimize and tune data systems for high performance and reliability
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions
  • Implement and manage data storage solutions in cloud environments (AWS, Azure, Google Cloud)
  • Ensure data quality and integrity through rigorous testing and validation
  • Continuously evaluate and integrate new technologies and tools to improve data processing capabilities
  • Manage distributed scheduled tasks on individual servers to a centralized ruleset
  • Work with the development team and database MSP to modernize the backup and recovery strategy for 3-4 SQL servers across different cloud environments
  • Support the addition of new tenants on the firm's production data platform
Qualifications:
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field from a top-tier university.
  • 4-5 years of relevant professional experience in data engineering
  • Strong programming skills in SQL and Python.
  • Proficiency in database administration
  • Proven experience migrating on-prem data and associated processes to cloud platforms (AWS, Azure, Google Cloud)
  • Demonstrated ability to design and implement efficient and reliable data pipelines and ETL processes
  • Strong problem-solving skills and ability to troubleshoot complex data issues
  • Excellent communication skills and ability to work collaboratively in a team environment
  • A proactive mindset with a willingness to take ownership and drive projects to completion. Strong organizational skills along with a desire to continually be challenged
  • Experience with monitoring, CI/CD, Load Balancing, and Testing tools (e.g. Redgate, Datadog)

  • Senior Cloud Data Solutions Engineer

    2 hours ago

    New York, New York, United States Eliassen Group Full time

    Hybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...

  • Senior Software Engineer

    3 hours ago

    New York, New York, United States Harrington Starr Full time

    Job OverviewHarrington Starr is seeking a highly skilled Senior Software Engineer - Cloud and Data to join our team in Manhattan.About the RoleWe are looking for an experienced software engineer with expertise in cloud-based technologies, particularly AWS.The successful candidate will work closely with the CTO to design, develop, test, and maintain...

  • Senior Data Engineer

    3 hours ago

    New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a Senior Data Engineer to join our team at Capital One. This role is responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.About the JobThis position requires collaboration with Agile teams to design, develop, test, implement, and support...

  • Cloud Data Engineer

    2 weeks ago

    New Brighton, United States All Volusia and Flagler Heating and Air Full time

    Bell Lumber and Pole Company requires a Cloud Data Engineer to enhance business processes and deliver data solutions by leveraging cloud data services. The role involves analyzing data workflows, identifying improvement areas, and leading advanced data solution implementations. The engineer will also develop custom business applications integrating with ERP...

  • Senior Cloud Engineer

    22 hours ago

    New York, United States Allcloud Inc. Full time

    Description Senior AWS Cloud Engineer Location: US / Canada (Eastern Time) - Home basedJob Type: Full-time, Permanent About AllCloud AllCloud is a global professional services company providing organizations with cloud enablement and transformation tools. As an AWS Premier Consulting Partner and audited MSP, a Salesforce Platinum Partner, and a Snowflake...

  • Cloud Data Engineer

    6 days ago

    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...

  • Cloud Data Engineer

    2 weeks ago

    New York, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Cloud Data Engineer

    2 weeks ago

    New York, United States People Placers Staffing Full time

    Title : Data/Cloud Engineer Location : New York, NY Salary/Pay Rate: $175,000 - $275,000 per year + Bonus Schedule: Full-Time, Partially Remote About the Client: People Placers Staffing is partnering with a $10 billion AUM hedge fund committed to developing state-of-the-art models and technology. They are building a cutting-edge, cloud-based data and...

  • Cloud Engineer

    2 months ago

    New York, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Senior Software Engineer

    3 weeks ago

    New York, United States Big Cloud Full time

    Are you interested in revolutionary technology?Are you passionate about large-scale NLP and search?Would you like to help shape a world-class ML platform with proven results?I'm recruiting for one of the most advanced NLP start-ups in New York City. Their open-source content discovery platform uses NLP to extract research and connect data points across the...

  • Senior Software Engineer

    6 months ago

    New York, United States Big Cloud Full time

    Are you interested in revolutionary technology?Are you passionate about large-scale NLP and search?Would you like to help shape a world-class ML platform with proven results?I'm recruiting for one of the most advanced NLP start-ups in New York City. Their open-source content discovery platform uses NLP to extract research and connect data points across the...

  • Cloud Data Engineer for Emerging Technologies

    2 hours ago

    New York, New York, United States Capital One Full time

    Capital One OverviewCapital One is a leading financial institution that empowers millions of Americans to achieve financial freedom. We are committed to innovation, diversity, and inclusion in the workplace.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team in Chicago, Illinois. As a key member of our data engineering team,...

  • Cloud Data engineer

    22 hours ago

    New York, United States Damco Solutions Full time

    Role: Cloud Data engineer Location: NYC NY (Onsite)(Hybrid) Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities:...

  • Senior Data Engineer

    1 day ago

    New York, United States TechnoGen Full time

    Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn. Kforce has a client in Brooklyn, NY that is seeking a Senior Data Engineer. Our team is headquartered in Brooklyn but has a remote-first culture and we encourage remote applicants...

  • Cloud Data Engineer

    2 weeks ago

    new york city, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Cloud Data Engineer

    2 weeks ago

    new york city, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Sr. Azure Data Engineer

    4 months ago

    New York, United States Hudson Data Full time

    Job Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...

  • Cloud Data Engineer

    1 month ago

    New York, United States Inizio Partners Full time

    About the job Cloud Data Engineer - GCP Cloud Data Engineer-GCP- 4 positions Location- Remote Salary- $125k base 130k base + (15% to 18%) Performance Bonus + Benefits 7-10 years of total IT experience & 2+ years of experience in GCP Hands-on experience in design, and development of enterprise data processing applications (ETL/ELT). Hands-on and robust...

  • Cloud Engineer

    1 month ago

    new york city, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Cloud Engineer

    2 months ago

    new york city, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...