Cloud Data Engineer

4 days ago

Charlotte, North Carolina, United States Euclid Innovations Full time $120,000 - $180,000 per year

Cloud Data Engineer

Location: Charlotte, NC

12 Months Contract

Cloud Data Engineer Job Description:

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Skills:

  • 5+ years Python coding experience.
  • 5+ years - SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

Education


• Minimally a BA degree within an engineering and/or computer science discipline


• Master's degree strongly preferred

  • Data Engineer

    3 days ago

    Charlotte, North Carolina, United States Euclid Innovations Full time $120,000 - $200,000 per year

    Cloud Data EngineerCharlotte, NC (3 days/week)Financial Client12 MonthsJob Description:Seeking a Cloud Data Engineer skilled in Python, PySpark, SQL, and enterprise-level data warehousing. Must collaborate effectively with business users and possess business analyst expertise.Major Responsibilities:Build and optimize data pipelines ensuring quality and...

  • Data Engineer

    4 days ago

    Charlotte, North Carolina, United States ATC Full time $200,000 - $250,000 per year

    Role DescriptionWe are seeking experienced software Data engineers in Charlotte (N.C) with 10+ years of relevant experience to support the design and development of a strategic data platform for investment bank.Role ObjectivesThese roles will be part of the Data Strategy team spanning across the Capital Markets and securities teams, broker-dealer and...

  • Associate Data Engineer

    3 days ago

    Charlotte, North Carolina, United States AssetMark Full time $95,000 - $107,000 per year

    Job Description:AssetMark is a leading strategic provider of innovative investment and consulting solutions serving independent financial advisors. We provide investment, relationship, and practice management solutions that advisors use in helping clients achieve wealth, independence, and purpose.The Job/What You'll Do:The Associate Data Engineer will play a...

  • Cloud Engineer

    2 days ago

    Charlotte, North Carolina, United States DataStaff, Inc. Full time $104,000 - $160,000 per year

    DataStaff, Incis seeking aCloud Engineerfor a direct-hire opportunity located inCharlotte, NC.*This position is Charlotte, NC or Woburn, MA (Hybrid) or RemoteThe Cloud Operations Engineer is responsible for advanced troubleshooting, system administration, and application environment support across cloud infrastructure. This role bridges operations,...

  • Cloud DevOps Engineer, CyberSecurity Associate

    3 days ago

    Charlotte, North Carolina, United States RSM US LLP Full time $85,100 - $161,700 per year

    We are the leading provider of professional services to the middle market globally, our purpose is to instill confidence in a world of change, empowering our clients and people to realize their full potential. Our exceptional people are the key to our unrivaled, culture and talent experience and our ability to be compelling to our clients. You'll find an...

  • Data Platform Engineer

    4 days ago

    Charlotte, North Carolina, United States Centraprise Full time $120,000 - $150,000 per year

    Data Platform EngineerMalvern PA or Charlotte, NC (Onsite)ContractResponsibilitiesData Platform engineers to help us build the AI-ready data platformsQualificationsAWS Step Functions, ETL, Glue, batch processing, S3, Lake Formation, Iceberg, AthenaPythonGithub CI/CD5-8 years software development experienceExperience in optimizing cloud infrastructure for...

  • Azure Cloud Engineer

    4 days ago

    Charlotte, North Carolina, United States Hallmark Global Solutions Ltd Full time $120,000 - $200,000 per year

    Looking for a highly motivated and experienced Azure Cloud Engineer to design, implement, and manage cloud infrastructure for state-of-the-art digital banking platforms. The ideal candidate will have a strong background in cloud technologies, automation, and digital platform development, with a focus on scalability, security, and performance in the financial...

  • Data Engineer IV

    2 days ago

    Charlotte, North Carolina, United States Primary Talent Partners Full time $120,000 - $180,000 per year

    Primary Talent Partners has a new contract opening for aData Engineer IVwith our large power and utilities client in Charlotte, NC. This is a 12-month contract with a potential for extension. Pay:$ $92.00/hr; W2 contract, no PTO, no Benefits. ACA-compliant supplemental package available for enrollment.Schedule:9 AM-5PM ESTDescription:Enterprise Data...

  • Director, Data Engineering

    4 days ago

    Charlotte, North Carolina, United States AssetMark Full time $156,000 - $173,000 per year

    Job Description:AssetMark is a leading strategic provider of innovative investment and consulting solutions serving independent financial advisors. We provide investment, relationship, and practice management solutions that advisors use in helping clients achieve wealth, independence, and purpose.The Director of Data Engineering & Platform Strategy is a...

  • data engineer

    2 days ago

    Charlotte, North Carolina, United States Unidine Full time $90,000 - $120,000 per year

    We are Compass Digital—the digital and technology arm of Compass Group North America. We build and scale digital products and technologies to exceed the expectations of our guests and clients. Backed by research, we create remarkable user experiences with increased choice and convenience. We offer end-to-end solutions, simultaneously boosting sales and...