Data Engineer with Python

5 days ago

New York, New York, United States SRS Consulting Inc Full time $120,000 - $200,000 per year

Role:
Data Engineer with Python

Duration:
Long Term

Location:
Remote – EST working hours

  • 12- 14 Plus years - Develop data pipelines for streaming and batch data processing needs to move data in and out of Snowflake data warehouse
  • Collaborate with engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions
  • 10 Years Hands-on experience with Snowflake, including schema design, query optimization, and data load techniques
  • 8 years of hands-on reporting experience leveraging Business Intelligence tools such as Looker, Qlik, Tableau, Power BI, etc.
  • Experience with DBT, including model development, testing, and documentation
  • Optimize data pipelines, ETL processes, and data integrations for large-scale data analytics use cases
  • 7+ years of experience in building and maintaining data pipelines and ETL/ELT processes in data-intensive organizations
  • Design, build, and maintain scalable data pipelines using Snowflake and DBT.
  • Design, build, and maintain scalable data pipelines using Snowflake and DBT.
  • Develop and manage ETL processes to ingest data from various sources into Snowflake.
  • Strong coding skills with Python and SQL for manipulating and analyzing data
  • Strong Experience on Anaconda and Jupyter Notebook
  • Hands-on experience with data movement using Snowpipe, Snow SQL, etc.
  • Able to build data integrations and ingestion pipelines for streaming and batch data
  • 5 years of designing and implementing operational production grade large-scale data pipelines, ETL/ELT and data integration solutions
  • Hands-on experience with cloud platforms such as AWS and Google Cloud
  • Proficiency with Kafka, AWS S3, SQS, Lambda, Pub/Sub, AWS DMS, Glue

Preferred - Good to Have

  • Familiarity with API security frameworks, token management and user access control including OAuth, JWT etc.,
  • Background in healthcare data especially patient centric clinical data and provider data is a plus

  • Python Engineer

    5 days ago

    New York, New York, United States McGregor Boyall Full time $120,000 - $250,000 per year

    Role:Python Software Developer (Equities)Location:New YorkIndustry:Hedge FundOverview:A significant global investment firm is seeking a Python Software Developer to join its New York based Equities Technology team where you'll be instrumental in building and supporting a real-time trading platform. This role involves direct collaboration with quant...

  • Python Engineer

    3 days ago

    New York, New York, United States Millennium Management Full time $175,000 - $250,000 per year

    Python Engineer - AI for Equities TechnologyWe are building a cutting-edge data transformation platform designed to convert unstructured data into structured, machine-readable formats for AI and analytics workflows. This platform processes vast volumes of heterogeneous data, applying advanced parsing methods, enrichment techniques, and LLM-powered extraction...

  • Data Engineer( Python/streamlit/Snowflake)

    3 days ago

    New York, New York, United States Capgemini Full time $103,330 - $128,656

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Python Engineer

    5 days ago

    New York, New York, United States DRW Full time $125,000 - $175,000 per year

    DRWis a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.Headquartered in Chicago with offices...

  • Python Engineer

    4 days ago

    New York, New York, United States DRW Full time $125,000 - $175,000

    DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.Headquartered in Chicago with offices...

  • Data Engineer

    3 days ago

    New York, New York, United States Trinity Technology Solutions LLC Full time $100,000 - $170,000 per year

    Job Title: Data EngineerJob Location: NYC (Onsite)Job Summary:We are seeking a skilledData Engineerto design, develop, and maintain data pipelines on our modern data platform. The ideal candidate will have hands-on experience withAzure Data Lakehouse, Databricks, and Python/SQL, and will collaborate with analytics, engineering, and business teams to deliver...

  • Senior/ Lead Python Engineer

    5 days ago

    New York, New York, United States Grid Dynamics Full time

    We are currently hiring a Senior/ Lead Python Engineer for a hybrid role in NYC, NYResponsibilitiesBuilding automated integration workflowsIntegrating knowledge APIs with Teams / SharepointWriting automated tests and ensuring quality of deploymentsOccasional UI changesRequirementsStrong experience in Python software developmentExperience with Azure4+ years...

  • Senior Python Software Engineer

    5 days ago

    New York, New York, United States FPT Americas Full time $120,000 - $200,000 per year

    Job Type: Contractor/Full timeWorkplace: Hybrid/ Long Island, New YorkWe are looking for a Senior Python Backend Engineer that also has experience in automation and production support work. The work will focus on backend work for our automation tools for structural engineers. Ideally, we are looking for someone with extensive experience withPython,...

  • Software Engineer

    3 days ago

    New York, New York, United States Jobs via eFinancialCareers Full time $120,000 - $300,000 per year

    Role:Software EngineerSalary:Up to $300,000 P/A + Bonus + BenefitsLocation:US/RemoteClient:Top FintechAbout:Our client is an ambitious and rapidly scaling fintech firm operating at the intersection of investment technology and data innovation.They're looking for a talentedPython Developerto join their growing team. If you're passionate about building robust...

  • Data Engineer

    2 days ago

    New York, New York, United States BeaconFire Inc. Full time $80,000 - $120,000 per year

    Hi, Rameez here from Beaconfire. I hope you're doing well We're currently hiring for an exciting Associate Data Engineer role, and I wanted to reach out to see if you or someone in your network might be interested.About the CompanyBeaconFire is based in Central NJ, specializing in Software Development, Web Development, and Business Intelligence; looking for...