Current jobs related to Web Scraping Data Engineer - New York, New York - Verition Fund Management LLC
-
Data Engineer
6 days ago
New York, New York, United States 10a Labs Full timeAbout 10a Labs: 10a Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.S. tech leaders. We combine proprietary technology, deep expertise, and multilingual threat intelligence to detect abuse at scale. We also deliver state-of-the-art red teaming across high-impact security and safety challenges. In this...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Winston Artory Group Full timeAbout the roleLocationUS Remote or Hybrid (east coast time-zone preferred)For candidates in NY or Miami, an interview may be conducted in person.The RoleWe're hiring a Senior Data Engineer to architect and scale the systems that power our AI-driven valuation tools, market analytics, and collector insights. You'll lead development of our data ingestion...
-
Web Engineer
5 days ago
New York, New York, United States Spotify Full time $125,562 - $179,374Podcast R&D is a product and technology team within Podcast Vertical at Spotify, focused on building best-in-class tools for creators and publishers. We own the platforms, tools, and features that power the creator experience allowing podcasters and publishers to host, create, and distribute their content, grow and engage their audiences, and earn revenue on...
-
Data Evangelist Intern
2 weeks ago
New York, New York, United States DataCamp Full timeAbout DataCampDataCamp's mission is to empower everyone with the data and AI skills essential for 21st-century success. By providing practical, engaging learning experiences, DataCamp equips learners and organizations of all sizes to harness the power of data and AI. As a trusted partner to over 17 million learners and 6,000+ companies, including 80% of the...
-
Staff Web Platform Engineer
3 days ago
New York, New York, United States SoFi Full timeEmployee Applicant Privacy NoticeWho we are: Shape a brighter financial future with us.Together with our members, we're changing the way people think about and interact with personal finance.We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...
-
Data Engineer
2 weeks ago
New York, New York, United States DS Technologies Inc Full timeAbout US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for...
-
Senior Software Engineer, Web Infrastructure
23 hours ago
New York, New York, United States Asana Full timeThe Web Infrastructure team speeds up product engineering by making it easy to build and ship complex web app features. From core UI libraries to data loading APIs, these frameworks empower product engineers to easily build highly-reactive and fast product features at scale.We are looking for a Senior Software Engineer to help make our engineering team move...
-
Data Engineer
2 weeks ago
New York, New York, United States BlueMatrix Full timeWe're looking for a motivated Data Engineer to help build and scale our cloud-native data pipelines using Snowflake and dbt. This role is ideal for someone who enjoys solving data challenges, improving performance, and delivering trusted data to stakeholders across the business.Responsibilities:Design, develop, and maintain ELT pipelines using dbt and...
-
Lead Data Test Engineer
1 week ago
New York, New York, United States InfraTech Solutions Full timeLead Data Quality and Validation EngineerOverviewOur client, a highly successful and established organization, is seeking an experiencedLead Data Quality and Validation Engineerto spearhead critical enterprise data quality initiatives. This role focuses on owning and optimizing the quality assurance lifecycle across complex, large-scale data platforms,...
-
Product Manager, Web
22 hours ago
New York, New York, United States A Place for Mom Full time $140,000 - $160,000We are seeking a hands-on Product Manager – Web to lead the evolution of A Place for Mom's digital experience and web platform. This role is responsible for optimizing our site's performance and discoverability through SEO excellence, driving engagement through data-informed experimentation, and laying the foundation for a more AI-powered, personalized...
Web Scraping Data Engineer
2 weeks ago
Verition Fund Management LLC ("Verition") is a multi-strategy, multi-manager hedge fund founded in 2008. Verition focuses on global investment strategies including Global Credit, Global Convertible, Volatility & Capital Structure Arbitrage, Event-Driven Investing, Equity Long/Short & Capital Markets Trading, and Global Quantitative Trading.
We are seeking a Data Engineer with experience utilizing Web Scraping technologies, frameworks and libraries in addition to traditional data engineering practices. This role is new to the team, and we need an engineer who has experience building scrapes and interacting with Portfolio Managers on the buy side to augment our data team. Our Data team operates a cloud platform for structured data, market data, security master, streaming data, alternative data that may be acquired from APIs, files, websites, internal databases etc. We want to enable a new service, Web Scraping, for our internal clients. Experience and knowledge of modern techniques for scraping, supporting large data sets, historical data, data monitoring, data validation, support, operations, request management, interaction with clients such as Technology, Operations and Portfolio managers will be required. This role will be an opportunity for an aspiring data engineer to help establish a new process, learn and grow into a more senior data engineering role as the person shows a positive track record with our new scraping capability.
Responsibilities:
- Utilize AI Models, Code, Libraries or applications
to enable a scalable Web Scraping capability - Web Scraping Request Management
including intake, assessment, accessing sites to scrape, utilizing tools to scrape, storage of scrape, validation and entitlement to users - Fielding Questions
from users about the scrapes and websites - Coordinating with Compliance
on approvals and TOU reviews - Some Experience building Data pipelines
in AWS platform utilizing existing tools like Cron, Glue, Eventbridge, Python based ETL, AWS Redshift - Normalizing/standardizing vendor data
, firm data for firm consumption - Implement data quality checks
to ensure reliability and accuracy of scraped data - Coordinate with Internal teams
on delivery, access, requests, support - Promote Data Engineering best practices
Required Skills and Qualifications:
- Bachelor's degree in computer science, Engineering, Mathematics or related field
- 2-5 experience in a similar role
- Prior buy side experience is strongly preferred (Multi-Strat/Hedge Funds)
- Capital markets experience is necessary with good working knowledge of reference data across asset classes and experience with trading systems
- AWS cloud experience with commons services (S3, lambda, cron, Event Bridge etc.)
- Experience with web-scraping frameworks (Scrapy, BeautifulSoup, Selenium, Playwright etc.)
- Strong hands-on skills with NoSQL and SQL databases, programming in Python, data pipeline orchestration tools and analytics tools
- Familiarity with time series data and common market data sources (Bloomberg, Refinitiv etc.) is a plus
- Familiarity with modern Dev Ops practices and infrastructure-as-code tools (e.g. Terraform, CloudFormation)
- Strong communication skills to work with stakeholders across technology, investment, and operations teams.
- Ability to work independently or as a part of a team in a fast-paced environment with tight deadlines.
Salary Range: $125,000 USD - $200,000 USD
