Web Scraping Specialist
1 month ago
$70k – $140k
Who We Are.
Wynd Labs is an early-stage startup that is on a mission to make public web data accessible for AI through contributions to Grass.
Grass is a network sharing application that allows users to share their unused bandwidth. Effectively, this is a residential proxy network that directly rewards individual residential IPs for the bandwidth they provide. Grass will route traffic equitably among its network and meter the amount of data that each node provides to fairly distribute rewards.
In non-technical terms: Grass unlocks everyone's ability to earn rewards by simply sharing their unused internet bandwidth on personal devices (laptops, smartphones).
This project is for those who lead with initiative and seek to challenge themselves and thrive on curiosity.
We operate with a lean, highly motivated team who revel in the responsibility that comes with autonomy. We have a flat organizational structure, the people making decisions are also the ones implementing them. We are driven by ambitious goals and a strong sense of urgency. Leadership is given to those who show initiative, consistently deliver excellence and bring the best out of those around them. Join us if you want to set the tone for a fair and equitable internet.
The Role.
We are seeking a Web Scraping Specialist who is proficient and brings significant experience in data extraction and web scraping techniques. You will join a small, specialized team and lead efforts to gather and analyze data, optimize scraping processes, and support our vision for a future where Grass plays a crucial role in transforming internet data accessibility.
Who You Are.
- Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.
- Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
- Knowledge of asynchronous programming, multithreading, and distributed scraping.
- In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
- Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.
- Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
- Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
- Active participation in open-source projects related to web scraping, data processing, or similar fields.
What You'll Be Doing.
- Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
- Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
- Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
- Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
- Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.
Why Work With Us.
- Opportunity. We are at at the forefront of developing a web-scale crawler and knowledge graph that allows ordinary people to participate in the process, and share in the benefits of AI development.
- Culture. We're a lean team working together to achieve a very ambitious goal of improving access to public web data and distributing the value of AI to the people. We prioritize low ego and high output.
- Compensation. You'll receive a competitive salary and equity package.
- Resources and growth. We're well-capitalized, with backing from leading venture funds like Polychain, Tribe, NLH, Hack, BH Digital, and more. We keep a lean team, and this is a rare opportunity to join. You'll learn a lot and grow as our company scales.
-
new york city, United States Stealth PropTech Full timeJob Title: Senior Web Scraping EngineerSalary: $145,000+/yr base salary post-funding* (We’re close—huge traction!)Equity Vesting and BonusesOpportunities for Advancement*Candidates must have extensive experience in web scraping, including Python proficiency and data parsing in complex environments. Familiarity with AWS/Linux is a plus.*Please note:This...
-
Business Data Infrastructure Specialist
42 minutes ago
New York, New York, United States Middesk Full timeData Infrastructure RoleWe're looking for a seasoned Business Data Infrastructure Specialist to join our Foundation team at Middesk. As a critical member of this team, you'll be responsible for designing and implementing scalable data pipelines, building reliable systems, and extending our web scraping capabilities. Your focus on data quality and scalability...
-
Web Applications Specialist
12 minutes ago
New York, New York, United States Columbia University Full timeWeb Applications Specialist at Columbia UniversityThe Columbia University Application Services department is seeking an experienced Web Applications Specialist to join its team. This role involves developing, maintaining, and supporting web applications and systems that support the College's administrative departments.Key Responsibilities:Design, develop,...
-
Web Application Specialist
24 minutes ago
New York, New York, United States FIRST SOFTSOLUTIONS INC Full timeJob Title: Web Application SpecialistAbout First Softsolutions Inc:First Softsolutions Inc is a leading provider of software solutions, dedicated to delivering high-quality products and services to our clients. We are seeking an experienced Web Application Specialist to join our team in New York City.Salary: $155,000 - $185,000 per yearJob Description:We are...
-
Cloud Transformation Specialist
3 weeks ago
New York, New York, United States Amazon Web Services, Inc. Full timeJob DescriptionAbout the Role:As a Sr. WW Specialist at Amazon Web Services, you will play a key role in driving the development and adoption of our Gen AI Next Generation Developer Experience services.Responsibilities:Lead the effort in scaling these services through partners globally, creating and executing strategies for growth. Work closely with AWS...
-
Web Development Specialist
31 minutes ago
New York, New York, United States Fud Full timeJob OverviewFud is seeking a skilled Web Development Specialist to join our community of freelancers. As a remote worker, you will have the opportunity to work with a supportive team and contribute to exciting projects. This role offers flexible working hours, allowing you to balance your work and personal life effectively.The estimated annual salary for...
-
Web Application Specialist
5 days ago
New York, New York, United States QNARY Full timeAbout the TeamWe are looking for a talented Web Application Specialist to partner and work closely with the product and services teams to translate wireframes, and designs into code.Your extensive knowledge of common UI testing frameworks (e.g., Jasmine, JSCoverage), understanding of UX principles and best practices, and knowledge of common browser developer...
-
Frontend Web Application Specialist
5 days ago
New York, New York, United States Neon Moose LLC dba Justworks Labs Full time**About the Role**The Frontend Web Application Specialist will be responsible for designing and developing user-centric frontend web applications that meet the needs of both internal and external users.To succeed in this role, you should have experience with modern front-end web development technologies, including HTML, CSS, and JavaScript. You should also...
-
Data Extraction Expert
3 weeks ago
New York, New York, United States Wynd Labs Full timeWeb Scraping SpecialistWe are seeking a highly skilled Data Extraction Expert to join our team at Wynd Labs. As a key member of our organization, you will play a critical role in gathering and analyzing data, optimizing scraping processes, and supporting our mission to make public web data accessible for AI.About Us:Wynd Labs is an early-stage startup...
-
Web Software Engineering Specialist
5 days ago
New York, New York, United States UnitedMasters | Translation Full timeUnitedMasters | Translation is reimagining how brands and artists come together to tell their stories, build profitable growth, and push culture forward. We are seeking a skilled Web Software Engineering Specialist to join our growing team. As a Hybrid role, you will work two days in the office and three days remote. Your primary responsibility will be...
-
Senior Web Architecture Specialist
3 weeks ago
New York, New York, United States MKS2 Technologies Full timeJob Overview We are seeking an experienced Senior Web Architecture Specialist to join our growing team at MKS2 Technologies, LLC. In this role, you will be responsible for developing and executing a comprehensive web architecture framework that ensures our website, CareScout.com, provides an exceptional user experience across various devices. Key...
-
Senior Web Architecture Specialist
3 weeks ago
New York, New York, United States Axiom Path Full timeAxiom Path is committed to simplifying and dignifying the aging experience by offering holistic long-term care solutions.We are looking for a Senior Web Architecture Specialist to lead web technology innovation in the senior care space. This role offers a dynamic opportunity to gain exposure to advanced architecture practices and collaborate with...
-
Web Specialist
2 days ago
New York, United States AEG Full timeIn order to be considered for this role, after clicking "Apply Now" above and being redirected, you must fully complete the application process on the follow-up screen. Overview This person will assist and facilitate all OVG corporate managed websites and support the venue level websites via agency management, direct collaboration with venue level teams and...
-
Analytics Intern
1 week ago
New York, United States GNY Insurance Companies Full timeJob DetailsJob Location NEW YORK HEADQUARTERS - NEW YORK, NY Description Position Summary: The purpose of this job is to assist Data Scientists to explore external data resources and to extract discovered data through web scraping. Essential Duties and Responsibilities:Explore potential useful external data resources.Extract external data through web...
-
Analytics Intern
1 month ago
New York, United States GNY Insurance Companies Full timeJob DetailsJob Location NEW YORK HEADQUARTERS - NEW YORK, NY Description Position Summary: The purpose of this job is to assist Data Scientists to explore external data resources and to extract discovered data through web scraping. Essential Duties and Responsibilities:Explore potential useful external data resources.Extract external data through web...
-
Web Specialist
1 day ago
New York, United States Oak View Group Full timeOak View Group Oak View Group is the global leader in venue development, management, and premium hospitality services for the live event industry. Offering an unmatched, 360-degree solution set for a collection of world-class owned venues and a client roster that includes the most influential, highest attended arenas, convention centers, music festivals,...
-
Web Merchandising Strategist
1 week ago
New York, New York, United States TopView Sightseeing Full timeJob OverviewTopView Sightseeing is a fast-paced company that offers one-of-a-kind experiences for tourists and locals. We operate globally, with offices in major cities like NYC, Philadelphia, Washington, DC, Atlanta, and London.About the RoleWe are seeking a skilled Web Merchandising Specialist to join our team. The ideal candidate will be responsible for...
-
Angular Web Application Specialist
6 days ago
New York, New York, United States TechnoGen Full timeWe are seeking an exceptional Angular Web Application Specialist to join our team in NYC. This contract position offers a competitive salary of $130,000 per year. Your primary function will be to design and develop high-performance front-end applications using Angular 10, CSS, and TypeScript.As an expert in front-end development, you will be responsible for...
-
Data Extraction Expert
1 week ago
New York, New York, United States Wynd Labs Full timeAbout the RoleWe are seeking a highly skilled Data Extraction Expert to join our team at Wynd Labs.As a key member of our team, you will play a crucial role in extracting and analyzing data from various online sources, ensuring reliability and efficiency.Your primary responsibility will be to write, test, and refine code that extracts data from complex...
-
Web Producer
3 weeks ago
New York, United States The College Board Full timeWeb Producer College Board - AP&I Location: This is a fully remote role, but candidates who live near College Board offices can be fully remote or hybrid (Tuesday and Wednesday in office). Type: This is a full-time position. About the Team With more than 38 courses and exams across multiple subject areas, Advanced Placement is the most widely accepted...