Web Scraping Specialist

1 month ago


New York, United States Wynd Labs Full time
Job DescriptionJob DescriptionWeb Scraping Specialist

$70k – $140k

Who We Are.

Wynd Labs is an early-stage startup that is on a mission to make public web data accessible for AI through contributions to Grass.

Grass is a network sharing application that allows users to share their unused bandwidth. Effectively, this is a residential proxy network that directly rewards individual residential IPs for the bandwidth they provide. Grass will route traffic equitably among its network and meter the amount of data that each node provides to fairly distribute rewards.

In non-technical terms: Grass unlocks everyone's ability to earn rewards by simply sharing their unused internet bandwidth on personal devices (laptops, smartphones).

This project is for those who lead with initiative and seek to challenge themselves and thrive on curiosity.

We operate with a lean, highly motivated team who revel in the responsibility that comes with autonomy. We have a flat organizational structure, the people making decisions are also the ones implementing them. We are driven by ambitious goals and a strong sense of urgency. Leadership is given to those who show initiative, consistently deliver excellence and bring the best out of those around them. Join us if you want to set the tone for a fair and equitable internet.

The Role.

We are seeking a Web Scraping Specialist who is proficient and brings significant experience in data extraction and web scraping techniques. You will join a small, specialized team and lead efforts to gather and analyze data, optimize scraping processes, and support our vision for a future where Grass plays a crucial role in transforming internet data accessibility.

Who You Are.

  • Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.
  • Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
  • Knowledge of asynchronous programming, multithreading, and distributed scraping.
  • In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
  • Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.
  • Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
  • Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
  • Active participation in open-source projects related to web scraping, data processing, or similar fields.

What You'll Be Doing.

  • Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
  • Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
  • Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
  • Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
  • Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.

Why Work With Us.

  • Opportunity. We are at at the forefront of developing a web-scale crawler and knowledge graph that allows ordinary people to participate in the process, and share in the benefits of AI development.
  • Culture. We're a lean team working together to achieve a very ambitious goal of improving access to public web data and distributing the value of AI to the people. We prioritize low ego and high output.
  • Compensation. You'll receive a competitive salary and equity package.
  • Resources and growth. We're well-capitalized, with backing from leading venture funds like Polychain, Tribe, NLH, Hack, BH Digital, and more. We keep a lean team, and this is a rare opportunity to join. You'll learn a lot and grow as our company scales.


  • new york city, United States Stealth PropTech Full time

    Job Title: Senior Web Scraping EngineerSalary: $145,000+/yr base salary post-funding* (We’re close—huge traction!)Equity Vesting and BonusesOpportunities for Advancement*Candidates must have extensive experience in web scraping, including Python proficiency and data parsing in complex environments. Familiarity with AWS/Linux is a plus.*Please note:This...


  • New York, New York, United States Middesk Full time

    Data Infrastructure RoleWe're looking for a seasoned Business Data Infrastructure Specialist to join our Foundation team at Middesk. As a critical member of this team, you'll be responsible for designing and implementing scalable data pipelines, building reliable systems, and extending our web scraping capabilities. Your focus on data quality and scalability...


  • New York, New York, United States Columbia University Full time

    Web Applications Specialist at Columbia UniversityThe Columbia University Application Services department is seeking an experienced Web Applications Specialist to join its team. This role involves developing, maintaining, and supporting web applications and systems that support the College's administrative departments.Key Responsibilities:Design, develop,...


  • New York, New York, United States FIRST SOFTSOLUTIONS INC Full time

    Job Title: Web Application SpecialistAbout First Softsolutions Inc:First Softsolutions Inc is a leading provider of software solutions, dedicated to delivering high-quality products and services to our clients. We are seeking an experienced Web Application Specialist to join our team in New York City.Salary: $155,000 - $185,000 per yearJob Description:We are...


  • New York, New York, United States Amazon Web Services, Inc. Full time

    Job DescriptionAbout the Role:As a Sr. WW Specialist at Amazon Web Services, you will play a key role in driving the development and adoption of our Gen AI Next Generation Developer Experience services.Responsibilities:Lead the effort in scaling these services through partners globally, creating and executing strategies for growth. Work closely with AWS...


  • New York, New York, United States Fud Full time

    Job OverviewFud is seeking a skilled Web Development Specialist to join our community of freelancers. As a remote worker, you will have the opportunity to work with a supportive team and contribute to exciting projects. This role offers flexible working hours, allowing you to balance your work and personal life effectively.The estimated annual salary for...


  • New York, New York, United States QNARY Full time

    About the TeamWe are looking for a talented Web Application Specialist to partner and work closely with the product and services teams to translate wireframes, and designs into code.Your extensive knowledge of common UI testing frameworks (e.g., Jasmine, JSCoverage), understanding of UX principles and best practices, and knowledge of common browser developer...


  • New York, New York, United States Neon Moose LLC dba Justworks Labs Full time

    **About the Role**The Frontend Web Application Specialist will be responsible for designing and developing user-centric frontend web applications that meet the needs of both internal and external users.To succeed in this role, you should have experience with modern front-end web development technologies, including HTML, CSS, and JavaScript. You should also...


  • New York, New York, United States Wynd Labs Full time

    Web Scraping SpecialistWe are seeking a highly skilled Data Extraction Expert to join our team at Wynd Labs. As a key member of our organization, you will play a critical role in gathering and analyzing data, optimizing scraping processes, and supporting our mission to make public web data accessible for AI.About Us:Wynd Labs is an early-stage startup...


  • New York, New York, United States UnitedMasters | Translation Full time

    UnitedMasters | Translation is reimagining how brands and artists come together to tell their stories, build profitable growth, and push culture forward. We are seeking a skilled Web Software Engineering Specialist to join our growing team. As a Hybrid role, you will work two days in the office and three days remote. Your primary responsibility will be...


  • New York, New York, United States MKS2 Technologies Full time

    Job Overview We are seeking an experienced Senior Web Architecture Specialist to join our growing team at MKS2 Technologies, LLC. In this role, you will be responsible for developing and executing a comprehensive web architecture framework that ensures our website, CareScout.com, provides an exceptional user experience across various devices. Key...


  • New York, New York, United States Axiom Path Full time

    Axiom Path is committed to simplifying and dignifying the aging experience by offering holistic long-term care solutions.We are looking for a Senior Web Architecture Specialist to lead web technology innovation in the senior care space. This role offers a dynamic opportunity to gain exposure to advanced architecture practices and collaborate with...

  • Web Specialist

    2 days ago


    New York, United States AEG Full time

    In order to be considered for this role, after clicking "Apply Now" above and being redirected, you must fully complete the application process on the follow-up screen. Overview This person will assist and facilitate all OVG corporate managed websites and support the venue level websites via agency management, direct collaboration with venue level teams and...

  • Analytics Intern

    1 week ago


    New York, United States GNY Insurance Companies Full time

    Job DetailsJob Location NEW YORK HEADQUARTERS - NEW YORK, NY  Description Position Summary: The purpose of this job is to assist Data Scientists to explore external data resources and to extract discovered data through web scraping. Essential Duties and Responsibilities:Explore potential useful external data resources.Extract external data through web...

  • Analytics Intern

    1 month ago


    New York, United States GNY Insurance Companies Full time

    Job DetailsJob Location NEW YORK HEADQUARTERS - NEW YORK, NY  Description Position Summary: The purpose of this job is to assist Data Scientists to explore external data resources and to extract discovered data through web scraping. Essential Duties and Responsibilities:Explore potential useful external data resources.Extract external data through web...

  • Web Specialist

    1 day ago


    New York, United States Oak View Group Full time

    Oak View Group Oak View Group is the global leader in venue development, management, and premium hospitality services for the live event industry. Offering an unmatched, 360-degree solution set for a collection of world-class owned venues and a client roster that includes the most influential, highest attended arenas, convention centers, music festivals,...


  • New York, New York, United States TopView Sightseeing Full time

    Job OverviewTopView Sightseeing is a fast-paced company that offers one-of-a-kind experiences for tourists and locals. We operate globally, with offices in major cities like NYC, Philadelphia, Washington, DC, Atlanta, and London.About the RoleWe are seeking a skilled Web Merchandising Specialist to join our team. The ideal candidate will be responsible for...


  • New York, New York, United States TechnoGen Full time

    We are seeking an exceptional Angular Web Application Specialist to join our team in NYC. This contract position offers a competitive salary of $130,000 per year. Your primary function will be to design and develop high-performance front-end applications using Angular 10, CSS, and TypeScript.As an expert in front-end development, you will be responsible for...


  • New York, New York, United States Wynd Labs Full time

    About the RoleWe are seeking a highly skilled Data Extraction Expert to join our team at Wynd Labs.As a key member of our team, you will play a crucial role in extracting and analyzing data from various online sources, ensuring reliability and efficiency.Your primary responsibility will be to write, test, and refine code that extracts data from complex...

  • Web Producer

    3 weeks ago


    New York, United States The College Board Full time

    Web Producer College Board - AP&I Location: This is a fully remote role, but candidates who live near College Board offices can be fully remote or hybrid (Tuesday and Wednesday in office). Type: This is a full-time position. About the Team With more than 38 courses and exams across multiple subject areas, Advanced Placement is the most widely accepted...