Web Scraping Specialist

2 weeks ago

New York, United States Wynd Labs Full time
Job DescriptionJob DescriptionWeb Scraping Specialist

$75k – $125k • 0.06% – 3.0%

Wynd is an early-stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such as our first product, Grass.

Grass is a network sharing application that allows users to sell their unused internet bandwidth.

Your day-to-day:

  • Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
  • Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
  • Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
  • Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
  • Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.

What experience you'll need:

  • Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.

Technical requirements:

  • Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
  • Knowledge of asynchronous programming, multithreading, and distributed scraping.
  • In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
  • Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.

Bonus points:

  • Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
  • Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
  • Active participation in open-source projects related to web scraping, data processing, or similar fields.

Apply

Our hiring process prioritizes a paid work trial over a traditional interview process.

  • Web Scraping Specialist

    3 weeks ago

    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionWeb Scraping Specialist$75k – $125k • 0.06% – 3.0%Wynd is an early-stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such as our first product, Grass.Grass is a network sharing application that allows users to sell their unused...

  • Senior Specialist, Core Compute

    2 weeks ago

    New York, United States Amazon.com, Inc. Full time

    Amazon Web Services (AWS) is the pioneer and recognized leader in Cloud Computing. Our web services provide a platform for IT infrastructure in-the-cloud that is used by hundreds of thousands of developers and businesses around the world. These custo Specialist, Business Development, Business Operations, Senior, Enterprise, Sales, Technology

  • Senior Local SEO Specialist

    5 days ago

    New York, United States Digital Service Hub Full time

    Company Description Digital Service Hub is a leading SEO Company dedicated to helping local businesses achieve success. With over 1 year and 6 months of experience and a team of passionate professionals, we are committed to supporting our clients in realizing their goals. Join us and get ready to drive impressive results. Role Description This is a full-time...

  • Senior Local SEO Specialist

    4 days ago

    New York, United States Digital Service Hub Full time

    Company Description Digital Service Hub is a leading SEO Company dedicated to helping local businesses achieve success. With over 1 year and 6 months of experience and a team of passionate professionals, we are committed to supporting our clients in realizing their goals. Join us and get ready to drive impressive results. Role Description This is a full-time...

  • Product Manager

    6 days ago

    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionProduct Manager$130k – $200k • 0.025% – .5%Wynd is an early-stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such as our first product, Grass.Grass is a network sharing application that allows users to sell their unused internet...

  • Engineering Contractor, Data

    3 weeks ago

    New York County, New York, United States Equinox Full time

    Job Description Equinox is seeking a 2 to 3-Month Engineering Contractor to join our data team. This role is a hands-on engineering position responsible for cleanly integrating a variety of sources into our data platform. The data platform supports the daily functions of our data warehouse, analytics, and business intelligence teams. Our ideal candidate is...

  • Senior Software Engineer

    3 weeks ago

    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionSenior Software Engineer (Backend)$120k – $200k • 0.05% – 0.75%Wynd is an early stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such our first product, Grass.Grass is a network sharing application that allows users to sell their...

  • Senior Software Engineer

    6 days ago

    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionSenior Software Engineer (Backend)$120k – $200k • 0.05% – 0.75%Wynd is an early stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such our first product, Grass.Grass is a network sharing application that allows users to sell their...

  • Content Specialist

    2 weeks ago

    New York, United States E-Impact Marketing LLC Full time

    This is a full-time on-site role for a Content Specialist in Brooklyn, NY. The Content Specialist will be responsible for day-to-day tasks such as new website content writing, long-form content development, content management, and creative writing. The ideal candidate will have a passion for writing, a desire to create engaging content, and a keen eye for...

  • Content Specialist

    2 weeks ago

    New York, United States E-Impact Marketing LLC Full time

    This is a full-time on-site role for a Content Specialist in Brooklyn, NY. The Content Specialist will be responsible for day-to-day tasks such as new website content writing, long-form content development, content management, and creative writing. The ideal candidate will have a passion for writing, a desire to create engaging content, and a keen eye for...

  • Marketing Specialist

    2 weeks ago

    New York, United States eTeam Full time

    Position: Marketing Specialist Location: NY, US zip 10036 Duration: 10 months Contract Pay rate:- $50/hr - $55/hr on W2 without any benefitsJob Description: As a Senior Marketing Operations Specialist, you will focus on email, list uploads, and webinar marketing to drive qualified conversions.You will create nurturing and trigger-based email campaigns,...

  • Graphic Designer

    3 weeks ago

    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionGraphic Designer$50k – $100k • 0.1% – 0.5%Wynd is an early stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such our first product, Grass. Grass is a network sharing application that allows users to sell their unused bandwidth.Your...

  • Amazon Ads PPC Specialist

    4 days ago

    New York, United States Custom Filters Direct Full time

    Company DescriptionCustom Filters Direct is a leading supplier of custom odd size HVAC filters for commercial and residential buildings. We serve thousands of customers and offer flexible order options. Whether you need a case of custom filters or a truckload, our team is dedicated to providing exceptional service.Role DescriptionThis is a full-time remote...

  • Embedded Systems Engineer

    3 weeks ago

    New York, United States Wynd Labs Full time

    Job DescriptionJob DescriptionEmbedded Systems Engineer$140k – $200k • 0.05% – 0.75%Wynd is an early stage startup empowering access to public web data. Wynd Network enables access to public web data through decentralized data scraping tools such our first product, Grass.Grass is a network sharing application that allows users to sell their unused...

  • Data Specialist

    3 weeks ago

    New York, United States City of New York Full time

    ONLY CANDIDATES WHO ARE PERMANENT ASSOCIATE CONTRACT SPECIALIST OR WHO ARE ELIGIBLE FOR APPOINTMENT FROM THE OPEN COMPETITIVE OR PROMOTIONAL ASSOCIATE CONTRACT SPECIALIST LIST WILL BE CONSIDERED FOR THIS POSITION. The New York City Department of Youth and Community Development (DYCD) invests in a network of community-based organizations and programs to...

  • Amazon Ads PPC Specialist

    4 weeks ago

    New York, United States Custom Filters Direct Full time

    Company DescriptionCustom Filters Direct is a leading supplier of custom odd size HVAC filters for commercial and residential buildings. We serve thousands of customers and offer flexible order options. Whether you need a case of custom filters or a truckload, our team is dedicated to providing exceptional service.Role DescriptionThis is a full-time remote...

  • Amazon Ads PPC Specialist

    3 weeks ago

    New York, United States Custom Filters Direct Full time

    Company DescriptionCustom Filters Direct is a leading supplier of custom odd size HVAC filters for commercial and residential buildings. We serve thousands of customers and offer flexible order options. Whether you need a case of custom filters or a truckload, our team is dedicated to providing exceptional service.Role DescriptionThis is a full-time remote...

  • Billing Specialist

    4 weeks ago

    New York, United States The Forum Group Full time

    Exciting Job Opportunity for a Legal Billing Specialist! Join a leading international law firm at the forefront of legal innovation, serving top financial institutions and Fortune Global 500 companies worldwide. As a globally recognized firm, they value dynamic individuals committed to service, innovation, and professional growth.Candidates must be...

  • Billing Specialist

    3 weeks ago

    New York, United States The Forum Group Full time

    Exciting Job Opportunity for a Legal Billing Specialist! Join a leading international law firm at the forefront of legal innovation, serving top financial institutions and Fortune Global 500 companies worldwide. As a globally recognized firm, they value dynamic individuals committed to service, innovation, and professional growth.Candidates must be...

  • Website Specialist

    2 days ago

    York, United States Steinmetz Coins and Currency Full time

    Job Summary: We are seeking a highly skilled and motivated Web Site Specialist to join our team. You will be operating in a small family business. Your job will be managing our retail web site. The day to day processing and shipping of all orders while helping manage the inventory of the site. There is also customer service responsibility. if you enjoy...