Java Developer with Web Crawler Experience

7 days ago

Austin, TX, United States Axiom Software Solutions Limited Full time

Role: Java Developer with Web Crawler Experience

Location: Austin TX(Hybrid)

Responsibilities:

1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources.

2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.).

3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible.

4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites.

5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations.

6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws).

Requirements:

Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient).

Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer.

Strong understanding of HTML, CSS, JavaScript, and web data structures.

Familiarity with data parsing and handling techniques for JSON, XML, and other common formats.

Experience with database technologies (SQL, NoSQL) to store and manage scraped data.

Knowledge of HTTP protocols, headers, proxies, and load handling.

  • Senior Java Developer

    2 weeks ago

    Austin, TX, United States Diverse Lynx Full time

    Role name: Developer Role Description: Role Senior Java DeveloperKey Qualifications -Minimum 10 years of experience in enterprise Java development -Strong foundation in Computer Science fundamentals such as data structures and algorithms -Experienced in delivering advanced solutions for a multi-tier, distributed web application with AWS knowledge and...

  • Senior Java Developer

    2 weeks ago

    Austin, TX, United States Diverse Lynx Full time

    Role name: Developer Role Description: Role Senior Java DeveloperKey Qualifications -Minimum 10 years of experience in enterprise Java development -Strong foundation in Computer Science fundamentals such as data structures and algorithms -Experienced in delivering advanced solutions for a multi-tier, distributed web application with AWS knowledge and...

  • Java Developer

    7 days ago

    Austin, TX, United States Diverse Lynx Full time

    Experience-- (Candidates should have worked for more than 6 Months)Role: Senior Java DeveloperKey Qualifications: -Minimum 10+ years of experience in enterprise Java development -Strong foundation in Computer Science fundamentals such as data structures and algorithms -Experienced in delivering advanced solutions for a multi-tier, distributed web application...

  • Java Backend Developer

    2 days ago

    Austin, TX, United States Diverse Lynx Full time

    Job Description: Job Summary: We are seeking a talented Senior Java Backend Engineer with a minimum of 7 years of experience to join our dynamic team in Austin, TX. The ideal candidate will have extensive experience in designing, developing, and deploying multi-tier distributed web applications in an enterprise environment. You will play a critical role...

  • Java Developer

    7 days ago

    Austin, TX, United States Syntricate Technologies Full time

    Position- Java Developer Duration-Contract Location- ustin, TX JD 1. 8+ years of experience. 2. Must Have skills - Java, Cryptographic concepts, Cryptographic signing and encryption, Unix/Bash, Network Security, SSL. 3. Nice to have skills - Networking and Communication Protocols (SFTP/HTTPS/SSL), Encryption / Decryption, Web Application Security and...

  • Java Developer with Python

    2 weeks ago

    Austin, TX, United States Diverse Lynx Full time

    Role: Java Developer with Python Location: Austin, TX/Sunnyvale, CA (Onsite) Contract Role Description: Must Have More than 8 years of experience in designing and developing scalable enterprise grade solutions. More experienced profiles are considered for senior developer roles. Extensive hands-on experience with Java, Spring Boot and Microservices. Hands-on...

  • Java Developer

    7 days ago

    Austin, TX, United States Damco Solutions Full time

    Candidates Must Have Crystal Reports and Power BI Experience ( Minimum 4 Years ) SKILLS:Java Developer with SQL, RESTful web services, Spring, JUnit, Angular, Crystal Reports, and Power BI experience Experience in Object Oriented Programming (OOP) in Java programming language • Experience in applications development on J2EE platform • Experience in...

  • Java Developer

    2 weeks ago

    Austin, TX, United States Concord IT Systems Full time

    Client : PAYPAL Location : Austin, TX (Hybrid) JD: 10+ years of hands-on development experience with Java / J2EE Experience with Object oriented programming & design concepts Experience in Java backend and middleware technologies Experience in building web applications Experience developing RESTful webservices based applications Experience with...

  • Java Fullstack Developer

    2 weeks ago

    Austin, TX, United States Info Way Solutions Full time

    Hi Friends, I am sending requirement, kindly get back to me if the job description suits you. Job Title: Java fullstack developer Job Location: ustin , TX Contract Type: C2C Job Description: Job Title: Java Full Stack Developer with React Job Description: We are seeking a talented Java Full Stack Developer with expertise in React to join our dynamic...

  • Java Fullstack Developer

    4 days ago

    Austin, TX, United States Info Way Solutions Full time

    Hi Friends, I am sending requirement, kindly get back to me if the job description suits you. Job Title: Java fullstack developer Job Location: ustin , TX Contract Type: C2C Job Description: Job Title: Java Full Stack Developer with React Job Description: We are seeking a talented Java Full Stack Developer with expertise in React to join our dynamic...