Java Developer with Web Crawler Experience

4 days ago

Austin, TX, United States Axiom Software Solutions Limited Full time

Role: Java Developer with Web Crawler Experience

Location: Austin TX(Hybrid)

Responsibilities:

1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources.

2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.).

3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible.

4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites.

5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations.

6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws).

Requirements:

Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient).

Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer.

Strong understanding of HTML, CSS, JavaScript, and web data structures.

Familiarity with data parsing and handling techniques for JSON, XML, and other common formats.

Experience with database technologies (SQL, NoSQL) to store and manage scraped data.

Knowledge of HTTP protocols, headers, proxies, and load handling.

  • Sr.Software Developer

    3 days ago

    Austin, TX, United States Crescens Full time

    Job Title: Sr.Software Developer (Java / Web Services) Location: Austin, TX (Onsite) Duration: 12+ Months Note: Position is ONSITE at the location listed above (NO REMOTE WORK). Program will only accept LOCAL ONLY candidates for this position (Within 50-mile radius). **Subject to change per the hiring team** Key Responsibilities: Plans, develops,...

  • Sr.Software Developer

    5 days ago

    Austin, TX, United States Crescens Full time

    Job Title: Sr.Software Developer (Java / Web Services) Location: Austin, TX (Onsite) Duration: 12+ Months Note: Position is ONSITE at the location listed above (NO REMOTE WORK). Program will only accept LOCAL ONLY candidates for this position (Within 50-mile radius). **Subject to change per the hiring team** Key Responsibilities: Plans, develops,...

  • Java Developer

    2 weeks ago

    Austin, TX, United States Crescens Full time

    Job Title: Java Developer Location: Austin, TX (Hybrid) Duration: 12+ MonthsKey Responsibilities: Performs application development, enhancement, maintenance, and support for State Portal, Workflow Management, Eligibility Web Services, Family Violence Program, Enterprise Document Services, Enterprise Content Management, Document Center, Call Center Inquiry,...

  • Java Developer

    2 weeks ago

    Austin, TX, United States Crescens Full time

    Job Title: Java Developer Location: Austin, TX (Hybrid) Duration: 12+ MonthsKey Responsibilities: Performs application development, enhancement, maintenance, and support for State Portal, Workflow Management, Eligibility Web Services, Family Violence Program, Enterprise Document Services, Enterprise Content Management, Document Center, Call Center Inquiry,...

  • Java Developer

    2 weeks ago

    Austin, TX, United States Syntricate Technologies Full time

    Position- Java Developer Duration-Contract Location- ustin, TX JD 1. 8+ years of experience. 2. Must Have skills - Java, Cryptographic concepts, Cryptographic signing and encryption, Unix/Bash, Network Security, SSL. 3. Nice to have skills - Networking and Communication Protocols (SFTP/HTTPS/SSL), Encryption / Decryption, Web Application Security and...

  • Java Developer

    1 week ago

    Austin, TX, United States Syntricate Technologies Full time

    Position- Java Developer Duration-Contract Location- ustin, TX JD 1. 8+ years of experience. 2. Must Have skills - Java, Cryptographic concepts, Cryptographic signing and encryption, Unix/Bash, Network Security, SSL. 3. Nice to have skills - Networking and Communication Protocols (SFTP/HTTPS/SSL), Encryption / Decryption, Web Application Security and...

  • Java Developer

    4 days ago

    Austin, TX, United States Syntricate Technologies Full time

    Position- Java Developer Duration-Contract Location- ustin, TX JD 1. 8+ years of experience. 2. Must Have skills - Java, Cryptographic concepts, Cryptographic signing and encryption, Unix/Bash, Network Security, SSL. 3. Nice to have skills - Networking and Communication Protocols (SFTP/HTTPS/SSL), Encryption / Decryption, Web Application Security and...

  • Java Developer

    2 weeks ago

    Austin, TX, United States Indotronix International Corporation Full time

    Java Developer | Austin, Texas, United States Java Developer Payrate: $62 - 72/hr Location: 1609 Centre Creek Dr., Suite 200, Austin, TX 78754, The working position is Hybrid - On Site and Telework . Duration: 8 Months II. CANDIDATE SKILLS AND QUALIFICATIONS Minimum Requirements: Candidates that do not meet or exceed the minimum stated...

  • Java Developer

    3 days ago

    Austin, TX, United States Artech Full time

    Java Developer (AI) 6-12 Months Austin Texas -Minimum 5 years of experience in enterprise Java development -Strong foundation in Computer Science fundamentals such as data structures and algorithms -Experienced in delivering advanced solutions for a multi-tier, distributed web application with AWS knowledge and experience -Knowledge in the Object...

  • Java Developer

    5 days ago

    Austin, TX, United States Artech Full time

    Java Developer (AI) 6-12 Months Austin Texas -Minimum 5 years of experience in enterprise Java development -Strong foundation in Computer Science fundamentals such as data structures and algorithms -Experienced in delivering advanced solutions for a multi-tier, distributed web application with AWS knowledge and experience -Knowledge in the Object...