AI Scraper Engineer

Join LNTECH inSurabaya as an AI Scraper Engineer to build and maintain robust, production-grade web and mobile application scrapers using Python. This role focuses on extracting valuable data through innovative techniques, including developing API clients and implementing headless browser solutions where necessary. You will play a pivotal role in uncovering internal and private APIs by reverse-engineering complex websites and applications, enabling the company to leverage data effectively.

About the Role

You will be responsible for designing, developing, and optimizing scrapers that efficiently gather data from diverse sources. This involves creating reliable Python-based tools and workflows to handle various scraping scenarios, ensuring scalability and resilience in production environments. A key aspect of the role is the ability to dissect and understand the structure of target sites and applications to identify hidden data sources and authentication mechanisms.

Key Responsibilities

• Develop and maintain high-performance Python scrapers for web and mobile applications.
• Design and implement supporting tooling, including API clients and headless browser flows.
• Reverse-engineer websites and mobile apps to discover internal/private APIs and authentication strategies.
• Optimize scraper performance, reliability, and error handling for production use.
• Collaborate with engineering teams to integrate scraped data into broader systems.

Requirements

• Proficiency in Python programming and experience building web scraping solutions.
• Understanding of HTTP protocols, APIs (REST, GraphQL), and web technologies.
• Experience with headless browser automation tools (e.g., Selenium, Playwright).
• Ability to analyze and deconstruct complex web pages and mobile applications.
• Strong problem-solving skills and attention to detail in debugging and optimization.

What We Offer

Contribute to cutting-edge projects in a dynamic environment. Enjoy competitive compensation and benefits, opportunities for professional growth, and a collaborative team culture focused on innovation and impact.