- Added TechInAsia spider to collect job data from Tech in Asia Jobs portal
- Implemented Algolia API integration for efficient data retrieval from TechInAsia
- Enhanced data sanitization to ensure CSV-friendly output
- Improved error handling and logging for the new spider
- Updated documentation to reflect the addition of TechInAsia as a data source
id-jobs collects job listings from Indonesian job portals and company websites, respecting each site's terms of service.
View the Data on Google Sheets: https://s.id/id-jobs-v2
View the Dashboard on LookerStudio by Google: https://s.id/id-jobs-dashboard
| Age | Time | Color |
|---|---|---|
| New | ≤ 1 day | |
| Hot | 1-7 days | |
| Recent | 8-15 days | |
| Aging | 16-21 days | |
| Old | 22-30 days | |
| Expired | > 30 days |
id-jobs automatically collects job data from various websites, cleans the information, and compiles it into a single spreadsheet. We use Scrapy for most sites and Playwright for sites with complex JavaScript rendering.
id-jobs simplifies job searching by gathering information from multiple sources into one place, providing insights on work arrangements, job levels, and application deadlines.
We collect data from various job portals and company websites, including: Blibli, Dealls, Evermos, Flip, GoTo, Glints (Lite), Jobstreet, Kalibrr, Karir.com, Kredivo, Mekari, SoftwareOne, Tiket, Tech in Asia Jobs, and more.
- Daily updates
- Work arrangement identification
- Job level detection
- Application deadline calculation
- Improved data accuracy
- User-friendly Google Sheets interface
- Job age tracking
- JavaScript-rendered content handling with Playwright
- Efficient pagination across multiple pages
- Integration with Algolia API for improved data retrieval
For a quick guide, see our Quickstart Guide.
Check our FAQ for common questions.
id-jobs is open source under the GPL-3.0 license. You can use, modify, and share the code, as long as you keep it open source.
We respect website terms of service when collecting data.