I am thinking of creating a job board system that scrapes data from company official career pages
Hi all, I am thinking of creating a job board system which 1. scrapes the job data from the company's official pages 2. do not encourage third-party talent acquisition firms to spam with duplicate posts How do I make money? 1. Selling home page slots to the companies that promotes high visibility Do you guys think this will work?
tylerdurden
Student
7 months ago
@lezgooomuthafucka - yes, please DM
samosa
Stealth
7 months ago
nhi chalega, all other platforms doing the exact same thing
tylerdurden
Student
7 months ago
@samosa yeah... linkedin, indeed, google are already scraping I think
Google has one similar to this. I tried this few years ago for a client. Only problem you will face is site limiting which you can bypass using Residential Proxies. If you are using Python there is a library called "cloudscraper". It works really well to unblock a lot of websites without having to use proxy.
You should think of implementing a queue based approach (Redis + RabbitMQ) to handle all the traffic and have retry mechanism.
jetLaggedEngineer
Stealth
7 months ago
While in my last yrs I also thought of making something similar but it included many more things
I have been thinking of something similar.
Like a website or an chrome extension to get internships/ jobs alert by scraping data from company's portals.
I am new to learning web development but have been brain storming the ideas.
It is it good or bad? Or can anyone give me some ideas which are different than regular ones
Discover More
Curated from across