ZestyPretzel
ZestyPretzel
Student

I am thinking of creating a job board system that scrapes data from company official career pages

Hi all,

I am thinking of creating a job board system which

  1. scrapes the job data from the company's official pages
  2. do not encourage third-party talent acquisition firms to spam with duplicate posts

How do I make money?

  1. Selling home page slots to the companies that promotes high visibility

Do you guys think this will work?

12mo ago
JazzyMuffin
JazzyMuffin

i’m working on something similar. wanna catch up?

ZestyPretzel
ZestyPretzel
Student12mo

@lezgooomuthafucka - yes, please DM

WigglyPenguin
WigglyPenguin

nhi chalega, all other platforms doing the exact same thing

ZestyPretzel
ZestyPretzel
Student12mo

@samosa yeah... linkedin, indeed, google are already scraping I think

JumpyWaffle
JumpyWaffle

Good initiative 🫡

ZippyUnicorn
ZippyUnicorn

Google has one similar to this. I tried this few years ago for a client. Only problem you will face is site limiting which you can bypass using Residential Proxies. If you are using Python there is a library called "cloudscraper". It works really well to unblock a lot of websites without having to use proxy.
You should think of implementing a queue based approach (Redis + RabbitMQ) to handle all the traffic and have retry mechanism.

DancingBurrito
DancingBurrito

While in my last yrs I also thought of making something similar but it included many more things

PrancingNoodle
PrancingNoodle
Zopper12mo

Interested would like to collaborate.

FluffyPickle
FluffyPickle
Target12mo

I have been thinking of something similar. Like a website or an chrome extension to get internships/ jobs alert by scraping data from company's portals. I am new to learning web development but have been brain storming the ideas. It is it good or bad? Or can anyone give me some ideas which are different than regular ones

Discover more
Curated from across
Misc
Misc16mo
by GigglyMochiSoftware Engineer

Job boards that work

4.5 years YOE. I'm looking to change jobs next year and wanted to know what job boards actually work. I have had great success with Angellist so far early career. Anything apart from that also brings in a lot of recruiter spam. Only Job...

Misc
Misc10mo
by ZippyWaffleSoftware Developer

Everyone is posting about job openings only 🤷

There are lot of communities and individuals on LinkedIn and Instagram who are postings job opportunities from various companies. Only few links will redirect to actual company careers pages mostly it will be redirected to google form wh...

Software Engineers
by BouncyWalrusAndroid Engineer

Worst hiring processes are opted by most companies

I have been looking for an Android Engineer for about 1.5 months and i applied on LinkedIn and company website but they don't reply.

But if I apply to naukari.com in the same company then the middle man as a consultant will call you and...