Job Scraper: Detect Duplicate Postings
R
Roger So
From Welly:
> Amanda was saying that a lot of recruitment agencies (e.g. Michael Page, Robert Walters...etc.) do their own job postings by copy pasting the original JDs of the clients. Is there a scraper where you can help us identify the original clients by scrapping the info on the job postings of those rec. firms? I assume it is technically feasible but not sure how long this would take you to build it.
> Original JDs should be posted ahead of the rec. firms' JDs. So recruiters get to copy and past them
Edwin Shao (T1)
I think this is technically too complicated for the ROI.
Roger So What do you think?
R
Roger So
If the JDs are indeed completely the same, we can perhaps try to compute the hash and check for hash collisions. But I suspect it's not as simple as it sounds.