exs-cyberjob-scraper
Web scraper, written in Elixir, that pulls cybersecurity job postings from public hiring APIs, isolates the genuine cybersecurity roles, and reports which certifications employers ask for most. 💜
An Elixir tool that scans hundreds of thousands of job postings from Greenhouse, Lever, Ashby, and Workday and ranks which cybersecurity certifications employers request most often.
This tool scans public job posting feeds from hiring platforms like Greenhouse, Lever, Ashby, and Workday, filters out non-security roles, and tallies which cybersecurity certifications employers mention most often in their listings. The output is a ranked list showing how frequently each credential appears across thousands of postings. It is built in Elixir, a programming language that runs on the Erlang virtual machine.
The most recent run the README documents scanned 278,145 job postings from 1,195 employers and isolated 11,511 as genuine cybersecurity roles. Of those, CISSP appeared in 19.1% of postings, making it the most requested certification. GIAC came second at 10.4%, followed by CISM at 8.3%, CompTIA Security+ at 7.7%, and OSCP at 6.3%. The list continues through twelve certifications in total, down to CompTIA CASP+ at 2.3%.
The README itself functions as a showcase of one particular run's results rather than as a code walkthrough. The data is presented as a table and as text-based bar charts for each certification. A separate file, README2.md, contains the actual setup instructions for running the scraper yourself.
Installation on a fresh Linux machine is described as two commands: run an install script that downloads Erlang, Elixir, and the project's dependencies, then run the certscout binary with a flag specifying which job board to target. The installer builds everything needed, so you do not need to have Elixir installed beforehand.
This would be useful to anyone trying to figure out which certifications to pursue for a cybersecurity career, or to anyone doing market research on what credentials employers in the security field currently value. The data is tied to a specific scan date, so the numbers reflect one point in time rather than a continuously updated feed.
Where it fits
- Find out which cybersecurity certifications employers demand most so you can prioritize which one to study for next.
- Run a fresh scan of current job board postings to see if certification demand has shifted since the last documented run.
- Use the ranked output as market research data when advising students or employees on career development in cybersecurity.