Web Crawlers:
Robots.txt template - allowlist
Simple robots.txt template. Allow lists legitimate user-agents / bots. Keeps unwanted robots out. Easily maintainable and immediately useful for most websites.
Collection of publications tagged with template.
Simple robots.txt template. Allow lists legitimate user-agents / bots. Keeps unwanted robots out. Easily maintainable and immediately useful for most websites.
Simple rsync backup shell script template to back up the user home directory to mountpoint, e.g. a hard drive, thumb drive, sd card, etc. Verifies mountpoint exists, writes log to mountpoint.
“Learning from conventions will make your site better.”