16_run_pii_scanner.sh - Scan Stata data for personal information

Description¶

Runs PII_stata_scan.do (top level of the repository) in Stata from inside the deposit directory, to flag variables that may contain personally identifiable information (PII). Needs Stata, so the pipeline runs it in the larsvilhuber/bitbucket-stata image. 24_amend_report.sh turns the summary into a report paragraph.

Usage¶

./automations/16_run_pii_scanner.sh <directory>

Environment Variables¶

• SkipProcessing - When yes, the script exits immediately.

• ProcessPii - When no, the script exits immediately.

Outputs¶

• generated/PII_stata_scan.log - Full Stata log

• generated/PII_stata_scan_summary.txt - Last 10 lines of the log

• generated/pii_stata_output.csv - Flagged variables

• generated/pii_stata_output.md - The first 20 rows of that file