qQuietPost Lab
← All notes

Note 02 / Dataset practice

Small notes on
email datasets.

A useful collection is more than a message count. Where a message came from, how often it repeats, and why it was labeled all affect what we can learn from it.

Keep the source context

Preserve the received message and its envelope information. Record the collection channel and arrival time so that later analysis can distinguish changes in content from changes in sampling.

Count patterns, not just copies

A bulk campaign can produce many nearly identical messages. Exact hashes identify identical files; similar templates need additional comparison. Keep originals while recording duplicate groups separately.

Evaluate beyond the collection

Separate related campaigns when preparing training and test data. Evaluate against representative normal messages as well, so that apparent gains do not hide an increase in false positives.

Correspondence

research-v8n@trap.quietpostlab.me

Experimental contact address. Messages may be retained for email research; replies are not guaranteed. Do not send sensitive information. Publication of this address is not consent to bulk marketing.