FND-1417

Data to purge

• Contact rollups data in ContactRollupsFinal.
• Survey data in Pd::MiscSurvey, Foorm::Submission, and Foorm::SimpleSurveySubmission.
• Professional development email history in Pd::Application::Email.

No action needed

• The current process already purges TeacherFeedback and ContactRollupsPardotMemory.
• ContactRollupsRaw and ContactRollupsProcessed are just intermediate tables. They are dropped and rebuilt everyday by the contact rollups process..
• contact_rollups_comparison table was dropped long ago.
• Pd::Application::Tag model doesn't contain PII data. The name field is just tag name. In addition, the pd_application_tags table is currently empty.
• Donor model doesn't contain PII data. It has organization/donor names, URLs and Twitter links; all can be considered public information. Moreover, the donors table has only 166 records. They can be manually deleted upon request.

Links

• PLC PII data
• LP PII data

Testing story

• Run unit tests bundle exec rails test test/helpers/delete_accounts_helper_test.rb

Follow-up work

• Drop survey_answers table. Last created row was from 2019-10-22. We have migrated previous survey data to the new foorm system.
• Back-purging data in ContactRollupsFinal, ContactRollupsPardotMemory, Pd::MiscSurvey, Foorm::Submission, Foorm::SimpleSurveySubmission, and Pd::Application::Email.

PR Checklist:

• Tests provide adequate coverage
• Privacy and Security impacts have been assessed
• Code is well-commented
• New features are translatable or updates will not break translations
• Relevant documentation has been added or updated
• User impact is well-understood and desirable
• Pull Request is labeled appropriately
• Follow-up work items (including potential tech debt) are tracked and linked