Feat/spam digest job

[BarbaraOliveira13]

✉️ Feature: Decidim-AI — Spam Summary Digest Event (Weekly / Daily)

🔧 This PR also fix a CI part by normalize nl local file.

MAIN SUBJECT :
This PR adds a Decidim digest system that aggregates spam reports detected by Decidim-AI and sends a daily or weekly summary email, to each organization’s administrators (selon leur choix de config 'frequency').

It integrates with Decidim EventsManager and EmailEvent notification system.

🧠 Technical Notes
resource: organization ensures Decidim’s BaseEvent behaves correctly
(the spam digest concerns all types of content: proposals, projects, comments, etc.)
If need more details, cf conclusion in the issue

🧭 Steps to Reproduce

1. Log in as an admin
2. Ensure Decidim-AI variables are configured in .env/.env.local:

DECIDIM_AI_BASIC_AUTH="decidimai:xxx"
DECIDIM_AI_ENABLED="true"
DECIDIM_AI_ENDPOINT=https://decidim-ai.k8s.osp.cat/spam/detection
DECIDIM_AI_GENERIC_SPAM_ANALYZER_ENABLED="true"
DECIDIM_AI_REPORTING_USER_EMAIL=spam-bot@osp.cat
DECIDIM_AI_USER_SPAM_ANALYZER_ENABLED="true"

(Replace xxx with the password stored in Passbolt)
5. Restart the server: spring stop && bundle exec rails s
10. Create the reporting_user (Spam Bot): script for console:

user = Decidim::Organization.first.users.find_or_initialize_by(email: "spam-bot@osp.cat")
unless user.persisted?
  password = SecureRandom.hex(10)
  user.password = password
  user.password_confirmation = password
  user.deleted_at = Time.current
  user.tos_agreement = true
  user.name = "Spam Bot"
  user.skip_confirmation!
  user.save!
end

• Start Sidekiq in a separate terminal: bundle exec sidekiq
• Creates SPAM
• Lot of possibilities, (exemple of SPAM: 'winamax.fr')
  • Create a new user, clic on the link from the mail (http://localhost:3000/letter_opener) to log in
    • Go to his account, and add a SPAM in the 'about' part
  • Add a SPAM comment
  • Crate a proposal, process, assembly... with a SPAM name or description
• Run the digest manually:

`Decidim::Ai::SpamDetection::SpamDigestGeneratorJob.perform_now(:weekly)` - => Before this commande: Update notifications settings to receive the right frequency (weekly with this command) `Decidim::Ai::SpamDetection::SpamDigestGeneratorJob.perform_now(:daily)` - - => Before this commande: Update notifications settings to receive the right frequency (daily with this command) - Open the generated email using LetterOpener

Expected output:

📌 Related Issues

https://github.com/orgs/OpenSourcePolitics/projects/26/views/1?filterQuery=assignee%3A%40me&pane=issue&itemId=129336496&issue=OpenSourcePolitics%7Cintern-tasks%7C114

Tasks

• Add specs
• In case of new dependencies or version bump, update related documentation

📷 Screenshots

Please add screenshots of the changes you're proposing if related to the UI

Extra information

For the DATA Team: ⚠️ The digest is not stored in any table — it’s generated dynamically when EventsManager.publish is called.

[AyakorK]

A lot of reviews, but we probably don't need to fix everything, some of them might be critical but other issues are reported just to keep a trace on it !

[Stef-Rousset]

Hello @BarbaraOliveira13 , thx for your PR !!!

I try to run the job Decidim::Ai::SpamDetection::SpamDigestGeneratorJob.perform_now(:daily) in console on local env, and I got an error

/Users/stephanierousset/.rvm/gems/ruby-3.2.2/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/postgresql_adapter.rb:768:in `exec_params': ERROR:  column decidim_moderations.decidim_organization_id does not exist (PG::UndefinedColumn)
LINE 1: ...s.created_at >= '2025-12-09 13:51:44.487895') AND "decidim_m...

I think it may be related to this line https://github.com/OpenSourcePolitics/decidim-app/pull/905/files#diff-236c78d077b1c09f66a2df7f331aefd14b4c5c86155cd2a12f2f2fb42038ff26R53, because decidim_moderations table has no column decidim_organization_id

[BarbaraOliveira13]

Hello @BarbaraOliveira13 , thx for your PR !!!

I try to run the job Decidim::Ai::SpamDetection::SpamDigestGeneratorJob.perform_now(:daily) in console on local env, and I got an error

/Users/stephanierousset/.rvm/gems/ruby-3.2.2/gems/activerecord-7.0.8.7/lib/active_record/connection_adapters/postgresql_adapter.rb:768:in `exec_params': ERROR:  column decidim_moderations.decidim_organization_id does not exist (PG::UndefinedColumn)
LINE 1: ...s.created_at >= '2025-12-09 13:51:44.487895') AND "decidim_m...

I think it may be related to this line https://github.com/OpenSourcePolitics/decidim-app/pull/905/files#diff-236c78d077b1c09f66a2df7f331aefd14b4c5c86155cd2a12f2f2fb42038ff26R53, because decidim_moderations table has no column decidim_organization_id

Hello @Stef-Rousset Oh, I had the right chain before I think... I should changed too much time :s
I will watch and fix It!
Thanks a lot for your review ! 🙏

[BarbaraOliveira13]

Fail CI is not relevant of my changes. It's a flaky CF Redesigned upload modal flaky test #10961
This PR is ready for review and more!

@Stef-Rousset you can re-run the job, I fix it ! 🙏

[BarbaraOliveira13]

Next step:

1. Review tech Alain or Guillaume
2. Test directement après un déploiement sur une app de test

[Stef-Rousset]

Decidim::Ai::SpamDetection::SpamDigestGeneratorJob.perform_now(:daily)

hello @BarbaraOliveira13 , great job, I run the code locally and everything works !!!
Just a last quick refacto on the spam_user_reports_since method: I think you don't need .includes(:user) and reports.select { |r| r.user.decidim_organization_id == organization.id }, as the .where(decidim_users: { decidim_organization_id: organization.id }) already filters the user reports belonging to the organization.

[BarbaraOliveira13]

Decidim::Ai::SpamDetection::SpamDigestGeneratorJob.perform_now(:daily)

hello @BarbaraOliveira13 , great job, I run the code locally and everything works !!! Just a last quick refacto on the spam_user_reports_since method: I think you don't need .includes(:user) and reports.select { |r| r.user.decidim_organization_id == organization.id }, as the .where(decidim_users: { decidim_organization_id: organization.id }) already filters the user reports belonging to the organization.

Thanks ! done 👍

[moustachu]

Great job !