Governance for End-to-End Encrypted Communities
The increasing harms caused by hate, harassment, and other forms of abuse online have motivated major platforms to explore hierarchical governance. The idea is to allow communities to have designated members take on moderation and leadership duties; meanwhile, members can still escalate issues to the platform. But these promising approaches have only been explored in plaintext settings where community content is public to the platform. It is unclear how one can realize hierarchical governance in the huge and increasing number of online communities that utilize end-to-end encrypted (E2EE) messaging for privacy.
We propose the design of private, hierarchical governance systems. These should enable similar levels of community governance as in plaintext settings, while maintaining cryptographic privacy of content not reported to the platform. We design the first such system, taking a layered approach that adds governance logic on top of an encrypted messaging protocol; we show how a simple modification to the message layer security (MLS) protocol suffices for achieving a rich set of governance policies. Our approach allows developers to rapidly prototype new governance features, taking inspiration from a plaintext system called PolicyKit. We report on an initial prototype encrypted messaging system called \sysname that supports content-based community and platform moderation, elections of community moderators, votes to remove abusive users, and more.
Armin Namavari is a DLI Doctoral Fellow and second year Computer Science PhD student at Cornell University. He is based at the Cornell Tech campus in NYC and advised by Tom Ristenpart. His research interests lie in security and applied cryptography. He also co-organizes the Cornell Security Seminar with Kushal Babel.