Dispute & Guardian System
A core principle of ECube is fairness. To ensure the reward mechanism remains just and accounts for potential misclassifications, we implemented a Dispute Resolution System through Community Guardian. This system allows users to challenge automated model decisions and provides a human oversight layer for content moderation and quality control.
Disputing Posts
Users can dispute any of their posts flagged as outliers by the Post Quality (PQ) MemAgent. This is crucial for several reasons:
Ensures Fairness: Automated systems are not perfect. Disputes provide a recourse for users who believe their content has been misclassified.
Model Improvement: Disputes provide valuable feedback to refine our MemAgents, helping them learn and adapt to nuanced content. By highlighting edge cases and challenging misclassifications, the system continuously improves MemAgent's accuracy and understanding of the real world.
Community Engagement: The dispute process encourages users to actively participate in maintaining the quality and fairness of the reward system.
If a post is successfully disputed, the user who made the post will earn 50% of the maximum points possible for that modality in that quest. For example, if the user successfully disputes a video post for a Quest where videos are worth 100 points, the user will earn 50 points after successful dispute resolution.
Successful disputes are how the model learns. They are a fundamental part of the ECube human-agent teaching loop and may earn additional rewards in the future.
Last updated