12/5/2023 0 Comments Windows 10 versions redditRule change history was challenging to track since there was no version control and no staging environment for sandbox testing. Each rule in REV1 ran as an independent process, necessitating costly vertical scaling as the safety staff added more rules. REV1, Reddit's initial rules engine, operated on raw EC2 instances instead of Kubernetes and ran on the deprecated Python 2.7. A Safety Actioning Worker consumes these topics and carries out the specified action. Each action type is associated with a unique topic, ensuring tighter schemas and more granular monitoring. REV2 sends structured Protobuf actions to specific Kafka topics when an action is determined. REV2's CI pipeline then persists these rules to S3, which is checked periodically for rule updates. Rules are primarily configured through code and stored in GitHub for version control. At its core, REV2 uses Lua scripts, termed "rules", that are triggered based on specific events from Kafka, such as a user posting or commenting.įlink Stateful Functions and Reddit's Baseplate application framework execute these Lua rules on message streaming from Apache Kafka topics. Rule Execution V2 (REV2) is Reddit's modernised rules-engine system to detect and act on policy-violating content. The new architecture includes improvements like transitioning from legacy EC2-based systems to Kubernetes, better rule version control with Github and S3 storage, and the capability to scale more efficiently with Flink Stateful Functions. Reddit's Safety Engineering team recently published how it modernised its Rule-Execution system, which detects and acts on policy-violating content in real time.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |